Skip to content
Ephizen logo ephizen / wiki

CS 504 — Backend for ML

FastAPI, Docker, queues, Ray/Modal, GPU scheduling, observability for endpoints — putting a model behind an HTTP endpoint that survives traffic.

CS
BACKLOG · WORK IN PROGRESS

This topic is being written.

The metadata and shape of this page are stable, but the body content isn't ready yet. We'll publish it once it meets the bar of teaching something new with worked examples and real tools.

No guides have been written for this chapter yet.

Back to chapters Track progress on GitHub