Skip to content

MigrationWorkingNotes.md

Latest commit

 

History

History
70 lines (59 loc) · 1.32 KB

MigrationWorkingNotes.md

File metadata and controls

70 lines (59 loc) · 1.32 KB

UV Setup

Deprecated notes for myself

Structure

docker/
  ├── cpu/
  │   ├── pyproject.toml     # CPU deps (torch CPU)
  │   └── requirements.lock  # CPU lockfile
  ├── gpu/
  │   ├── pyproject.toml     # GPU deps (torch CUDA)
  │   └── requirements.lock  # GPU lockfile
  └── shared/
      └── pyproject.toml     # Common deps

Regenerate Lock Files

CPU

cd docker/cpu
uv pip compile pyproject.toml ../shared/pyproject.toml --output-file requirements.lock

GPU

cd docker/gpu
uv pip compile pyproject.toml ../shared/pyproject.toml --output-file requirements.lock

Local Dev Setup

CPU

cd docker/cpu
uv venv
.venv\Scripts\activate  # Windows
uv pip sync requirements.lock

GPU

cd docker/gpu
uv venv
.venv\Scripts\activate  # Windows
uv pip sync requirements.lock --extra-index-url https://download.pytorch.org/whl/cu121 --index-strategy unsafe-best-match

Run Server

# From project root with venv active:
uvicorn api.src.main:app --reload

Docker

CPU

cd docker/cpu
docker compose up

GPU

cd docker/gpu
docker compose up

Known Issues

  • Module imports: Run server from project root
  • PyTorch CUDA: Always use --extra-index-url and --index-strategy for GPU env