Pin backend-api dependencies to exact versions#28
Open
listlessbird wants to merge 23 commits into
Open
Conversation
* feat: late fusion search with RRF and disk-cached text FAISS index Build a separate text FAISS index alongside the image index during rebuild, using the existing caption/OCR text embeddings stored in S3. The text index is cached on disk but only loaded into memory lazily on first use, keeping the default startup fast. Search now supports a `mode` query parameter (image/text/hybrid). In hybrid mode (the default), both indexes are queried independently with the same text embedding and results are merged using Reciprocal Rank Fusion (score = 1/(rank+k), k=60). Closes #9 * fix: fetch text index artifacts independently of image index cache Text index files were only downloaded inside the `if not index_file.exists()` guard, so nodes that already had the image index cached from before text indexes existed would never fetch text_index.faiss. This caused has_text_index() to report false and hybrid mode to silently degrade to image-only. Move text artifact fetching to its own `if not text_index_local.exists()` block that runs unconditionally. * fix: skip mismatched text embeddings instead of aborting index build A single _text.npy with a wrong dimension caused a NumPy broadcast error that killed the entire rebuild. Since text indexing is optional, log a warning and skip the bad vector so the image index (and the rest of the text index) still gets built. * feat: add text meta * chore: tuning notebook * chore: setup nbstripout * fix: one off rrf, text index check * fix: exception handle * chore: add basic tests * chore: test actions * chore: branding * fix: missing mode param in test
previously were using the temporal cli on vms, i dont like setting it up anymore
fix search request model
added a load more button, however api doesnt properly return a has_more flag (TODO)
Owner
Author
|
in the light of recent litellm package compromise |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Description
>=) with exact==pins for runtime dependencies inbackend-api/pyproject.toml, including packages such asfastapi,uvicorn,transformers,pydantic,numpy, andboto3.backend-api/pyproject.toml, includingipykernel,pandas,ruff, andtypes-boto3-customto match the vendored wheel.backend-api/uv.lockso lock metadata reflects the new exact specifiers.Testing
cd backend-api && uv lock --check, which failed initially becausepyproject.tomlchanged and the lockfile needed refresh.cd backend-api && uv lockto refresh the lockfile, which completed successfully.cd backend-api && uv lock --check, which completed successfully and validated the updated lockfile.Codex Task