Adopt Turso performance patterns (batch inserts, lazy schema, LRU cache)#488
Adopt Turso performance patterns (batch inserts, lazy schema, LRU cache)#488iberi22 wants to merge 1 commit into
Conversation
- Implement lazy schema initialization with tokio::sync::OnceCell - Add batch insert methods for chunks, symbols, and embeddings using transactions - Refactor ConnectionManager with moka-based LRU connection pooling - Migrate ConnectionManager to async libsql - Offload FTS population to spawn_blocking
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with New to Jules? Learn more at jules.google/docs. For security, I will only act on instructions from the user who triggered this task. |
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Warning You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again! |
1 participant
This PR implements several performance optimizations inspired by Turso:
CodebaseDbandConversationsDbnow defer table creation and pragma configuration until the first database operation usingtokio::sync::OnceCell. This reduces startup time and avoids creating unnecessary database files for inactive projects.insert_chunks_batch,insert_symbols_batch, andinsert_embeddings_batchinCodebaseDbutilizelibsqltransactions to group multiple operations, significantly speeding up initial repository indexing.ConnectionManagerhas been refactored to usemoka::future::Cachefor project connections. It maintains a maximum of 10 active connections with a 30-minute idle timeout, optimizing resource usage (memory and file descriptors).ConnectionManagernow uses the asynchronouslibsqldriver. Heavy CPU-bound or blocking database tasks like FTS population are offloaded totokio::task::spawn_blocking.Tests have been updated and verified to pass with the new async/lazy patterns.
Fixes #427
PR created automatically by Jules for task 3815789264760191763 started by @iberi22