Skip to content

Major Feature Update: Security Framework, Auto File Detection, and Apple Silicon Support#8

Merged
barrulus merged 21 commits intomainfrom
dev
Jun 10, 2025
Merged

Major Feature Update: Security Framework, Auto File Detection, and Apple Silicon Support#8
barrulus merged 21 commits intomainfrom
dev

Conversation

@barrulus
Copy link
Owner

Summary

This PR introduces comprehensive improvements to the vector code retrieval system with three major feature areas:

🔒 Security-First Trust Management

  • Client-side trust_remote_code management with auto-detection and user consent prompts
  • Persistent approval tracking in .env files with model-specific hashing
  • Cross-component consistency between indexing, querying, and remote serving
  • Interactive security warnings with clear risk/benefit explanations

📁 Intelligent File Detection

  • Content-based file analysis replacing hardcoded extension lists
  • Automatic text file detection with binary file filtering
  • Multi-encoding support for robust file processing
  • Recursive directory scanning with intelligent ignore patterns

🚀 Apple Silicon GPU Support

  • Metal Performance Shaders (MPS) detection and utilization
  • Cross-platform GPU acceleration (CUDA + MPS + CPU fallback)
  • Significant performance improvements on MacBooks with Apple Silicon

🛠 Additional Improvements

  • Enhanced documentation with comprehensive security and usage guides
  • Type safety improvements with Pylance compliance across codebase
  • Better error handling and user feedback
  • Environment configuration updates and examples

Test Plan

  • Test trust_remote_code prompts with various models
  • Verify automatic file detection across different repositories
  • Confirm Apple Silicon GPU acceleration on MacBooks
  • Validate client-server trust communication
  • Test backward compatibility with existing databases

Breaking Changes

None - all changes are backward compatible with existing installations and databases.

barrulus added 21 commits June 9, 2025 20:06
# TODO - make that a config not hardcode
│                                                                                                                                │
│   Automatically indexes all text files by examining content rather than relying on hardcoded extensions. Implements            │
│   recursive scanning with intelligent binary/text detection and multi-encoding support.
Add comprehensive security framework with auto-detection, user consent prompts, and persistent approval tracking. Client determines trust settings and communicates them to remote embedding server.
Auto-detect trust requirements for default model at startup to prevent loading failures. Add --trust-remote-code flag for manual override. Update documentation to reflect security framework improvements.
@barrulus barrulus merged commit 2d375d4 into main Jun 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant