🛡️ AI Code Trust Validator

Trust your AI-generated code before shipping to production.

The complete quality gate for AI-assisted development

Installation • Quick Start • Features • CLI Reference • Documentation

🎯 The Problem

84% of developers use AI coding tools. Only 29% trust the output. (Stack Overflow 2025)

AI writes code fast, but that code often contains:

🔓 Security vulnerabilities — SQL injection, hardcoded secrets, command injection
🎭 Hallucinations — Fake imports, invented functions, imaginary APIs
🐛 Logic errors — Unreachable code, infinite loops, dead branches
📉 Technical debt — Missing docs, poor naming, deep nesting
🔗 Dependency issues — Circular imports, missing modules, unused code

You can't ship what you can't trust.

✨ Features

Category	Features
🔍 Analysis	Security scanning, Hallucination detection, Logic validation, Best practices
🌐 Multi-Language	Python, JavaScript, TypeScript support
🤖 AI Auto-Fix	LLM-powered fixes (OpenAI, Anthropic, Ollama)
📊 Reports	JSON, HTML (beautiful dashboard), SARIF (GitHub Security), PDF
🔧 Fixes	Auto-fix suggestions, Confidence scores, One-click apply
🧪 Testing	Auto-generate pytest tests, Edge case detection, Coverage analysis
🌐 API	REST API server, OpenAPI docs, Batch validation, Webhook support
👀 Monitoring	File watch mode, Live dashboard, Continuous validation
📦 Multi-file	Dependency analysis, Circular dependency detection, Import validation
⚡ Performance	Intelligent caching, Incremental analysis, ~10,000+ lines/sec
🔌 Extensible	Plugin system, Custom analyzers, Hook system
🐳 Deployment	Docker, Docker Compose, GitHub Action, Pre-commit hooks
💻 IDE Integration	VS Code extension, JetBrains plugin, LSP server
📈 Team Analytics	Dashboard, Leaderboards, Trend analysis, Project breakdown

📦 Installation

# From PyPI (recommended)
pip install ai-trust-validator

# With server support
pip install ai-trust-validator[server]

# With all extras
pip install ai-trust-validator[all]

# From source
git clone https://github.com/rudra496/ai-code-trust-validator.git
cd ai-code-trust-validator
pip install -e ".[all]"

# Docker
docker pull ghcr.io/rudra496/ai-code-trust-validator:latest
docker run -v ./code:/code ghcr.io/rudra496/ai-code-trust-validator validate /code

🚀 Quick Start

CLI

# Validate a file (Python, JS, or TS)
aitrust validate generated_code.py
aitrust validate src/app.js
aitrust validate src/component.tsx

# Validate directory with minimum score
aitrust validate src/ --min-score 75 --strict

# Generate HTML report
aitrust report src/ --format html --output report.html

# Get fix suggestions
aitrust suggest-fixes buggy_code.py

# AI-powered auto-fix (requires API key)
export OPENAI_API_KEY="sk-..."
aitrust ai-fix file.py --apply

# Generate tests
aitrust generate-tests module.py --output tests/test_module.py

# Start API server
aitrust serve --port 8080

# Watch for changes with live dashboard
aitrust watch src/ --dashboard

# Analyze dependencies
aitrust analyze-deps src/

# Run benchmarks
aitrust benchmark --iterations 100

# View team analytics
aitrust analytics --days 30

# Start LSP server (for IDE integration)
aitrust lsp

# Show supported languages
aitrust languages

Python API

from ai_trust_validator import Validator, Config, MultiLanguageValidator

# Simple validation (auto-detects language)
validator = MultiLanguageValidator()
result = validator.validate("generated_code.py")  # or .js, .ts files

print(f"Trust Score: {result.trust_score}/100")
print(f"Passed: {result.passed}")

for issue in result.critical_issues:
    print(f"[CRITICAL] {issue.message}")
    if issue.suggestion:
        print(f"  💡 {issue.suggestion}")

# With custom config
config = Config(min_score=80, strict_mode=True)
validator = Validator(config)
result = validator.validate_code(code_string)

# Multi-file analysis
from ai_trust_validator import MultiFileAnalyzer
analyzer = MultiFileAnalyzer(validator)
result = analyzer.analyze_directory("src/")
print(f"Circular deps: {result.circular_dependencies}")

# Team analytics
from ai_trust_validator import AnalyticsDB
db = AnalyticsDB()
db.record_validation("file.py", result, user="dev1", project="myapp")
stats = db.get_stats(days=30)
print(f"Team avg: {stats.average_score}")

🌐 JavaScript/TypeScript Support

The validator supports JavaScript and TypeScript files with comprehensive analysis:

Supported File Types

Language	Extensions	Analysis Type
JavaScript	.js, .mjs, .cjs, .jsx	Pattern-based analysis
TypeScript	.ts, .tsx, .mts	JS + type checking

Security Checks for JS/TS

eval(), new Function() - Code injection risks
innerHTML, outerHTML - XSS vulnerabilities
document.write() - XSS and DOM manipulation risks
setTimeout(string) - Code injection via strings
Prototype pollution (__proto__, constructor.prototype)
Hardcoded secrets and API keys
child_process.exec() - Command injection
@ts-ignore, any type - Type safety bypass

Hallucination Detection

Detects hallucinated npm packages
Identifies fake/invented functions
Checks for placeholder API URLs

Usage

from ai_trust_validator import MultiLanguageValidator, detect_language

validator = MultiLanguageValidator()

# Auto-detects language from file extension
result = validator.validate("src/app.js")
print(f"Language: {detect_language('src/app.js')}")  # 'javascript'
print(f"Trust Score: {result.trust_score}/100")

🤖 AI-Powered Auto-Fix

Use LLMs to automatically fix detected issues. Supports multiple providers:

Supported Providers

Provider	Environment Variable	Default Model
OpenAI	`OPENAI_API_KEY`	gpt-4o-mini
Anthropic	`ANTHROPIC_API_KEY`	claude-3-haiku-20240307
Ollama	`USE_OLLAMA=true`	llama3
Custom	`LLM_BASE_URL` + `LLM_API_KEY`	configurable

CLI Usage

# Set your API key
export OPENAI_API_KEY="sk-..."

# Fix a file (shows fixed code)
aitrust ai-fix file.py

# Apply fixes directly (creates .backup file)
aitrust ai-fix file.py --apply

# Fix only security issues
aitrust ai-fix file.py --category security

# Use different provider/model
aitrust ai-fix file.js --provider ollama --model llama3
aitrust ai-fix file.ts --provider anthropic --model claude-3-haiku-20240307

Python API

from ai_trust_validator import Validator, AIAutoFixer, LLMConfig

# Configure LLM
config = LLMConfig(
    provider="openai",
    model="gpt-4o-mini",
    api_key="sk-..."
)

fixer = AIAutoFixer(config)
validator = Validator()

# Validate and fix
code = open("file.py").read()
result = validator.validate(code, is_file=False)
fix_result = fixer.fix(code, result.all_issues, language="python")

if fix_result.success:
    print(f"Fixed with {fix_result.confidence:.0%} confidence")
    print(fix_result.fixed_code)

Quick Fix Function

from ai_trust_validator import ai_fix_code

result = ai_fix_code(
    code,
    issues,
    language="javascript",
    api_key="sk-..."
)
print(result.fixed_code)

💻 IDE Integration

VS Code

# Install from VS Code Marketplace
# Search for "AI Trust Validator"

# Or install manually
cd vscode-extension
npm install
npm run compile

Features:

Real-time diagnostics
Trust score in status bar
Quick fix suggestions
Hover information
Auto-validate on save

JetBrains (IntelliJ, PyCharm)

# Install from JetBrains Marketplace
# Search for "AI Trust Validator"

# Or build from source
cd jetbrains-plugin
./gradlew build
# Install the built plugin from build/distributions/

Features:

Real-time code analysis with inline warnings
Trust score in status bar
Tool window with detailed results
One-click AI-powered fixes
Project-wide validation

LSP Server (Neovim, Emacs, etc.)

# Start LSP server
aitrust lsp

# Configure in your LSP client
# Command: aitrust lsp
# Language: python, javascript, typescript

📊 Example Output

🔍 Analyzing: generated_code.py
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

📊 TRUST SCORE: 67/100 ⚠️

┌─────────────────────────────────────────────────────┐
│ Category              Score   Issues               │
├─────────────────────────────────────────────────────┤
│ Security              72      2 medium, 1 low      │
│ Hallucinations        45      3 critical           │
│ Logic                 85      1 minor              │
│ Best Practices        70      2 warnings           │
└─────────────────────────────────────────────────────┘

🚨 Critical Issues:
  [HALLUCINATION] Line 12: Import 'fancy_lib' does not exist
  [HALLUCINATION] Line 18: Function 'quick_sort_v2' not defined
  [SECURITY] Line 24: Potential SQL injection via f-string

💡 AI Suggestions:
  → Replace 'fancy_lib' with 'numpy' or 'pandas'
  → Use built-in sorted() instead of 'quick_sort_v2'
  → Use parameterized queries: cursor.execute("... WHERE id = ?", (user_id,))

🔧 CLI Reference

Command	Description
`aitrust validate <path>`	Validate code and show trust score
`aitrust report <path>`	Generate detailed report (JSON/HTML/SARIF)
`aitrust suggest-fixes <path>`	Show fix suggestions for issues
`aitrust ai-fix <path>`	Apply AI-powered fixes
`aitrust generate-tests <path>`	Generate pytest tests
`aitrust serve`	Start REST API server
`aitrust watch <path>`	Watch files for changes
`aitrust benchmark`	Run performance benchmarks
`aitrust analyze-deps <path>`	Multi-file dependency analysis
`aitrust analytics`	View team analytics
`aitrust cache <action>`	Manage validation cache
`aitrust lsp`	Start LSP server for IDEs
`aitrust languages`	Show supported languages

🐳 Docker & Deployment

Docker Compose

version: '3.8'
services:
  validator:
    image: ghcr.io/rudra496/ai-code-trust-validator:latest
    ports:
      - "8080:8080"
    command: serve --port 8080
    volumes:
      - ./code:/code:ro
      - ./.aitrust_cache:/app/.aitrust_cache

GitHub Action

name: AI Code Trust Check
on: [pull_request]

jobs:
  trust-check:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      
      - name: Validate AI Code
        uses: rudra496/ai-code-trust-validator@v0.4.0
        with:
          path: 'src/'
          min-score: '75'
          format: 'sarif'

Pre-commit Hook

# .pre-commit-config.yaml
repos:
  - repo: https://github.com/rudra496/ai-code-trust-validator
    rev: v0.4.0
    hooks:
      - id: ai-trust-validator
        args: ['--min-score', '70']

🔌 Plugin System

Create custom analyzers:

from ai_trust_validator import AnalyzerPlugin, PluginMetadata, Issue

class MyCustomAnalyzer(AnalyzerPlugin):
    @property
    def metadata(self):
        return PluginMetadata(
            name="my_custom",
            version="1.0.0",
            author="You",
            description="Custom analyzer"
        )
    
    def analyze(self, tree, code, context):
        issues = []
        # Your analysis logic
        return issues

# Register
from ai_trust_validator import PluginManager
manager = PluginManager()
manager.register(MyCustomAnalyzer())

📈 Performance

Metric	Value
Throughput	10,000+ lines/sec
Avg validation	5-20ms per file
Memory	<50MB typical
Cache hit rate	95%+ on re-runs

Run your own benchmarks:

aitrust benchmark --iterations 1000

🗺️ Roadmap

Completed ✅

Coming Soon 🚧

Cloud hosted version

📊 Statistics

🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Ways to help:

🐛 Report bugs
💡 Suggest features
📝 Improve documentation
🔧 Submit pull requests
⭐ Star the repo!

📄 License

MIT License — use it freely. Just don't blame us if AI breaks production. 😉

🔗 Connect with the Creator

Rudra Sarker • Developer & Researcher

Built to close the AI trust gap.

If this helped you, consider giving it a ⭐ — it helps others find it too!

Made with ❤️ by Rudra Sarker

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
.github/workflows		.github/workflows
ai_trust_validator		ai_trust_validator
dashboard		dashboard
jetbrains-plugin		jetbrains-plugin
tests		tests
vscode-extension		vscode-extension
.aitrust.yaml		.aitrust.yaml
.gitignore		.gitignore
.pre-commit-hooks.yaml		.pre-commit-hooks.yaml
CONTRIBUTING.md		CONTRIBUTING.md
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
action.yml		action.yml
docker-compose.yml		docker-compose.yml
pyproject.toml		pyproject.toml

Folders and files

Latest commit

History

Repository files navigation

🛡️ AI Code Trust Validator

🎯 The Problem

✨ Features

📦 Installation

🚀 Quick Start

CLI

Python API

🌐 JavaScript/TypeScript Support

Supported File Types

Security Checks for JS/TS

Hallucination Detection

Usage

🤖 AI-Powered Auto-Fix

Supported Providers

CLI Usage

Python API

Quick Fix Function

💻 IDE Integration

VS Code

JetBrains (IntelliJ, PyCharm)

LSP Server (Neovim, Emacs, etc.)

📊 Example Output

🔧 CLI Reference

🐳 Docker & Deployment

Docker Compose

GitHub Action

Pre-commit Hook

🔌 Plugin System

📈 Performance

🗺️ Roadmap

Completed ✅

Coming Soon 🚧

📊 Statistics

🤝 Contributing

📄 License

🔗 Connect with the Creator

About

Topics

Resources

License

Contributing

Security policy

Uh oh!

Stars

Watchers

Forks

Releases 3

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages