Skip to content

joybratasarkar/SpecForge

SpecForge

Open-source QA agent platform for OpenAPI-driven testing with:

  1. Scenario generation (LLM + heuristics fallback)
  2. GAM memory/research context enrichment
  3. RL-guided mutation and scenario selection
  4. Isolated API execution and verification
  5. Structured reporting and reproducible failure artifacts

License

Licensed under Apache License 2.0.

See LICENSE for full terms.

Quick Start

  1. Create backend virtual environment and install dependencies.
python3 -m venv backend/.venv
backend/.venv/bin/pip install -r backend/requirements.txt
  1. Start backend API.
./backend/start-backend.sh
  1. Start frontend UI in a new terminal.
./frontend/start-frontend.sh
  1. Open the UI.
http://localhost:3001

Common Run Commands

  1. Run a QA domain execution.
./backend/run_qa_domain.sh --domain ecommerce --customer-mode --verify-persistence
  1. Run backend customer API server.
./backend/run_customer_backend_fastapi.sh
  1. Run frontend in full Next.js mode.
./frontend/start-full-next.sh

Documentation

Start here:

  1. docs/agent-architecture-flow-in-depth.md
  2. docs/qa-agent-runtime-step-map.md
  3. docs/qa-agent-learning-data-flow.md
  4. docs/qa-agent-glass-box-deep-dive.md

Full docs index: docs/README.md

Repository Layout

  1. backend/: FastAPI services, QA runtime, RL/GAM integration, tests
  2. frontend/: Next.js customer UI and startup wrappers
  3. docs/: architecture, runtime, data flow, and API-flow docs
  4. data/: local runtime/test assets

Development

  1. Backend developer guide: backend/README.md
  2. Frontend developer guide: frontend/README.md
  3. Contribution guide: CONTRIBUTING.md
  4. Security policy: SECURITY.md
  5. Code of conduct: CODE_OF_CONDUCT.md

Notes

  1. Some components are research-oriented and evolve rapidly.
  2. Validate security/compliance requirements before production deployment.

About

SpecForge is an adaptive OpenAPI QA agent using LLM + GAM + RL to generate, execute, and improve API tests over time.

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors