This guide gets the maintained TypeScript stack running locally and points you at the first useful evaluation flow.
Required:
- Node.js
18.17+(20is recommended) - npm
Optional:
- Python
3.10+if you are working on the legacy CrewAI service - A local LLM runtime if your chosen agent path depends on one
Run from the repository root:
npm installThe root postinstall builds the shared packages used by the backend, frontend, and agent-service-api workspaces.
cp backend/.env.example backend/.env
cp frontend/.env.example frontend/.env.local
cp agent-service-api/.env.example agent-service-api/.envThe defaults connect the local services together:
- Frontend:
http://localhost:3000 - Backend:
http://localhost:5100 - Agent Service API:
http://localhost:5003
The backend writes SQLite data to backend/data/agent-testing.db by default.
npm run devThis starts the backend, agent-service-api, and frontend together. The Python agent-service is not part of the default development path.
Open http://localhost:3000.
- Open LLM configs and add or verify the model/API configuration your agent will use.
- Open Agents and create or select the agent version you want to evaluate.
- Open Conversations and create a conversation script with realistic messages.
- Open Quick execute, select the agent and conversation, then execute.
- Open Jobs to track queue progress.
- Open Sessions to inspect the transcript, timing, token usage, and scoring signals.
- If the frontend cannot reach the API, confirm
frontend/.env.localhasNEXT_PUBLIC_API_URL=http://localhost:5100. - If you created local env files before the default backend port changed, update
backend/.env,frontend/.env.local, andagent-service-api/.envtogether. - If jobs stay pending, confirm
agent-service-api/.envpointsBACKEND_URLat the backend and thatnpm run devis still running. - If shared package types look stale, run
npm run build:packagesor restartnpm run dev. - If you are working on CrewAI, start
agent-serviceseparately and verifybackend/.envhas the correctAGENT_SERVICE_URL.