Agent memory backends each publish their own benchmark numbers, on different tests, measured different ways. memtrust runs the same evals against all four and publishes the raw logs. Run against the vendors, not by them.
python cli open-source benchmark memory evaluation reproducibility eval ai-agents locomo contradiction-detection llm llm-eval llm-memory agent-memory longmemeval mem0-alternative memory-backend independent-benchmark
-
Updated
Jul 22, 2026 - Python