Skip to content

RayanAIX/hcms

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python License Status AI

🧠 Human Cognition Measurement System (HCMS)


🚀 Rethinking How We Measure Understanding

Most learning systems measure correctness.

But correctness is not understanding.

HCMS (Human Cognition Measurement System) is an AI-driven framework that measures how people think, not just whether they are right.

Instead of reducing intelligence to a score, HCMS models:

  • How confident a learner is
  • How consistent their reasoning remains
  • Whether their understanding stays stable under pressure

This reveals something traditional systems miss entirely:

Two people can get the same answer — and understand completely differently.


🧠 What HCMS Does

HCMS is a research-grade cognitive measurement system designed to evaluate human understanding beyond surface performance.

It captures deep cognitive signals including:

  • Understanding Level — conceptual depth and correctness
  • Confidence Calibration — alignment between belief and reality
  • Consistency — reasoning stability across attempts
  • Misconception Detection — identification of hidden errors
  • Robustness — performance under noise and perturbation
  • Explainability — transparent reasoning and decision tracing

⚙️ System Overview

HCMS operates as a complete, end-to-end pipeline:

  1. Signal Extraction — Processes learner interaction data
  2. Cognitive Inference — Models latent states (mastery, confidence, uncertainty)
  3. Validation — Ensures reliability and consistency
  4. Stress Testing — Evaluates stability under perturbation
  5. Explainability — Generates interpretable reasoning outputs
  6. Final Profiling — Produces structured cognitive reports

🧩 System Architecture

HCMS_Final/
│
├── phases/                    # Research history and experimental evolution
│
├── cognition_ai/              # Final system layer
│   ├── run_full_system.py     # Entry point
│   ├── config.json            # Configuration
│   ├── outputs/
│   │   └── final_learner_report.json
│   └── paper/                 # Research paper (Markdown)
│       ├── abstract.md
│       ├── introduction.md
│       ├── related_work.md
│       ├── methodology.md
│       ├── experiments.md
│       ├── results.md
│       └── conclusion.md
│
└── README.md

🚀 How to Run

Install Dependencies

pip install -r requirements.txt

Execute System

python cognition_ai/run_full_system.py

Output

cognition_ai/outputs/final_learner_report.json

📊 Example Output

{
  "Understanding Level": "Partial",
  "Calibration": "Miscalibrated",
  "Consistency Score": 0.83,
  "System Verdict": "Needs targeted remediation"
}

This output reflects thinking patterns, not just correctness.


🔬 Why This Matters

Traditional systems ask:

Did the learner get it right?

HCMS asks:

Do they truly understand — and do they know that they understand?

This enables:

  • Deeper insight into learning behavior
  • Early detection of misconceptions
  • More effective personalized feedback
  • Fairer and more meaningful evaluation

🎯 Applications

  • EdTech platforms
  • Adaptive learning systems
  • AI-based assessment tools
  • Cognitive research
  • Intelligent tutoring systems

🧪 Research Foundation

HCMS is built through structured experimentation including:

  • Controlled cognitive experiments
  • Confidence–accuracy analysis
  • Stability and robustness testing
  • Explainability-driven evaluation

📄 Research & Citation

📄 Preprint (DOI-backed) Beyond Correctness: Measuring Cognitive Stability and Confidence Calibration in Human Understanding https://doi.org/10.5281/zenodo.18269740

If you use this work, please cite:

@article{shahid2026hcms,
  title={Beyond Correctness: Measuring Cognitive Stability and Confidence Calibration in Human Understanding},
  author={Shahid, Muhammad Rayan},
  year={2026},
  publisher={Zenodo},
  doi={10.5281/zenodo.18269740}
}

📌 Status

  • ✅ Research validated
  • ✅ System operational
  • ✅ Ready for application and extension

👤 Author

Muhammad Rayan Shahid

AI Researcher | Human-Centered AI | Cognitive Systems


🌟 Closing Thought

Understanding is not a score. It is a structure — and HCMS measures that structure.

About

An end-to-end, research-grade AI system for measuring human cognition. HCMS models mastery, confidence, learning stability, and adaptability through analysis, inference, validation, robustness testing, and explainability — bridging human-centered AI research and applied systems.

Topics

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors