Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 31 additions & 25 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,41 +1,47 @@
# NodeSynth
# NodeSynth: Socially Aligned Synthetic Data for AI Evaluation

Tool Prototype: http://go/sarai-external-prototype
🚀 [**Launch Live Prototype**](https://support-tickets-29m1bnjrfkk.streamlit.app/#end-to-end-workflow)

NodeSynth is a research prototype that implements a scalable, multi-stage
method for creating socially relevant and grounded synthetic data (e.g.,
annotated queries) for AI model evaluation. The pipeline breaks down topics
related to safety policies (e.g., harassment) and sensitive domains (e.g.,
education) into taxonomies using a fine-tuned taxonomy generator; identifies
key relationships within the taxonomies (e.g., social groups, use cases); and
validates synthetic query quality for model evaluation.
**NodeSynth** is a research prototype that implements a scalable, multi-stage methodology for creating socially relevant and evidence-grounded synthetic data (e.g., annotated queries) for AI model evaluation.

NodeSynth enables users (e.g., researchers, developers) to go from a topic to a
synthetic dataset capturing relationships that represent documented harms in the
real world. This prototype and the approach outlined in the accompanying paper
can be used to conduct lightweight model evaluations specific to sensitive
topics, enabling model developers and deployers to prioritize key areas of
concern for in-depth human evaluation.
The pipeline breaks down topics related to safety policies (e.g., harassment) and sensitive domains (e.g., education) into granular taxonomies using a fine-tuned taxonomy generator. It identifies key relationships within these taxonomies (e.g., affected social groups, geographic regions, use cases) and generates high-fidelity synthetic queries designed for rigorous model evaluation.

## 🚨 The Challenge
Standard benchmarks and manual query creation struggle to capture real-world sociotechnical nuance or scale effectively. While generic synthetic data offers an alternative, these datasets often contain unintended biases, lack diversity, and are inaccurate for highly-sensitive domains. NodeSynth enables users (researchers, developers, and auditors) to go from a high-level topic to a rich synthetic dataset capturing relationships that represent *documented harms* in the real world.

## 💡 Core Contributions
* **Sociotechnical Framework:** Leverages an expert-curated Taxonomy Generator (TaG) to ground abstract concepts in concrete, evidence-based scenarios.
* **Empowered Scaling:** Enables resource-constrained entities to conduct lightweight, scalable model evaluations specific to sensitive topics.
* **Interpretable Diagnostics:** Allows evaluators to trace exact failure intersections (demographics, geography, taxonomy level) to prioritize key areas of concern for targeted mitigation and in-depth human evaluation.

<p align="center">
<img src="NodeSynth_flow.svg" alt="NodeSynth Flowchart" width="100%">
<br>
<em><b>Figure 1:</b> A visual representation of the NodeSynth approach. Based on user inputs, NodeSynth (Step 1) creates a complete, three layer taxonomy using a fine-tuned model; and (Step 2) extracts metadata (e.g., sensitive characteristics) from relevant sources, related to the branches of the taxonomy. Utilizing the aforementioned concepts and annotations, NodeSynth (Step 3) generates annotated synthetic queries for model evaluation.</em>
</p>

## Getting Started

TODO: Add installation and usage instructions.
## 🔄 End-to-End Workflow

## Requirements
You can explore the full workflow directly in our [**Live Prototype**](https://support-tickets-29m1bnjrfkk.streamlit.app/#end-to-end-workflow):

TODO: List requirements and dependencies.
1. **Concept Setup:** Define the overarching theme (e.g., "Cultural Bias", "Medical Advice") and operational constraints (countries, languages, modality).
2. **Taxonomy Generation:** The system leverages a fine-tuned taxonomy generator (TaG) to intelligently extrapolate a structured vocabulary (L1, L2, L3).
3. **Data Synthesis:** Generate synthetic examples, anchoring them in intersections of sensitive attributes and complex societal contexts.
4. **Evaluation:** Define a rubric targeting nuanced harms. Evaluate the target model's performance on the synthetic dataset.
5. **Analysis Dashboard:** Perform root-cause analysis. Trace where model performance degrades across taxonomic and demographic intersections.

This prototype and the approach outlined in the [accompanying paper](https://arxiv.org/abs/2605.14381) can be used to conduct lightweight model evaluations specific to sensitive topics, enabling model developers and deployers to prioritize key areas of concern for in-depth human evaluation.

## Usage
## ⚙️ Getting Started

TODO: Add usage examples.
TODO: Add installation and usage instructions.

## ⚙️ Requirements

TODO: List requirements and dependencies.

## Citation
## 📖 Citation

If you use NodeSynth in your research, please cite the following paper:

Expand All @@ -47,7 +53,7 @@ If you use NodeSynth in your research, please cite the following paper:
}
```

## Disclaimer
## ⚠️ Disclaimer

This is not an officially supported Google product. This project is not
eligible for the [Google Open Source Software Vulnerability Rewards
Expand All @@ -56,11 +62,11 @@ Program](https://bughunters.google.com/open-source-security).
This project is intended for demonstration purposes only. It is not
intended for use in a production environment.

## License
## ⚖️ License

This project is licensed under the Apache License 2.0 - see the [LICENSE](LICENSE) file for details.

## Contributing
## 🤝 Contributing

See [`CONTRIBUTING.md`](CONTRIBUTING.md) for details.

Expand Down