Skip to content

Cluster visualization: force graph, dendrograms, matrices#464

Open
ocg-goodfire wants to merge 2 commits intoclustering-corefrom
clustering-app
Open

Cluster visualization: force graph, dendrograms, matrices#464
ocg-goodfire wants to merge 2 commits intoclustering-corefrom
clustering-app

Conversation

@ocg-goodfire
Copy link
Copy Markdown
Collaborator

Summary

  • 5 new Svelte visualization components: force graph, dendrogram, correlation matrix, full matrix, mini matrix
  • Backend endpoints for pairwise correlations, coactivation, merge iterations, full matrix
  • Lazy-loaded MembershipSnapshot caching per clustering run
  • Depends on #$(gh pr list --head clustering-core --json number -q '.[0].number') (clustering-core)

Test plan

  • Manual: load a clustering run in the app, verify all new viz tabs render
  • basedpyright clean
  • ruff clean

🤖 Generated with Claude Code

ocg-goodfire and others added 2 commits March 28, 2026 16:58
Major clustering module improvements:
- Compressed membership representation (CompressedMembership, MembershipBuilder)
- Harvest-then-merge workflow: spd-cluster-harvest + spd-cluster-merge CLIs
- Removed uncompressed (dense tensor) merge codepath
- Shared collect_memberships() dispatch eliminates duplication
- exp_rank merge pair sampler
- numba dependency for sparse math performance

Also includes:
- Autointerp: rate-limit config moved from global to per-provider
- Harvest intruder: streaming trials, SLURM scripts
- AGENTS.md symlinks for agent discovery
- Removed unused blog export scripts

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
New app components for exploring clustering results:
- ClusterForceGraph: interactive force-directed graph of cluster relationships
- ClusterDendrogram: hierarchical merge tree visualization
- ClusterCorrelationMatrix: pairwise cluster metrics (jaccard, precision, PMI)
- ClusterFullMatrix: binned overview + detail pan/zoom matrix
- ClusterMiniMatrix: compact inline matrix view
- dendrogram.ts: tree layout utilities

Backend:
- New endpoints for pairwise correlations, coactivation, merge iterations, full matrix
- Lazy-loaded MembershipSnapshot caching per clustering run

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant