Skip to content

feat(delphi): replay loader resolves private datasets under real_data/.local#2651

Draft
jucor wants to merge 1 commit into
spr/edge/d5f1f51dfrom
spr/edge/a543ecf1
Draft

feat(delphi): replay loader resolves private datasets under real_data/.local#2651
jucor wants to merge 1 commit into
spr/edge/d5f1f51dfrom
spr/edge/a543ecf1

Conversation

@jucor

@jucor jucor commented Jul 22, 2026

Copy link
Copy Markdown
Collaborator

dataset_dir() only globbed real_data/-, so the five private
datasets (bg2018, pakistan, engage, bg2050, FLI — slugs allowed in code
per the 2026-07-05 naming policy; report-id dirs still never appear) were
invisible to the replay harness and could not join the certify battery.
Now also searches real_data/.local/
-, with top-level (public)
matches taking priority on slug collision. Groundwork for extending the
battery to all real_data datasets (GOAL_R1_PARITY.md Battery section).

commit-id:a543ecf1


Stack:


⚠️ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

This was referenced Jul 22, 2026
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data/.local feat(delphi): replay loader resolves private datasets under real_data… Jul 22, 2026
@jucor
jucor changed the base branch from spr/edge/d5f1f51d to edge July 22, 2026 06:16
@jucor
jucor force-pushed the spr/edge/a543ecf1 branch from 8d3c893 to 474f3b5 Compare July 22, 2026 06:16
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data… feat(delphi): replay loader resolves private datasets under real_data/.local Jul 22, 2026
@jucor
jucor changed the base branch from edge to spr/edge/d5f1f51d July 22, 2026 06:16
…/.local

dataset_dir() only globbed real_data/*-<slug>, so the five private
datasets (bg2018, pakistan, engage, bg2050, FLI — slugs allowed in code
per the 2026-07-05 naming policy; report-id dirs still never appear) were
invisible to the replay harness and could not join the certify battery.
Now also searches real_data/.local/*-<slug>, with top-level (public)
matches taking priority on slug collision. Groundwork for extending the
battery to all real_data datasets (GOAL_R1_PARITY.md Battery section).

commit-id:a543ecf1
@github-actions

Copy link
Copy Markdown

Delphi Coverage Report

File Stmts Miss Cover
init.py 2 0 100%
benchmarks/bench_pca.py 128 107 16%
benchmarks/bench_repness.py 81 65 20%
benchmarks/bench_update_votes.py 38 28 26%
benchmarks/benchmark_utils.py 34 24 29%
components/init.py 1 0 100%
components/config.py 165 133 19%
conversation/init.py 2 0 100%
conversation/conversation.py 1300 261 80%
conversation/manager.py 131 42 68%
database/init.py 1 0 100%
database/dynamodb.py 395 189 52%
database/postgres.py 310 166 46%
pca_kmeans_rep/init.py 5 0 100%
pca_kmeans_rep/clusters.py 257 21 92%
pca_kmeans_rep/corr.py 98 17 83%
pca_kmeans_rep/group_k_smoother.py 28 0 100%
pca_kmeans_rep/legacy_kmeans.py 151 6 96%
pca_kmeans_rep/pca.py 130 18 86%
pca_kmeans_rep/repness.py 223 6 97%
poller/init.py 4 0 100%
poller/math_writer.py 41 1 98%
poller/service.py 235 62 74%
poller/worker_pool.py 75 0 100%
regression/init.py 4 0 100%
regression/clojure_comparer.py 188 20 89%
regression/comparer.py 887 649 27%
regression/datasets.py 135 27 80%
regression/recorder.py 36 27 25%
regression/utils.py 130 85 35%
replay/init.py 2 0 100%
replay/certify.py 452 121 73%
replay/crosslang.py 128 3 98%
replay/driver.py 51 2 96%
replay/prodclone.py 184 16 91%
replay/real_data.py 21 2 90%
replay/schedule.py 125 6 95%
replay/stepcompare.py 77 1 99%
replay/store.py 120 11 91%
replay/types.py 65 8 88%
run_math_pipeline.py 261 114 56%
umap_narrative/500_generate_embedding_umap_cluster.py 210 109 48%
umap_narrative/501_calculate_comment_extremity.py 112 53 53%
umap_narrative/502_calculate_priorities.py 135 135 0%
umap_narrative/700_datamapplot_for_layer.py 502 502 0%
umap_narrative/701_static_datamapplot_for_layer.py 310 310 0%
umap_narrative/702_consensus_divisive_datamapplot.py 432 432 0%
umap_narrative/801_narrative_report_batch.py 785 785 0%
umap_narrative/802_process_batch_results.py 268 268 0%
umap_narrative/803_check_batch_status.py 183 183 0%
umap_narrative/llm_factory_constructor/init.py 2 2 0%
umap_narrative/llm_factory_constructor/model_provider.py 192 192 0%
umap_narrative/polismath_commentgraph/init.py 1 0 100%
umap_narrative/polismath_commentgraph/cli.py 270 270 0%
umap_narrative/polismath_commentgraph/core/init.py 3 3 0%
umap_narrative/polismath_commentgraph/core/clustering.py 108 108 0%
umap_narrative/polismath_commentgraph/core/embedding.py 104 104 0%
umap_narrative/polismath_commentgraph/lambda_handler.py 219 219 0%
umap_narrative/polismath_commentgraph/schemas/init.py 2 0 100%
umap_narrative/polismath_commentgraph/schemas/dynamo_models.py 160 9 94%
umap_narrative/polismath_commentgraph/tests/conftest.py 17 17 0%
umap_narrative/polismath_commentgraph/tests/test_clustering.py 74 74 0%
umap_narrative/polismath_commentgraph/tests/test_embedding.py 55 55 0%
umap_narrative/polismath_commentgraph/tests/test_storage.py 87 87 0%
umap_narrative/polismath_commentgraph/utils/init.py 3 0 100%
umap_narrative/polismath_commentgraph/utils/converter.py 283 237 16%
umap_narrative/polismath_commentgraph/utils/group_data.py 354 336 5%
umap_narrative/polismath_commentgraph/utils/storage.py 584 518 11%
umap_narrative/reset_conversation.py 159 50 69%
umap_narrative/run_pipeline.py 453 312 31%
utils/clj_hash.py 44 0 100%
utils/engine_mode.py 9 0 100%
utils/env_flags.py 13 0 100%
utils/general.py 62 41 34%
utils/serialization.py 9 5 44%
Total 12905 7654 41%

@jucor
jucor force-pushed the spr/edge/a543ecf1 branch from 474f3b5 to 1f8024a Compare July 22, 2026 06:32
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data/.local feat(delphi): replay loader resolves private datasets under real_data… Jul 22, 2026
@jucor
jucor changed the base branch from spr/edge/d5f1f51d to edge July 22, 2026 06:50
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data… feat(delphi): replay loader resolves private datasets under real_data/.local Jul 22, 2026
@jucor
jucor changed the base branch from edge to spr/edge/d5f1f51d July 22, 2026 06:50
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data/.local feat(delphi): replay loader resolves private datasets under real_data… Jul 22, 2026
@jucor
jucor changed the base branch from spr/edge/d5f1f51d to edge July 22, 2026 08:11
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data… feat(delphi): replay loader resolves private datasets under real_data/.local Jul 22, 2026
@jucor
jucor changed the base branch from edge to spr/edge/d5f1f51d July 22, 2026 08:11
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data/.local feat(delphi): replay loader resolves private datasets under real_data… Jul 22, 2026
@jucor
jucor changed the base branch from spr/edge/d5f1f51d to edge July 22, 2026 09:58
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data… feat(delphi): replay loader resolves private datasets under real_data/.local Jul 22, 2026
@jucor
jucor changed the base branch from edge to spr/edge/d5f1f51d July 22, 2026 09:58
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data/.local feat(delphi): replay loader resolves private datasets under real_data… Jul 22, 2026
@jucor
jucor changed the base branch from spr/edge/d5f1f51d to edge July 22, 2026 11:20
@jucor jucor changed the title feat(delphi): replay loader resolves private datasets under real_data… feat(delphi): replay loader resolves private datasets under real_data/.local Jul 22, 2026
@jucor
jucor changed the base branch from edge to spr/edge/d5f1f51d July 22, 2026 11:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant