Body:## Summary
In "Step 3 — Set up the correctness evaluator in Langfuse", users configure the
Correctness evaluator and target dataset runs, but the step that actually runs
the dataset comes later in the workshop. So the evaluator setup screen has no
data to map or validate against.
What happens
Following Step 3, the "Set up evaluator" screen shows:
- Results table (filter Dataset =
dad-it-support-workshop) says "No results."
- Evaluation Prompt Preview says "No trace data found, please adjust filters or
switch to not show preview."
With no dataset run yet, there's nothing to map the template variables against
or confirm the evaluator is wired correctly.
Expected
Either:
- Reorder so the dataset run happens before setting up the evaluator, or
- Clarify in Step 3 that empty data is expected here — the evaluator runs
automatically on new/incoming experiments once the dataset is run in the
later step ("Run on new experiments" is enabled), so the empty preview is
normal.
Reported by
Workshop attendee (Si Shuo Yang) via Slack #langfuse-workshop-feedback.
Body:## Summary
In "Step 3 — Set up the correctness evaluator in Langfuse", users configure the
Correctness evaluator and target dataset runs, but the step that actually runs
the dataset comes later in the workshop. So the evaluator setup screen has no
data to map or validate against.
What happens
Following Step 3, the "Set up evaluator" screen shows:
dad-it-support-workshop) says "No results."switch to not show preview."
With no dataset run yet, there's nothing to map the template variables against
or confirm the evaluator is wired correctly.
Expected
Either:
automatically on new/incoming experiments once the dataset is run in the
later step ("Run on new experiments" is enabled), so the empty preview is
normal.
Reported by
Workshop attendee (Si Shuo Yang) via Slack #langfuse-workshop-feedback.