Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions logs/dbt.log
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
17:02:16.333324 [debug] [MainThread]: Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'start', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10a62cad0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10b68b4d0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10b68bc50>]}


============================== 17:02:16.336997 | c9e4b7ca-f97c-48a7-9dfe-89aee8ad9c0f ==============================
17:02:16.336997 [info ] [MainThread]: Running with dbt=1.11.12
17:02:16.337420 [debug] [MainThread]: running dbt with arguments {'log_format': 'default', 'warn_error': 'None', 'introspect': 'True', 'no_print': 'None', 'quiet': 'False', 'use_colors': 'True', 'cache_selected_only': 'False', 'warn_error_options': 'WarnErrorOptionsV2(error=[], warn=[], silence=[])', 'log_path': 'logs', 'indirect_selection': 'eager', 'profiles_dir': '/Users/qhoque/.dbt', 'partial_parse': 'True', 'write_json': 'True', 'empty': 'False', 'use_experimental_parser': 'False', 'static_parser': 'True', 'target_path': 'None', 'log_cache_events': 'False', 'fail_fast': 'False', 'invocation_command': 'dbt compile --target dev --select marts__micromasters_dedp_exam_grades', 'debug': 'False', 'printer_width': '80', 'send_anonymous_usage_stats': 'True', 'version_check': 'True'}
17:02:16.337813 [error] [MainThread]: Encountered an error:
Runtime Error
No dbt_project.yml found at expected path /private/tmp/ol-data-platform/dbt_project.yml
Verify that each entry within packages.yml (and their transitive dependencies) contains a file named dbt_project.yml

17:02:16.338215 [debug] [MainThread]: Resource report: {"command_name": "compile", "command_success": false, "command_wall_clock_time": 0.058058582, "process_in_blocks": "0", "process_kernel_time": 0.195369, "process_mem_max_rss": "121487360", "process_out_blocks": "0", "process_user_time": 0.919255}
17:02:16.338519 [debug] [MainThread]: Command `dbt compile` failed at 17:02:16.338466 after 0.06 seconds
17:02:16.338713 [debug] [MainThread]: Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'end', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10b69e2c0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10b63a450>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10b7145a0>]}
17:02:16.338893 [debug] [MainThread]: Flushing usage events
17:02:16.527810 [debug] [MainThread]: An error was encountered while trying to flush usage events
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,31 @@ with micromasters_exam_grades as (
select * from {{ ref('int__micromasters__users') }}
)

-- semester + passing_grade for MITxOnline proctored exam runs are now sourced from
-- dim_course_run (added in #2319) instead of being re-derived here. The pure MicroMasters
-- branch below (micromasters_exam_grades) still reads these fields directly from
-- int__micromasters__dedp_proctored_exam_grades because those exam runs are not represented
-- in dim_course_run until MicroMasters grades are added to tfact_grade (tracked in epic #2072).
-- Guard against dim_course_run SCD2 expiration gap: multiple is_current=true rows
-- for the same courserun_readable_id can fan out mitxonline_exam_grades rows.
-- Pick the latest, matching the established pattern in dim_product.
, mitxonline_courserun_metadata as (
select courserun_readable_id, semester, passing_grade
from (
select
courserun_readable_id
, semester

@KatelynGit KatelynGit Jul 8, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm getting the following error currently when running the build

15:21:32 Completed with 1 error, 0 partial successes, and 1 warning:
15:21:32
15:21:32 Failure in model marts__micromasters_dedp_exam_grades (models/marts/micromasters/marts__micromasters_dedp_exam_grades.sql)

15:21:32 Database Error in model marts__micromasters_dedp_exam_grades (models/marts/micromasters/marts__micromasters_dedp_exam_grades.sql)
TrinoUserError(type=USER_ERROR, name=COLUMN_NOT_FOUND, message="line 35:15: Column 'semester' cannot be resolved", query_id=20260708_152128_00035_4j8nd)
compiled code at target/run/open_learning/models/marts/micromasters/marts__micromasters_dedp_exam_grades.sql

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was hitting the production dim_course_run table before its full-refresh completed (needed after #2319 added semester/passing_grade — see the SCD2 self-referential-read caveat that also caused a similar Dagster failure on courserun_upgrade_deadline this week). The refresh finished successfully in production earlier today and semester/passing_grade are confirmed present. Please pull latest main and retry the build — let us know if it still fails.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm getting another error with the build but I think it might be taken care of the update you mentioned that went in before this:

00:55:24 Completed with 1 error, 0 partial successes, and 0 warnings:
00:55:24
00:55:24 Failure in test not_null_marts__micromasters_dedp_exam_grades_semester (models/marts/micromasters/_marts_micromasters__models.yml)
00:55:24 Got 8137 results, configured to fail if >10

, passing_grade
, row_number() over (
partition by courserun_readable_id
order by effective_date desc nulls last
) as _row_num
from {{ ref('dim_course_run') }}
where platform = 'mitxonline' and is_current
)
where _row_num = 1
)

select
course_number
, course_title
Expand All @@ -36,12 +61,14 @@ select
, mitxonline_exam_grades.user_full_name
, micromasters_users.user_email as user_micromasters_email
, mitxonline_exam_grades.user_email as user_mitxonline_email
, mitxonline_exam_grades.proctoredexamgrade_passing_grade
, mitxonline_courserun_metadata.passing_grade as proctoredexamgrade_passing_grade
, mitxonline_exam_grades.proctoredexamgrade_grade as proctoredexamgrade_percentage_grade
, mitxonline_exam_grades.proctoredexamgrade_created_on
, mitxonline_exam_grades.semester
, mitxonline_courserun_metadata.semester
from mitxonline_exam_grades
left join micromasters_users on mitxonline_exam_grades.user_username = micromasters_users.user_mitxonline_username
left join mitxonline_courserun_metadata
on mitxonline_exam_grades.courserun_readable_id = mitxonline_courserun_metadata.courserun_readable_id
left join micromasters_exam_grades
on
mitxonline_exam_grades.courserun_readable_id = micromasters_exam_grades.examrun_readable_id
Expand Down
Loading