Skip to content

https://raw.githubusercontent.com/MicrosoftLearning/mslearn-genaiops/refs/heads/main/docs/04-automated-evaluation.md - Issues #49

@SkillableKarl

Description

@SkillableKarl

-In Task 'Run cloud evaluation', Step 1, the note indicates the script should run for '5-15 minutes', however in my latest run it was still going & in excess of 45 minutes, in a 'polling for completion' state so I cancelled this instance. I saw no errors and the job may have eventually completed but this amount of time obviously tests patience. Uncertain what, if anything, can be optimized to reduce or eliminate the delay.

Image

-In Step 2 of same Task, we see the same issue with git config for user email/username - likely a step should be added to include the code Student will need to run.

Image

In any case, although I have not been able to immediately reproduce the following issue that was reported by our QA person, I believe it is likely valid and perhaps you can investigate and verify/fix in Instructions as needed:

-Exercise # Automate with GitHub Actions - Task #Test with a pull request - Step #4
Issue Identified: Realized the workflow wasn't running automatically when a PR was created. after tracking the trigger and investigating the workflow I found that the needed lines were commented out.

After uncommenting the lines i was able to trigger the workflow.
path→ mslearn-genaiops.github\workflows\evaluate-agent.yml → lines 5-6

Image

QA person also noted the workflow run took ~55 minutes to complete. This potential long delay to completion should probably be noted in Instructions.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions