feat(python-sdk)!: async-first evaluators with evaluate_sync wrapper

[czi-fsisenda]

Summary:

async-first evaluators with evaluate_sync wrapper

Test Plan:

• Wrote automated tests
  • Unit tests
• Manually tested my changes, and here are the details:

[Copilot]

Pull request overview

This PR makes the Python SDK evaluator execution async-first by converting BaseEvaluator.evaluate, prompt-chain execution, and evaluator implementations to async, while adding evaluate_sync for synchronous callers.

Changes:

• Converted base evaluator flow and prompt-chain execution to async/await.
• Updated built-in vocabulary and conventionality evaluators to await prompt steps.
• Updated tests and README examples to use evaluate_sync.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
sdks/python/src/learning_commons_evaluators/evaluators/base.py	Introduces async evaluation and sync wrapper.
sdks/python/src/learning_commons_evaluators/evaluators/conventionality.py	Converts conventionality implementation to async prompt execution.
sdks/python/src/learning_commons_evaluators/evaluators/vocabulary.py	Converts vocabulary implementation and helper chain to async prompt execution.
sdks/python/README.md	Updates usage examples for evaluate_sync.
sdks/python/tests/evaluators/test_base.py	Updates base evaluator tests for async helpers and sync wrapper.
sdks/python/tests/evaluators/test_conventionality.py	Updates evaluator calls to evaluate_sync.
sdks/python/tests/evaluators/test_vocabulary.py	Updates evaluator calls to evaluate_sync.
sdks/python/tests/contract_tests/harness.py	Updates harness usage example.
sdks/python/tests/contract_tests/test_conventionality.py	Updates contract evaluator call to evaluate_sync.
sdks/python/tests/contract_tests/test_vocabulary.py	Updates contract evaluator calls to evaluate_sync.

Comments suppressed due to low confidence (1)

sdks/python/src/learning_commons_evaluators/evaluators/base.py:84

• The new async public entrypoint is only exercised indirectly through evaluate_sync; there is no test that calls await evaluator.evaluate(...) from an existing event loop. Because this PR makes evaluate the primary async API, add a direct async test so regressions in the awaited API are caught independently of the sync wrapper.

    async def evaluate(
        self,
        input: InputT,
        evaluation_settings: SettingsT | None = None,
    ) -> OutputT:

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.