Add tests for new feature API Endpoints: Business logic events for LLM-based SDKs#6339
Add tests for new feature API Endpoints: Business logic events for LLM-based SDKs#6339estringana wants to merge 10 commits intomainfrom
Conversation
|
|
0b79828 to
6772469
Compare
| } | ||
| } | ||
| }, | ||
| { |
There was a problem hiding this comment.
For now, LLM rules are not merged yet on appsec-event-rules repository. For that reason they are harcoded here but in the future they will be removed from here. You can see the PR where this rules have been copy from here https://github.com/DataDog/appsec-event-rules/pull/265
| @rfc( | ||
| "https://docs.google.com/document/d/1TIFxbtbkldjOA6S5JFlCTMfqniXfJXZmDKptI5w2pnk/edit?tab=t.0#heading=h.xtljwwxyhqk7" | ||
| ) | ||
| @scenarios.appsec_rasp |
There was a problem hiding this comment.
It does not belong to RASP but rasp scenarios for now are the ones which have a way of injecting harcoded rules. Once llm rules are merged we can revisit the right scenario for these tests. More info on this comment https://github.com/DataDog/system-tests/pull/6339/changes#r2827405239
| def api_llm_endpoint(test_object): | ||
| """API Security - Business logic events for LLM-based SDKs | ||
|
|
||
| https://feature-parity.us1.prod.dog/#/?feature=543 |
There was a problem hiding this comment.
is 543 the right number? No sure where I need to get it from
There was a problem hiding this comment.
Close, but probably no : https://feature-parity.us1.prod.dog/#/?feature=543
I'm in Paris, we can meet to see how to play with the Feature Parity Dashboard
There was a problem hiding this comment.
I'll be in Paris tomorrow. Let's meet
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🔗 Commit SHA: 4a7f6a5 | Docs | Datadog PR Page | Was this helpful? Give us feedback! |
8601851 to
7cb22da
Compare
Motivation
This PR creates all required tests in order to fully test the new feature API Endpoints: Business logic events for LLM-based SDKs
You can find the RFC here RFC API Endpoints: Business logic events for LLM-based SDKs
Changes
Workflow
🚀 Once your PR is reviewed and the CI green, you can merge it!
🛟 #apm-shared-testing 🛟
Reviewer checklist
tests/ormanifests/is modified ? I have the approval from R&P teambuild-XXX-imagelabel is present