Added embedding API to C++ SDK

[phanindraraja]

Summary

Adds embedding support to the C++ SDK and aligns the embedding samples across all SDK languages to a consistent initialization sequence. Includes optimizations to the existing embedding client implementations.

Changes

C++ SDK — embedding client

Public OpenAIEmbeddingClient exposing GenerateEmbedding (single input) and GenerateEmbeddings (batch input). Empty and whitespace-only inputs are rejected client-side. Responses parse into strongly-typed EmbeddingCreateResponse / EmbeddingObject / EmbeddingUsage structs via nlohmann/json.

• Tests: 13 unit tests with a mocked core (no native DLL required) and one E2E test that exercises the full download → load → embed → unload flow against a real model.
• In-tree sample: sdk/cpp/sample/main.cpp gains an embeddings example. The example prefers a CPU variant, validates that the model is loaded, generates one single-input embedding and one batch embedding, and unloads the model.
• Standalone sample: samples/cpp/embeddings/{main.cpp,README.md} provides a top-level entry point for the embeddings demo. Discovers and registers execution providers, then runs the same single + batch flow.
• Documentation: sdk/cpp/README.md lists embeddings under Features, gains a usage section with a code snippet, and registers OpenAIEmbeddingClient in the API reference table and embedding_client.h in the project structure.

Embedding sample alignment

Every embedding sample runs the same seven-step sequence: create the manager → discover execution providers (prints a table) → download and register execution providers → get the catalog → get the model → download the model → load the model. The model alias is qwen3-embedding-0.6b across all samples.

Optimizations to existing embedding clients

• Materialize the batch input collection once before validation and serialization, avoiding multiple enumerations.
• Rename a setup-method local that shadowed a class-level static.
• Remove a test helper that mutated a shared model config file in place without restoring it.
• Replace a value-discarding map call with an idiomatic insert-if-absent pattern when injecting missing response fields.
• Drop redundant length checks on collections already covered by truthiness.
• Remove a stale TOC entry from the API docs.

Testing

• C++ unit tests: 13/13 pass under ctest --preset x64-debug.
• Full C++ test suite: 168/168 ran tests pass.
• C++ E2E embedding test runs locally with the native Core DLL staged alongside the test binary and --gtest_also_run_disabled_tests.
• C# SDK builds clean for both net8.0 and netstandard2.0 targets.
• All embedding integration surfaces are unchanged from the user's perspective.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
foundry-local	Ready	Preview, Comment	May 8, 2026 7:29pm

[Copilot]

Pull request overview

Adds an OpenAI-compatible embeddings client to the C++ SDK and aligns surrounding SDK/sample code to support embedding usage consistently across languages.

Changes:

• Introduces OpenAIEmbeddingClient (C++), including JSON parsing for embedding responses and CMake integration.
• Adds C++ unit tests + disabled E2E coverage for embeddings; updates the C++ sample to demonstrate single and batch embeddings.
• Minor cleanups/alignments in Rust/Python/C# embedding clients/tests/docs and updates samples to use the newer embedding alias and to download/register execution providers before running.

Reviewed changes

Copilot reviewed 19 out of 19 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
sdk/rust/src/openai/embedding_client.rs	Simplifies/clarifies response “patching” before deserializing into async_openai types.
sdk/rust/docs/api.md	Removes outdated TOC entry for an embedding response type.
sdk/python/src/openai/embedding_client.py	Simplifies empty-input check (if not inputs).
sdk/cs/test/FoundryLocal.Tests/Utils.cs	Removes the model-config max_length patch helper (no longer used).
sdk/cs/test/FoundryLocal.Tests/EmbeddingClientTests.cs	Removes max_length patch usage; minor variable rename/cleanup.
sdk/cs/src/OpenAI/EmbeddingClient.cs	Avoids multiple enumeration by materializing inputs once and validating the list.
sdk/cpp/test/e2e_test.cpp	Adds disabled E2E test for downloading/loading/unloading and generating embeddings (single + batch).
sdk/cpp/test/client_test.cpp	Adds unit tests validating request format, response parsing, and input/core-error handling for embeddings.
sdk/cpp/src/parser.h	Adds from_json parsers for embedding response structs.
sdk/cpp/src/openai_embedding_client.cpp	Implements the C++ embeddings client over the native embeddings command.
sdk/cpp/sample/main.cpp	Adds a runnable embeddings example (single + batch).
sdk/cpp/include/openai/openai_embedding_client.h	New public C++ header exposing embedding client + response types.
sdk/cpp/include/model.h	Grants embedding client access to IModel::CoreAccess (friend + forward decl).
sdk/cpp/include/foundry_local.h	Exposes embeddings client via umbrella header include.
sdk/cpp/CMakeLists.txt	Enables /EHsc on MSVC and adds the new embeddings source file to the static library.
samples/rust/embeddings/src/main.rs	Updates embedding alias and adds EP discovery + download/register with progress output.
samples/python/embeddings/src/app.py	Updates embedding alias and adds EP discovery + download/register with progress output.
samples/js/embeddings/app.js	Updates embedding alias and adds EP discovery + download/register with progress output.
samples/cs/embeddings/Program.cs	Updates embedding alias and adds EP discovery + download/register with progress output.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.