Model Catalog Migration 8B/9: Extended LLM Provider Integration (Minor Updates)

integrations/llms/ai21.mdx

@@ -1,11 +1,11 @@
 ---
 title: "AI21"
 description: "Integrate AI21 models with Portkey's AI Gateway"
 ---
 
 Portkey provides a robust and secure gateway to integrate various Large Language Models (LLMs) into applications, including [AI21's models](https://ai21.com).
 
 With Portkey, take advantage of features like fast AI gateway access, observability, prompt management, and more, while securely managing API keys through [Model Catalog](/product/model-catalog).
 
 ## Quick Start
 
@@ -30,13 +30,13 @@
 ```
 
 ```js Javascript icon="square-js"
-        import Portkey from 'portkey-ai'
+import Portkey from 'portkey-ai'
 
 // 1. Install: npm install portkey-ai
 // 2. Add @ai21 provider in model catalog
 // 3. Use it:
 
-        const portkey = new Portkey({
+const portkey = new Portkey({
     apiKey: "PORTKEY_API_KEY"
 })
 
@@ -48,7 +48,7 @@
 console.log(response.choices[0].message.content)
 ```
 
-```python OpenAI Py icon="openai"
+```python OpenAI Py icon="python"
 from openai import OpenAI
 from portkey_ai import PORTKEY_GATEWAY_URL
 
@@ -69,7 +69,7 @@
 print(response.choices[0].message.content)
         ```
 
-```js OpenAI JS icon="openai"
+```js OpenAI JS icon="square-js"
 import OpenAI from "openai"
 import { PORTKEY_GATEWAY_URL } from "portkey-ai"
 

integrations/llms/anyscale-llama2-mistral-zephyr.mdx

@@ -1,11 +1,11 @@
 ---
 title: "Anyscale"
 description: Use Anyscale's serverless endpoints for Llama, Mistral, and other open-source models through Portkey.
 ---
 
 ## Quick Start
 
 Get started with Anyscale in under 2 minutes:
 
 <CodeGroup>
 
@@ -45,7 +45,7 @@
 console.log(response.choices[0].message.content)
 ```
 
-```python OpenAI Py icon="openai"
+```python OpenAI Py icon="python"
 from openai import OpenAI
 from portkey_ai import PORTKEY_GATEWAY_URL
 
@@ -66,7 +66,7 @@
 print(response.choices[0].message.content)
 ```
 
-```js OpenAI JS icon="openai"
+```js OpenAI JS icon="square-js"
 import OpenAI from "openai"
 import { PORTKEY_GATEWAY_URL } from "portkey-ai"
 
@@ -104,10 +104,10 @@
 
 ## Add Provider in Model Catalog
 
 Before making requests, add Anyscale to your Model Catalog:
 
 1. Go to [**Model Catalog → Add Provider**](https://app.portkey.ai/model-catalog/providers)
 2. Select **Anyscale**
 3. Enter your [Anyscale API key](https://console.anyscale.com/v2/api-keys)
 4. Name your provider (e.g., `anyscale`)
 

integrations/llms/fireworks/files.mdx

@@ -53,7 +53,7 @@ await uploadFile();
   </Tab>
 <Tab title="REST">
 ```sh
-# you can also use a virtual key here
+# you can also use a provider from Model Catalog here
 curl --location 'https://api.portkey.ai/v1/files' \
 --header 'x-portkey-api-key: <portkey_api_key>' \
 --header 'x-portkey-provider: fireworks-ai' \

integrations/llms/google-palm.mdx

@@ -2,20 +2,20 @@
 title: "Google Palm"
 ---
 
 Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including [Google Palm APIs](https://developers.generativeai.google/guide/palm%5Fapi%5Foverview).
 
 With Portkey, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a [virtual key](/product/ai-gateway/virtual-keys) system.
 
 <Note>
 Provider Slug. `palm`
 </Note>
 ## Portkey SDK Integration with Google Palm
 
 Portkey provides a consistent API to interact with models from various providers. To integrate Google Palm with Portkey:
 
 ### 1\. Install the Portkey SDK
 
 Add the Portkey SDK to your application to interact with Google Palm's API through Portkey's gateway.
 <Tabs>
     <Tab title="NodeJS">
         ```
@@ -32,16 +32,16 @@
 
 
 
 ### 2\. Initialize Portkey with the Virtual Key
 
 Set up Portkey with your virtual key as part of the initialization configuration. You can create a [virtual key](/product/ai-gateway/virtual-keys) for Google Palm in the UI.
 <Tabs>
     <Tab title="NodeJS SDK">
         ```js
-        import Portkey from 'portkey-ai'
+import Portkey from 'portkey-ai'
 
 
-        const portkey = new Portkey({
+const portkey = new Portkey({
 
             apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
 
@@ -71,11 +71,11 @@
 
 ### **3\. Invoke Chat Completions with** Google Palm
 
 Use the Portkey instance to send requests to Google Palm. You can also override the virtual key directly in the API call if needed.
 <Tabs>
     <Tab title="NodeJS SDK">
         ```js
-        const chatCompletion = await portkey.chat.completions.create({
+const chatCompletion = await portkey.chat.completions.create({
 
             messages: [{ role: 'user', content: 'Say this is a test' }],
 

integrations/llms/oracle.mdx

@@ -2,17 +2,17 @@
 title: "Oracle Cloud Infrastructure"
 ---
 
 Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including [Oracle Cloud Infrastructure (OCI) Generative AI](https://www.oracle.com/artificial-intelligence/generative-ai/generative-ai-service/).
 
 <Note>
 Provider Slug: `oracle`
 </Note>
 
 ## Portkey SDK Integration with Oracle OCI
 
 Portkey provides a consistent API to interact with models from various providers. To integrate Oracle OCI Generative AI with Portkey:
 
 ### 1\. Install the Portkey SDK
 <Tabs>
     <Tab title="NodeJS">
         ```sh
@@ -26,7 +26,7 @@
     </Tab>
 </Tabs>
 
 ### 2\. Initialize Portkey with Oracle OCI
 
 Oracle OCI uses API key-based authentication with request signing. You'll need the following credentials from your OCI console:
 
@@ -40,14 +40,14 @@
 | `oraclePrivateKey` | Private key content (PEM format) |
 | `oracleKeyPassphrase` | (Optional) Passphrase for encrypted private key |
 
 Add these credentials to Portkey to create your Oracle virtual key.
 
 <Tabs>
     <Tab title="NodeJS SDK">
         ```js
-        import Portkey from 'portkey-ai'
+import Portkey from 'portkey-ai'
 
-        const portkey = new Portkey({
+const portkey = new Portkey({
             apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
             provider: "@ORACLE_PROVIDER" // Your Oracle OCI virtual key
         })
@@ -70,7 +70,7 @@
 <Tabs>
     <Tab title="NodeJS SDK">
         ```js
-        const chatCompletion = await portkey.chat.completions.create({
+const chatCompletion = await portkey.chat.completions.create({
             messages: [{ role: 'user', content: 'Say this is a test' }],
             model: 'cohere.command-r-plus',
         });