Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions integrations/llms/ai21.mdx
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
---
title: "AI21"
description: "Integrate AI21 models with Portkey's AI Gateway"

Check warning on line 3 in integrations/llms/ai21.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/ai21.mdx#L3

Did you really mean 'Portkey's'?
---

Portkey provides a robust and secure gateway to integrate various Large Language Models (LLMs) into applications, including [AI21's models](https://ai21.com).

Check warning on line 6 in integrations/llms/ai21.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/ai21.mdx#L6

Did you really mean 'Portkey'?

Check warning on line 6 in integrations/llms/ai21.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/ai21.mdx#L6

Did you really mean 'LLMs'?

With Portkey, take advantage of features like fast AI gateway access, observability, prompt management, and more, while securely managing API keys through [Model Catalog](/product/model-catalog).

Check warning on line 8 in integrations/llms/ai21.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/ai21.mdx#L8

Did you really mean 'Portkey'?

## Quick Start

Expand All @@ -30,13 +30,13 @@
```

```js Javascript icon="square-js"
import Portkey from 'portkey-ai'
import Portkey from 'portkey-ai'

// 1. Install: npm install portkey-ai
// 2. Add @ai21 provider in model catalog
// 3. Use it:

const portkey = new Portkey({
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY"
})

Expand All @@ -48,7 +48,7 @@
console.log(response.choices[0].message.content)
```

```python OpenAI Py icon="openai"
```python OpenAI Py icon="python"
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL

Expand All @@ -69,7 +69,7 @@
print(response.choices[0].message.content)
```

```js OpenAI JS icon="openai"
```js OpenAI JS icon="square-js"
import OpenAI from "openai"
import { PORTKEY_GATEWAY_URL } from "portkey-ai"

Expand Down
4 changes: 2 additions & 2 deletions integrations/llms/anyscale-llama2-mistral-zephyr.mdx
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
---
title: "Anyscale"
description: Use Anyscale's serverless endpoints for Llama, Mistral, and other open-source models through Portkey.

Check warning on line 3 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L3

Did you really mean 'Anyscale'?

Check warning on line 3 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L3

Did you really mean 'serverless'?

Check warning on line 3 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L3

Did you really mean 'Portkey'?
---

## Quick Start

Get started with Anyscale in under 2 minutes:

Check warning on line 8 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L8

Did you really mean 'Anyscale'?

<CodeGroup>

Expand Down Expand Up @@ -45,7 +45,7 @@
console.log(response.choices[0].message.content)
```

```python OpenAI Py icon="openai"
```python OpenAI Py icon="python"
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL

Expand All @@ -66,7 +66,7 @@
print(response.choices[0].message.content)
```

```js OpenAI JS icon="openai"
```js OpenAI JS icon="square-js"
import OpenAI from "openai"
import { PORTKEY_GATEWAY_URL } from "portkey-ai"

Expand Down Expand Up @@ -104,10 +104,10 @@

## Add Provider in Model Catalog

Before making requests, add Anyscale to your Model Catalog:

Check warning on line 107 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L107

Did you really mean 'Anyscale'?

1. Go to [**Model Catalog → Add Provider**](https://app.portkey.ai/model-catalog/providers)
2. Select **Anyscale**

Check warning on line 110 in integrations/llms/anyscale-llama2-mistral-zephyr.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/anyscale-llama2-mistral-zephyr.mdx#L110

Did you really mean 'Anyscale'?
3. Enter your [Anyscale API key](https://console.anyscale.com/v2/api-keys)
4. Name your provider (e.g., `anyscale`)

Expand Down
2 changes: 1 addition & 1 deletion integrations/llms/fireworks/files.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ await uploadFile();
</Tab>
<Tab title="REST">
```sh
# you can also use a virtual key here
# you can also use a provider from Model Catalog here
curl --location 'https://api.portkey.ai/v1/files' \
--header 'x-portkey-api-key: <portkey_api_key>' \
--header 'x-portkey-provider: fireworks-ai' \
Expand Down
6 changes: 3 additions & 3 deletions integrations/llms/google-palm.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,20 +2,20 @@
title: "Google Palm"
---

Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including [Google Palm APIs](https://developers.generativeai.google/guide/palm%5Fapi%5Foverview).

Check warning on line 5 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L5

Did you really mean 'Portkey'?

Check warning on line 5 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L5

Did you really mean 'LLMs'?

With Portkey, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a [virtual key](/product/ai-gateway/virtual-keys) system.

Check warning on line 7 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L7

Did you really mean 'Portkey'?

<Note>
Provider Slug. `palm`
</Note>
## Portkey SDK Integration with Google Palm

Check warning on line 12 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L12

Did you really mean 'Portkey'?

Portkey provides a consistent API to interact with models from various providers. To integrate Google Palm with Portkey:

Check warning on line 14 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L14

Did you really mean 'Portkey'?

Check warning on line 14 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L14

Did you really mean 'Portkey'?

### 1\. Install the Portkey SDK

Check warning on line 16 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L16

Did you really mean 'Portkey'?

Add the Portkey SDK to your application to interact with Google Palm's API through Portkey's gateway.

Check warning on line 18 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L18

Did you really mean 'Portkey'?

Check warning on line 18 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L18

Did you really mean 'Portkey's'?
<Tabs>
<Tab title="NodeJS">
```
Expand All @@ -32,16 +32,16 @@



### 2\. Initialize Portkey with the Virtual Key

Check warning on line 35 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L35

Did you really mean 'Portkey'?

Set up Portkey with your virtual key as part of the initialization configuration. You can create a [virtual key](/product/ai-gateway/virtual-keys) for Google Palm in the UI.

Check warning on line 37 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L37

Did you really mean 'Portkey'?
<Tabs>
<Tab title="NodeJS SDK">
```js
import Portkey from 'portkey-ai'
import Portkey from 'portkey-ai'


const portkey = new Portkey({
const portkey = new Portkey({

apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]

Expand Down Expand Up @@ -71,11 +71,11 @@

### **3\. Invoke Chat Completions with** Google Palm

Use the Portkey instance to send requests to Google Palm. You can also override the virtual key directly in the API call if needed.

Check warning on line 74 in integrations/llms/google-palm.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/google-palm.mdx#L74

Did you really mean 'Portkey'?
<Tabs>
<Tab title="NodeJS SDK">
```js
const chatCompletion = await portkey.chat.completions.create({
const chatCompletion = await portkey.chat.completions.create({

messages: [{ role: 'user', content: 'Say this is a test' }],

Expand Down
6 changes: 3 additions & 3 deletions integrations/llms/oracle.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,17 +2,17 @@
title: "Oracle Cloud Infrastructure"
---

Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including [Oracle Cloud Infrastructure (OCI) Generative AI](https://www.oracle.com/artificial-intelligence/generative-ai/generative-ai-service/).

Check warning on line 5 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L5

Did you really mean 'Portkey'?

Check warning on line 5 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L5

Did you really mean 'LLMs'?

<Note>
Provider Slug: `oracle`
</Note>

## Portkey SDK Integration with Oracle OCI

Check warning on line 11 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L11

Did you really mean 'Portkey'?

Portkey provides a consistent API to interact with models from various providers. To integrate Oracle OCI Generative AI with Portkey:

Check warning on line 13 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L13

Did you really mean 'Portkey'?

Check warning on line 13 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L13

Did you really mean 'Portkey'?

### 1\. Install the Portkey SDK

Check warning on line 15 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L15

Did you really mean 'Portkey'?
<Tabs>
<Tab title="NodeJS">
```sh
Expand All @@ -26,7 +26,7 @@
</Tab>
</Tabs>

### 2\. Initialize Portkey with Oracle OCI

Check warning on line 29 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L29

Did you really mean 'Portkey'?

Oracle OCI uses API key-based authentication with request signing. You'll need the following credentials from your OCI console:

Expand All @@ -40,14 +40,14 @@
| `oraclePrivateKey` | Private key content (PEM format) |
| `oracleKeyPassphrase` | (Optional) Passphrase for encrypted private key |

Add these credentials to Portkey to create your Oracle virtual key.

Check warning on line 43 in integrations/llms/oracle.mdx

View check run for this annotation

Mintlify / Mintlify Validation (portkey-docs) - vale-spellcheck

integrations/llms/oracle.mdx#L43

Did you really mean 'Portkey'?

<Tabs>
<Tab title="NodeJS SDK">
```js
import Portkey from 'portkey-ai'
import Portkey from 'portkey-ai'

const portkey = new Portkey({
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
provider: "@ORACLE_PROVIDER" // Your Oracle OCI virtual key
})
Expand All @@ -70,7 +70,7 @@
<Tabs>
<Tab title="NodeJS SDK">
```js
const chatCompletion = await portkey.chat.completions.create({
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'cohere.command-r-plus',
});
Expand Down
Loading