使用 AI Gateway 入门

Portkey 是 AI 应用的控制面板。凭借其流行的 AI Gateway 和可观察性套件，数百个团队交付可靠、成本高效且快速的应用。

快速入门

由于 Portkey 完全兼容 OpenAI 签名，您可以通过 OpenAI 客户端连接到 Portkey AI 网关。

• 将 base_url 设置为 PORTKEY_GATEWAY_URL

• 添加 default_headers 以使用 createHeaders 辅助方法获取 Portkey 所需的头信息。

Python

安装 OpenAI 和 Portkey SDK

pip install -qU portkey-ai openai

创建客户端

import os
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL, createHeaders

client = OpenAI(
  api_key=os.environ.get("OPENAI_API_KEY"),
  base_url=PORTKEY_GATEWAY_URL, # 👈 或 'http://localhost:8787/v1'
  default_headers=createHeaders(
    provider="openai", # 👈 或 'anthropic', 'together-ai', 'stability-ai' 等
    api_key=os.environ.get("PORTKEY_API_KEY") # 👈 自托管时跳过
  )
)

Javascript / Typescript

REST API

其他 SDK

示例

OpenAI 聊天完成

Provider: openai

Model being tested here: gpt-4o-mini

Python

import os
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL, createHeaders

client = OpenAI(
  api_key=os.environ.get("OPENAI_API_KEY"),
  base_url=PORTKEY_GATEWAY_URL, # 👈 或 'http://localhost:8787/v1'
  default_headers=createHeaders(
    provider="openai",
    api_key=os.environ.get("PORTKEY_API_KEY") # 👈 自托管时跳过
  )
)

client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", "content": "什么是分形？"}],
)

JS/TS

cURL

A fractal is a complex geometric shape that can be split into parts, each of which is a reduced-scale copy of the whole. Fractals are typically self-similar and independent of scale, meaning they look similar at any zoom level. They often appear in nature, in things like snowflakes, coastlines, and fern leaves. The term "fractal" was coined by mathematician Benoit Mandelbrot in 1975.

Anthropic

Provider: anthropic

Model being tested here: claude-3-5-sonnet-20240620

Python

import os
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL, createHeaders

client = OpenAI(
  api_key=os.environ.get("OPENAI_API_KEY"),
  base_url=PORTKEY_GATEWAY_URL, # 👈 or 'http://localhost:8787/v1'
  default_headers=createHeaders(
    provider="anthropic",
    api_key=os.environ.get("PORTKEY_API_KEY") # 👈 skip when self-hosting
  )
)

client.chat.completions.create(
  model="claude-3-5-sonnet-20240620",
  messages=[{"role": "user", "content": "什么是分形？"}],
  max_tokens=250
)

JS/TS

cURL

A fractal is a complex geometric shape that can be split into parts, each of which is a reduced-scale copy of the whole. Fractals are typically self-similar and independent of scale, meaning they look similar at any zoom level. They often appear in nature, in things like snowflakes, coastlines, and fern leaves. The term "fractal" was coined by mathematician Benoit Mandelbrot in 1975.

Mistral AI

Provider: mistral-ai

Model being tested here: mistral-medium

Python

import os
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL, createHeaders

client = OpenAI(
  api_key=os.environ.get("OPENAI_API_KEY"),
  base_url=PORTKEY_GATEWAY_URL, # 👈 or 'http://localhost:8787/v1'
  default_headers=createHeaders(
    provider="mistral-ai",
    api_key=os.environ.get("PORTKEY_API_KEY") # 👈 skip when self-hosting
  )
)

client.chat.completions.create(
  model="mistral-medium",
  messages=[{"role": "user", "content": "What's a fractal?"}],
)

JS/TS

cURL

分形是一种复杂的几何形状，可以被拆分

Together AI

提供者: together-ai

正在测试的模型: togethercomputer/llama-2-70b-chat

Python

import os
from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL, createHeaders

client = OpenAI(
  api_key=os.environ.get("OPENAI_API_KEY"),
  base_url=PORTKEY_GATEWAY_URL, # 👈 或 'http://localhost:8787/v1'
  default_headers=createHeaders(
    provider="together-ai",
    api_key=os.environ.get("PORTKEY_API_KEY") # 👈 自托管时跳过
  )
)

client.chat.completions.create(
  model="togethercomputer/llama-2-70b-chat",
  messages=[{"role": "user", "content": "什么是分形?"}],
)

JS/TS

cURL

A fractal is a complex geometric shape that can be spl

其他提供者

Portkey 支持 30 多个提供者及其所有模型。要在 OpenAI SDK 或 API 中使用它们，请更新提供者和模型以开始使用这些模型。

所有提供者列表