To access any model through the phospho proxy, you need to have a phospho API key and a project on the phospho platform. You can get one by signing up on phospho.ai.

​

OpenAI

The phospho proxy is OpenAI compatible. You can use the OpenAI client to send requests to the phospho API. Messages sent through the phospho proxy will appear in your phospho dashboard.

Available models:

• gpt-4o
• gpt-4o-mini

To access these models through the phospho proxy, you need to:

• set the base_url to https://api.phospho.ai/v2/{YOUR_PHOSPHO_PROJECT_ID}/ (instead of https://api.openai.com/v1/)
• set the OPENAI_API_KEY to your phospho API key
• set the model to the desired model with the prefix openai: ( e.g. openai:gpt-4o or openai:gpt-4o-mini)

​

Anthropic

Docs coming soon.

​

Mistral ai

Docs coming soon.