Models API
LLMs
Call LLMs through the phospho proxy
Access to this feature is restricted. Contact us at contact@phospho.ai to request access.
To access any model through the phospho proxy, you need to have a phospho API key and a project on the phospho platform. You can get one by signing up on phospho.ai.
OpenAI
The phospho proxy is OpenAI compatible. You can use the OpenAI client to send requests to the phospho API. Messages sent through the phospho proxy will appear in your phospho dashboard.
Available models:
gpt-4o
gpt-4o-mini
To access these models through the phospho proxy, you need to:
- set the base_url to
https://api.phospho.ai/v2/{YOUR_PHOSPHO_PROJECT_ID}/
(instead ofhttps://api.openai.com/v1/
) - set the OPENAI_API_KEY to your phospho API key
- set the model to the desired model with the prefix
openai:
( e.g.openai:gpt-4o
oropenai:gpt-4o-mini
)
Anthropic
Docs coming soon.
Mistral ai
Docs coming soon.
Was this page helpful?