LLMs
Call LLMs through the phospho proxy
Access to this feature is restricted. Contact us at contact@phospho.ai to request access.
To access any model through the phospho proxy, you need to have a phospho API key and a project on the phospho platform. You can get one by signing up on phospho.ai.
To access the Tak API, please refer to the Tak API page.
OpenAI
The phospho proxy is OpenAI compatible. You can use the OpenAI client to send requests to the phospho API. Messages sent through the phospho proxy will appear in your phospho dashboard.
Available models:
gpt-4o
gpt-4o-mini
To access these models through the phospho proxy, you need to:
- set the base_url to
https://api.phospho.ai/v2/{YOUR_PHOSPHO_PROJECT_ID}/
(instead ofhttps://api.openai.com/v1/
) - set the OPENAI_API_KEY to your phospho API key
- set the model to the desired model with the prefix
openai:
( e.g.openai:gpt-4o
oropenai:gpt-4o-mini
)
Mistral ai
The phospho proxy is Mistral ai compatible. You can use the Mistral client to send requests to the phospho API. Messages sent through the phospho proxy will appear in your phospho dashboard.
Available models:
mistral-small-latest
mistral-small-latest
To access these models through the phospho proxy, you need to:
- set the server_url to
https://api.phospho.ai/v2/{YOUR_PHOSPHO_PROJECT_ID}/
- set the MISTRAL_API_KEY to your phospho API key
- set the model to the desired model with the prefix
mistral:
( e.g.mistral:mistral-large-latest
ormistral:mistral-small-latest
)
Anthropic
Docs coming soon.
Was this page helpful?