ModelParameter CountContext LengthModel Type
llama-3.1-sonar-small-128k-online8B127,072Chat Completion
llama-3.1-sonar-large-128k-online70B127,072Chat Completion
llama-3.1-sonar-huge-128k-online405B127,072Chat Completion

The search component of our models do not attend to the system prompt. You can use the system prompt to provide instructions related to style, tone, and language of the response.

Beta Access: The Online LLMs have some features in closed beta - to request access to them, please fill out this form.

Initial SetupRate Limits