Discussions

I've noticed with the llama-3-sonar-large-32k-chat model I can set a 'system' role and so have some upfront content on all queries to give the model some personality e.g. a mountain bike guide and assistant. When I change the model to llama-3-sonar-large-32k-online to take better advantage of the real-time search so the accuracy of results the system role seems to be ignored/doesn't work, Is there a way to use the 'system' role on the 'online' version of the model or is that functionality not available I am using the Vercel API for perplexity