#
Live demo
You can interact with bots in the Live demo for free using our open LLaMa server. But the recommended way is to use your own endpoint.
#
Instructions
You can interact with bot right away by just clicking on them, it will use our default open endpoint which is using the Chronos-Hermes 13b model.
If you want use a custom endpoint, you can click on the burger menu on the top right corner and select "Custom endpoint". Then, paste your endpoint URL in the text box. You can also set a custom OpenAI API key if you want to use gpt3.5-turbo for responses instead.
In order to set up a custom endpoint, you can follow the How to use the endpoints guide.
What is Prompt Stragety?
Prompt strategy is the method used to describe the conversation to the language model. Some models are more sentive to some strategies than others. You can try different strategies to see which one works best for your model.
SBFandW++work well for OpenAIPygmalion styleworks good forPygmalion 6b,7b and 13bAlpacaandVicuna 1.1generally work well forLLaMAinstruct models like WizardLM.