openplayground

An LLM playground you can run on your laptop.

Features

• Use any model from OpenAI, Anthropic, Cohere, Forefront, HuggingFace, Aleph Alpha, and llama.cpp.
• Full playground UI, including history, parameter tuning, keyboard shortcuts, and logprops.
• Compare models side-by-side with the same prompt, individually tune model parameters, and retry with different paramaters.
• Automatically detects local models in your HuggingFace cache, and lets you install new ones.
• Works OK on your phone.
• Probably won't kill everyone.