Ollama
A one-command model manager and OpenAI-style server built on llama.cpp — unbeatable for quick LLM starts, with the flexibility of the underlying runtime.
cudametalrocmcpuGGUF
No benchmarks pasted on Ollama yet. Paste one — it takes one keystroke and no form.