llamafile
Mozilla's single-executable GGUF packs the model and runtime into one chmod-and-run file — ideal for sharing demos, less for fleet serving.
https://github.com/Mozilla-Ocho/llamafile
cpucudametalvulkanrocmGGUF
No benchmarks pasted on llamafile yet. Paste one — it takes one keystroke and no form.