Hardware /

AMD Radeon RX 7900 GRE

2measured results
116best gen tok/s*

*Headline excludes tiny/test models (under 0.6B params or TinyStories-style). Open in rig checker →

llama.cpp

ModelQuantGen tok/sPrompt tok/sSourceContext testedBuild
Llama 2 7BQ4_01162,336llama.cpp (Vulkan) ↗512+128llama.cpp Vulkan @4b2a477Details →
Llama 2 7BQ4_01112,251llama.cpp (Vulkan) ↗512+128llama.cpp Vulkan @4b2a477Details →

Ollama

No measured Ollama results yet. Submit yours →

MLX

No measured MLX results yet. Submit yours →