GTX 1070 Ti

7measured results

117best gen tok/s*

8 GBreported memory

*Headline excludes tiny/test models (under 0.6B params or TinyStories-style). Open in rig checker →

llama.cpp

Model	Quant	Gen tok/s	Prompt tok/s	Source	Context tested	Build
Llama 3.2 1B Instruct	Q4_K - Medium	117	3,003	LocalScore ↗	512+128	llamafile 0.9.2	Details →
Llama 3.2 1B Instruct	Q4_K - Medium	116	2,993	LocalScore ↗	512+128	llamafile 0.9.2	Details →
Llama 3.2 1B Instruct	Q4_K - Medium	114	2,944	LocalScore ↗	512+128	llamafile 0.9.2	Details →
Llama 2 7B	Q4_0	43.4	293	llama.cpp (Vulkan) ↗	512+128	llama.cpp Vulkan @860a9e4 — eGPU	Details →
Llama 2 7B	Q4_0	42.9	298	llama.cpp (Vulkan) ↗	512+128	llama.cpp Vulkan @860a9e4 — eGPU	Details →
Llama 2 7B	Q4_0	37.9	791	llama.cpp (CUDA) ↗	512+128	llama.cpp CUDA @79c1160	Details →
Llama 2 7B	Q4_0	37.8	714	llama.cpp (CUDA) ↗	512+128	llama.cpp CUDA @79c1160	Details →

Ollama

No measured Ollama results yet. Submit yours →

MLX

No measured MLX results yet. Submit yours →

Includes results from LocalScore, a Mozilla Builders project by cjpais, mirrored in the cn0303/local-llm-speed-benchmarks dataset. LocalScore runs use llamafile, which is built on llama.cpp.