Accelerator icon
NVIDIA GeForce RTX 4060 Laptop GPU
GPU
8
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Prompt Speed
6225tokens/s
Generation Speed
96.4tokens/s
Time to First Token
224ms
LocalScore
1388
COMPARE MODELS

1 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

NVIDIA GeForce RTX 4060 Laptop GPU - 8GB