Accelerator icon
AMD Radeon 780M
GPU
27
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Llama 3.2 3B Instruct
Q4_K - Medium3.6B
Prompt Speed
690tokens/s
288tokens/s
Generation Speed
11.7tokens/s
6.4tokens/s
Time to First Token
1.88sec
4.58sec
LocalScore
162
74
COMPARE MODELS

2 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

Llama 3.2 3B Instruct

Q4_K - Medium

AMD Radeon 780M - 27GB