Lastest LocalScore Results

Home Latest Results Download About Blog

Latest LocalScore Results

04/06/2025 - 9:16 PM

Intel Core Ultra 7 258V (arrowlake-s)

CPU

30.3

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

34.0

tokens/s

generation

14.46

sec

time to first token

101

tokens/s

prompt

62

LocalScore

CPU

Intel Core Ultra 7 258V (arrowlake-s)

RAM

30.3GB

OS

Linux

04/06/2025 - 9:12 PM

AMD Ryzen 7 3700X 8-Core Processor (znver2)

CPU

31.3

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

40.6

tokens/s

generation

5.33

sec

time to first token

280

tokens/s

prompt

129

LocalScore

CPU

AMD Ryzen 7 3700X 8-Core Processor (znver2)

RAM

31.3GB

OS

Windows

04/06/2025 - 9:08 PM

AMD Ryzen 7 5700X 8-Core Processor (znver3)

CPU

31.9

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

6.2

tokens/s

generation

35.56

sec

time to first token

38

tokens/s

prompt

19

LocalScore

CPU

AMD Ryzen 7 5700X 8-Core Processor (znver3)

RAM

31.9GB

OS

Windows

04/06/2025 - 8:31 PM

GPU

22

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

19.9

tokens/s

generation

1.16

sec

time to first token

1133

tokens/s

prompt

269

LocalScore

CPU

AMD EPYC 9554 64-Core Processor (znver4)

RAM

43GB

OS

Linux

04/06/2025 - 8:20 PM

Apple M1 Pro 6P+2E+14GPU

GPU

32

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

20.0

tokens/s

generation

7.23

sec

time to first token

173

tokens/s

prompt

78

LocalScore

CPU

Apple M1 Pro 6P+2E

RAM

32GB

OS

Darwin

04/06/2025 - 8:13 PM

NVIDIA GeForce RTX 3090

GPU

24

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

113

tokens/s

generation

326

ms

time to first token

3991

tokens/s

prompt

1113

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

62.7GB

OS

Linux

04/06/2025 - 8:10 PM

Apple M3 4P+4E+10GPU

GPU

16

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

13.6

tokens/s

generation

8.92

sec

time to first token

137

tokens/s

prompt

59

LocalScore

CPU

Apple M3 4P+4E

RAM

16GB

OS

Darwin

04/06/2025 - 8:08 PM

NVIDIA GeForce RTX 3090

GPU

24

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

65.1

tokens/s

generation

592

ms

time to first token

2185

tokens/s

prompt

622

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

62.7GB

OS

Linux

04/06/2025 - 8:08 PM

Apple M1 Pro 6P+2E+14GPU

GPU

32

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

71.0

tokens/s

generation

1.13

sec

time to first token

1064

tokens/s

prompt

405

LocalScore

CPU

Apple M1 Pro 6P+2E

RAM

32GB

OS

Darwin

04/06/2025 - 8:03 PM

Intel Xeon CPU E5-2699 v3 @ 2.30GHz (haswell)

CPU

377.8

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

22.2

tokens/s

generation

3.18

sec

time to first token

447

tokens/s

prompt

146

LocalScore

CPU

Intel Xeon CPU E5-2699 v3 @ 2.30GHz (haswell)

RAM

377.8GB

OS

Linux