LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.

LEADERBOARD
PROMPT
6749
tokens/s
GENERATION
91.9
tokens/s
TTFT
197
ms
LOCALSCORE
1463
PROMPT
7374
tokens/s
GENERATION
74.8
tokens/s
TTFT
184
ms
LOCALSCORE
1434
PROMPT
5202
tokens/s
GENERATION
120
tokens/s
TTFT
236
ms
LOCALSCORE
1382
PROMPT
4024
tokens/s
GENERATION
110
tokens/s
TTFT
320
ms
LOCALSCORE
1113
PROMPT
3771
tokens/s
GENERATION
108
tokens/s
TTFT
342
ms
LOCALSCORE
1060
PROMPT
3571
tokens/s
GENERATION
110
tokens/s
TTFT
336
ms
LOCALSCORE
1054
PROMPT
3739
tokens/s
GENERATION
104
tokens/s
TTFT
343
ms
LOCALSCORE
1042
PROMPT
5487
tokens/s
GENERATION
51.3
tokens/s
TTFT
252
ms
LOCALSCORE
1038
PROMPT
4222
tokens/s
GENERATION
77.6
tokens/s
TTFT
316
ms
LOCALSCORE
1012
GPU / 45GB
PROMPT
5328
tokens/s
GENERATION
45.9
tokens/s
TTFT
262
ms
LOCALSCORE
977
GPU / 44GB
PROMPT
5065
tokens/s
GENERATION
45.1
tokens/s
TTFT
274
ms
LOCALSCORE
941
PROMPT
3447
tokens/s
GENERATION
90.5
tokens/s
TTFT
378
ms
LOCALSCORE
938
PROMPT
4461
tokens/s
GENERATION
54.4
tokens/s
TTFT
301
ms
LOCALSCORE
931
GPU / 44GB
PROMPT
3270
tokens/s
GENERATION
80.6
tokens/s
TTFT
401
ms
LOCALSCORE
870
PROMPT
3692
tokens/s
GENERATION
60.0
tokens/s
TTFT
371
ms
LOCALSCORE
839
PROMPT
3192
tokens/s
GENERATION
76.3
tokens/s
TTFT
415
ms
LOCALSCORE
838
PROMPT
2890
tokens/s
GENERATION
89.9
tokens/s
TTFT
445
ms
LOCALSCORE
836
PROMPT
2509
tokens/s
GENERATION
83.2
tokens/s
TTFT
520
ms
LOCALSCORE
738