LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
LEADERBOARD
GPU / 47GB
PROMPT
27281
tokens/s
GENERATION
411
tokens/s
TTFT
53
ms
LOCALSCORE
5948
GPU / 32GB
PROMPT
17479
tokens/s
GENERATION
247
tokens/s
TTFT
80
ms
LOCALSCORE
3780
PROMPT
20440
tokens/s
GENERATION
191
tokens/s
TTFT
181
ms
LOCALSCORE
3234
PROMPT
18081
tokens/s
GENERATION
106
tokens/s
TTFT
74
ms
LOCALSCORE
2962
GPU / 16GB
PROMPT
11965
tokens/s
GENERATION
207
tokens/s
TTFT
148
ms
LOCALSCORE
2559
GPU / 23GB
PROMPT
11677
tokens/s
GENERATION
138
tokens/s
TTFT
462
ms
LOCALSCORE
1920
GPU / 8GB
PROMPT
5696
tokens/s
GENERATION
189
tokens/s
TTFT
236
ms
LOCALSCORE
1660
GPU / 47GB
PROMPT
6808
tokens/s
GENERATION
121
tokens/s
TTFT
199
ms
LOCALSCORE
1605
PROMPT
6346
tokens/s
GENERATION
85.8
tokens/s
TTFT
208
ms
LOCALSCORE
1393
GPU / 32GB
PROMPT
4979
tokens/s
GENERATION
78.7
tokens/s
TTFT
267
ms
LOCALSCORE
1136
PROMPT
4416
tokens/s
GENERATION
64.0
tokens/s
TTFT
311
ms
LOCALSCORE
992
GPU / 47GB
PROMPT
3552
tokens/s
GENERATION
70.0
tokens/s
TTFT
369
ms
LOCALSCORE
877
GPU / 32GB
PROMPT
2803
tokens/s
GENERATION
46.2
tokens/s
TTFT
468
ms
LOCALSCORE
651
PROMPT
2581
tokens/s
GENERATION
17.9
tokens/s
TTFT
637
ms
LOCALSCORE
438