logo
HomeLatest ResultsDownloadAboutBlog

LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.

LEADERBOARD
model icon
NVIDIA RTX PRO 6000 Blackwell Workstation Edition
GPU / 95GB
PROMPT
8479
tokens/s
GENERATION
138
tokens/s
TTFT
146
ms
LOCALSCORE
2000
NVIDIA RTX 6000 Ada Generation
GPU / 47GB
PROMPT
6808
tokens/s
GENERATION
121
tokens/s
TTFT
199
ms
LOCALSCORE
1605
NVIDIA GeForce RTX 4090
GPU / 24GB
PROMPT
6749
tokens/s
GENERATION
91.9
tokens/s
TTFT
197
ms
LOCALSCORE
1463
NVIDIA GeForce RTX 5090
GPU / 31GB
PROMPT
7374
tokens/s
GENERATION
74.8
tokens/s
TTFT
184
ms
LOCALSCORE
1434
NVIDIA H100 PCIe
GPU / 79GB
PROMPT
5202
tokens/s
GENERATION
120
tokens/s
TTFT
236
ms
LOCALSCORE
1382
NVIDIA GeForce RTX 3090 Ti
GPU / 24GB
PROMPT
4024
tokens/s
GENERATION
110
tokens/s
TTFT
320
ms
LOCALSCORE
1113
NVIDIA A100-SXM4-80GB
GPU / 79GB
PROMPT
3571
tokens/s
GENERATION
110
tokens/s
TTFT
336
ms
LOCALSCORE
1054
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
3727
tokens/s
GENERATION
106
tokens/s
TTFT
345
ms
LOCALSCORE
1047
NVIDIA GeForce RTX 3080 Ti
GPU / 12GB
PROMPT
3739
tokens/s
GENERATION
104
tokens/s
TTFT
343
ms
LOCALSCORE
1042
NVIDIA RTX 6000 Ada Generation
GPU / 48GB
PROMPT
5487
tokens/s
GENERATION
51.3
tokens/s
TTFT
252
ms
LOCALSCORE
1038
NVIDIA GeForce RTX 4070 Ti SUPER
GPU / 16GB
PROMPT
4222
tokens/s
GENERATION
77.6
tokens/s
TTFT
316
ms
LOCALSCORE
1012
NVIDIA L40S
GPU / 45GB
PROMPT
5328
tokens/s
GENERATION
45.9
tokens/s
TTFT
262
ms
LOCALSCORE
977
NVIDIA RTX A6000
GPU / 48GB
PROMPT
3447
tokens/s
GENERATION
90.5
tokens/s
TTFT
378
ms
LOCALSCORE
938
NVIDIA RTX A5000
GPU / 24GB
PROMPT
2890
tokens/s
GENERATION
89.9
tokens/s
TTFT
445
ms
LOCALSCORE
836
NVIDIA GeForce RTX 3070 Ti
GPU / 8GB
PROMPT
2509
tokens/s
GENERATION
83.2
tokens/s
TTFT
520
ms
LOCALSCORE
738
NVIDIA GeForce RTX 5060 Ti
GPU / 15GB
PROMPT
2427
tokens/s
GENERATION
60.6
tokens/s
TTFT
557
ms
LOCALSCORE
641