The SkatterBencher AI Benchmark leaderboard consists of all benchmark results from SkatterBencher CPU and GPU overclocking guides. You can find more information about how the benchmark is configured below the AI Benchmark leaderboard.
AI Benchmark Leaderboard
| SKU | OC Strategy | Benchmark Score |
|---|---|---|
| NVIDIA RTX A5000 Laptop | WSL_CUDNN | 26830 |
| NVIDIA RTX A5000 Laptop | WSL_TENSORRT | 26767 |
| NVIDIA RTX A5000 Laptop | WN_DIRECTML | 26318 |
| NVIDIA RTX A5000 Laptop | WSL_DIRECTML | 23287 |
| Intel Arc A770 | SB64_OCS4 | 16935 |
| Intel Arc A770 | SB64_OCS3 | 16561 |
| NVIDIA GeForce RTX 3050 | SB62_OCS2 | 16418 |
| Intel Arc A770 | SB64_OCS2 | 15972 |
| NVIDIA GeForce RTX 3050 | SB62_OCS1 | 15847 |
| Intel Arc A770 | SB64_OCS1 | 15669 |
| NVIDIA GeForce RTX 3050 | SB62_OCS3 | 15167 |
| NVIDIA GeForce RTX 3050 | SB62_EVGA | 14556 |
| Intel Arc A770 | SB64_Stock | 14325 |
| NVIDIA GeForce RTX 3050 | SB62_Stock | 14209 |
| Intel Xeon w7-3465X | SB63_OCS4 | 12100 |
| Intel Xeon w7-3465X | SB63_OCS3 | 11431 |
| Intel Xeon w5-3435X | SB61_OCS4 | 9591 |
| Intel Xeon w7-2495X | SB59_OCS4 | 9492 |
| Intel Xeon w7-2495X | SB59_OCS2 | 9354 |
| Intel Xeon w5-3435X | SB61_OCS3 | 9283 |
| Intel Xeon w7-2495X | SB59_OCS3 | 9033 |
| Intel Xeon w7-3465X | SB63_OCS1 | 8988 |
| Intel Xeon w7-3465X | SB63_Stock | 8599 |
| Intel Xeon w5-3435X | SB61_OCS2 | 8541 |
| Intel Xeon w7-2495X | SB59_OCS1 | 7988 |
| Intel Xeon w7-2495X | SB59_Stock | 7593 |
| AMD Ryzen 9 7950X | SB45_OCS5 | 7497 |
| AMD Ryzen 9 7950X | SB45_OCS3 | 7484 |
| AMD Ryzen 9 7950X | SB45_OCS4 | 7441 |
| AMD Ryzen 9 7950X | SB45_OCS2 | 7363 |
| AMD Ryzen 9 7950X3D | SB56_OCS2 | 7080 |
| AMD Ryzen 9 7950X | SB45_OCS1 | 6990 |
| Intel Xeon w5-3435X | SB61_OCS1 | 6981 |
| Intel Core i9-13900K | SB49_OCS3 | 6980 |
| AMD Ryzen 9 7950X3D | SB56_OCS3 | 6956 |
| Intel Core i9-13900K | SB49_OCS2 | 6954 |
| Intel Core i9-13900K | SB49_OCS4 | 6935 |
| AMD Ryzen 9 7950X3D | SB56_OCS1 | 6928 |
| Intel Xeon w5-3435X | SB61_Stock | 6800 |
| Intel Core i9-13900K | SB49_OCS1 | 6754 |
| AMD Ryzen 9 7900 | SB54_OCS5 | 6687 |
| AMD Ryzen 9 7900 | SB54_OCS3 | 6657 |
| AMD Ryzen 9 7900 | SB54_OCS4 | 6587 |
| Intel Arc A380 | SB44_OCS4 | 6582 |
| AMD Ryzen 9 7950X | SB45_Stock | 6580 |
| Intel Core i9-13900KS | SB53_OCS4 | 6526 |
| AMD Ryzen 9 7900 | SB54_OCS2 | 6489 |
| Intel Core i9-13900KS | SB53_OCS3 | 6476 |
| AMD Ryzen 9 7900X | SB46_OCS4 | 6466 |
| AMD Ryzen 9 7900X | SB46_OCS3 | 6457 |
| AMD Ryzen Threadripper 5990X | SB43_OCS5 | 6426 |
| AMD Ryzen 9 7900X | SB46_OCS5 | 6407 |
| AMD Ryzen 9 7950X3D | SB56_Stock | 6405 |
| Intel Arc A380 | SB44_OCS3 | 6382 |
| AMD Ryzen 9 7900X | SB46_OCS2 | 6359 |
| Intel Arc A380 | SB44_OCS2 | 6331 |
| AMD Ryzen 9 7900 | SB54_OCS1 | 6328 |
| AMD Ryzen Threadripper 5990X | SB43_OCS4 | 6315 |
| AMD Ryzen 9 7900X | SB46_OCS1 | 6311 |
| AMD Ryzen Threadripper 5990X | SB43_OCS3_NoSMT | 6252 |
| Intel Core i9-13900KS | SB53_OCS2 | 6219 |
| AMD Ryzen 9 7900X3D | SB58_OCS3 | 6195 |
| Intel Core i9-13900K | SB49_Stock | 6192 |
| AMD Ryzen 9 7900X3D | SB58_OCS2 | 6125 |
| Intel Arc A380 | SB44_OCS1 | 6098 |
| AMD Ryzen 9 7900X3D | SB58_OCS1 | 6098 |
| Intel Core i9-13900KS | SB53_OCS1 | 6073 |
| AMD Ryzen Threadripper 5990X | SB43_OCS2_NoSMT | 5952 |
| AMD Ryzen 9 7900X | SB46_Stock | 5951 |
| AMD Ryzen Threadripper 5990X | SB43_OCS1_NoSMT | 5950 |
| Intel Arc A380 | SB44_Stock | 5799 |
| Intel Core i9-13900K P-Core | SB52_OCS5 | 5773 |
| Intel Core i7-13700K | SB50_OCS4 | 5764 |
| Intel Core i9-13900K P-Core | SB52_OCS4 | 5755 |
| AMD Ryzen 9 7900X3D | SB58_Stock | 5710 |
| Intel Core i9-13900K P-Core | SB52_OCS3 | 5670 |
| AMD Ryzen 7 7800X3D | SB60_OCS4 | 5655 |
| Intel Core i7-13700K | SB50_OCS3 | 5629 |
| AMD Ryzen 7 7700X | SB47_OCS3 | 5587 |
| AMD Ryzen 7 7700X | SB47_OCS4 | 5576 |
| AMD Ryzen 7 7700X | SB47_OCS2 | 5548 |
| AMD Ryzen 7 7700X | SB47_OCS5 | 5541 |
| Intel Core i9-13900K P-Core | SB52_OCS2 | 5539 |
| AMD Ryzen 7 7700X | SB47_OCS6 | 5528 |
| AMD Ryzen 7 7800X3D | SB60_OCS5 | 5527 |
| AMD Ryzen 7 7800X3D | SB60_OCS2 | 5473 |
| Intel Core i9-13900K P-Core | SB52_OCS1 | 5471 |
| AMD Ryzen 7 7700X | SB47_OCS1 | 5469 |
| AMD Ryzen 7 7800X3D | SB60_OCS3 | 5468 |
| Intel Core i9-13900KS | SB53_Stock | 5448 |
| AMD Ryzen Threadripper 5990X | SB43_OCS3 | 5401 |
| AMD Ryzen 9 7900 | SB54_Stock | 5368 |
| AMD Ryzen 7 7800X3D | SB60_OCS1 | 5363 |
| AMD Ryzen Threadripper 3990X | SB36_OCS5 | 5344 |
| AMD Ryzen Threadripper 3990X | SB36_OCS2_NoSMT | 5325 |
| AMD Ryzen Threadripper 5990X | SB43_OCS2 | 5227 |
| AMD Ryzen Threadripper 3990X | SB36_OCS1_NoSMT | 5212 |
| AMD Ryzen 7 7700X | SB47_Stock | 5172 |
| AMD Ryzen Threadripper 5990X | SB43_OCS1 | 5158 |
| Intel Core i9-12900KF | SB34_OCS4 | 5153 |
| AMD Ryzen 7 7800X3D | SB60_Stock | 5144 |
| Intel Core i9-12900K | SB30_OCS5 | 5115 |
| Intel Core i7-13700K | SB50_OCS2 | 5100 |
| Intel Core i7-13700K | SB50_OCS1 | 5062 |
| Intel Core i9-12900K | SB30_OCS2 | 5044 |
| Intel Core i9-12900KF | SB34_OCS3 | 4989 |
| Intel Core i9-13900K P-Core | SB52_Stock | 4961 |
| Intel Core i9-12900KF | SB34_OCS2 | 4821 |
| AMD Ryzen Threadripper 3990X | SB36_OCS2 | 4820 |
| Intel Core i9-12900K | SB30_OCS4 | 4754 |
| Intel Core i7-13700K | SB50_Stock | 4727 |
| AMD Ryzen Threadripper 3990X | SB36_OCS4 | 4687 |
| Intel Core i9-12900K | SB30_OCS1 | 4650 |
| AMD Ryzen Threadripper 3990X | SB36_OCS1 | 4632 |
| AMD Ryzen Threadripper 5990X | SB43_Stock_NoSMT | 4594 |
| AMD Ryzen 5 7600X | SB48_OCS4 | 4575 |
| AMD Ryzen 5 7600X | SB48_OCS5 | 4573 |
| AMD Ryzen 5 7600X | SB48_OCS6 | 4570 |
| AMD Ryzen 5 7600X | SB48_OCS3 | 4562 |
| Intel Core i9-12900KF | SB34_OCS1 | 4550 |
| AMD Ryzen 5 7600X | SB48_OCS2 | 4529 |
| Intel Core i9-12900K | SB30_OCS3 | 4498 |
| Intel Core i7-12700K | SB31_OCS4 | 4494 |
| AMD Ryzen 5 7600X | SB48_OCS1 | 4491 |
| Intel Core i7-12700K | SB31_OCS3 | 4454 |
| AMD Ryzen Threadripper 3990X | SB36_OCS3 | 4418 |
| Intel Core i5-13600K | SB51_OCS3 | 4337 |
| Intel Core i9-12900K | SB30_Stock | 4324 |
| Intel Core i5-13600K | SB51_OCS4 | 4301 |
| Intel Core i7-12700K | SB31_OCS2 | 4285 |
| AMD Ryzen Threadripper 5990X | SB43_Stock | 4277 |
| Intel Core i9-12900KF | SB34_Stock | 4269 |
| AMD Ryzen 5 7600X | SB48_Stock | 4205 |
| AMD Ryzen 3 5300GE (IGP) | SB35_OCS3 | 4202 |
| AMD Ryzen 3 5300GE (IGP) | SB35_OCS4 | 4200 |
| Intel Core i7-12700K | SB31_OCS1 | 4115 |
| AMD Ryzen Threadripper 3990X | SB36_Stock_NoSMT | 4023 |
| Intel Core i7-12700K | SB31_Stock | 3939 |
| Intel Core i5-13600K | SB51_OCS2 | 3813 |
| Intel Core i5-13600K | SB51_OCS1 | 3748 |
| Intel Core i5-12400 | SB37_OCS3 | 3680 |
| Intel Core i5-12400 | SB37_OCS4 | 3648 |
| AMD Ryzen Threadripper 3990X | SB36_Stock | 3626 |
| AMD Ryzen 7 5800X3D | SB39_OCS3 | 3609 |
| AMD Ryzen 3 5300GE (IGP) | SB35_OCS2 | 3596 |
| Intel Core i5-13600K | SB51_Stock | 3563 |
| AMD Ryzen 7 5800X3D | SB39_OCS1 | 3480 |
| AMD Ryzen 7 5800X3D | SB39_OCS2 | 3473 |
| AMD Ryzen 3 5300GE (IGP) | SB35_OCS1 | 3470 |
| Intel Core i5-12600KF | SB32_OCS3 | 3257 |
| Intel Core i5-12600KF | SB32_OCS2 | 3196 |
| AMD Ryzen 7 5800X3D | SB39_Stock | 3196 |
| Intel Core i5-12400 | SB37_OCS2 | 3195 |
| Intel Core i5-12600KF | SB32_OCS1 | 3130 |
| Intel Core i9-11980HK | SB65_OCS3 | 3088 |
| Intel Core i5-12400 | SB37_OCS1 | 3083 |
| Intel Core i9-11980HK | SB65_OCS2 | 3079 |
| AMD Ryzen 3 5300GE (IGP) | SB35_Stock | 2775 |
| Intel Core i9-11980HK | SB65_OCS1 | 2771 |
| Intel Core i9-11900H | WSL_DIRECTML_ONEDNN | 2735 |
| Intel Core i9-11900H | WN_DIRECTML_ONEDNN | 2713 |
| Intel Core i5-12600KF | SB32_Stock | 2681 |
| AMD Radeon Graphics (Ryzen 7000) | SB55_OCS3 | 2645 |
| AMD Radeon Graphics (Ryzen 7000) | SB55_OCS2 | 2622 |
| Intel Core i9-11980HK | SB65_Stock | 2575 |
| Intel Core i5-12400 | SB37_Stock | 2551 |
| Intel Core i9-11900H | WSL_DIRECTML | 2240 |
| Intel UHD Graphics 770 (13th Gen) | SB57_OCS4 | 2072 |
| AMD Radeon Graphics (Ryzen 7000) | SB55_OCS1 | 2057 |
| Intel UHD Graphics 770 (13th Gen) | SB57_OCS3 | 2055 |
| Intel UHD Graphics 770 (12th Gen) | SB33_OCS4 | 2046 |
| AMD Radeon Graphics (Ryzen 7000) | SB55_Stock | 2037 |
| Intel UHD Graphics 770 (12th Gen) | SB33_OCS3 | 1949 |
| Intel UHD Graphics 770 (12th Gen) | SB33_OCS2 | 1825 |
| Intel UHD Graphics 770 (13th Gen) | SB57_OCS2 | 1739 |
| AMD Ryzen 3 5300GE | SB35_OCS3 | 1504 |
| AMD Ryzen 3 5300GE | SB35_OCS4 | 1469 |
| AMD Ryzen 3 5300GE | SB35_OCS2 | 1448 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS6 | 1446 |
| AMD Ryzen 3 5300GE | SB35_OCS1 | 1419 |
| Intel UHD Graphics for 11th Gen | WN_DIRECTML | 1417 |
| Intel UHD Graphics for 11th Gen | WSL_DIRECTML | 1396 |
| Intel UHD Graphics 730 (12th Gen) | SB38_OCS4 | 1388 |
| Intel UHD Graphics 770 (13th Gen) | SB57_OCS1 | 1387 |
| Intel UHD Graphics 770 (13th Gen) | SB57_Stock | 1379 |
| Intel UHD Graphics 770 (12th Gen) | SB33_OCS1 | 1361 |
| Intel UHD Graphics 770 (12th Gen) | SB33_Stock | 1352 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS5 | 1264 |
| Intel UHD Graphics 730 (12th Gen) | SB38_OCS3 | 1223 |
| AMD Ryzen 3 5300GE | SB35_Stock | 1179 |
| Intel UHD Graphics 730 (12th Gen) | SB38_OCS2 | 1116 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS4 | 1107 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS3 | 1098 |
| Intel UHD Graphics 730 (12th Gen) | SB38_OCS1 | 1080 |
| Intel UHD Graphics 730 (12th Gen) | SB38_Stock | 1072 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS2 | 1066 |
| Intel UHD Graphics 750 (11th Gen) | SB28_OCS1 | 1064 |
| Intel UHD Graphics 750 (11th Gen) | SB28_Stock | 1064 |
| Intel Core i9-11900H | WN_DIRECTML | 892 |
Leaderboard Notes:
- OC Strategy is coded as SkatterBencher # + OC Strategy #
- The Core i9-13900KS benchmark scores seem off. I noticed a particular issue with the OS for that system where the score would be significantly slower than expected unless the process affinity was manually set.
- TensorFlow-DirectML was used for: Intel UHD Graphics 750 (11th Gen), Intel UHD Graphics 730 (12th Gen), Intel UHD Graphics 770 (12th Gen), Intel UHD Graphics 770 (13th Gen), AMD Radeon Graphics (Ryzen 7000), AMD Ryzen 3 5300GE (IGP), and Intel Arc A380.
AI Benchmark
AI Benchmark Alpha is an open-source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs. The benchmark is relying on the TensorFlow machine learning library, and is providing a lightweight solution for assessing inference and training speed for key Deep Learning models. The benchmark itself takes about 20 minutes to run and outputs three scores: inference score, training score, and AI-Score. It’s the latter we use as performance measurement.
While there are many ways to run AI Benchmark on your machine, I use an Anaconda Python environment with the latest Tensorflow optimizations. For hardware that lacks native TensorFlow support I rely on TensorFlow-DirectML or the TensorFlow-DirectML plugin to run the benchmark. Obviously the performance is not as good as native TensorFlow.
I explained how I install TensorFlow-DirectML in a separate page on my website.
I also enable the OneAPI optimizations (set TF_ENABLE_ONEDNN_OPTS=1) when applicable