NVIDIA Vera Rubin NVL72 (TRT-LLM + Dynamo)
Submitted by NVIDIA Corporationon 2026-10-16 Published on 2026-11-04
Result statement
NVIDIA Corporation ran kimi-k3 on NVIDIA Vera Rubin NVL72 (TRT-LLM + Dynamo) and achieved a verified 25,495.4 tokens/second System TPS at 25,719.8ms TTFT P90 in the Standardized division of the Available category on November 4, 2026 .
[1] MLPerf Endpoints v1.0 kimi-k3, published November 4, 2026; retrieved from results.mlcommons.org on November 18, 2026. Result —, run 13: concurrency = 1,536 queries, TTFT P90 = 25,719.8ms, System TPS = 25,495.4 tokens/sec, interactivity = 16.6 tokens/sec per user and total provisioned system power = 151.33 kW. Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
System TPS vs. Tokens/s per User
System TPS vs. Concurrency
Time to First Token P90 vs. Concurrency
Tokens/s per User vs. Concurrency
Processor
Accelerator
Host / Storage
Networking
Other
| Field Name | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Run 6 | Run 7 | Run 8 | Run 9 | Run 10 | Run 11 | Run 12 | Run 13 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Run Date | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 | 10/16/2026 |
| Concurrency | 15 | 18 | 40 | 48 | 56 | 64 | 96 | 192 | 193 | 256 | 512 | 1,024 | 1,536 |
| System Tokens/Second | 1,564.3 | 1,718.9 | 3,589.5 | 3,607.5 | 4,482.6 | 4,412.6 | 5,569.6 | 9,940.0 | 9,382.9 | 11,259.7 | 16,172.4 | 23,260.8 | 25,495.4 |
| Tokens/Second per User | 104.3 | 95.5 | 89.7 | 75.2 | 80.0 | 68.9 | 58.0 | 51.8 | 48.6 | 44.0 | 31.6 | 22.7 | 16.6 |
| TTFT P90 (ms) | 553.0 | 589.1 | 734.3 | 829.2 | 715.8 | 1165.3 | 2062.7 | 1286.0 | 1280.7 | 2280.5 | 4897.5 | 15712.7 | 25719.8 |
| Utilization | 6.1% | 6.7% | 14.1% | 14.1% | 17.6% | 17.3% | 21.8% | 39.0% | 36.8% | 44.2% | 63.4% | 91.2% | 100.0% |
| Configuration Summary | kimi-k3-dynamo-final · online · c15 | kimi-k3-dynamo-final · online · c18 | kimi-k3-dynamo-final · online · c40 | kimi-k3-dynamo-final · online · c48 | kimi-k3-dynamo-final · online · c56 | kimi-k3-dynamo-final · online · c64 | kimi-k3-dynamo-final · online · c96 | kimi-k3-dynamo-final · online · c192 | kimi-k3-dynamo-final · online · c193 | kimi-k3-dynamo-final · online · c256 | kimi-k3-dynamo-final · online · c512 | kimi-k3-dynamo-final · online · c1024 | kimi-k3-dynamo-final · online · c1536 |
| Config Type | online | online | online | online | online | online | online | online | online | online | online | online | online |
| Config Region | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Target QPS | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Result State | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete |
| Measured Accuracy Score | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Benchmark Version | unknown | unknown | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | unknown | unknown | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce | d3c57f2eba127c819e5a8fd83101d9e5f4e15fce |
| Result Version | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 |
| Archive URI | gs://mlperf-endpoints-blob/runs/de652d3a-ba81-4aed-a4ab-4a346046ad1b/archive.tar.gz | gs://mlperf-endpoints-blob/runs/caace767-32d5-4a1a-8dd3-52c8cdc993e0/archive.tar.gz | gs://mlperf-endpoints-blob/runs/687e8dfe-6ff5-49f3-af7f-1bae1b650728/archive.tar.gz | gs://mlperf-endpoints-blob/runs/080eee8a-141a-4445-b2a9-6e22688483f4/archive.tar.gz | gs://mlperf-endpoints-blob/runs/0404b876-66c7-4fab-be7a-bb3f35ed46b4/archive.tar.gz | gs://mlperf-endpoints-blob/runs/3aef0054-e4c1-491f-95df-1302be6a304d/archive.tar.gz | gs://mlperf-endpoints-blob/runs/90f5a34d-2a51-4112-9956-a9f74c90c9d9/archive.tar.gz | gs://mlperf-endpoints-blob/runs/6ffb47e2-4c87-426e-a0a0-5e7fb4904256/archive.tar.gz | gs://mlperf-endpoints-blob/runs/5db272a2-fa36-4f4e-99e6-823dbc5a0af8/archive.tar.gz | gs://mlperf-endpoints-blob/runs/d6b9e94f-113a-44f8-83b8-b674be66f0c1/archive.tar.gz | gs://mlperf-endpoints-blob/runs/5efac990-6501-4481-b5f7-1160b8457b2f/archive.tar.gz | gs://mlperf-endpoints-blob/runs/03442ff1-1b14-43d3-8bb1-bf0b41e40d41/archive.tar.gz | gs://mlperf-endpoints-blob/runs/ba78df10-2cbd-4dcb-a047-303138830a76/archive.tar.gz |
| QPS | 3.3024 | 3.6156 | 7.6737 | 7.7830 | 9.5396 | 9.2697 | 11.9686 | 21.6030 | 20.5594 | 24.6686 | 35.2837 | 50.3752 | 55.3366 |
| Total Output Tokens | 9,099,278 | 9,101,779 | 18,142,858 | 17,774,418 | 17,876,698 | 17,940,274 | 16,788,992 | 33,128,619 | 32,746,536 | 40,533,039 | 61,554,116 | 66,448,723 | 74,156,831 |
| Average Output Tokens | 473.67 | 475.41 | 467.77 | 463.52 | 469.9 | 476.02 | 465.35 | 460.12 | 456.38 | 456.44 | 458.35 | 461.75 | 460.74 |
| Run Duration (s) | 5,816.98 | 5,295.05 | 5,054.40 | 4,927.12 | 3,987.99 | 4,065.70 | 3,014.39 | 3,332.87 | 3,490.03 | 3,599.84 | 3,806.12 | 2,856.68 | 2,908.63 |
| Total Queries | 19,210 | 19,145 | 38,786 | 38,348 | 38,044 | 37,688 | 36,078 | 72,000 | 71,753 | 88,803 | 134,294 | 143,906 | 160,954 |
| Total Queries Issued | 19,210 | 19,145 | 38,786 | 38,348 | 38,044 | 37,688 | 36,078 | 72,000 | 71,753 | 88,803 | 134,294 | 143,906 | 160,954 |
| Total Queries Failed | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Time to First Token (TTFT) (ms) | |||||||||||||
| Minimum | 182.2 | 185.4 | 193.0 | 224.2 | 214.4 | 224.5 | 248.8 | 226.4 | 235.8 | 230.4 | 1489.2 | 1531.0 | 1616.2 |
| Average | 410.2 | 435.9 | 536.8 | 589.6 | 532.7 | 747.8 | 1121.0 | 839.6 | 839.5 | 1285.6 | 3748.7 | 7497.7 | 13087.0 |
| P50 | 346.9 | 372.5 | 446.1 | 473.5 | 418.9 | 567.3 | 818.8 | 597.8 | 606.7 | 970.8 | 3272.0 | 4801.2 | 10112.7 |
| P90 | 553.0 | 589.1 | 734.3 | 829.2 | 715.8 | 1165.3 | 2062.7 | 1286.0 | 1280.7 | 2280.5 | 4897.5 | 15712.7 | 25719.8 |
| P95 | 704.2 | 723.0 | 915.7 | 1059.2 | 970.8 | 1557.6 | 2544.2 | 1727.1 | 1758.8 | 2850.7 | 5873.3 | 19736.5 | 30901.1 |
| P99 | 1444.5 | 1608.7 | 1922.4 | 2283.8 | 2329.4 | 2781.2 | 4096.5 | 3725.4 | 4247.3 | 5151.8 | 9816.6 | 34673.4 | 62113.2 |
| P999 | 6748.1 | 8233.2 | 14737.7 | 14704.9 | 12317.7 | 19778.5 | 22921.1 | 24109.2 | 19345.0 | 20885.9 | 65253.2 | 71793.9 | 115780.4 |
| Maximum | 18997.4 | 15957.7 | 27589.9 | 27262.6 | 26996.4 | 29726.3 | 24673.4 | 64943.4 | 41909.1 | 58090.8 | 90948.7 | 133825.6 | 149361.3 |
| Time Per Output Token (TPOT) (ms) | |||||||||||||
| Minimum | 0.01 | -0.00 | 0.53 | -0.01 | 2.87 | 3.96 | 0.01 | 0.00 | 0.01 | 0.07 | 0.03 | 0.01 | 0.04 |
| Average | 5.43 | 6.32 | 6.74 | 9.04 | 8.17 | 9.93 | 11.5 | 14.3 | 15.4 | 16.6 | 19.6 | 22.5 | 24.5 |
| P50 | 5.33 | 6.23 | 6.63 | 8.95 | 8.01 | 9.87 | 11.2 | 14.1 | 15.1 | 16.4 | 19.4 | 22.2 | 24.1 |
| P90 | 6.85 | 7.96 | 8.46 | 10.5 | 10.2 | 11.6 | 13.9 | 16.6 | 18.6 | 19.3 | 23.2 | 26.4 | 29.2 |
| P95 | 7.37 | 8.59 | 9.10 | 11.1 | 11.0 | 12.2 | 14.9 | 17.6 | 20.0 | 20.4 | 24.5 | 28.0 | 31.3 |
| P99 | 8.54 | 9.96 | 10.6 | 12.7 | 12.9 | 13.8 | 17.3 | 20.0 | 23.3 | 23.3 | 27.8 | 32.9 | 37.4 |
| P999 | 10.6 | 12.2 | 13.5 | 15.7 | 16.1 | 17.9 | 21.3 | 24.6 | 29.1 | 30.7 | 34.2 | 58.2 | 73.1 |
| Maximum | 97.5 | 216.6 | 903.2 | 1950.3 | 817.1 | 361.8 | 2726.4 | 2550.3 | 3961.5 | 2525.7 | 5098.2 | 7307.3 | 11321.6 |
| Query Latency (ms) | |||||||||||||
| Minimum | 321.1 | 333.8 | 364.5 | 264.6 | 401.3 | 455.8 | 524.7 | 605.2 | 563.6 | 650.1 | 2036.4 | 2084.7 | 2497.5 |
| Average | 2884.8 | 3311.5 | 3547.4 | 4467.5 | 4170.2 | 5135.7 | 6078.4 | 6911.4 | 7383.6 | 8271.8 | 12066.1 | 17037.1 | 23440.0 |
| P50 | 1062.3 | 1185.2 | 1332.7 | 1643.1 | 1483.2 | 1964.3 | 2636.5 | 2498.9 | 2639.3 | 3376.3 | 6062.3 | 10382.4 | 16455.5 |
| P90 | 6296.1 | 7309.1 | 7725.1 | 9734.2 | 9406.9 | 11289.0 | 12975.6 | 15406.9 | 16514.8 | 18086.1 | 23949.6 | 33776.6 | 44136.3 |
| P95 | 11142.1 | 12744.2 | 13556.1 | 16931.3 | 16104.1 | 19405.2 | 22472.9 | 27290.7 | 28513.6 | 30794.2 | 41241.7 | 52605.9 | 67137.4 |
| P99 | 31428.6 | 36155.1 | 37997.6 | 48019.4 | 45294.9 | 55170.7 | 61209.7 | 73612.9 | 77970.6 | 83403.0 | 105897.2 | 124658.3 | 145271.1 |
| P999 | 53827.7 | 61478.4 | 67565.6 | 81928.9 | 80855.8 | 90165.4 | 105568.1 | 127530.1 | 144499.7 | 146198.8 | 181734.8 | 209270.6 | 229762.5 |
| Maximum | 70869.0 | 109979.7 | 84574.2 | 129553.5 | 133877.8 | 171992.1 | 125083.7 | 229480.2 | 188326.9 | 173902.8 | 301287.6 | 254284.0 | 293699.3 |