Back previous/next report: k j

Intel 1-node-2S-GNR_128C

Submitted by Intel Corporationon 2026-10-21 Published on 2026-11-04

Result statement

Intel Corporation ran Qwen3.6 35B-A3B on 1-node-2S-GNR_128C and achieved a verified 395.6 tokens/second System TPS at 6,854.9ms TTFT P90 in the Standardized division of the Available category on November 4, 2026 .

[1] MLPerf Endpoints v1.0 Qwen3.6 35B-A3B, published November 4, 2026; retrieved from results.mlcommons.org on November 18, 2026. Result —, run 7: concurrency = 256 queries, TTFT P90 = 6,854.9ms, System TPS = 395.6 tokens/sec, interactivity = 1.5 tokens/sec per user and total provisioned system power = 1.5 kW. Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.

Submission Info
Intel Corporation
d529d8b2-f21b-41e0-b48f-d1de27746c5b
Submission Status PUBLISHED
2026-10-21
2026-11-04
Version v1.0
Division Standardized
Deployment Client on Premises
Model
Model Name Qwen3.6 35B-A3B
Division Standardized
Model Precision INT8
Model Link —
Calibration Link —
Model Notes —
Datasets
Dataset Name agentic_combined
Dataset Type performance
Average Input Tokens —
Dataset Link —

System TPS vs. Tokens/s per User

200300400System TPS051015Tokens/s per User

System TPS vs. Concurrency

200300400System TPS050100150200250# of queries

Time to First Token P90 vs. Concurrency

4.0k5.0k6.0k7.0kTTFT P90 (ms)050100150200250# of queries

Tokens/s per User vs. Concurrency

051015Tokens/s per User050100150200250# of queries
SUT Summary
Intel
1-node-2S-GNR_128C
Available
System Category — · —
1x2S-GNR-AP
1
1
Max Supported Concurrency 256
Node Type ID 0
Node Count 1
Software
Ubuntu
Framework vLLM 0.30.1rc1.dev57+g67ddac3ea; vLLM 0.31.1rc1.dev366+g7a0d68f29; vLLM 0.32.0rc1.dev8+g7a0d68f29.d20261018
vLLM 0.30.1rc1.dev57+g67ddac3ea; vLLM 0.31.1rc1.dev366+g7a0d68f29; vLLM 0.32.0rc1.dev8+g7a0d68f29.d20261018
vLLM cpu
Not applicable (CPU inference; no accelerator driver required)
Link to Container —
Operating System ubuntu 26.04
Filesystem ext4 vfat
Other Software vLLM 0.30.1rc1.dev57+g67ddac3ea [sha256:320822eb5201c388cccb926f76caa94f81ea20fba5579773a0637dc721ee33f6]: Python 3.12.14; PyTorch 2.13.0+cpu; container OS Ubuntu 25.04; transformers 5.17.0; vLLM 0.31.1rc1.dev366+g7a0d68f29 [sha256:d45df48f5e737142f62e77d4960a79605af03a32afbec63c4959b2f9d2e9f46d]: Python 3.12.15; PyTorch 2.13.0+cpu; container OS Ubuntu 22.04.5 LTS; transformers 5.19.0; vLLM 0.32.0rc1.dev8+g7a0d68f29.d20261018 [sha256:7b1435a0fb63969b12a6509c721e51c8ed1ad767655434fb95c166cd8672f422]: Python 3.12.15; PyTorch 2.13.0+cpu; container OS Ubuntu 22.04.5 LTS; transformers 5.19.0
Software Notes —
Hardware

Processor

Intel(R) Xeon(R) 6980P
2
256
VCPUs Per Processor 256

Accelerator

—
0
—
—
—
—

Host / Storage

2.4T
Memory Configuration 24 x 96GB DDR5-8800
Storage Capacity 5.3 TB NVMe SSD
Storage Type NVMe SSD

Networking

1x Ethernet
Ethernet
Network Topology —

Other

Other Hardware —
Cooling —
Hardware Notes —
Run Data
Field NameRun 1Run 2Run 3Run 4Run 5Run 6Run 7
Run Date10/20/202610/20/202610/20/202610/20/202610/20/202610/20/202610/20/2026
Concurrency812163264128256
System Tokens/Second140.4173.2200.2250.0315.5352.6395.6
Tokens/Second per User17.514.412.57.84.92.81.5
TTFT P90 (ms)3906.04091.73984.44604.04720.75831.06854.9
Utilization35.5%43.8%50.6%63.2%79.8%89.1%100.0%
Configuration Summaryqwen-agentic-benchmark · online · c8qwen-agentic-benchmark · online · c12qwen-agentic-benchmark · online · c16qwen-agentic-benchmark · online · c32qwen-agentic-benchmark · online · c64qwen-agentic-benchmark · online · c128qwen-agentic-benchmark · online · c256
Config Typeonlineonlineonlineonlineonlineonlineonline
Config Region———————
Target QPS———————
Result Statecompletecompletecompletecompletecompletecompletecomplete
Measured Accuracy Score———————
Benchmark Versionunknownunknownunknownunknownunknownunknownunknown
Result Version0.1.00.1.00.1.00.1.00.1.00.1.00.1.0
Archive URIgs://mlperf-endpoints-blob/runs/eb6b301a-4bf1-4e75-bf8a-b4f1602d78a8/archive.tar.gzgs://mlperf-endpoints-blob/runs/946c1767-c2c3-4593-87ff-fd6fdbc30352/archive.tar.gzgs://mlperf-endpoints-blob/runs/a586a6b0-e113-45e1-9d05-9a029842ce2c/archive.tar.gzgs://mlperf-endpoints-blob/runs/57aed279-0a32-433d-92e6-115d917bf58e/archive.tar.gzgs://mlperf-endpoints-blob/runs/87e98840-f159-40b6-a050-7e0f147fbc31/archive.tar.gzgs://mlperf-endpoints-blob/runs/f757343f-74f2-4272-9449-0471c1ee8fde/archive.tar.gzgs://mlperf-endpoints-blob/runs/147b5bf4-0e7e-4ee6-98c8-865acf377ab7/archive.tar.gz
QPS0.36280.45210.50790.65380.83010.93771.0458
Total Output Tokens7,673,2637,498,1737,557,0036,822,3136,126,73612,264,21017,329,150
Average Output Tokens386.89383.15394.05382.37380.02376.01378.25
Run Duration (s)54,671.5143,289.6637,755.8327,290.7719,421.3334,782.3643,808.67
Total Queries19,83319,57019,17817,84216,12232,61745,814
Total Queries Issued19,83319,57019,17817,84216,12232,61745,814
Total Queries Failed0000000
Time to First Token (TTFT) (ms)
Minimum212.3206.3232.1281.7353.4303.6462.3
Average2155.22274.72289.82634.42945.13593.04472.1
P501590.61665.11616.31825.01918.52404.52992.5
P903906.04091.73984.44604.04720.75831.06854.9
P955266.55477.35359.96203.26220.87777.59044.0
P999651.510308.810296.711720.712794.217103.420036.6
P99927316.729806.386095.3114261.2117432.4124154.6145276.5
Maximum112420.6114106.2113586.2115203.1120376.4126769.9155749.2
Time Per Output Token (TPOT) (ms)
Minimum26.730.039.629.782.6134.393.3
Average48.260.870.9117.3184.7340.2594.3
P5044.654.864.6108.8176.9333.6598.1
P9061.880.793.7159.1243.9441.5758.5
P9572.895.2109.0184.6274.8487.8822.0
P99107.5141.8158.5257.7364.1606.3980.8
P999192.8275.8270.0413.5550.7917.01294.8
Maximum814.0811.9417.9611.5842.21506.21658.1
Query Latency (ms)
Minimum1385.11136.1992.41757.91724.44915.23412.4
Average20397.624877.629660.146760.471904.4129477.3226439.7
P507540.09134.910044.715741.123164.540483.767677.4
P9047155.359280.171678.8112144.8169455.8303243.0543700.9
P9579709.599780.1122513.6192929.3297572.4536316.3946830.5
P99201375.5236399.2295501.7471234.4757470.41360882.32371868.3
P999371776.4411011.6576916.9867385.61424979.32711589.94757867.6
Maximum460824.9570302.4802682.21258797.71847056.03247566.05875301.9