You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 04:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Thu Jan 01, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31546991045,91cyclictest1419-21runrttasks21:12:400
315529910044,49cyclictest4401-21cpuspeed_turbos23:32:233
31546991005,88cyclictest0-21swapper/019:22:490
31546991004,87cyclictest0-21swapper/019:12:170
3154699974,49cyclictest13731-21munin-node21:37:250
3154699947,23cyclictest21609-1kworker/0:0H23:32:410
3154699944,25cyclictest0-21swapper/022:17:220
3154699944,23cyclictest0-21swapper/019:12:400
3154699934,30cyclictest0-21swapper/020:12:410
31546999318,13cyclictest0-21swapper/023:37:330
31546999314,13cyclictest0-21swapper/019:42:450
3154699923,25cyclictest0-21swapper/023:42:210
291632920,3sleep3361ktimersoftd/323:17:093
3155099913,9cyclictest6504-21latency20:12:391
3154699903,80cyclictest0-21swapper/021:02:320
3154699903,25cyclictest0-21swapper/019:38:210
31552998933,49cyclictest0-21swapper/321:17:133
31546998916,11cyclictest0-21swapper/022:47:100
31546998915,12cyclictest0-21swapper/020:42:390
31552998837,45cyclictest0-21swapper/319:22:173
31552998837,44cyclictest9937-21crond20:22:153
3154699884,24cyclictest0-21swapper/021:57:240
3154699880,30cyclictest0-21swapper/020:35:390
31552998725,11cyclictest4689-21df_abs19:02:343
31552998614,18cyclictest0-21swapper/320:22:273
3155099864,12cyclictest0-21swapper/119:17:541
3154699869,20cyclictest0-21swapper/021:52:130
3155299853,75cyclictest0-21swapper/300:07:253
31552998525,10cyclictest18837-21cpuspeed_turbos21:47:253
31552998520,10cyclictest0-21swapper/318:56:563
3155099855,12cyclictest0-21swapper/123:02:261
3155099855,12cyclictest0-21swapper/121:52:251
3154699855,16cyclictest0-21swapper/022:47:330
3155299844,33cyclictest0-21swapper/319:22:503
3155099844,12cyclictest0-21swapper/120:57:441
3155099844,12cyclictest0-21swapper/120:57:441
3155099844,12cyclictest0-21swapper/100:07:311
3154699845,29cyclictest0-21swapper/019:52:340
3154699845,14cyclictest0-21swapper/023:07:320
3154699845,14cyclictest0-21swapper/023:07:320
3155299839,9cyclictest121850irq/46-eth020:52:143
3155299834,71cyclictest0-21swapper/322:47:483
3155299834,33cyclictest0-21swapper/319:37:483
31552998331,10cyclictest8473-21fschecks_time22:32:283
3155299833,13cyclictest0-21swapper/323:39:523
31552998329,10cyclictest2142-21unixbench_multi22:17:433
31552998325,10cyclictest17721-21timerandwakeup19:27:493
31552998323,9cyclictest22851-21sendmail_mailqu00:12:363
3155099834,12cyclictest0-21swapper/121:42:311
3155099834,12cyclictest0-21swapper/121:42:311
3155099833,8cyclictest6340-21munin-run21:22:121
3155099833,13cyclictest0-21swapper/122:12:351
3155099832,9cyclictest6091-21sshd19:03:161
3155299824,34cyclictest0-21swapper/320:32:363
3155299824,27cyclictest0-21swapper/323:27:393
3155299824,25cyclictest0-21swapper/320:28:553
31552998225,10cyclictest792-21timerandwakeup21:07:423
31552998222,9cyclictest27667-21fschecks_time20:57:353
31552998222,9cyclictest27667-21fschecks_time20:57:353
31552998222,10cyclictest19043-21unixbench_singl22:52:593
3155099824,9cyclictest22912-21sort00:12:381
3155099823,12cyclictest0-21swapper/119:52:431
31550998221,45cyclictest0-21swapper/123:22:201
31550998219,57cyclictest9205-21gzip20:17:471
3154699824,16cyclictest0-21swapper/023:17:280
3155299814,32cyclictest0-21swapper/323:42:193
3155299814,12cyclictest0-21swapper/322:57:293
3155299814,12cyclictest0-21swapper/322:42:243
3155299813,27cyclictest0-21swapper/323:02:353
31552998112,9cyclictest121850irq/46-eth019:32:493
31552998112,9cyclictest121850irq/46-eth019:32:493
3155099814,12cyclictest0-21swapper/123:52:071
3155099814,12cyclictest0-21swapper/123:52:071
3155099813,9cyclictest1419-21runrttasks21:30:231
31550998120,45cyclictest26829-21munin-node23:12:421
3154699814,20cyclictest0-21swapper/023:12:430
3155299804,35cyclictest0-21swapper/320:42:483
3155299804,27cyclictest0-21swapper/320:12:343
3155299804,26cyclictest0-21swapper/319:48:483
3155299803,31cyclictest0-21swapper/322:05:563
3155299803,24cyclictest0-21swapper/323:52:203
3155299803,24cyclictest0-21swapper/320:02:353
3155299803,12cyclictest0-21swapper/321:23:173
3155099804,9cyclictest23411-21tail19:42:301
3155099804,12cyclictest0-21swapper/119:47:361
3155099804,12cyclictest0-21swapper/119:32:381
3155099804,12cyclictest0-21swapper/119:32:381
3155099803,10cyclictest12445-21yum-updatesd-he21:32:371
31550998020,43cyclictest1287-21snmpd21:48:371
31550998016,46cyclictest2949-21munin-node22:22:411
3154699804,17cyclictest0-21swapper/022:37:340
3155299794,33cyclictest0-21swapper/319:17:183
3155299794,28cyclictest0-21swapper/319:57:523
3155299794,13cyclictest0-21swapper/322:12:393
3155299793,32cyclictest0-21swapper/300:02:193
3155299793,29cyclictest6332-21idleruntime-cro21:22:123
3155299793,27cyclictest0-21swapper/319:42:413
3155299793,23cyclictest0-21swapper/321:27:443
3155299793,13cyclictest0-21swapper/322:40:263
3155099794,9cyclictest19742-21cut22:57:231
3155099794,7cyclictest8802-21idleruntime-cro19:12:171
3155099794,57cyclictest4398-21cpuspeed_turbos23:32:231
3155099794,11cyclictest0-21swapper/123:07:211
3155099794,11cyclictest0-21swapper/123:07:211
3155099794,11cyclictest0-21swapper/119:12:481
3155099793,12cyclictest0-21swapper/120:27:381
31546997914,15cyclictest31208-21fschecks_time19:57:340
3155299784,23cyclictest0-21swapper/320:37:483
3155299784,21cyclictest24530-21munin-node20:52:433
31552997820,16cyclictest1419-21runrttasks21:58:503
3155099784,9cyclictest10680-21diskstats22:37:261
3155099784,8cyclictest25548-21sh20:52:351
3155099783,8cyclictest26078-21sort00:22:061
3155099783,13cyclictest0-21swapper/122:32:211
31550997820,41cyclictest30192-21if_eth023:17:281
31550997810,49cyclictest0-21swapper/120:52:141
3155299774,22cyclictest0-21swapper/323:17:193
3155299774,12cyclictest0-21swapper/323:24:253
31552997712,9cyclictest121850irq/46-eth000:22:053
3155099774,9cyclictest32265-21diskstats21:07:271
3155099773,8cyclictest15185-21hwlatdetect23:57:281
31550997721,49cyclictest137311munin-node21:37:301
3155299765,19cyclictest213152expr21:52:273
3155299764,12cyclictest0-21swapper/323:48:183
3155299764,12cyclictest0-21swapper/323:48:183
3155299763,24cyclictest0-21swapper/321:37:413
3155299763,23cyclictest0-21swapper/322:07:373
31552997623,10cyclictest3776-21gltestperf22:22:303
31552997617,9cyclictest17842-21unixbench_multi21:42:453
31552997617,9cyclictest17842-21unixbench_multi21:42:453
3155099765,9cyclictest11749-21timerandwakeup20:22:471
3155099764,12cyclictest0-21swapper/119:27:351
3155099763,53cyclictest1217-21fschecks_time20:02:351
3155099763,11cyclictest2765-21latency23:27:311
31550997617,43cyclictest23297-21munin-node21:57:311
31552997527,10cyclictest29190-21kernelversion19:52:423
3155099754,10cyclictest0-21swapper/120:42:271
3155099753,9cyclictest31644-21munin-node19:57:401
3155099753,8cyclictest29833-21df_abs21:02:311
3155099753,11cyclictest1802-21telnet18:57:291
31550997512,42cyclictest28863-21gltestperf22:07:291
3155299744,12cyclictest0-21swapper/319:08:423
31552997423,10cyclictest15952-21sed23:57:403
3155099748,7cyclictest121850irq/46-eth019:22:381
3155099743,11cyclictest0-21swapper/123:52:331
3155099743,10cyclictest0-21swapper/120:40:371
31550997419,49cyclictest4767-21unixbench_singl20:07:501
31550997419,48cyclictest14807-21latency_hist22:47:101
3154699744,63cyclictest0-21swapper/018:52:460
18662740,4sleep2281ktimersoftd/222:17:392
3155099739,7cyclictest1287-21snmpd23:43:251
3155099735,9cyclictest0-21swapper/119:37:281
3155099735,62cyclictest0-21swapper/122:17:211
3155099734,11cyclictest6639-21aten_r1power_vo23:37:181
3155099733,8cyclictest17316-21cut22:52:351
31550997313,39cyclictest7822-21kworker/1:221:22:251
3155299724,15cyclictest0-21swapper/321:32:443
3155099723,9cyclictest121850irq/46-eth021:12:341
31550997216,50cyclictest5639-21cpuspeed_turbos22:27:251
31550997216,50cyclictest5639-21cpuspeed_turbos22:27:251
3155299713,22cyclictest0-21swapper/322:27:233
3155299713,22cyclictest0-21swapper/322:27:233
3155099716,8cyclictest121850irq/46-eth022:02:281
3155099703,8cyclictest32342-21diskstats18:52:351
3155099703,61cyclictest0-21swapper/100:02:181
3155099703,11cyclictest0-21swapper/122:47:261
31550997028,36cyclictest15763-21gltestperf20:32:341
31552996918,7cyclictest4029-21munin-run19:02:183
248599680,2rtkit-daemon0-21swapper/219:25:432
3155299664,14cyclictest0-21swapper/321:02:353
31551996610,32cyclictest21947-1kworker/2:0H18:57:332
248599660,8rtkit-daemon0-21swapper/220:48:252
248599660,8rtkit-daemon0-21swapper/220:17:262
248599660,4rtkit-daemon0-21swapper/222:59:192
248599660,11rtkit-daemon0-21swapper/223:37:482
248599660,10rtkit-daemon0-21swapper/222:55:122
248599660,10rtkit-daemon0-21swapper/220:56:092
248599660,10rtkit-daemon0-21swapper/219:04:362
248599650,9rtkit-daemon0-21swapper/221:51:152
248599650,9rtkit-daemon0-21swapper/221:45:072
248599650,9rtkit-daemon0-21swapper/221:45:072
248599650,8rtkit-daemon0-21swapper/220:25:402
248599650,7rtkit-daemon0-21swapper/219:39:352
248599650,4rtkit-daemon0-21swapper/223:03:122
248599650,4rtkit-daemon0-21swapper/221:37:002
248599650,4rtkit-daemon0-21swapper/219:58:412
248599650,3rtkit-daemon0-21swapper/223:13:262
248599650,3rtkit-daemon0-21swapper/223:07:422
248599650,3rtkit-daemon0-21swapper/223:07:422
248599650,10rtkit-daemon0-21swapper/222:34:052
248599650,10rtkit-daemon0-21swapper/221:28:002
3155099643,8cyclictest1419-21runrttasks18:52:191
3155099643,8cyclictest1419-21runrttasks18:52:191
248599640,9rtkit-daemon0-21swapper/223:47:182
248599640,9rtkit-daemon0-21swapper/223:47:182
248599640,9rtkit-daemon0-21swapper/223:21:492
248599640,9rtkit-daemon0-21swapper/222:25:362
248599640,9rtkit-daemon0-21swapper/219:07:512
248599640,8rtkit-daemon0-21swapper/221:57:222
248599640,8rtkit-daemon0-21swapper/219:36:572
248599640,8rtkit-daemon0-21swapper/219:36:572
248599640,7rtkit-daemon0-21swapper/223:43:482
248599640,7rtkit-daemon0-21swapper/222:42:202
248599640,7rtkit-daemon0-21swapper/222:39:502
248599640,7rtkit-daemon0-21swapper/222:27:212
248599640,7rtkit-daemon0-21swapper/222:27:212
248599640,7rtkit-daemon0-21swapper/220:30:102
248599640,4rtkit-daemon0-21swapper/220:33:102
248599640,2rtkit-daemon0-21swapper/223:30:262
248599640,10rtkit-daemon0-21swapper/221:54:372
248599640,10rtkit-daemon0-21swapper/220:14:412
248599640,10rtkit-daemon0-21swapper/219:43:352
248599640,10rtkit-daemon0-21swapper/200:16:162
3155299635,15cyclictest0-21swapper/320:07:303
248599630,9rtkit-daemon0-21swapper/221:39:302
248599630,9rtkit-daemon0-21swapper/221:08:162
248599630,8rtkit-daemon0-21swapper/220:58:472
248599630,8rtkit-daemon0-21swapper/220:58:472
248599630,8rtkit-daemon0-21swapper/220:04:412
248599630,7rtkit-daemon0-21swapper/223:52:552
248599630,7rtkit-daemon0-21swapper/219:13:582
248599630,4rtkit-daemon0-21swapper/222:16:442
248599630,4rtkit-daemon0-21swapper/221:12:162
248599630,4rtkit-daemon0-21swapper/220:42:252
248599630,3rtkit-daemon0-21swapper/219:27:282
3154699624,48cyclictest0-21swapper/021:32:430
248599620,9rtkit-daemon0-21swapper/219:49:122
248599620,8rtkit-daemon0-21swapper/221:19:232
248599620,7rtkit-daemon0-21swapper/221:23:162
248599620,7rtkit-daemon0-21swapper/219:18:432
248599620,6rtkit-daemon0-21swapper/223:22:492
248599620,3rtkit-daemon0-21swapper/220:39:552
248599620,3rtkit-daemon0-21swapper/200:18:162
248599620,10rtkit-daemon0-21swapper/223:32:112
3154699614,51cyclictest0-21swapper/021:07:360
3154699614,50cyclictest0-21swapper/023:57:390
3154699604,50cyclictest0-21swapper/023:07:090
3154699604,47cyclictest1419-21runrttasks00:12:270
31551995938,11cyclictest16119-21grep22:47:402
39072584,46sleep00-21swapper/019:00:570
3154699584,48cyclictest0-21swapper/022:27:320
3154699584,48cyclictest0-21swapper/022:27:320
240762573,47sleep00-21swapper/020:49:360
3154699555,30cyclictest0-21swapper/023:52:320
31546995538,10cyclictest18174-21gltestperf20:37:340
3154699553,47cyclictest0-21swapper/021:22:430
3154699553,32cyclictest0-21swapper/019:36:190
3154699553,32cyclictest0-21swapper/019:36:190
31546995524,25cyclictest0-21swapper/020:58:500
31546995524,25cyclictest0-21swapper/020:58:500
3155299545,27cyclictest0-21swapper/323:07:283
3155299545,27cyclictest0-21swapper/323:07:283
3154699543,36cyclictest0-21swapper/000:02:300
3154699543,30cyclictest0-21swapper/000:10:110
31546995421,13cyclictest0-21swapper/022:02:390
31546995420,14cyclictest0-21swapper/022:32:320
31546995419,12cyclictest0-21swapper/021:19:260
31551995322,12cyclictest0-21swapper/220:07:442
3154699535,27cyclictest0-21swapper/022:57:300
3154699534,29cyclictest0-21swapper/021:47:340
3154699534,29cyclictest0-21swapper/020:02:280
3154699534,28cyclictest0-21swapper/020:28:550
3154699534,26cyclictest0-21swapper/019:17:310
3154699533,13cyclictest0-21swapper/023:49:150
3154699533,13cyclictest0-21swapper/023:49:150
31546995316,13cyclictest0-21swapper/021:46:550
31546995316,13cyclictest0-21swapper/021:46:550
31546995314,14cyclictest0-21swapper/019:27:510
3154699525,28cyclictest0-21swapper/020:52:330
3154699525,28cyclictest0-21swapper/018:52:190
3154699525,28cyclictest0-21swapper/018:52:190
3154699524,28cyclictest0-21swapper/023:24:320
3154699524,27cyclictest0-21swapper/023:27:340
3154699524,23cyclictest0-21swapper/000:17:240
31546995219,13cyclictest0-21swapper/022:07:380
31546995218,14cyclictest0-21swapper/020:22:390
305792522,11sleep20-21swapper/221:02:442
31551995134,10cyclictest26511-21gltestperf22:02:312
31551995133,11cyclictest19917-21cut00:07:262
3154699514,27cyclictest0-21swapper/022:15:530
3154699514,26cyclictest1419-21runrttasks22:22:270
3154699513,10cyclictest0-21swapper/020:07:400
3154699513,10cyclictest0-21swapper/019:02:470
3154699505,26cyclictest0-21swapper/021:29:060
3154699504,24cyclictest0-21swapper/019:47:270
3154699503,23cyclictest0-21swapper/020:17:520
3155199495,26cyclictest0-21swapper/223:57:182
3155199494,27cyclictest0-21swapper/219:52:472
3155199494,27cyclictest0-21swapper/200:02:302
3155199493,38cyclictest28157-21head22:07:222
31546994924,17cyclictest0-21swapper/022:52:370
31551994619,22cyclictest0-21swapper/218:57:002
3155299434,13cyclictest0-21swapper/318:52:193
3155299434,13cyclictest0-21swapper/318:52:193
3155199412,22cyclictest31530-21latency_hist18:52:202
3155199404,30cyclictest0-21swapper/218:52:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional