You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 10:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed May 13, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32248991105,98cyclictest0-21swapper/320:53:383
32246991074,49cyclictest27781-21rm21:13:331
322459910734,9cyclictest1419-21runrttasks19:46:190
322459910539,11cyclictest0-21swapper/019:07:440
322459910331,12cyclictest0-21swapper/020:08:440
32246991024,48cyclictest0-21swapper/119:18:381
322459910238,8cyclictest9906-21ps19:58:430
32245991023,50cyclictest0-21swapper/020:58:110
322459910133,12cyclictest0-21swapper/018:48:330
32245991013,49cyclictest19010-21gltestperf21:48:320
322459910039,9cyclictest1419-21runrttasks20:14:450
32245999936,11cyclictest0-21swapper/019:28:260
3224699984,48cyclictest1419-21runrttasks19:32:441
3224599985,49cyclictest0-21swapper/018:53:380
32245999837,7cyclictest26220-21rm20:23:330
3224699964,53cyclictest0-21swapper/118:53:491
3224699964,51cyclictest0-21swapper/120:43:231
3224699964,48cyclictest15350-21nscd19:28:141
32245999638,10cyclictest0-21swapper/021:23:390
32245999637,13cyclictest0-21swapper/019:48:460
32245999637,10cyclictest0-21swapper/019:38:010
3224599963,55cyclictest0-21swapper/020:34:190
32248999539,9cyclictest31344-21telnet17:53:313
32246999537,12cyclictest0-21swapper/121:38:451
32246999537,12cyclictest0-21swapper/121:38:451
32246999531,11cyclictest0-21swapper/119:14:351
32245999538,12cyclictest0-21swapper/021:13:110
32245999436,13cyclictest0-21swapper/020:48:120
32246999311,45cyclictest0-21swapper/119:43:591
3224599933,50cyclictest0-21swapper/019:15:520
3224599933,49cyclictest0-21swapper/021:28:330
3224699928,15cyclictest0-21swapper/119:03:161
3224699924,50cyclictest25797-21yum-updatesd-he19:34:211
32245999237,10cyclictest0-21swapper/017:13:400
32245999234,13cyclictest0-21swapper/022:08:320
3224599923,50cyclictest0-21swapper/021:19:190
3224599923,50cyclictest0-21swapper/021:03:270
3224599923,48cyclictest0-21swapper/017:03:220
32245999228,11cyclictest0-21swapper/020:32:220
32246999129,12cyclictest0-21swapper/120:38:421
32245999138,10cyclictest0-21swapper/020:48:390
3224599913,51cyclictest0-21swapper/021:33:430
3224599903,49cyclictest0-21swapper/018:08:180
32246998938,11cyclictest0-21swapper/121:18:221
32246998937,12cyclictest0-21swapper/120:18:471
32245998935,9cyclictest0-21swapper/021:56:390
32245998935,10cyclictest0-21swapper/016:48:510
32245998834,10cyclictest0-21swapper/022:00:170
264942860,2sleep3361ktimersoftd/321:13:113
32245998535,10cyclictest0-21swapper/020:22:390
32245998435,10cyclictest0-21swapper/021:13:400
32247996810,35cyclictest281ktimersoftd/221:38:372
32247996810,35cyclictest281ktimersoftd/221:38:372
32246996841,13cyclictest0-21swapper/122:13:201
3224599684,47cyclictest30338-21latency_hist19:43:150
3224699675,54cyclictest0-21swapper/121:43:221
3224699674,55cyclictest0-21swapper/121:23:311
32247996623,28cyclictest1419-21runrttasks20:55:512
32246996640,12cyclictest0-21swapper/121:34:151
41352654,12sleep20-21swapper/221:27:382
3224699659,49cyclictest21635-21crond20:18:121
193532650,2sleep00-21swapper/019:25:090
3224699644,53cyclictest0-21swapper/119:38:311
32245996437,12cyclictest0-21swapper/020:58:320
32245996437,12cyclictest0-21swapper/020:58:320
3224599643,53cyclictest0-21swapper/021:38:420
3224599643,53cyclictest0-21swapper/021:38:420
32248996334,13cyclictest0-21swapper/319:43:473
32247996323,29cyclictest0-21swapper/220:43:452
3224699634,52cyclictest0-21swapper/121:58:201
32245996338,12cyclictest0-21swapper/018:58:330
3224599633,53cyclictest0-21swapper/018:43:160
32248996232,13cyclictest0-21swapper/319:38:273
3224899623,50cyclictest16060-21ntp_states21:43:383
3224799625,15cyclictest0-21swapper/220:03:362
32246996247,10cyclictest17429-21gltestperf20:58:311
32246996247,10cyclictest17429-21gltestperf20:58:311
32246996242,9cyclictest0-21swapper/119:48:461
3224699624,51cyclictest0-21swapper/120:53:351
3224699624,51cyclictest0-21swapper/120:30:201
32246996234,12cyclictest0-21swapper/120:04:371
3224699623,53cyclictest0-21swapper/121:53:101
32245996236,12cyclictest0-21swapper/020:08:140
32245996236,12cyclictest0-21swapper/019:08:410
98502615,11sleep20-21swapper/219:12:262
3224699614,51cyclictest0-21swapper/121:28:321
3224699614,50cyclictest10459-21diskstats20:48:301
3224699614,49cyclictest0-21swapper/118:18:171
32246996136,12cyclictest0-21swapper/122:03:421
3224699613,50cyclictest5639-21cut16:58:391
32245996138,9cyclictest2660-21tail16:53:330
32245996138,9cyclictest2660-21tail16:53:330
32248996036,9cyclictest11937-21ssh19:13:473
3224699604,49cyclictest8047-21sort19:08:401
3224699603,51cyclictest0-21swapper/118:48:421
32245996036,9cyclictest28390-21head22:03:220
32245996035,11cyclictest0-21swapper/019:53:500
3224599603,51cyclictest0-21swapper/022:13:430
3224599603,48cyclictest14885-21ssh21:43:220
32248995930,13cyclictest0-21swapper/321:13:313
32248995930,13cyclictest0-21swapper/320:33:383
32248995930,13cyclictest0-21swapper/319:08:393
3224899593,49cyclictest1287-21snmpd21:38:103
32246995937,8cyclictest27369-21grep17:43:381
32246995933,12cyclictest0-21swapper/119:03:361
3224599593,50cyclictest22691-21uname17:33:420
32248995831,13cyclictest0-21swapper/319:58:333
32248995831,12cyclictest0-21swapper/322:08:133
32248995830,13cyclictest0-21swapper/321:03:283
3224899583,47cyclictest18550-21munin-node20:13:363
3224899583,47cyclictest0-21swapper/319:03:413
3224799584,31cyclictest0-21swapper/221:58:372
3224699584,48cyclictest0-21swapper/116:58:211
3224699584,48cyclictest0-21swapper/116:58:211
32246995834,11cyclictest0-21swapper/119:58:381
32246995833,11cyclictest0-21swapper/120:34:091
32246995832,12cyclictest0-21swapper/120:23:221
3224699583,49cyclictest0-21swapper/117:28:311
3224699583,48cyclictest800-21timerandwakeup22:08:421
3224599584,49cyclictest0-21swapper/019:18:480
3224599584,46cyclictest0-21swapper/017:18:290
32245995837,9cyclictest924-21idleruntime-cro17:58:190
3224599583,49cyclictest0-21swapper/018:48:160
3224599583,49cyclictest0-21swapper/017:53:200
3224599583,49cyclictest0-21swapper/017:28:470
306202582,7sleep330642-21ssh18:53:533
291522583,12sleep20-21swapper/221:15:452
266092584,46sleep30-21swapper/317:43:323
3224899576,42cyclictest25884-21diskstats20:23:303
32248995737,7cyclictest12666-21ssh20:52:073
32248995733,9cyclictest361ktimersoftd/320:38:443
3224899573,46cyclictest1456-21rt-features16:48:503
32248995729,13cyclictest0-21swapper/322:15:473
32248995729,13cyclictest0-21swapper/319:57:003
32248995729,13cyclictest0-21swapper/319:33:163
32248995728,13cyclictest0-21swapper/321:48:293
32248995725,12cyclictest0-21swapper/317:43:203
32248995725,12cyclictest0-21swapper/317:43:203
3224799573,9cyclictest0-21swapper/220:28:242
32247995715,13cyclictest0-21swapper/221:08:362
3224699574,48cyclictest0-21swapper/118:28:361
3224699573,49cyclictest0-21swapper/120:09:021
32245995737,9cyclictest0-21swapper/017:43:520
32245995729,11cyclictest0-21swapper/020:41:370
3224899564,45cyclictest24259-21ssh20:20:303
32248995637,7cyclictest27067-21rm21:59:563
32248995635,7cyclictest14998-21ssh19:18:403
32248995634,8cyclictest29962-21ssh22:03:443
32248995634,8cyclictest14882-21kworker/3:221:53:423
32248995629,12cyclictest0-21swapper/319:02:293
32248995628,13cyclictest0-21swapper/321:28:433
32248995628,12cyclictest0-21swapper/320:43:243
3224799565,31cyclictest0-21swapper/221:46:012
3224799565,30cyclictest0-21swapper/221:48:492
3224799564,13cyclictest0-21swapper/219:06:562
3224699564,45cyclictest0-21swapper/121:08:491
3224699563,48cyclictest0-21swapper/121:05:391
3224599564,46cyclictest0-21swapper/018:33:380
3224599563,48cyclictest0-21swapper/018:08:280
237752563,45sleep223796-21ssh20:18:492
32248995538,10cyclictest14459-21tail18:23:423
32248995538,10cyclictest14459-21tail18:23:423
32248995534,8cyclictest28382-21ssh18:53:013
32248995531,8cyclictest774-21ssh21:23:103
3224899553,46cyclictest0-21swapper/320:28:243
3224899553,45cyclictest1419-21runrttasks20:05:433
32248995529,12cyclictest0-21swapper/320:09:413
32248995528,12cyclictest0-21swapper/319:52:263
32248995527,13cyclictest0-21swapper/319:28:313
3224799553,13cyclictest0-21swapper/219:33:422
3224799553,12cyclictest0-21swapper/219:23:362
32247995515,10cyclictest28351-21kworker/2:220:48:322
3224699554,46cyclictest0-21swapper/121:54:041
3224699553,47cyclictest0-21swapper/116:48:221
32245995531,11cyclictest0-21swapper/018:13:460
308102558,37sleep20-21swapper/216:43:392
3224899544,45cyclictest24979-21diskmemload19:25:193
32248995436,11cyclictest2346-21sort21:23:353
32248995433,7cyclictest23879-21latency_hist17:38:193
3224899543,43cyclictest10872-21munin-node18:18:413
3224799542,20cyclictest0-21swapper/219:32:042
3224699544,45cyclictest0-21swapper/118:33:471
3224699543,46cyclictest0-21swapper/118:08:361
3224699543,45cyclictest5379-21cpuspeed_turbos19:53:271
3224699542,46cyclictest0-21swapper/117:34:121
32245995432,11cyclictest0-21swapper/018:23:460
32245995432,11cyclictest0-21swapper/018:23:460
32245995426,13cyclictest0-21swapper/017:28:190
3224799534,33cyclictest0-21swapper/222:08:332
3224699534,42cyclictest0-21swapper/118:43:291
32246995331,11cyclictest0-21swapper/118:39:441
32246995331,11cyclictest0-21swapper/117:23:401
222292538,36sleep322232-21sshd18:38:533
188602532,9sleep30-21swapper/317:26:073
50232523,43sleep20-21swapper/220:38:572
32248995237,9cyclictest18404-21unixbench_multi20:58:453
32248995237,9cyclictest18404-21unixbench_multi20:58:453
3224899523,36cyclictest0-21swapper/317:18:473
32248995224,13cyclictest0-21swapper/318:13:183
32248995222,15cyclictest0-21swapper/318:38:183
3224799526,14cyclictest0-21swapper/220:08:222
3224799525,41cyclictest28351-21kworker/2:221:18:292
3224799525,41cyclictest0-21swapper/217:43:332
3224799525,40cyclictest0-21swapper/222:13:332
3224799525,40cyclictest0-21swapper/217:23:202
3224799525,30cyclictest0-21swapper/219:43:452
3224799524,33cyclictest0-21swapper/221:03:342
3224799524,14cyclictest0-21swapper/218:03:182
32247995222,14cyclictest0-21swapper/221:32:272
32246995229,12cyclictest0-21swapper/118:18:311
32245995230,11cyclictest0-21swapper/017:03:490
32245995229,12cyclictest0-21swapper/018:18:300
244922526,9sleep10-21swapper/117:38:341
244922526,9sleep10-21swapper/117:38:341
187632522,9sleep20-21swapper/217:24:532
84752512,9sleep28562-21aten_r1power_po19:58:252
47382513,6sleep34920-21sed16:58:223
47382513,6sleep34920-21sed16:58:223
3224899513,27cyclictest0-21swapper/321:38:303
3224899513,27cyclictest0-21swapper/321:38:303
32248995122,13cyclictest0-21swapper/318:18:183
3224799516,39cyclictest0-21swapper/217:34:512
3224799515,41cyclictest1419-21runrttasks16:54:352
3224799515,41cyclictest1419-21runrttasks16:54:352
3224799515,29cyclictest0-21swapper/222:03:442
3224799514,43cyclictest0-21swapper/220:59:132
3224799514,43cyclictest0-21swapper/220:59:132
3224799514,41cyclictest0-21swapper/219:49:152
3224799514,37cyclictest0-21swapper/219:43:002
3224799514,30cyclictest0-21swapper/220:33:302
32247995136,9cyclictest5397-21grep19:53:272
3224799513,43cyclictest0-21swapper/221:56:122
3224699513,10cyclictest0-21swapper/117:08:371
32246995129,11cyclictest0-21swapper/117:48:531
32246995129,11cyclictest0-21swapper/116:52:521
32246995128,11cyclictest0-21swapper/117:18:201
32246995124,11cyclictest0-21swapper/117:06:591
32246995119,26cyclictest31890-21fschecks_count17:53:361
32245995129,11cyclictest0-21swapper/017:58:500
57392502,42sleep20-21swapper/218:06:442
3224799505,40cyclictest0-21swapper/218:49:162
3224799505,39cyclictest0-21swapper/221:33:152
3224799505,39cyclictest0-21swapper/216:48:362
3224799504,41cyclictest0-21swapper/219:14:162
3224799504,41cyclictest0-21swapper/217:08:372
32247995035,9cyclictest18779-21grep18:33:342
32246995036,8cyclictest5420-21grep18:03:521
3224699503,43cyclictest0-21swapper/118:26:471
3224699503,43cyclictest0-21swapper/118:26:471
32245995029,11cyclictest0-21swapper/017:38:300
32245995029,11cyclictest0-21swapper/017:38:300
32248994924,10cyclictest0-21swapper/317:03:353
32248994918,26cyclictest0-21swapper/318:04:173
3224799495,39cyclictest0-21swapper/220:13:502
3224799495,39cyclictest0-21swapper/217:38:492
3224799495,39cyclictest0-21swapper/217:38:492
3224799495,39cyclictest0-21swapper/217:32:572
3224799494,40cyclictest0-21swapper/219:18:402
3224799494,40cyclictest0-21swapper/219:00:572
32247994934,10cyclictest32432-21needreboot17:53:432
32246994922,10cyclictest0-21swapper/117:21:561
3224599493,41cyclictest0-21swapper/017:08:370
300632494,7sleep00-21swapper/016:43:330
32248994831,10cyclictest28860-21aten_r1power_cu17:48:313
32248994823,10cyclictest0-21swapper/317:59:533
32248994822,11cyclictest0-21swapper/318:28:283
3224799485,38cyclictest0-21swapper/220:25:172
3224799485,38cyclictest0-21swapper/218:43:272
3224799484,40cyclictest0-21swapper/218:53:432
32246994824,10cyclictest0-21swapper/117:58:301
3224899473,26cyclictest0-21swapper/316:58:423
32248994722,10cyclictest0-21swapper/317:08:563
3224799475,14cyclictest0-21swapper/216:58:362
32247994733,9cyclictest12078-21tail18:18:432
3224599473,39cyclictest0-21swapper/018:32:070
300902475,36sleep20-21swapper/217:48:472
32248994621,10cyclictest0-21swapper/318:44:433
3224799464,37cyclictest0-21swapper/217:13:412
32247994630,10cyclictest9829-21ps18:13:452
3224899453,26cyclictest0-21swapper/317:13:323
32248994522,10cyclictest0-21swapper/317:30:233
3224799454,13cyclictest0-21swapper/218:38:292
3224799444,33cyclictest0-21swapper/217:03:452
32247994425,10cyclictest1419-21runrttasks18:33:172
32247994422,13cyclictest0-21swapper/218:08:362
3224799435,28cyclictest0-21swapper/218:23:492
3224799435,28cyclictest0-21swapper/218:23:492
32248993419,9cyclictest32379-21sort16:48:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional