You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-04 - 01:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Jan 04, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25327991045,47cyclictest0-21swapper/119:19:291
25327991045,47cyclictest0-21swapper/119:19:291
25325991014,51cyclictest0-21swapper/023:14:320
253289910038,46cyclictest0-21swapper/223:49:502
25327991007,51cyclictest0-21swapper/123:29:471
2532799984,49cyclictest0-21swapper/120:34:261
2532799975,48cyclictest0-21swapper/119:39:591
2532799955,48cyclictest0-21swapper/120:46:581
2532899945,29cyclictest0-21swapper/219:49:482
25328999436,12cyclictest0-21swapper/223:29:582
2532899934,29cyclictest0-21swapper/223:09:412
2532599932,46cyclictest9885-21munin-node21:39:380
25328999220,12cyclictest0-21swapper/220:11:562
2532899916,27cyclictest0-21swapper/222:14:392
2532899914,28cyclictest0-21swapper/200:09:342
2532899904,47cyclictest0-21swapper/220:19:522
2532899904,28cyclictest0-21swapper/220:04:492
2532899894,28cyclictest0-21swapper/222:09:462
2532899894,28cyclictest0-21swapper/222:09:462
25328998820,13cyclictest0-21swapper/222:44:432
2532899874,29cyclictest0-21swapper/219:14:562
2532899874,29cyclictest0-21swapper/219:14:562
2532899873,29cyclictest0-21swapper/221:19:182
2532899864,28cyclictest0-21swapper/218:49:532
25328998623,13cyclictest0-21swapper/223:39:292
25328998620,12cyclictest0-21swapper/220:59:372
2532799864,46cyclictest27831-21cat18:54:301
318232850,4sleep312-21rcu_preempt21:14:593
2532899854,40cyclictest0-21swapper/220:24:442
2532899845,29cyclictest0-21swapper/220:14:502
25328998421,14cyclictest0-21swapper/219:19:472
2532899825,28cyclictest0-21swapper/200:04:362
2532899814,39cyclictest0-21swapper/221:59:502
2532899814,36cyclictest0-21swapper/222:49:512
2532899814,36cyclictest0-21swapper/222:49:512
2532899814,28cyclictest0-21swapper/220:51:182
2532899804,38cyclictest0-21swapper/223:23:522
2532899804,28cyclictest0-21swapper/221:09:542
2532899774,26cyclictest0-21swapper/220:46:132
248599680,5rtkit-daemon7156-21smartctl22:39:423
25328996639,12cyclictest0-21swapper/223:34:402
25328996639,12cyclictest0-21swapper/223:34:402
248599660,6rtkit-daemon2484-21rtkit-daemon19:20:053
248599660,5rtkit-daemon2484-21rtkit-daemon18:49:363
248599660,4rtkit-daemon2484-21rtkit-daemon22:58:413
248599660,4rtkit-daemon2484-21rtkit-daemon20:45:093
109722660,6sleep110975-21latency21:39:481
248599650,4rtkit-daemon2484-21rtkit-daemon23:38:473
248599650,4rtkit-daemon2484-21rtkit-daemon23:38:473
248599650,4rtkit-daemon2484-21rtkit-daemon22:53:413
248599650,4rtkit-daemon2484-21rtkit-daemon22:53:413
2532799645,51cyclictest0-21swapper/122:54:491
248599640,8rtkit-daemon0-21swapper/319:54:563
248599640,8rtkit-daemon0-21swapper/319:54:563
248599640,7rtkit-daemon0-21swapper/321:04:233
248599640,7rtkit-daemon0-21swapper/300:01:463
248599640,5rtkit-daemon2805-21munin-node19:09:433
248599640,4rtkit-daemon2484-21rtkit-daemon20:15:103
248599640,12rtkit-daemon15858-21kworker/3:223:04:343
25328996318,12cyclictest0-21swapper/219:37:552
248599630,9rtkit-daemon0-21swapper/319:27:053
248599630,7rtkit-daemon0-21swapper/321:59:443
248599630,6rtkit-daemon0-21swapper/321:42:523
248599630,5rtkit-daemon1641-21processes19:04:583
248599630,3rtkit-daemon0-21swapper/319:17:353
248599630,3rtkit-daemon0-21swapper/319:17:353
2532599626,48cyclictest6979-21cut20:24:440
248599620,8rtkit-daemon0-21swapper/320:55:163
248599620,7rtkit-daemon0-21swapper/323:24:403
248599620,7rtkit-daemon0-21swapper/321:24:373
248599620,7rtkit-daemon0-21swapper/321:24:373
248599620,7rtkit-daemon0-21swapper/300:13:083
248599620,6rtkit-daemon0-21swapper/320:28:253
248599620,5rtkit-daemon9677-21iostat22:44:423
248599620,5rtkit-daemon10824-21interrupts23:54:393
248599620,5rtkit-daemon0-21swapper/323:16:113
248599620,5rtkit-daemon0-21swapper/321:04:383
248599620,4rtkit-daemon13324-21if_eth019:29:493
248599620,3rtkit-daemon0-21swapper/300:04:393
248599620,2rtkit-daemon0-21swapper/300:14:233
2532999615,37cyclictest0-21swapper/322:19:553
2532799615,48cyclictest0-21swapper/119:29:571
2532599615,49cyclictest0-21swapper/020:19:590
248599610,8rtkit-daemon0-21swapper/320:39:543
248599610,8rtkit-daemon0-21swapper/320:39:543
248599610,7rtkit-daemon0-21swapper/321:49:513
248599610,6rtkit-daemon0-21swapper/323:00:343
248599610,6rtkit-daemon0-21swapper/320:53:163
248599610,5rtkit-daemon9996-21yum-updatesd-he20:30:103
248599610,4rtkit-daemon29506-21df20:04:413
2532799604,48cyclictest18708-21unixbench_multi00:09:521
2532799603,12cyclictest0-21swapper/120:21:181
2532599604,50cyclictest0-21swapper/019:29:400
2532599604,48cyclictest0-21swapper/022:14:360
248599600,5rtkit-daemon8882-21sensors_temp23:49:473
248599600,5rtkit-daemon0-21swapper/323:33:553
2532799594,48cyclictest2789-21yum-updatesd-he22:29:491
248599590,8rtkit-daemon0-21swapper/322:34:053
248599590,5rtkit-daemon28841-21munin-node18:54:513
248599590,5rtkit-daemon25017-21fw_packets22:09:433
248599590,5rtkit-daemon25017-21fw_packets22:09:433
248599590,4rtkit-daemon29660-21yum21:10:013
248599590,4rtkit-daemon2484-21rtkit-daemon23:44:243
248599590,4rtkit-daemon2484-21rtkit-daemon20:23:103
248599590,4rtkit-daemon23640-21yum22:04:583
248599590,4rtkit-daemon0-21swapper/321:19:453
254822582,49sleep00-21swapper/022:09:510
254822582,49sleep00-21swapper/022:09:510
2532799585,46cyclictest0-21swapper/121:29:361
2532799583,11cyclictest0-21swapper/122:59:551
2532599585,46cyclictest30440-21aten2.4-expect18:59:420
2532599584,47cyclictest0-21swapper/020:59:370
2532599583,49cyclictest0-21swapper/021:59:420
248599580,6rtkit-daemon27356-21runrttasks23:22:103
248599580,4rtkit-daemon2484-21rtkit-daemon21:32:373
248599580,2rtkit-daemon0-21swapper/319:50:493
2532799573,48cyclictest0-21swapper/123:24:381
2532599574,47cyclictest12218-21munin-node23:59:490
2532599574,46cyclictest29158-21tail22:19:350
2532599573,47cyclictest27331-21sshd23:21:520
25328995620,16cyclictest0-21swapper/222:29:542
2532799563,9cyclictest1128-21crond23:59:171
2532799563,47cyclictest0-21swapper/121:34:481
2532799563,46cyclictest27624-21awk21:09:241
2532799563,46cyclictest21682-21latency_hist19:49:281
2532799563,46cyclictest1566-21telnet20:14:431
2532599563,46cyclictest2655-21munin-node23:39:450
2532899556,37cyclictest0-21swapper/221:30:002
2532899555,30cyclictest0-21swapper/222:24:322
2532899554,34cyclictest29914-21crond23:29:182
2532799554,44cyclictest12242-21aten2.4-expect23:59:301
2532599553,46cyclictest0-21swapper/000:14:480
2532599553,45cyclictest15984-21aten_r1power_vo22:59:330
2532599553,45cyclictest0-21swapper/019:23:100
2532599553,12cyclictest0-21swapper/023:32:260
2532599553,12cyclictest0-21swapper/022:54:430
2532599553,12cyclictest0-21swapper/020:49:260
286402542,9sleep20-21swapper/220:01:512
286402542,9sleep20-21swapper/220:01:512
2532999545,28cyclictest1419-21runrttasks22:24:543
2532999545,27cyclictest0-21swapper/321:44:373
2532899544,30cyclictest0-21swapper/219:14:282
25328995435,7cyclictest12288-21munin-node21:44:472
2532799545,42cyclictest11167-21cut20:34:371
2532799544,13cyclictest0-21swapper/122:14:351
2532799543,45cyclictest0-21swapper/122:36:391
2532599543,45cyclictest14597-21munin-node00:04:420
2532599543,45cyclictest0-21swapper/022:29:510
2532599543,45cyclictest0-21swapper/020:40:050
2532599543,45cyclictest0-21swapper/020:40:050
2532599543,44cyclictest0-21swapper/020:09:290
2532599543,44cyclictest0-21swapper/020:04:370
2532599543,14cyclictest0-21swapper/021:06:170
2532599543,12cyclictest0-21swapper/022:49:420
2532599543,12cyclictest0-21swapper/022:49:420
2532599543,11cyclictest0-21swapper/019:04:500
189342542,9sleep20-21swapper/221:55:502
279802533,10sleep10-21swapper/121:09:381
2532899535,29cyclictest0-21swapper/220:39:422
2532899535,29cyclictest0-21swapper/220:39:422
2532899534,40cyclictest0-21swapper/218:54:492
2532799535,27cyclictest0-21swapper/121:46:231
2532799533,12cyclictest0-21swapper/100:06:451
25327995322,25cyclictest0-21swapper/119:09:291
2532799532,15cyclictest0-21swapper/119:50:021
2532799532,11cyclictest0-21swapper/120:14:281
2532599533,45cyclictest0-21swapper/000:09:480
2532599533,44cyclictest10537-21diskstats19:24:460
2532599533,43cyclictest1287-21snmpd21:31:210
2532599533,43cyclictest0-21swapper/023:57:500
2532599532,13cyclictest0-21swapper/020:44:380
215542533,9sleep00-21swapper/019:47:540
2532999525,28cyclictest0-21swapper/321:54:393
2532999524,29cyclictest0-21swapper/319:34:553
25329995221,13cyclictest0-21swapper/318:59:473
2532899524,41cyclictest0-21swapper/222:39:422
25328995218,20cyclictest0-21swapper/221:24:432
25328995218,20cyclictest0-21swapper/221:24:432
2532799525,29cyclictest0-21swapper/122:49:511
2532799525,29cyclictest0-21swapper/122:49:511
2532799524,42cyclictest29396-21sshd18:55:021
2532799523,12cyclictest0-21swapper/119:59:471
2532799523,12cyclictest0-21swapper/119:59:471
2532799523,12cyclictest0-21swapper/119:10:031
25327995212,13cyclictest0-21swapper/122:48:121
2532599523,13cyclictest0-21swapper/021:25:010
2532599523,13cyclictest0-21swapper/021:25:010
2532599523,13cyclictest0-21swapper/021:23:570
2532599523,13cyclictest0-21swapper/019:59:540
2532599523,13cyclictest0-21swapper/019:59:540
2532599523,12cyclictest0-21swapper/019:35:010
2532599522,44cyclictest0-21swapper/021:54:420
2532599522,44cyclictest0-21swapper/019:10:030
25325995218,12cyclictest0-21swapper/022:39:400
58122512,9sleep20-21swapper/222:36:422
298892513,9sleep00-21swapper/018:57:030
2532999514,29cyclictest0-21swapper/320:34:593
2532999514,27cyclictest0-21swapper/322:39:213
2532899515,28cyclictest0-21swapper/222:59:412
2532899515,28cyclictest0-21swapper/219:04:572
2532899514,39cyclictest0-21swapper/222:04:342
2532899514,30cyclictest0-21swapper/221:49:402
2532899514,29cyclictest0-21swapper/223:44:342
2532899514,29cyclictest0-21swapper/223:04:372
25328995131,9cyclictest0-21swapper/223:16:262
25328995131,9cyclictest0-21swapper/219:39:422
2532899513,43cyclictest0-21swapper/222:58:082
25328995121,13cyclictest0-21swapper/219:44:572
2532799516,38cyclictest0-21swapper/120:04:591
2532799513,43cyclictest0-21swapper/123:44:511
2532799513,14cyclictest0-21swapper/123:19:501
2532799513,13cyclictest0-21swapper/121:21:201
2532599515,39cyclictest0-21swapper/020:19:250
2532599513,43cyclictest0-21swapper/022:44:300
2532599513,43cyclictest0-21swapper/021:39:160
2532599513,41cyclictest0-21swapper/020:34:270
2532599513,28cyclictest0-21swapper/020:29:510
250662514,41sleep00-21swapper/018:46:360
248599510,5rtkit-daemon2484-21rtkit-daemon19:59:413
248599510,5rtkit-daemon2484-21rtkit-daemon19:59:413
201012513,42sleep10-21swapper/123:05:591
7842503,9sleep00-21swapper/022:25:390
320732502,41sleep00-21swapper/021:15:220
262112502,42sleep00-21swapper/019:56:210
262112502,42sleep00-21swapper/019:56:210
2532999504,28cyclictest0-21swapper/319:44:533
2532899504,29cyclictest0-21swapper/221:34:432
2532899504,29cyclictest0-21swapper/218:59:562
2532899504,29cyclictest0-21swapper/200:14:342
2532899504,28cyclictest0-21swapper/220:34:532
25328995020,12cyclictest0-21swapper/219:29:392
2532799505,12cyclictest0-21swapper/120:24:461
2532799503,13cyclictest0-21swapper/122:19:341
2532799503,12cyclictest0-21swapper/122:09:361
2532799503,12cyclictest0-21swapper/122:09:361
2532599504,13cyclictest0-21swapper/023:24:430
2532599503,40cyclictest0-21swapper/018:49:430
25325995023,21cyclictest24066-21latency_hist19:54:280
226972503,9sleep10-21swapper/120:57:411
2532899494,28cyclictest0-21swapper/221:39:422
2532899493,28cyclictest0-21swapper/221:19:432
2532799493,40cyclictest0-21swapper/119:54:391
2532799493,40cyclictest0-21swapper/119:54:391
2532799493,39cyclictest23341-21expr23:14:321
2532799493,13cyclictest0-21swapper/122:24:401
2532799493,12cyclictest0-21swapper/123:34:521
2532799493,12cyclictest0-21swapper/123:34:521
2532799493,11cyclictest0-21swapper/123:49:391
25327994920,22cyclictest19914-21sshd20:49:581
2532599494,38cyclictest0-21swapper/019:14:430
2532599494,38cyclictest0-21swapper/019:14:430
2532599494,12cyclictest0-21swapper/021:44:490
248599490,5rtkit-daemon2484-21rtkit-daemon23:09:413
248599490,4rtkit-daemon2484-21rtkit-daemon21:38:443
95682485,9sleep00-21swapper/023:54:030
57852483,9sleep00-21swapper/022:36:190
2532999484,26cyclictest0-21swapper/322:14:503
2532899483,28cyclictest0-21swapper/223:59:392
2532799486,26cyclictest0-21swapper/122:06:261
2532799485,11cyclictest20390-21munin-node00:14:391
2532799483,13cyclictest0-21swapper/121:17:071
25327994819,8cyclictest21737-21cat22:04:231
2532599484,30cyclictest0-21swapper/022:04:520
25325994834,9cyclictest20952-21tr23:09:350
25325994832,10cyclictest19419-21tail23:04:460
2532599483,40cyclictest0-21swapper/021:49:480
225702482,41sleep10-21swapper/123:12:041
47042473,9sleep30-21swapper/323:42:493
2532999474,26cyclictest0-21swapper/319:44:283
25329994730,11cyclictest31826-21cpuspeed_turbos20:09:403
2532899475,25cyclictest0-21swapper/220:54:372
2532899474,26cyclictest0-21swapper/222:19:342
2532899473,39cyclictest0-21swapper/220:29:512
2532899473,27cyclictest0-21swapper/219:54:432
2532899473,27cyclictest0-21swapper/219:54:432
2532799474,26cyclictest18467-21rt-features21:54:521
2532799474,24cyclictest9960-21munin-node19:24:451
2532799473,39cyclictest0-21swapper/121:00:031
2532799473,39cyclictest0-21swapper/119:36:211
2532799473,13cyclictest0-21swapper/122:41:311
25327994718,12cyclictest0-21swapper/123:39:531
2532599474,37cyclictest0-21swapper/021:09:520
2532599473,37cyclictest0-21swapper/023:34:310
2532599473,37cyclictest0-21swapper/023:34:310
2532599472,12cyclictest0-21swapper/023:47:490
2532899463,21cyclictest0-21swapper/223:57:592
25328994619,12cyclictest0-21swapper/221:04:372
25325994616,7cyclictest22843-21latency_hist20:59:250
189552463,38sleep00-21swapper/019:40:210
2532799454,33cyclictest0-21swapper/119:19:491
2532799454,30cyclictest0-21swapper/119:03:591
153972452,36sleep10-21swapper/120:40:561
153972452,36sleep10-21swapper/120:40:561
2532799443,11cyclictest0-21swapper/121:49:241
25328994325,13cyclictest0-21swapper/218:49:312
25328994314,12cyclictest0-21swapper/219:24:412
2532799433,14cyclictest0-21swapper/121:25:051
2532799433,14cyclictest0-21swapper/121:25:051
2532999414,29cyclictest25380-21sort18:49:303
2532799394,9cyclictest25465-21sed18:49:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional