You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 07:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 16, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991150,7rtkit-daemon0-21swapper/121:42:541
1352899993,73cyclictest0-21swapper/020:58:350
248599980,5rtkit-daemon12-21rcu_preempt21:50:461
1352899974,75cyclictest0-21swapper/020:16:110
1352899974,68cyclictest0-21swapper/019:29:500
1352899974,68cyclictest0-21swapper/019:29:500
1352899964,72cyclictest0-21swapper/021:38:530
13528999620,51cyclictest0-21swapper/021:55:530
13528999518,10cyclictest27630-21if_err_eth021:18:540
1352899934,23cyclictest0-21swapper/020:47:320
1352899934,22cyclictest0-21swapper/021:43:480
1352899924,71cyclictest0-21swapper/022:33:590
1352899924,24cyclictest1287-21snmpd19:16:190
1352899924,22cyclictest0-21swapper/022:42:480
13528999216,12cyclictest0-21swapper/020:41:260
13528999215,11cyclictest0-21swapper/022:31:490
13528999213,12cyclictest0-21swapper/019:50:150
1352899918,66cyclictest0-21swapper/019:19:020
1352899914,24cyclictest0-21swapper/020:10:240
1352899914,24cyclictest0-21swapper/020:10:240
1352899914,21cyclictest32066-21kworker/0:221:03:510
1352899914,21cyclictest0-21swapper/022:01:040
1352899914,21cyclictest0-21swapper/019:43:040
1352899913,72cyclictest9527-21interrupts20:03:570
1352899913,25cyclictest0-21swapper/019:23:510
1352899913,21cyclictest28850-21munin-node19:44:070
13528999116,10cyclictest5005-21ssh19:58:370
13528999111,19cyclictest0-21swapper/020:00:590
1352899904,68cyclictest0-21swapper/022:18:470
1352899904,23cyclictest0-21swapper/020:58:460
1352899904,21cyclictest0-21swapper/019:37:020
1352899904,20cyclictest0-21swapper/018:55:060
1352899894,32cyclictest0-21swapper/021:33:590
1352899894,27cyclictest0-21swapper/020:26:400
1352899894,24cyclictest0-21swapper/020:21:000
1352899894,23cyclictest0-21swapper/020:33:480
13528998917,13cyclictest0-21swapper/019:13:370
1352899885,61cyclictest121850irq/46-eth022:24:290
1352899884,67cyclictest0-21swapper/022:08:450
1352899884,67cyclictest0-21swapper/022:08:450
1352899884,67cyclictest0-21swapper/018:34:060
1352899884,66cyclictest0-21swapper/017:34:080
1352899884,64cyclictest0-21swapper/020:51:390
1352899884,64cyclictest0-21swapper/020:51:390
1352899884,63cyclictest0-21swapper/022:14:050
1352899884,27cyclictest0-21swapper/022:06:390
1352899883,23cyclictest0-21swapper/021:09:020
13528998819,53cyclictest0-21swapper/018:40:030
13528998817,13cyclictest0-21swapper/017:19:000
248599870,29rtkit-daemon9678-21crond19:18:371
248599870,27rtkit-daemon23032-21systemd-cgroups21:13:331
1352899873,24cyclictest0-21swapper/021:48:480
13528998716,8cyclictest6268-21diskmemload21:23:560
248599860,29rtkit-daemon13791-21cpuspeed_turbos19:23:521
1352899863,24cyclictest0-21swapper/017:58:580
1352899863,21cyclictest0-21swapper/020:33:070
13528998617,10cyclictest0-21swapper/021:13:370
13528998615,12cyclictest0-21swapper/017:53:520
248599850,29rtkit-daemon13520-21cyclictest22:38:221
1352899855,27cyclictest0-21swapper/021:33:340
1352899855,27cyclictest0-21swapper/021:33:340
248599840,29rtkit-daemon0-21swapper/018:49:011
1352899843,9cyclictest27517-21fschecks_time18:48:560
1352899843,23cyclictest0-21swapper/017:48:530
1352899834,72cyclictest0-21swapper/018:58:510
1352899834,71cyclictest0-21swapper/017:24:030
1352899833,73cyclictest11836-21grep18:14:140
1352899833,73cyclictest11836-21grep18:14:140
248599820,20rtkit-daemon0-21swapper/022:28:521
1352899823,61cyclictest0-21swapper/017:14:160
248599810,27rtkit-daemon0-21swapper/018:43:541
1352899814,13cyclictest0-21swapper/017:44:020
1352899813,70cyclictest0-21swapper/018:44:070
13528998119,55cyclictest0-21swapper/019:04:080
248599800,28rtkit-daemon0-21swapper/017:19:041
248599800,22rtkit-daemon0-21swapper/022:38:591
248599790,24rtkit-daemon0-21swapper/019:19:151
248599790,24rtkit-daemon0-21swapper/017:49:481
1352899794,11cyclictest23078-21idleruntime-cro17:33:420
1352899794,11cyclictest23078-21idleruntime-cro17:33:420
1352899793,22cyclictest0-21swapper/018:28:520
1184727910,15sleep30-21swapper/317:08:593
248599780,24rtkit-daemon0-21swapper/020:50:111
248599780,24rtkit-daemon0-21swapper/020:50:111
248599780,22rtkit-daemon0-21swapper/020:38:571
248599770,27rtkit-daemon0-21swapper/020:54:041
248599770,20rtkit-daemon0-21swapper/018:33:541
1352899774,12cyclictest0-21swapper/018:09:070
1352899774,12cyclictest0-21swapper/018:09:070
248599760,23rtkit-daemon0-21swapper/019:46:361
248599760,20rtkit-daemon0-21swapper/021:27:171
13528997610,9cyclictest0-21swapper/017:39:540
248599750,23rtkit-daemon0-21swapper/018:28:541
1352899753,14cyclictest0-21swapper/018:18:550
1352899743,13cyclictest0-21swapper/018:04:000
1352899743,12cyclictest0-21swapper/018:24:160
248599700,9rtkit-daemon0-21swapper/122:01:532
248599690,5rtkit-daemon6258-21crond19:13:381
248599690,5rtkit-daemon10818-21ssh20:05:432
13531996915,47cyclictest0-21swapper/221:23:492
248599680,8rtkit-daemon0-21swapper/022:21:231
248599670,8rtkit-daemon0-21swapper/119:50:512
248599670,7rtkit-daemon0-21swapper/021:46:091
1352899675,14cyclictest0-21swapper/017:13:420
13531996611,47cyclictest0-21swapper/221:38:432
13531996610,49cyclictest0-21swapper/220:42:002
13531996610,49cyclictest0-21swapper/219:19:282
248599650,4rtkit-daemon2484-21rtkit-daemon18:19:022
13531996515,42cyclictest0-21swapper/220:24:052
13532996444,13cyclictest0-21swapper/321:14:033
13531996419,37cyclictest11010-21grep20:53:572
13531996415,41cyclictest13742-21df_abs20:58:502
13531996414,43cyclictest0-21swapper/220:18:542
13531996413,44cyclictest0-21swapper/220:49:072
13531996413,44cyclictest0-21swapper/220:49:072
13531996410,47cyclictest0-21swapper/220:14:152
13531996320,11cyclictest9965-21ssh22:28:492
13531996318,37cyclictest3488-21ssh19:54:072
13531996316,27cyclictest28500-21grep18:49:112
248599620,7rtkit-daemon0-21swapper/021:16:331
1353299625,22cyclictest0-21swapper/320:24:263
1353199629,46cyclictest0-21swapper/222:15:232
13531996219,36cyclictest19923-21aten_r1power_cu21:08:452
13531996217,38cyclictest6537-21taskset19:59:052
13531996213,21cyclictest0-21swapper/222:13:042
13531996213,21cyclictest0-21swapper/222:13:042
13531996210,46cyclictest0-21swapper/222:18:432
13531996210,45cyclictest1419-21runrttasks21:15:532
1353099627,37cyclictest18-21rcuc/121:00:561
248599610,5rtkit-daemon0-21swapper/019:40:291
1353199619,15cyclictest0-21swapper/221:49:012
1353199618,14cyclictest0-21swapper/222:26:042
1353199616,48cyclictest0-21swapper/219:37:102
13531996112,42cyclictest4881-21ssh21:33:472
316642603,11sleep10-21swapper/122:13:451
13532996041,12cyclictest0-21swapper/319:26:243
1353199609,45cyclictest0-21swapper/221:56:292
1353199608,16cyclictest0-21swapper/219:13:582
13531996014,29cyclictest13739-21ssh20:09:102
13531996014,29cyclictest13739-21ssh20:09:102
13531996011,42cyclictest0-21swapper/219:28:092
13531996011,41cyclictest0-21swapper/218:28:592
13531996011,16cyclictest0-21swapper/220:44:072
83112594,12sleep10-21swapper/118:08:581
83112594,12sleep10-21swapper/118:08:581
199582593,12sleep10-21swapper/119:32:431
199582593,12sleep10-21swapper/119:32:431
13532995940,12cyclictest0-21swapper/321:54:053
1353299594,47cyclictest0-21swapper/320:07:083
1353199599,33cyclictest0-21swapper/221:03:522
1353199598,44cyclictest0-21swapper/222:07:162
13531995912,41cyclictest0-21swapper/221:29:242
13531995912,41cyclictest0-21swapper/221:29:242
13531995911,41cyclictest7782-21basename18:08:512
13531995911,41cyclictest7782-21basename18:08:512
13531995911,41cyclictest0-21swapper/220:28:592
13531995911,41cyclictest0-21swapper/217:43:592
1353199588,43cyclictest0-21swapper/222:41:342
13531995812,37cyclictest0-21swapper/221:19:582
13531995811,38cyclictest0-21swapper/218:03:542
1353099585,30cyclictest1419-21runrttasks21:34:101
1353099584,15cyclictest0-21swapper/120:10:431
1353099584,15cyclictest0-21swapper/120:10:431
13530995837,11cyclictest26610-21grep17:39:021
248599570,4rtkit-daemon2484-21rtkit-daemon17:27:193
248599570,4rtkit-daemon2484-21rtkit-daemon17:20:272
13532995743,9cyclictest0-21swapper/320:38:363
1353299574,45cyclictest0-21swapper/322:33:593
13531995714,37cyclictest28800-21aten_r1power_vo20:33:482
13531995710,16cyclictest0-21swapper/219:33:132
13531995710,16cyclictest0-21swapper/219:33:132
1353099574,39cyclictest0-21swapper/122:27:341
1353099574,14cyclictest0-21swapper/121:58:511
1353099573,48cyclictest17573-21interrupts21:03:561
13530995719,25cyclictest0-21swapper/119:37:551
151992562,32sleep30-21swapper/320:59:413
13532995642,9cyclictest0-21swapper/319:35:183
1353299564,38cyclictest0-21swapper/319:59:053
1353299564,31cyclictest0-21swapper/321:04:093
13532995638,12cyclictest0-21swapper/319:29:043
13532995638,12cyclictest0-21swapper/319:29:043
1353199567,29cyclictest0-21swapper/217:28:282
1353199565,45cyclictest0-21swapper/217:58:582
13531995613,36cyclictest5285-21missed_timers19:09:042
13531995612,37cyclictest12863-21grep22:33:462
13531995612,37cyclictest0-21swapper/217:49:072
1353099565,14cyclictest0-21swapper/118:40:031
1353099564,30cyclictest0-21swapper/120:03:371
1353099564,22cyclictest0-21swapper/120:14:001
1353099563,40cyclictest0-21swapper/122:09:001
1353099563,40cyclictest0-21swapper/122:09:001
294662553,45sleep129601-21ls18:53:531
206222554,12sleep10-21swapper/117:28:021
13532995541,10cyclictest0-21swapper/322:01:223
13532995540,9cyclictest0-21swapper/318:43:563
13532995540,10cyclictest0-21swapper/319:58:213
1353299554,44cyclictest0-21swapper/319:20:563
13532995536,13cyclictest0-21swapper/320:44:213
13532995535,13cyclictest0-21swapper/320:28:533
13532995526,9cyclictest10542-21fschecks_time20:53:503
1353199557,41cyclictest0-21swapper/218:38:572
13531995537,12cyclictest10876-21fschecks_time18:13:592
13531995537,12cyclictest10876-21fschecks_time18:13:592
13531995536,13cyclictest0-21swapper/219:38:542
1353199553,44cyclictest0-21swapper/217:14:142
13531995512,37cyclictest6268-21diskmemload19:47:422
1353099555,15cyclictest0-21swapper/120:44:141
1353099554,34cyclictest0-21swapper/120:07:191
13530995537,10cyclictest20377-21grep20:19:101
1353099553,9cyclictest2589-21grep19:53:531
13530995523,12cyclictest22541-21diskstats20:23:511
114862553,45sleep10-21swapper/118:14:101
114862553,45sleep10-21swapper/118:14:101
1353299545,41cyclictest0-21swapper/321:08:513
13532995438,11cyclictest0-21swapper/322:42:203
13531995437,10cyclictest2157-21unixbench_multi17:54:142
13531995419,28cyclictest20275-21cut18:33:572
1353099548,22cyclictest0-21swapper/117:58:521
1353099544,31cyclictest0-21swapper/120:32:491
13530995436,11cyclictest32469-21gltestperf18:58:591
13532995339,9cyclictest0-21swapper/322:04:003
13532995338,10cyclictest0-21swapper/320:09:253
13532995338,10cyclictest0-21swapper/320:09:253
13532995336,9cyclictest15250-21cut21:48:493
13532995334,13cyclictest0-21swapper/321:34:053
13532995327,12cyclictest0-21swapper/322:16:093
1353299532,45cyclictest0-21swapper/317:18:543
1353199538,39cyclictest0-21swapper/218:58:542
13531995318,28cyclictest11457-21grep21:43:452
13531995312,34cyclictest15819-21hwlatdetect18:24:002
13530995311,26cyclictest0-21swapper/119:49:411
37212523,11sleep10-21swapper/119:06:431
1353299525,41cyclictest0-21swapper/319:49:003
1353299525,40cyclictest0-21swapper/318:29:133
1353299524,41cyclictest8522-21fschecks_time21:38:493
1353299524,40cyclictest0-21swapper/322:18:523
13532995238,9cyclictest0-21swapper/322:08:493
13532995238,9cyclictest0-21swapper/322:08:493
13532995236,10cyclictest0-21swapper/321:43:483
13532995234,12cyclictest0-21swapper/321:23:313
13532995233,11cyclictest14654-21crond18:23:403
13532995232,13cyclictest0-21swapper/320:18:493
1353299523,42cyclictest0-21swapper/322:24:043
1353199528,37cyclictest0-21swapper/218:54:082
1353199523,42cyclictest0-21swapper/217:29:092
1353199523,42cyclictest0-21swapper/217:29:092
1353099525,28cyclictest0-21swapper/118:04:001
1353099524,30cyclictest0-21swapper/117:58:251
1353099524,21cyclictest0-21swapper/120:38:051
13530995234,11cyclictest14580-21head17:14:021
13530995220,12cyclictest26630-21munin-node21:18:591
119552522,9sleep30-21swapper/318:14:403
119552522,9sleep30-21swapper/318:14:403
1353299514,28cyclictest0-21swapper/320:49:053
1353299514,28cyclictest0-21swapper/320:49:053
13532995136,10cyclictest0-21swapper/321:28:553
13532995136,10cyclictest0-21swapper/321:28:553
13532995136,10cyclictest0-21swapper/321:23:573
13532995135,11cyclictest0-21swapper/318:24:023
1353099518,19cyclictest0-21swapper/117:48:421
1353099515,14cyclictest0-21swapper/122:05:211
1353099515,14cyclictest0-21swapper/121:58:051
1353099514,28cyclictest0-21swapper/117:34:151
1353299504,39cyclictest0-21swapper/319:44:063
1353299504,39cyclictest0-21swapper/318:53:493
13532995035,10cyclictest0-21swapper/320:39:073
13532995033,11cyclictest0-21swapper/322:29:043
13532995032,10cyclictest21284-21tr17:28:563
13532995032,10cyclictest21284-21tr17:28:563
13532995025,8cyclictest9926-21cat18:13:413
13532995025,8cyclictest9926-21cat18:13:413
1353199504,26cyclictest0-21swapper/219:03:502
1353099504,24cyclictest3359-21ssh21:30:331
1353099504,24cyclictest3359-21ssh21:30:331
13530995030,11cyclictest21266-21tr17:28:561
13530995030,11cyclictest21266-21tr17:28:561
312042492,38sleep30-21swapper/317:49:013
144162493,11sleep10-21swapper/118:20:351
1353299494,40cyclictest0-21swapper/319:13:513
1353299494,38cyclictest0-21swapper/317:18:423
1353299494,27cyclictest0-21swapper/319:09:003
1353299494,27cyclictest0-21swapper/318:59:123
1353299494,27cyclictest0-21swapper/318:49:113
13532994933,11cyclictest0-21swapper/317:53:513
13532994933,11cyclictest0-21swapper/317:33:543
13532994932,11cyclictest0-21swapper/320:13:533
13532994928,14cyclictest0-21swapper/319:03:543
13531994932,10cyclictest27399-21unixbench_multi17:39:152
256702482,38sleep30-21swapper/317:38:453
1353299485,23cyclictest24402-21df19:38:513
13532994833,10cyclictest0-21swapper/317:44:133
1353299474,26cyclictest0-21swapper/318:34:053
13532994732,10cyclictest0-21swapper/318:03:533
13532994730,10cyclictest4687-21unixbench_singl17:59:143
13532994729,11cyclictest22420-21cpuspeed_turbos18:38:533
1353199477,33cyclictest0-21swapper/217:34:002
1353199475,36cyclictest0-21swapper/218:43:512
13530994728,12cyclictest15564-21fschecks_count18:23:571
1353199454,32cyclictest0-21swapper/217:13:442
1353099428,22cyclictest0-21swapper/117:13:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional