You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 09:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat May 02, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2390221280,4sleep1201ktimersoftd/120:15:451
20442970,4sleep118-21rcuc/118:54:091
248599830,4rtkit-daemon2484-21rtkit-daemon20:42:331
248599820,27rtkit-daemon2583-21diskmemload20:49:331
248599810,24rtkit-daemon0-21swapper/018:09:021
248599780,26rtkit-daemon0-21swapper/021:09:021
248599780,26rtkit-daemon0-21swapper/019:19:291
248599780,26rtkit-daemon0-21swapper/019:08:071
248599780,26rtkit-daemon0-21swapper/019:08:071
248599780,26rtkit-daemon0-21swapper/017:03:421
248599780,25rtkit-daemon2583-21diskmemload19:14:591
248599780,25rtkit-daemon13648-21strings17:04:051
248599770,26rtkit-daemon0-21swapper/020:56:331
248599770,26rtkit-daemon0-21swapper/019:09:301
248599770,24rtkit-daemon0-21swapper/019:00:001
248599750,5rtkit-daemon10045-21systemd-cgroups16:58:420
248599750,24rtkit-daemon0-21swapper/017:35:411
984199743,64cyclictest1419-21runrttasks21:27:291
248599730,23rtkit-daemon0-21swapper/017:29:191
248599710,22rtkit-daemon0-21swapper/017:41:111
248599710,22rtkit-daemon0-21swapper/017:41:111
9842997041,13cyclictest0-21swapper/220:33:502
85832690,3sleep3361ktimersoftd/319:05:443
85832690,3sleep3361ktimersoftd/319:05:443
248599690,4rtkit-daemon2484-21rtkit-daemon19:42:363
984199685,56cyclictest0-21swapper/121:29:011
248599660,7rtkit-daemon0-21swapper/322:09:083
248599660,6rtkit-daemon0-21swapper/322:07:303
248599660,6rtkit-daemon0-21swapper/320:30:343
248599660,6rtkit-daemon0-21swapper/020:58:481
248599660,5rtkit-daemon2484-21rtkit-daemon19:45:063
248599660,5rtkit-daemon2484-21rtkit-daemon19:45:063
248599660,4rtkit-daemon2484-21rtkit-daemon21:13:023
248599660,4rtkit-daemon2484-21rtkit-daemon19:56:353
984199654,53cyclictest0-21swapper/120:18:531
248599650,8rtkit-daemon0-21swapper/320:40:493
248599650,7rtkit-daemon0-21swapper/322:25:073
248599650,7rtkit-daemon0-21swapper/322:25:073
248599650,7rtkit-daemon0-21swapper/319:59:503
248599650,6rtkit-daemon2484-21rtkit-daemon19:31:293
248599650,6rtkit-daemon0-21swapper/322:21:303
248599650,6rtkit-daemon0-21swapper/322:16:223
248599650,6rtkit-daemon0-21swapper/321:41:543
248599650,6rtkit-daemon0-21swapper/320:26:343
248599650,6rtkit-daemon0-21swapper/320:26:343
248599650,6rtkit-daemon0-21swapper/320:12:273
248599650,5rtkit-daemon0-21swapper/321:26:323
984199645,53cyclictest0-21swapper/122:03:441
984199643,55cyclictest0-21swapper/121:49:021
984199643,54cyclictest0-21swapper/120:43:581
9841996414,43cyclictest0-21swapper/120:04:061
248599640,6rtkit-daemon0-21swapper/321:59:453
248599640,6rtkit-daemon0-21swapper/321:45:533
248599640,6rtkit-daemon0-21swapper/321:45:533
248599640,6rtkit-daemon0-21swapper/321:32:393
248599640,6rtkit-daemon0-21swapper/320:14:423
248599640,4rtkit-daemon2484-21rtkit-daemon21:52:013
248599640,4rtkit-daemon2484-21rtkit-daemon21:14:173
248599640,4rtkit-daemon2484-21rtkit-daemon20:04:573
248599640,11rtkit-daemon0-21swapper/320:34:343
9842996343,13cyclictest0-21swapper/221:44:042
9842996343,13cyclictest0-21swapper/221:44:042
984299634,51cyclictest0-21swapper/220:18:342
9842996318,29cyclictest0-21swapper/219:33:152
984199635,31cyclictest0-21swapper/118:33:581
984199634,52cyclictest3705-21ps22:08:591
248599630,8rtkit-daemon0-21swapper/320:19:493
248599630,3rtkit-daemon0-21swapper/321:22:093
9842996241,13cyclictest0-21swapper/221:54:102
9842996241,12cyclictest0-21swapper/222:24:012
9842996241,12cyclictest0-21swapper/222:24:012
984199624,50cyclictest0-21swapper/117:08:561
9839996224,23cyclictest0-21swapper/020:47:150
9832625,10sleep00-21swapper/017:45:240
47472624,50sleep20-21swapper/221:23:482
248599620,9rtkit-daemon0-21swapper/321:34:163
248599620,8rtkit-daemon0-21swapper/017:21:561
248599620,7rtkit-daemon0-21swapper/321:54:313
248599620,7rtkit-daemon0-21swapper/319:50:433
248599620,7rtkit-daemon0-21swapper/319:50:433
984299613,49cyclictest2598-21strings19:43:592
984299613,49cyclictest2598-21strings19:43:592
984199614,51cyclictest0-21swapper/119:44:061
984199614,51cyclictest0-21swapper/119:44:061
984199614,50cyclictest0-21swapper/117:44:081
984199614,49cyclictest0-21swapper/122:23:551
984199614,49cyclictest0-21swapper/122:23:551
984199614,49cyclictest0-21swapper/122:18:451
984199614,49cyclictest0-21swapper/121:04:061
984199614,49cyclictest0-21swapper/121:04:061
984199614,49cyclictest0-21swapper/118:44:031
248599610,5rtkit-daemon0-21swapper/319:34:063
9843996043,11cyclictest16036-21needreboot17:09:023
9842996040,13cyclictest0-21swapper/221:18:552
9842996039,14cyclictest0-21swapper/219:53:482
9842996038,13cyclictest0-21swapper/219:59:032
9842996019,24cyclictest0-21swapper/222:15:132
984199607,46cyclictest0-21swapper/118:03:491
984199604,50cyclictest0-21swapper/122:02:551
984199604,50cyclictest0-21swapper/120:08:551
984199604,49cyclictest0-21swapper/121:53:481
984199604,49cyclictest0-21swapper/120:23:591
984199604,49cyclictest0-21swapper/120:23:591
984199604,48cyclictest0-21swapper/121:43:581
984199604,48cyclictest0-21swapper/121:43:581
984199604,39cyclictest0-21swapper/119:29:091
984199603,51cyclictest0-21swapper/120:31:431
984199593,49cyclictest31006-21fschecks_time19:38:521
984299584,46cyclictest0-21swapper/219:48:502
984299584,46cyclictest0-21swapper/219:48:502
9842995838,12cyclictest0-21swapper/222:03:542
9842995837,13cyclictest0-21swapper/219:11:202
984299582,50cyclictest0-21swapper/221:33:422
984199584,47cyclictest0-21swapper/121:38:411
30102583,9sleep10-21swapper/121:20:241
248599580,7rtkit-daemon0-21swapper/019:24:441
15572583,47sleep21559-21ssh20:30:462
984399574,36cyclictest0-21swapper/321:06:493
984399574,36cyclictest0-21swapper/321:06:493
984299574,46cyclictest0-21swapper/221:38:572
9842995739,12cyclictest0-21swapper/222:09:022
9842995738,13cyclictest0-21swapper/219:23:492
984299572,50cyclictest0-21swapper/220:55:132
984299572,50cyclictest0-21swapper/220:45:092
984299572,49cyclictest0-21swapper/220:05:282
984199574,48cyclictest0-21swapper/122:15:091
984199574,47cyclictest0-21swapper/119:54:001
984199574,46cyclictest30909-21wc21:13:571
984199574,36cyclictest0-21swapper/119:58:381
984199574,24cyclictest26872-21munin-node19:34:031
984199573,36cyclictest0-21swapper/119:52:221
984199573,36cyclictest0-21swapper/119:52:221
9839995737,13cyclictest0-21swapper/020:38:460
90392573,12sleep20-21swapper/221:29:042
56662573,11sleep10-21swapper/117:54:121
220822572,48sleep00-21swapper/021:48:540
131462572,9sleep30-21swapper/318:10:553
9842995622,13cyclictest0-21swapper/221:58:512
984299562,49cyclictest0-21swapper/220:21:182
984299562,48cyclictest0-21swapper/219:17:482
983999564,46cyclictest0-21swapper/018:44:110
9842995538,11cyclictest0-21swapper/219:07:482
9842995538,11cyclictest0-21swapper/219:07:482
984299553,44cyclictest0-21swapper/221:13:482
984299552,48cyclictest0-21swapper/221:02:122
984299552,48cyclictest0-21swapper/220:09:032
984199554,45cyclictest0-21swapper/121:34:221
984199554,45cyclictest0-21swapper/120:33:471
984199552,48cyclictest0-21swapper/118:51:341
983999554,43cyclictest0-21swapper/019:03:550
983999554,43cyclictest0-21swapper/019:03:550
984399545,41cyclictest0-21swapper/320:44:003
984399544,23cyclictest0-21swapper/320:49:273
984299545,41cyclictest0-21swapper/217:23:402
9842995436,12cyclictest0-21swapper/218:53:542
984299543,45cyclictest0-21swapper/219:33:452
9839995438,10cyclictest613-21grep18:53:500
983999543,45cyclictest0-21swapper/021:38:500
984399534,41cyclictest19381-21munin-run17:18:403
984399534,28cyclictest0-21swapper/318:53:373
9843995336,10cyclictest17110-21grep19:18:493
984299535,27cyclictest0-21swapper/219:02:552
984299534,26cyclictest0-21swapper/221:09:252
984299533,43cyclictest0-21swapper/219:18:492
984299532,47cyclictest0-21swapper/222:21:152
984299532,46cyclictest0-21swapper/220:40:192
9841995334,10cyclictest7029-21cut17:58:551
984199532,46cyclictest0-21swapper/118:14:091
983999538,15cyclictest0-21swapper/019:45:140
983999538,15cyclictest0-21swapper/019:45:140
983999534,43cyclictest16545-21tr20:53:440
983999534,36cyclictest0-21swapper/020:12:150
983999534,30cyclictest0-21swapper/022:27:550
983999534,30cyclictest0-21swapper/022:27:550
983999533,43cyclictest2583-21diskmemload21:13:300
983999533,17cyclictest0-21swapper/021:44:050
983999533,17cyclictest0-21swapper/021:44:050
297422533,43sleep20-21swapper/217:38:572
297422533,43sleep20-21swapper/217:38:572
181822533,43sleep118242-21iostat17:14:011
138102532,9sleep00-21swapper/021:37:530
984399529,25cyclictest0-21swapper/321:03:253
984399525,28cyclictest0-21swapper/320:53:563
984399523,32cyclictest2583-21diskmemload19:00:363
9843995222,13cyclictest0-21swapper/317:45:383
9843995220,13cyclictest0-21swapper/318:44:103
984299524,41cyclictest0-21swapper/221:48:502
984299524,40cyclictest0-21swapper/218:48:472
984299524,40cyclictest0-21swapper/218:29:082
984299524,30cyclictest0-21swapper/219:38:502
984299524,28cyclictest0-21swapper/221:03:432
984299524,28cyclictest0-21swapper/221:03:432
984299522,44cyclictest0-21swapper/220:23:362
984299522,44cyclictest0-21swapper/220:23:362
983999524,43cyclictest0-21swapper/019:28:410
983999524,42cyclictest0-21swapper/021:21:110
9839995231,13cyclictest0-21swapper/021:54:060
983999523,44cyclictest0-21swapper/022:00:530
215692522,9sleep30-21swapper/317:21:133
115742522,44sleep00-21swapper/022:21:430
984399515,27cyclictest25658-21aten_r1power_po18:38:473
984399514,27cyclictest0-21swapper/317:23:503
9843995130,14cyclictest0-21swapper/319:11:463
9843995120,12cyclictest0-21swapper/317:58:503
984299518,24cyclictest23207-21aten2.4-expect18:33:492
984299514,40cyclictest0-21swapper/218:04:012
984299514,40cyclictest0-21swapper/217:08:412
984299514,29cyclictest0-21swapper/218:44:112
984299514,28cyclictest0-21swapper/218:14:302
984299514,28cyclictest0-21swapper/217:59:012
9842995128,10cyclictest0-21swapper/218:23:552
9842995128,10cyclictest0-21swapper/218:23:552
9842995119,14cyclictest0-21swapper/220:49:372
984199514,30cyclictest0-21swapper/117:28:411
983999515,40cyclictest0-21swapper/021:28:300
983999514,41cyclictest0-21swapper/019:39:020
983999514,12cyclictest0-21swapper/019:49:000
983999514,12cyclictest0-21swapper/019:49:000
983999513,42cyclictest0-21swapper/022:13:070
983999513,36cyclictest0-21swapper/019:03:300
7372512,43sleep00-21swapper/022:04:420
214842512,9sleep00-21swapper/020:59:110
147792512,7sleep014783-21ssh20:49:230
107672512,42sleep00-21swapper/018:06:040
984399504,28cyclictest0-21swapper/319:13:593
984399504,28cyclictest0-21swapper/317:29:083
984399504,27cyclictest0-21swapper/318:33:383
984299504,39cyclictest0-21swapper/218:19:022
984299504,39cyclictest0-21swapper/217:35:242
984299504,28cyclictest0-21swapper/217:53:572
984299504,27cyclictest0-21swapper/217:29:032
984299503,27cyclictest0-21swapper/216:59:092
984199504,30cyclictest0-21swapper/118:39:031
983999504,41cyclictest0-21swapper/020:25:560
983999504,41cyclictest0-21swapper/020:25:560
9839995030,13cyclictest0-21swapper/020:03:440
9839995022,13cyclictest0-21swapper/019:23:490
9839995021,12cyclictest0-21swapper/022:16:470
9839995020,12cyclictest0-21swapper/017:24:020
9839995013,31cyclictest11527-21grep19:09:080
85072502,42sleep00-21swapper/018:02:460
268772502,10sleep00-21swapper/020:19:240
193152502,9sleep20-21swapper/217:17:572
984399495,21cyclictest8935-21aten2.4-expect18:03:503
984399494,29cyclictest0-21swapper/317:39:103
984399494,29cyclictest0-21swapper/317:39:103
984399494,28cyclictest0-21swapper/318:23:593
984399494,28cyclictest0-21swapper/318:23:593
9843994932,11cyclictest16855-21gltestperf18:18:563
9843994930,11cyclictest4363-21tr17:53:533
9843994922,10cyclictest20389-21cpuspeed19:23:473
9843994921,12cyclictest0-21swapper/316:59:093
984299494,28cyclictest0-21swapper/217:48:502
984299494,28cyclictest0-21swapper/217:09:092
9842994918,13cyclictest0-21swapper/218:09:072
984199493,26cyclictest0-21swapper/118:28:381
984199493,26cyclictest0-21swapper/118:28:381
983999494,12cyclictest0-21swapper/019:53:530
983999493,40cyclictest0-21swapper/021:06:570
983999493,40cyclictest0-21swapper/021:06:570
9839994929,14cyclictest0-21swapper/021:33:300
9839994922,12cyclictest0-21swapper/018:53:310
9839994911,11cyclictest0-21swapper/019:58:480
228102492,41sleep00-21swapper/018:32:200
157702492,41sleep00-21swapper/019:16:180
984399484,27cyclictest0-21swapper/318:38:383
984299485,27cyclictest0-21swapper/217:25:342
984299483,38cyclictest0-21swapper/217:44:022
984199485,28cyclictest0-21swapper/118:33:331
983999485,38cyclictest12-21rcu_preempt19:34:380
983999484,9cyclictest18624-21munin-node19:19:120
983999484,25cyclictest0-21swapper/020:15:190
983999484,12cyclictest0-21swapper/020:28:470
9839994832,9cyclictest30014-21grep17:38:590
9839994832,9cyclictest30014-21grep17:38:590
192982482,39sleep00-21swapper/017:17:430
984299474,26cyclictest0-21swapper/218:40:472
984199474,28cyclictest0-21swapper/117:50:391
984199473,26cyclictest0-21swapper/118:19:061
983999474,37cyclictest0-21swapper/020:37:260
9839994730,10cyclictest24704-21cpuspeed_turbos17:28:520
983999473,39cyclictest0-21swapper/021:14:190
9839994728,13cyclictest0-21swapper/018:39:020
181252472,40sleep00-21swapper/018:23:300
984399464,26cyclictest0-21swapper/318:15:433
9843994632,8cyclictest1828-21chrt17:48:533
9843994617,12cyclictest0-21swapper/317:34:103
9839994630,10cyclictest20147-21df17:18:550
983999463,26cyclictest0-21swapper/017:49:150
287972462,9sleep00-21swapper/017:37:100
167102462,9sleep00-21swapper/017:10:050
145212462,38sleep00-21swapper/017:07:470
983999455,25cyclictest0-21swapper/018:09:020
250332452,38sleep00-21swapper/018:35:150
124392452,35sleep30-21swapper/317:03:513
9843994427,11cyclictest1453-21missed_timers18:54:003
9839994427,12cyclictest0-21swapper/018:27:540
9839994427,12cyclictest0-21swapper/018:27:540
9839994417,10cyclictest13652-21aten_r1power_en18:13:490
983999434,33cyclictest0-21swapper/017:53:550
96242434,6sleep00-21swapper/016:56:190
984399417,21cyclictest0-21swapper/316:58:423
984199384,14cyclictest0-21swapper/116:58:421
984299372,29cyclictest0-21swapper/216:58:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional