You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 13:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun May 31, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1674421280,5sleep116743-21sed10:43:041
21780991103,12cyclictest0-21swapper/009:27:480
21787991015,30cyclictest1227-21runrttasks09:32:132
2178799975,39cyclictest0-21swapper/212:12:442
2178099963,57cyclictest0-21swapper/011:46:040
21780999539,12cyclictest0-21swapper/009:47:330
2178799943,27cyclictest23159-21ssh09:18:022
21787999334,52cyclictest0-21swapper/209:49:052
21787999330,11cyclictest24953-21ssh10:07:562
2178899925,70cyclictest0-21swapper/309:12:353
2178899925,70cyclictest0-21swapper/309:12:353
2178899924,11cyclictest0-21swapper/311:12:383
2178899924,11cyclictest0-21swapper/311:12:383
2178799924,25cyclictest4827-21rm11:13:032
2178799924,25cyclictest4827-21rm11:13:032
2178899914,55cyclictest0-21swapper/311:00:363
21787999129,10cyclictest14504-21diskmemload10:52:502
21787999122,9cyclictest7328-21rm12:06:382
21787999117,11cyclictest30794-21ssh11:52:472
21787999117,11cyclictest30794-21ssh11:52:472
2178899908,64cyclictest19848-21aten_r1power_cu11:37:383
2178899903,11cyclictest0-21swapper/312:01:083
2178799904,25cyclictest14504-21diskmemload11:27:302
21787999035,49cyclictest0-21swapper/211:43:152
21787999015,11cyclictest0-21swapper/210:13:532
2178799894,39cyclictest0-21swapper/211:37:582
2178799894,27cyclictest0-21swapper/211:12:102
2178799894,25cyclictest0-21swapper/210:34:542
2178799894,25cyclictest0-21swapper/210:34:542
2178799894,24cyclictest0-21swapper/210:18:272
2178799894,15cyclictest0-21swapper/210:37:492
2178799894,13cyclictest0-21swapper/212:27:562
21787998931,13cyclictest0-21swapper/209:22:502
2178799893,21cyclictest0-21swapper/212:00:162
21787998918,12cyclictest0-21swapper/210:48:332
2178899883,12cyclictest0-21swapper/309:37:563
2178799886,13cyclictest0-21swapper/211:07:302
2178799884,40cyclictest0-21swapper/209:37:442
2178799884,28cyclictest0-21swapper/209:52:432
2178799884,28cyclictest0-21swapper/209:52:432
2178799884,27cyclictest0-21swapper/210:06:102
2178799883,23cyclictest0-21swapper/212:32:342
2178799883,23cyclictest0-21swapper/212:32:342
21787998827,14cyclictest0-21swapper/210:42:512
21787998822,13cyclictest0-21swapper/211:33:062
2178899874,12cyclictest0-21swapper/309:57:503
2178899874,11cyclictest0-21swapper/310:57:063
2178799875,27cyclictest0-21swapper/209:43:322
2178799874,28cyclictest0-21swapper/207:38:122
2178799874,25cyclictest0-21swapper/210:26:322
2178799874,24cyclictest1227-21runrttasks10:57:342
2178799874,24cyclictest0-21swapper/212:22:402
2178799874,13cyclictest0-21swapper/212:07:392
21787998731,10cyclictest32455-21latency_hist08:37:362
21787998730,14cyclictest0-21swapper/209:32:482
21787998718,14cyclictest0-21swapper/207:57:552
21787998716,13cyclictest0-21swapper/211:27:502
21787998713,12cyclictest0-21swapper/211:17:502
2178899864,10cyclictest0-21swapper/310:12:213
2178899863,12cyclictest0-21swapper/311:43:303
2178799865,15cyclictest0-21swapper/209:12:492
2178799865,13cyclictest0-21swapper/212:17:472
2178799864,30cyclictest16709-21ssh09:08:262
2178799864,30cyclictest16709-21ssh09:08:262
2178799864,10cyclictest16917-21munin-node09:57:572
2178899856,72cyclictest0-21swapper/309:35:213
2178899853,12cyclictest0-21swapper/312:04:043
2178899853,11cyclictest0-21swapper/311:52:583
2178899853,11cyclictest0-21swapper/311:52:583
2178899853,11cyclictest0-21swapper/310:25:293
21787998521,9cyclictest23401-21kworker/2:110:27:562
2178899847,52cyclictest0-21swapper/309:30:453
2178899844,12cyclictest0-21swapper/311:48:013
2178899844,12cyclictest0-21swapper/311:23:453
2178899844,12cyclictest0-21swapper/307:22:393
2178899843,12cyclictest0-21swapper/311:11:173
2178899843,11cyclictest0-21swapper/310:33:323
2178899843,11cyclictest0-21swapper/310:33:323
21788998414,47cyclictest9156-21ssh11:21:273
21788998413,43cyclictest99471munin-node08:58:043
2178799847,12cyclictest0-21swapper/208:38:092
2178799844,12cyclictest0-21swapper/211:47:412
21787998424,13cyclictest0-21swapper/207:49:022
21787998423,9cyclictest24447-21telnet07:12:502
2178899834,12cyclictest0-21swapper/308:12:373
2178899833,12cyclictest0-21swapper/311:31:173
2178899833,12cyclictest0-21swapper/310:44:023
2178899833,12cyclictest0-21swapper/310:38:353
2178899833,12cyclictest0-21swapper/309:24:253
2178899833,11cyclictest0-21swapper/310:15:263
2178799835,33cyclictest0-21swapper/207:52:492
2178799835,28cyclictest0-21swapper/209:02:052
2178799835,15cyclictest0-21swapper/208:42:562
2178799834,34cyclictest0-21swapper/208:03:012
2178799834,29cyclictest0-21swapper/208:28:052
2178799834,29cyclictest0-21swapper/208:28:052
2178799834,24cyclictest0-21swapper/207:32:502
219499820,5rtkit-daemon2193-21rtkit-daemon11:56:361
219499820,5rtkit-daemon2193-21rtkit-daemon11:56:361
2178899829,53cyclictest107550irq/46-eth012:07:433
2178899828,62cyclictest0-21swapper/309:48:353
2178899824,8cyclictest1227-21runrttasks08:32:483
2178899824,12cyclictest0-21swapper/308:07:373
2178899824,11cyclictest0-21swapper/309:14:143
2178899823,8cyclictest24315-21taskset09:20:113
2178899823,12cyclictest0-21swapper/307:13:023
2178899823,11cyclictest0-21swapper/312:29:373
2178899823,11cyclictest0-21swapper/309:52:423
2178899823,11cyclictest0-21swapper/309:52:423
21788998214,47cyclictest1124-21snmpd07:41:473
2178799824,32cyclictest0-21swapper/208:47:492
2178799824,15cyclictest1227-21runrttasks07:11:112
2178799823,12cyclictest27696-21basename08:27:362
2178899814,60cyclictest0-21swapper/309:47:123
2178899814,12cyclictest0-21swapper/310:02:513
2178899813,12cyclictest0-21swapper/312:32:403
2178899813,12cyclictest0-21swapper/312:32:403
2178899813,11cyclictest0-21swapper/311:33:283
2178899813,11cyclictest0-21swapper/309:07:343
2178799815,15cyclictest0-21swapper/207:17:552
2178799814,16cyclictest0-21swapper/208:12:482
21787998112,13cyclictest0-21swapper/207:22:512
2178899804,56cyclictest0-21swapper/307:08:063
2178899803,9cyclictest5499-21cpuspeed_turbos08:47:493
21788998018,39cyclictest29083-21df_inode11:02:463
21788998014,44cyclictest0-21swapper/310:30:153
21787998016,12cyclictest0-21swapper/207:27:502
2178899798,64cyclictest0-21swapper/308:23:093
2178899793,11cyclictest0-21swapper/312:21:343
2178899793,10cyclictest0-21swapper/312:23:123
21787997919,10cyclictest7169-21grep07:42:572
21787997919,10cyclictest7169-21grep07:42:572
2178899784,11cyclictest0-21swapper/310:21:513
2178899783,9cyclictest19263-21which10:47:513
2178899783,9cyclictest15069-21switchtime07:58:093
2178899773,8cyclictest12754-21switchtime12:12:583
2178899763,11cyclictest0-21swapper/307:27:033
21787997627,13cyclictest0-21swapper/208:52:552
2178899753,57cyclictest12880-21sshd07:53:113
2178899753,11cyclictest0-21swapper/307:52:223
2178899736,58cyclictest0-21swapper/307:33:323
2178899733,52cyclictest22911-21idleruntime-cro08:17:363
2178899733,51cyclictest32317-21grep07:27:563
2178899724,12cyclictest0-21swapper/308:57:353
2178899724,11cyclictest0-21swapper/308:37:473
2178899717,56cyclictest0-21swapper/308:42:533
21788997018,46cyclictest7274-21gltestperf07:42:583
21788997018,46cyclictest7274-21gltestperf07:42:583
2178099704,15cyclictest0-21swapper/010:38:070
219499680,5rtkit-daemon2193-21rtkit-daemon07:07:390
2178899685,56cyclictest0-21swapper/308:27:513
2178899685,56cyclictest0-21swapper/308:27:513
21788996818,43cyclictest24899-21unixbench_singl08:18:093
2178799684,17cyclictest0-21swapper/208:11:102
2178699664,55cyclictest3139-21systemd-cgroups09:37:331
21780996616,11cyclictest0-21swapper/011:52:490
21780996616,11cyclictest0-21swapper/011:52:490
2178899654,12cyclictest0-21swapper/307:07:393
62472644,52sleep00-21swapper/009:41:410
219499640,5rtkit-daemon2193-21rtkit-daemon11:42:290
2178099644,13cyclictest0-21swapper/009:58:070
2178699635,52cyclictest0-21swapper/112:27:491
2178699635,52cyclictest0-21swapper/109:27:571
2178699634,52cyclictest31782-21ntp_offset10:17:591
2178699626,49cyclictest1124-21snmpd10:57:281
2178699625,49cyclictest11210-21iostat_ios09:47:541
2178699625,49cyclictest0-21swapper/109:42:331
2178699624,51cyclictest32627-21fschecks_time11:07:481
2178699624,51cyclictest0-21swapper/110:07:471
2178699624,50cyclictest6875-21aten_r1power_po09:42:451
205472627,10sleep00-21swapper/012:25:350
81412610,5sleep118-21rcuc/107:43:121
81412610,5sleep118-21rcuc/107:43:121
2178699616,48cyclictest0-21swapper/109:22:521
2178699615,49cyclictest27982-21kworker/1:111:30:271
2178699615,49cyclictest0-21swapper/111:33:591
2178699615,49cyclictest0-21swapper/111:02:291
2178699615,49cyclictest0-21swapper/109:59:121
2178699615,49cyclictest0-21swapper/109:09:041
2178699615,49cyclictest0-21swapper/109:09:041
2178699615,49cyclictest0-21swapper/108:48:051
2178699615,48cyclictest29314-21perl11:02:491
2178699615,48cyclictest12639-21iostat_ios10:37:541
2178699614,50cyclictest9875-21sort10:33:041
2178699614,50cyclictest9875-21sort10:33:041
2178699614,50cyclictest0-21swapper/108:28:081
2178699614,50cyclictest0-21swapper/108:28:081
2178699614,50cyclictest0-21swapper/108:20:101
2178699614,49cyclictest23311-21python09:18:051
179632613,51sleep00-21swapper/010:47:110
2178699605,49cyclictest0-21swapper/112:36:481
2178699605,49cyclictest0-21swapper/112:36:481
2178699605,49cyclictest0-21swapper/112:13:491
2178099603,52cyclictest0-21swapper/012:02:000
85802593,49sleep00-21swapper/011:19:240
2178699595,47cyclictest20411-21diskstats11:37:441
2178699595,47cyclictest0-21swapper/109:53:001
2178699595,47cyclictest0-21swapper/109:53:001
2178699595,47cyclictest0-21swapper/108:57:471
2178699594,48cyclictest0-21swapper/110:31:521
21786995921,22cyclictest2929-21seq11:12:341
21786995921,22cyclictest2929-21seq11:12:341
21780995937,8cyclictest4297-21ssh11:12:560
21780995937,8cyclictest4297-21ssh11:12:560
2178099593,12cyclictest0-21swapper/012:17:400
21780995929,12cyclictest0-21swapper/012:28:010
21780995925,19cyclictest0-21swapper/008:47:470
2178699585,47cyclictest11972-21ssh11:24:251
2178699585,47cyclictest0-21swapper/112:00:561
2178699584,47cyclictest14685-21aten_r1power_po12:17:381
2178699584,46cyclictest0-21swapper/111:46:571
21786995817,23cyclictest20611-21cat10:02:471
2178099583,12cyclictest0-21swapper/010:27:540
21780995813,20cyclictest0-21swapper/010:52:430
2178699575,46cyclictest0-21swapper/109:16:581
2178699575,45cyclictest26322-21perl08:22:551
2178099578,9cyclictest25508-21unixbench_singl10:08:030
2178099574,12cyclictest0-21swapper/009:53:030
2178099574,12cyclictest0-21swapper/009:53:030
21780995734,9cyclictest10990-21gltestperf09:47:510
21780995732,8cyclictest20504-21ssh10:49:050
2178099573,49cyclictest0-21swapper/007:32:470
21780995727,14cyclictest0-21swapper/012:07:510
21780995725,12cyclictest0-21swapper/009:10:540
21780995725,12cyclictest0-21swapper/009:10:540
21780995719,23cyclictest19449-21latency08:07:590
21780995715,10cyclictest0-21swapper/010:36:220
21780995715,10cyclictest0-21swapper/010:36:220
2178699564,45cyclictest0-21swapper/107:28:041
2178099564,12cyclictest0-21swapper/009:23:000
2178099563,13cyclictest0-21swapper/011:04:160
2178099563,12cyclictest0-21swapper/010:02:450
2178099563,12cyclictest0-21swapper/009:18:030
21780995629,13cyclictest0-21swapper/008:32:510
21780995629,12cyclictest0-21swapper/010:22:540
21780995626,12cyclictest0-21swapper/011:27:330
21780995611,7cyclictest0-21swapper/010:13:050
21780995611,26cyclictest0-21swapper/012:32:500
21780995611,26cyclictest0-21swapper/012:32:500
132592563,37sleep10-21swapper/107:56:391
229612553,45sleep00-21swapper/007:08:010
219499550,6rtkit-daemon2193-21rtkit-daemon07:38:010
219499550,5rtkit-daemon2193-21rtkit-daemon11:08:000
219499550,5rtkit-daemon2193-21rtkit-daemon07:46:080
219499550,5rtkit-daemon2193-21rtkit-daemon07:46:080
2178699554,45cyclictest0-21swapper/112:04:331
2178699554,29cyclictest0-21swapper/110:12:521
21780995532,9cyclictest21616-21ssh09:17:350
2178099553,12cyclictest0-21swapper/011:32:570
219499540,5rtkit-daemon2193-21rtkit-daemon08:22:590
2178099543,11cyclictest0-21swapper/010:17:450
21780995427,13cyclictest0-21swapper/011:50:180
2178099542,11cyclictest0-21swapper/012:12:410
15112543,11sleep10-21swapper/107:32:491
219499530,5rtkit-daemon2193-21rtkit-daemon09:32:560
219499530,5rtkit-daemon2193-21rtkit-daemon09:02:570
219499530,5rtkit-daemon2193-21rtkit-daemon08:52:500
2178699536,30cyclictest0-21swapper/108:37:011
2178699533,44cyclictest0-21swapper/110:51:181
21786995317,30cyclictest9399-21switchtime12:07:591
2178099534,8cyclictest10097-21munin-node11:22:430
2178099533,36cyclictest0-21swapper/011:00:480
118982536,12sleep00-21swapper/008:59:500
219499520,5rtkit-daemon2193-21rtkit-daemon08:32:360
219499520,5rtkit-daemon2193-21rtkit-daemon08:32:360
2178699525,29cyclictest0-21swapper/107:27:381
2178699524,30cyclictest0-21swapper/109:03:071
2178699524,29cyclictest0-21swapper/107:48:061
2178699524,26cyclictest0-21swapper/108:47:351
2178699523,25cyclictest0-21swapper/108:03:031
2178699523,20cyclictest0-21swapper/112:22:381
21786995216,19cyclictest0-21swapper/110:23:261
2178099522,11cyclictest0-21swapper/007:18:050
219499510,5rtkit-daemon2193-21rtkit-daemon08:42:580
219499510,5rtkit-daemon2193-21rtkit-daemon07:15:390
2178699515,12cyclictest0-21swapper/111:19:411
2178699513,25cyclictest0-21swapper/107:57:501
2178099513,10cyclictest0-21swapper/007:23:250
24692503,11sleep10-21swapper/108:41:371
2178799504,28cyclictest0-21swapper/208:17:482
2178699504,26cyclictest0-21swapper/108:57:351
2178699503,10cyclictest0-21swapper/111:48:401
2178099502,11cyclictest0-21swapper/008:17:360
194092503,40sleep10-21swapper/108:08:001
179022503,41sleep00-21swapper/008:04:440
12092502,42sleep00-21swapper/007:31:510
225702493,10sleep10-21swapper/108:13:161
219499490,5rtkit-daemon2193-21rtkit-daemon08:37:510
2178699495,26cyclictest0-21swapper/107:16:431
2178699493,24cyclictest0-21swapper/107:38:021
21780994931,7cyclictest30037-21kworker/0:212:04:180
98192483,38sleep00-21swapper/007:47:590
21787994818,11cyclictest0-21swapper/209:02:462
2178699483,22cyclictest0-21swapper/107:18:051
21786994732,9cyclictest23678-21grep07:08:121
2178099474,13cyclictest0-21swapper/007:58:000
2178099463,27cyclictest0-21swapper/007:57:380
21780994619,11cyclictest0-21swapper/008:17:570
2178699434,14cyclictest0-21swapper/107:07:401
217072434,32sleep20-21swapper/207:07:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional