You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 14:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Apr 24, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
442399280,27cyclictest0-21swapper/200:21:152
442399280,1cyclictest8880-21latency_hist00:30:012
442399270,0cyclictest30073-21diskmemload22:37:242
442399270,0cyclictest30073-21diskmemload00:08:152
441499270,24cyclictest0-21swapper/023:37:220
442399260,21cyclictest0-21swapper/223:40:222
4414992620,5cyclictest8881-21turbostat.cron00:30:010
441499260,23cyclictest10387-21ssh23:26:560
4425992523,1cyclictest10795-21apachectl00:00:003
4425992522,2cyclictest1201-21sh20:10:003
442599250,2cyclictest3931-21ssh23:52:253
442599250,24cyclictest13374-21timedrift21:55:323
4423992520,4cyclictest0-21swapper/221:22:082
442399250,24cyclictest0-21swapper/222:29:512
442399250,21cyclictest30073-21diskmemload21:17:432
442399250,21cyclictest0-21swapper/221:49:452
442399250,0cyclictest0-21swapper/223:56:112
441899250,24cyclictest0-21swapper/122:16:341
4414992524,1cyclictest0-21swapper/022:49:580
4414992520,4cyclictest2326-21ssh00:22:400
4414992520,4cyclictest17951-21ssh23:03:460
441499250,24cyclictest31756-21ssh23:48:180
441499250,21cyclictest9051-21ssh21:51:170
441499250,21cyclictest0-21swapper/021:19:110
441499250,1cyclictest25120-21ssh22:06:470
441499250,1cyclictest10567-21apt-get22:25:230
441499250,0cyclictest0-21swapper/023:10:000
4425992422,1cyclictest15613-21ls20:40:003
442599240,23cyclictest19070-21perf00:40:003
442599240,23cyclictest0-21swapper/323:47:363
442599240,23cyclictest0-21swapper/321:28:253
442599240,1cyclictest30073-21diskmemload21:48:443
4423992422,1cyclictest0-21swapper/200:30:352
4423992420,4cyclictest0-21swapper/223:17:412
4423992420,3cyclictest0-21swapper/221:39:022
4423992420,3cyclictest0-21swapper/221:28:332
442399240,23cyclictest14267-21apt-get19:30:232
442399240,23cyclictest0-21swapper/223:53:102
442399240,23cyclictest0-21swapper/222:57:442
442399240,1cyclictest0-21swapper/221:59:592
442399240,0cyclictest0-21swapper/222:02:102
442399240,0cyclictest0-21swapper/200:10:212
4418992422,1cyclictest19438-21ssh23:35:311
441899240,23cyclictest31495-21kernelversion21:10:281
441899240,23cyclictest10650-21rm23:27:211
4414992421,3cyclictest0-21swapper/023:12:540
4414992420,4cyclictest0-21swapper/021:45:020
4414992420,3cyclictest30073-21diskmemload00:37:520
441499240,0cyclictest30073-21diskmemload21:31:260
441499240,0cyclictest0-21swapper/000:11:160
4425992323,0cyclictest30073-21diskmemload00:10:303
4425992323,0cyclictest0-21swapper/322:39:453
4425992323,0cyclictest0-21swapper/322:02:063
4425992323,0cyclictest0-21swapper/321:50:593
4425992323,0cyclictest0-21swapper/300:00:193
4425992322,1cyclictest30073-21diskmemload21:20:303
4425992321,1cyclictest4957-21systemctl22:20:003
4425992321,1cyclictest19490-21if_err_eno121:30:273
4425992321,1cyclictest0-21swapper/322:40:573
4425992321,1cyclictest0-21swapper/321:41:123
442599230,2cyclictest30073-21diskmemload21:13:163
442599230,23cyclictest0-21swapper/323:34:313
442599230,23cyclictest0-21swapper/323:34:313
442599230,22cyclictest4451-21grep22:50:263
442599230,22cyclictest31747-21diskmemload23:16:153
442599230,22cyclictest2165-21latency_hist23:20:013
442599230,22cyclictest16355-21cron19:35:013
442599230,1cyclictest5513-21sh22:20:243
442599230,0cyclictest30073-21diskmemload23:27:543
4423992323,0cyclictest30073-21diskmemload22:15:312
4423992323,0cyclictest0-21swapper/222:11:322
4423992323,0cyclictest0-21swapper/200:00:372
4423992321,2cyclictest32306-21ssh21:10:332
4423992320,3cyclictest0-21swapper/223:20:532
4423992320,3cyclictest0-21swapper/223:11:222
4423992318,4cyclictest0-21swapper/223:45:272
442399230,23cyclictest0-21swapper/222:06:422
442399230,23cyclictest0-21swapper/221:33:352
442399230,22cyclictest30073-21diskmemload23:07:302
442399230,22cyclictest0-21swapper/222:40:392
442399230,22cyclictest0-21swapper/222:33:092
442399230,0cyclictest0-21swapper/223:25:102
442399230,0cyclictest0-21swapper/222:53:082
4418992323,0cyclictest0-21swapper/123:50:421
4418992323,0cyclictest0-21swapper/123:11:461
4418992323,0cyclictest0-21swapper/122:50:371
4418992323,0cyclictest0-21swapper/121:46:291
4418992321,1cyclictest24863-21rm22:06:161
4418992321,1cyclictest0-21swapper/123:21:241
4418992321,1cyclictest0-21swapper/100:12:501
441899230,2cyclictest28234-21ssh22:10:281
441899230,23cyclictest30073-21diskmemload22:48:481
441899230,23cyclictest0-21swapper/122:39:321
441899230,23cyclictest0-21swapper/100:30:401
441899230,23cyclictest0-21swapper/100:21:091
441899230,22cyclictest30688-21ssh00:19:321
441899230,22cyclictest30073-21diskmemload00:28:291
441899230,22cyclictest26655-21dpkg19:55:021
441899230,22cyclictest21142-21ssh23:05:421
441899230,22cyclictest19785-21ssh22:01:291
441899230,22cyclictest0-21swapper/123:55:251
441899230,22cyclictest0-21swapper/122:30:301
441899230,22cyclictest0-21swapper/121:35:481
441899230,22cyclictest0-21swapper/100:40:001
441899230,0cyclictest0-21swapper/123:42:031
441899230,0cyclictest0-21swapper/121:33:461
4414992323,0cyclictest30073-21diskmemload00:34:310
4414992323,0cyclictest0-21swapper/022:17:190
4414992322,1cyclictest0-21swapper/021:12:420
4414992321,2cyclictest0-21swapper/022:57:480
4414992320,3cyclictest0-21swapper/000:08:150
4414992320,2cyclictest0-21swapper/021:39:100
4414992319,4cyclictest0-21swapper/022:37:240
4414992319,3cyclictest0-21swapper/021:56:010
4414992318,4cyclictest0-21swapper/022:50:250
441499231,21cyclictest3591-21cron20:15:010
441499230,23cyclictest0-21swapper/023:56:230
441499230,23cyclictest0-21swapper/023:30:050
441499230,23cyclictest0-21swapper/023:30:050
441499230,22cyclictest882-21ssh21:44:400
441499230,22cyclictest26251-21ssh00:15:020
441499230,1cyclictest62550irq/127-eno122:00:260
441499230,0cyclictest0-21swapper/023:20:550
4425992222,0cyclictest0-21swapper/322:26:093
4425992222,0cyclictest0-21swapper/300:16:013
4425992220,1cyclictest6040-21perf20:20:013
4425992220,1cyclictest15899-21ssh23:00:333
4425992220,1cyclictest0-21swapper/300:30:293
442599220,22cyclictest0-21swapper/322:57:503
442599220,21cyclictest26046-21cat19:55:003
442599220,21cyclictest19695-21sh22:33:573
442599220,21cyclictest0-21swapper/323:40:213
442599220,21cyclictest0-21swapper/323:10:233
442599220,21cyclictest0-21swapper/323:05:403
442599220,21cyclictest0-21swapper/322:10:153
442599220,21cyclictest0-21swapper/321:35:243
442599220,21cyclictest0-21swapper/320:00:233
442599220,1cyclictest7991-21awk21:20:013
442599220,1cyclictest30073-21diskmemload22:48:133
442599220,1cyclictest0-21swapper/300:29:123
442599220,0cyclictest0-21swapper/322:06:023
442599220,0cyclictest0-21swapper/300:21:313
4423992222,0cyclictest0-21swapper/220:20:242
4423992221,1cyclictest0-21swapper/222:46:182
4423992221,1cyclictest0-21swapper/219:55:222
4423992221,0cyclictest0-21swapper/223:03:082
4423992218,3cyclictest0-21swapper/222:20:342
442399220,21cyclictest0-21swapper/223:35:232
442399220,21cyclictest0-21swapper/223:30:242
442399220,21cyclictest0-21swapper/223:30:242
442399220,1cyclictest6464-21sh21:50:012
442399220,1cyclictest0-21swapper/200:16:272
4418992222,0cyclictest0-21swapper/123:31:091
4418992222,0cyclictest0-21swapper/123:31:091
4418992222,0cyclictest0-21swapper/122:58:001
4418992222,0cyclictest0-21swapper/121:51:081
4418992220,1cyclictest10836-21perf20:30:011
4418992220,1cyclictest0-21swapper/122:40:541
4418992220,1cyclictest0-21swapper/122:21:541
4418992220,1cyclictest0-21swapper/119:15:001
441899220,22cyclictest30073-21diskmemload23:17:441
441899220,22cyclictest16958-21sh23:02:081
441899220,22cyclictest0-21swapper/121:15:431
441899220,21cyclictest9174-21idleruntime-cro19:20:001
441899220,21cyclictest8435-21sh20:25:011
441899220,21cyclictest13568-21apt-get21:25:251
441899220,21cyclictest0-21swapper/123:46:131
441899220,21cyclictest0-21swapper/121:55:311
441899220,21cyclictest0-21swapper/121:40:301
441899220,21cyclictest0-21swapper/100:02:191
441899220,1cyclictest0-21swapper/122:25:231
4414992222,0cyclictest30073-21diskmemload21:26:170
4414992222,0cyclictest0-21swapper/023:50:400
4414992222,0cyclictest0-21swapper/022:42:580
4414992222,0cyclictest0-21swapper/022:23:590
4414992221,1cyclictest774-21runrttasks23:15:120
4414992221,1cyclictest30073-21diskmemload21:22:040
441499220,22cyclictest0-21swapper/022:30:240
441499220,21cyclictest6050-21munin-run20:20:010
441499220,20cyclictest0-21swapper/022:11:170
441499220,1cyclictest0-21swapper/021:10:010
4425992119,1cyclictest21474-21apt-get19:45:233
442599210,21cyclictest0-21swapper/320:40:233
442599210,21cyclictest0-21swapper/300:05:243
4423992121,0cyclictest0-21swapper/200:35:502
4423992120,1cyclictest19078-21apt-get19:40:222
4423992120,0cyclictest0-21swapper/219:20:232
4423992118,3cyclictest0-21swapper/221:40:582
442399210,0cyclictest0-21swapper/219:25:222
4418992121,0cyclictest27981-21apt-get21:05:231
4418992121,0cyclictest0-21swapper/120:15:241
4418992120,1cyclictest23922-21apt-get19:50:231
441899210,21cyclictest0-21swapper/100:05:111
441899210,20cyclictest18326-21apt-get20:45:231
441899210,0cyclictest0-21swapper/120:55:231
441899210,0cyclictest0-21swapper/119:40:221
441899210,0cyclictest0-21swapper/119:30:231
4414992119,2cyclictest23117-21apt-get20:55:230
4425992020,0cyclictest0-21swapper/320:25:223
4425992019,1cyclictest0-21swapper/321:00:243
4425992018,1cyclictest28845-21perf20:00:003
442599201,2cyclictest0-21swapper/320:30:233
442599200,0cyclictest0-21swapper/319:10:233
4423992019,1cyclictest31525-21apt-get20:05:232
4423992018,1cyclictest18791-21latency_hist19:40:012
442399200,0cyclictest0-21swapper/220:10:232
4418992020,0cyclictest9478-21apt-get19:20:231
4418992018,1cyclictest31252-21munin-plugin-st20:05:001
4418992018,1cyclictest25586-21apt-get21:00:241
4414992020,0cyclictest0-21swapper/019:45:230
4414992020,0cyclictest0-21swapper/019:30:230
4425991919,0cyclictest0-21swapper/320:45:233
4423991919,0cyclictest0-21swapper/219:50:232
4418991919,0cyclictest0-21swapper/120:50:231
4418991919,0cyclictest0-21swapper/120:05:231
4414991919,0cyclictest0-21swapper/020:45:230
4414991919,0cyclictest0-21swapper/020:35:220
4414991919,0cyclictest0-21swapper/020:20:230
4414991918,1cyclictest19078-21apt-get19:40:220
4414991918,0cyclictest0-21swapper/019:25:220
4425991818,0cyclictest0-21swapper/320:20:233
4425991818,0cyclictest0-21swapper/319:20:233
4423991818,0cyclictest7057-21apt-get19:15:212
4423991818,0cyclictest0-21swapper/221:00:242
4423991818,0cyclictest0-21swapper/220:35:222
4418991818,0cyclictest0-21swapper/119:45:231
4418991818,0cyclictest0-21swapper/119:35:231
4418991816,1cyclictest11869-21apt-get19:25:221
4414991816,1cyclictest313-21systemd-journal21:05:010
441499180,18cyclictest0-21swapper/019:20:230
4425991717,0cyclictest0-21swapper/320:50:233
4423991716,1cyclictest4664-21apt-get19:10:232
4414991717,0cyclictest0-21swapper/020:30:010
4414991717,0cyclictest0-21swapper/020:05:240
4414991716,1cyclictest0-21swapper/019:55:220
441499170,5cyclictest0-21swapper/019:10:230
4425991616,0cyclictest0-21swapper/319:15:213
4425991614,1cyclictest0-21swapper/319:25:293
4423991616,0cyclictest0-21swapper/220:35:012
4423991615,1cyclictest0-21swapper/220:45:232
442399160,16cyclictest0-21swapper/220:58:362
442399160,16cyclictest0-21swapper/219:47:452
442399160,0cyclictest0-21swapper/220:18:352
4414991615,1cyclictest0-21swapper/019:50:230
441499161,4cyclictest22352-21sed20:50:320
441499160,14cyclictest0-21swapper/020:40:090
441499160,0cyclictest0-21swapper/020:30:560
4425991515,0cyclictest0-21swapper/320:10:233
442599150,1cyclictest25302-21perf21:00:003
4423991515,0cyclictest0-21swapper/220:25:222
4423991511,4cyclictest0-21swapper/220:00:222
4414991514,1cyclictest0-21swapper/020:01:360
4414991513,1cyclictest18786-21ls19:40:010
4425991414,0cyclictest0-21swapper/321:05:453
442599140,5cyclictest0-21swapper/319:35:233
442599140,14cyclictest0-21swapper/319:40:433
442399140,14cyclictest0-21swapper/220:40:142
442399140,0cyclictest0-21swapper/220:50:252
4418991414,0cyclictest0-21swapper/120:40:111
441899140,0cyclictest0-21swapper/120:35:281
441899140,0cyclictest0-21swapper/120:30:381
441499140,0cyclictest0-21swapper/019:15:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional