You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 10:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 24, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1863399280,22cyclictest29888-21munin-run20:40:001
1863399280,1cyclictest0-21swapper/123:03:481
18638992722,4cyclictest14724-21rm21:12:442
18633992723,4cyclictest12289-21diskmemload22:49:291
18633992721,5cyclictest22636-21ssh00:39:291
1863399270,2cyclictest19088-21ssh22:42:161
1863399270,22cyclictest15859-21ssh00:33:261
1863399270,22cyclictest10867-21taskset22:34:341
1863899260,2cyclictest9195-21sh23:02:132
1863899260,21cyclictest0-21swapper/222:12:572
1863899260,1cyclictest1378-21sshd21:28:092
18633992620,5cyclictest12289-21diskmemload22:08:141
1863399260,25cyclictest0-21swapper/100:12:591
1863399260,21cyclictest0-21swapper/121:12:381
1863399260,1cyclictest0-21swapper/122:55:251
1863399260,0cyclictest0-21swapper/121:52:581
18640992522,2cyclictest13079-21ntp_kernel_err22:08:023
1864099250,24cyclictest0-21swapper/300:06:343
18638992523,1cyclictest13652-21ssh21:39:302
18638992523,1cyclictest13652-21ssh21:39:302
18638992520,1cyclictest0-21swapper/222:49:472
18638992520,1cyclictest0-21swapper/221:20:412
18638992520,0cyclictest12289-21diskmemload22:08:032
18638992519,0cyclictest0-21swapper/222:52:582
1863899250,24cyclictest0-21swapper/200:09:262
1863899250,21cyclictest6733-21ssh22:31:172
1863899250,21cyclictest0-21swapper/221:49:462
1863899250,1cyclictest0-21swapper/223:48:222
1863899250,1cyclictest0-21swapper/223:43:552
1863899250,1cyclictest0-21swapper/221:34:342
1863899250,1cyclictest0-21swapper/200:11:272
18633992521,3cyclictest0-21swapper/122:39:341
18633992520,4cyclictest32504-21ssh23:51:261
18633992520,4cyclictest19332-21ssh23:10:101
18633992517,7cyclictest5711-21turbostat.cron00:25:001
1863399250,24cyclictest0-21swapper/123:42:181
1863399250,1cyclictest21927-21ssh22:16:151
1863399250,1cyclictest12289-21diskmemload23:31:571
1863399250,1cyclictest0-21swapper/123:06:511
1863399250,0cyclictest12289-21diskmemload00:28:101
1863099250,25cyclictest0-21swapper/023:35:020
1863099250,24cyclictest0-21swapper/021:58:550
18640992421,2cyclictest17269-21dump-pmu-power22:40:013
1864099240,23cyclictest23222-21rm22:17:573
1864099240,1cyclictest0-21swapper/321:42:353
18638992422,0cyclictest0-21swapper/223:06:402
18638992421,3cyclictest0-21swapper/223:20:212
18638992421,1cyclictest0-21swapper/200:32:532
18638992420,3cyclictest0-21swapper/223:54:262
18638992420,0cyclictest0-21swapper/222:57:142
1863899240,23cyclictest18195-21sh00:35:512
1863899240,23cyclictest0-21swapper/221:40:562
1863899240,0cyclictest1546-21ssh22:26:502
1863899240,0cyclictest0-21swapper/223:14:182
1863399244,16cyclictest19303-21sh23:38:531
18633992420,3cyclictest31710-1kworker/u9:121:38:511
18633992420,3cyclictest31710-1kworker/u9:121:38:511
18633992420,3cyclictest26887-21apt-get23:17:561
18633992419,4cyclictest12289-21diskmemload21:21:511
18633992419,4cyclictest0-21swapper/122:11:211
1863399240,2cyclictest10375-21ssh00:00:041
1863399240,2cyclictest10375-21ssh00:00:041
1863399240,24cyclictest0-21swapper/121:57:441
1863399240,24cyclictest0-21swapper/100:09:041
1863399240,21cyclictest0-21swapper/122:20:411
1863399240,20cyclictest0-21swapper/123:20:411
1863399240,1cyclictest8627-21sh23:29:441
1863399240,0cyclictest0-21swapper/122:02:051
18630992423,1cyclictest0-21swapper/023:05:170
1863099240,2cyclictest14388-21rm21:12:180
1863099240,2cyclictest10863-21ssh22:06:140
1863099240,23cyclictest21806-21sh22:16:060
1863099240,23cyclictest12289-21diskmemload23:20:340
1863099240,23cyclictest12289-21diskmemload22:55:180
1863099240,23cyclictest12289-21diskmemload22:34:380
1863099240,23cyclictest12289-21diskmemload00:26:470
1863099240,23cyclictest10617-21cron20:00:000
1863099240,0cyclictest0-21swapper/022:27:580
1863099240,0cyclictest0-21swapper/021:54:520
18640992323,0cyclictest12289-21diskmemload23:15:043
18640992323,0cyclictest0-21swapper/322:57:573
18640992323,0cyclictest0-21swapper/322:02:133
18640992323,0cyclictest0-21swapper/321:51:343
18640992322,0cyclictest0-21swapper/321:47:573
18640992321,1cyclictest0-21swapper/322:48:323
18640992321,1cyclictest0-21swapper/321:15:163
1864099230,2cyclictest8244-21wc19:55:003
1864099230,23cyclictest12289-21diskmemload23:09:403
1864099230,23cyclictest0-21swapper/323:32:243
1864099230,23cyclictest0-21swapper/323:21:563
1864099230,23cyclictest0-21swapper/300:03:343
1864099230,23cyclictest0-21swapper/300:03:343
1864099230,22cyclictest29870-21dump-pmu-power20:40:003
1864099230,22cyclictest28860-21sh22:22:583
1864099230,22cyclictest24528-21sh23:15:003
1864099230,1cyclictest8939-21munin-run23:30:013
1864099230,0cyclictest12289-21diskmemload22:27:473
1864099230,0cyclictest0-21swapper/323:51:353
1864099230,0cyclictest0-21swapper/323:41:403
1864099230,0cyclictest0-21swapper/300:20:593
1864099230,0cyclictest0-21swapper/300:19:173
18638992321,1cyclictest25104-21ssh22:18:102
18638992321,1cyclictest0-21swapper/223:55:012
18638992320,0cyclictest0-21swapper/223:17:232
18638992320,0cyclictest0-21swapper/222:22:092
18638992320,0cyclictest0-21swapper/200:17:302
18638992319,1cyclictest17937-21ssh22:40:412
1863899230,22cyclictest15213-21rm23:35:392
1863899230,22cyclictest12289-21diskmemload23:30:302
1863899230,22cyclictest12289-21diskmemload00:23:202
1863899230,22cyclictest0-21swapper/222:03:142
1863899230,1cyclictest4122-21latency_hist22:00:002
1863899230,0cyclictest0-21swapper/223:28:542
1863899230,0cyclictest0-21swapper/222:39:372
1863899230,0cyclictest0-21swapper/200:00:362
1863899230,0cyclictest0-21swapper/200:00:362
18633992323,0cyclictest0-21swapper/122:53:171
18633992321,2cyclictest0-21swapper/100:16:221
18633992321,1cyclictest0-21swapper/122:26:391
18633992321,1cyclictest0-21swapper/121:45:451
18633992320,3cyclictest0-21swapper/121:40:251
1863399230,22cyclictest5548-21sh23:56:181
1863399230,22cyclictest3226-21rm21:30:181
1863399230,0cyclictest0-21swapper/121:25:231
18630992323,0cyclictest6473-21apt-get22:02:560
18630992323,0cyclictest12289-21diskmemload23:58:420
18630992323,0cyclictest12289-21diskmemload21:42:170
18630992323,0cyclictest0-21swapper/022:13:580
18630992323,0cyclictest0-21swapper/021:18:030
18630992323,0cyclictest0-21swapper/000:23:520
18630992323,0cyclictest0-21swapper/000:09:000
18630992321,1cyclictest0-21swapper/023:33:240
18630992321,1cyclictest0-21swapper/021:37:150
18630992321,1cyclictest0-21swapper/021:37:150
18630992321,1cyclictest0-21swapper/019:20:010
18630992320,2cyclictest28617-21munin-plugin-st19:30:010
18630992320,2cyclictest23201-21ssh00:12:180
1863099230,2cyclictest26220-21turbostat19:25:010
1863099230,2cyclictest16017-21sh00:33:420
1863099230,23cyclictest0-21swapper/021:25:070
1863099230,23cyclictest0-21swapper/000:35:440
1863099230,22cyclictest606-21dbus-daemon21:35:000
1863099230,22cyclictest29614-21ssh22:51:100
1863099230,22cyclictest25550-21apt-get20:32:540
1863099230,22cyclictest0-21swapper/023:11:350
1863099230,1cyclictest27959-21ssh23:47:500
1863099230,1cyclictest24760-21ssh21:49:250
1863099230,0cyclictest0-21swapper/023:51:550
1863099230,0cyclictest0-21swapper/023:29:010
18640992222,0cyclictest12289-21diskmemload21:36:333
18640992222,0cyclictest12289-21diskmemload21:36:333
18640992222,0cyclictest0-21swapper/321:33:523
18640992222,0cyclictest0-21swapper/319:10:023
18640992220,1cyclictest606-21dbus-daemon20:05:013
18640992220,1cyclictest0-21swapper/319:37:563
18640992220,1cyclictest0-21swapper/300:26:043
1864099220,2cyclictest23795-21ls19:20:013
1864099220,21cyclictest29150-21apt-get21:25:023
1864099220,21cyclictest16441-21ssh22:11:223
1864099220,21cyclictest12289-21diskmemload23:55:343
1864099220,21cyclictest0-21swapper/322:50:093
1864099220,21cyclictest0-21swapper/321:20:093
1864099220,21cyclictest0-21swapper/300:35:023
1864099220,1cyclictest3788-21ssh21:59:373
1864099220,1cyclictest0-21swapper/323:02:263
1864099220,1cyclictest0-21swapper/300:31:243
1864099220,0cyclictest12289-21diskmemload21:10:473
1864099220,0cyclictest0-21swapper/323:45:463
18638992220,1cyclictest0-21swapper/200:26:182
1863899220,21cyclictest8731-21apt-get19:57:572
1863899220,21cyclictest28592-21cron19:30:012
1863899220,21cyclictest25693-21diskmemload21:50:172
1863899220,21cyclictest2317-21perf20:50:002
1863899220,1cyclictest3467-21perf19:45:002
1863399223,18cyclictest1013-21run-parts19:40:001
18633992222,0cyclictest12289-21diskmemload21:15:531
18633992218,4cyclictest0-21swapper/119:47:561
1863399220,22cyclictest0-21swapper/123:45:291
1863399220,21cyclictest2794-21apt-get20:52:561
1863399220,21cyclictest0-21swapper/121:02:561
18630992222,0cyclictest12289-21diskmemload22:40:080
18630992222,0cyclictest0-21swapper/023:18:070
18630992222,0cyclictest0-21swapper/021:21:380
1863099220,21cyclictest8261-21perf19:55:000
1863099220,21cyclictest23699-21ssh22:45:470
1863099220,21cyclictest12289-21diskmemload22:36:250
1863099220,21cyclictest0-21swapper/023:00:150
1863099220,21cyclictest0-21swapper/019:12:560
1863099220,1cyclictest29413-21apt-get00:17:590
1863099220,1cyclictest20615-21ssh23:40:210
1863099220,1cyclictest0-21swapper/022:21:550
1863099220,1cyclictest0-21swapper/000:02:050
1863099220,1cyclictest0-21swapper/000:02:050
18640992121,0cyclictest0-21swapper/323:35:073
18640992119,1cyclictest12301-21apt21:10:013
1864099210,20cyclictest18329-21apt-get20:17:553
1864099210,20cyclictest13540-21apt-get20:07:563
1864099210,20cyclictest12289-21diskmemload22:40:013
1864099210,0cyclictest0-21swapper/322:30:363
1864099210,0cyclictest0-21swapper/320:52:563
18638992121,0cyclictest0-21swapper/220:32:542
18638992120,0cyclictest0-21swapper/220:17:552
18638992119,1cyclictest4698-21awk20:55:012
1863899210,20cyclictest5192-21apt-get20:57:572
1863899210,20cyclictest0-21swapper/219:37:562
1863899210,0cyclictest3940-21apt-get19:47:552
18633992121,0cyclictest0-21swapper/120:27:551
18633992121,0cyclictest0-21swapper/119:32:551
1863399210,3cyclictest19604-21ptp4l20:18:031
1863399210,20cyclictest349-21apt20:47:591
1863399210,20cyclictest0-21swapper/120:57:571
1863399210,0cyclictest21882-21apt-get19:17:561
1864099200,1cyclictest28600-21perf19:30:013
1864099200,0cyclictest0-21swapper/320:42:573
1864099200,0cyclictest0-21swapper/319:57:573
18638992020,0cyclictest0-21swapper/220:12:562
18633992020,0cyclictest10397-21apt-get21:07:571
18633992020,0cyclictest0-21swapper/119:42:561
18633992018,1cyclictest0-21swapper/120:45:001
1863399200,2cyclictest8700-21/usr/sbin/munin19:57:561
1863399200,20cyclictest18564-21apt-get19:10:021
1863399200,1cyclictest26695-21apt-get19:27:571
18630992020,0cyclictest23151-21apt-get20:27:560
18630992020,0cyclictest0-21swapper/020:02:570
18630992020,0cyclictest0-21swapper/019:47:560
18630992020,0cyclictest0-21swapper/019:42:560
18630992017,2cyclictest313-21systemd-journal20:20:010
18630992017,2cyclictest0-21swapper/021:10:010
1863099200,0cyclictest0-21swapper/020:42:570
18640991919,0cyclictest0-21swapper/320:47:593
18638991919,0cyclictest0-21swapper/220:27:552
18638991918,0cyclictest27944-21apt-get20:37:562
18638991917,1cyclictest0-21swapper/220:05:012
18633991917,1cyclictest6338-21apt-get19:52:571
18630991919,0cyclictest0-21swapper/020:57:560
18640991818,0cyclictest0-21swapper/320:57:573
18640991818,0cyclictest0-21swapper/319:32:553
18638991818,0cyclictest0-21swapper/221:07:572
18638991818,0cyclictest0-21swapper/220:07:562
18638991816,1cyclictest30363-21apt-get20:42:572
18630991817,0cyclictest0-21swapper/019:37:560
18630991816,1cyclictest29859-21latency_hist20:40:000
1863099180,17cyclictest1-21systemd20:50:000
18640991715,1cyclictest27479-21munin-run20:35:003
18638991717,0cyclictest0-21swapper/219:22:582
1863399173,13cyclictest313-21systemd-journal20:05:011
18633991717,0cyclictest0-21swapper/120:12:551
18633991717,0cyclictest0-21swapper/119:22:581
18633991715,1cyclictest0-21swapper/120:10:011
18638991616,0cyclictest0-21swapper/219:10:022
1863399160,15cyclictest0-21swapper/120:22:591
18630991616,0cyclictest0-21swapper/021:00:020
18630991616,0cyclictest0-21swapper/020:52:560
18630991616,0cyclictest0-21swapper/020:07:560
18630991614,1cyclictest0-21swapper/020:13:030
1864099150,14cyclictest9899-21cron21:05:013
18638991515,0cyclictest0-21swapper/221:02:572
18638991515,0cyclictest0-21swapper/219:17:562
1863899150,14cyclictest0-21swapper/219:35:002
18633991515,0cyclictest0-21swapper/120:32:541
18630991515,0cyclictest0-21swapper/019:32:550
18640991414,0cyclictest0-21swapper/319:40:023
1864099140,14cyclictest0-21swapper/320:26:443
1864099140,14cyclictest0-21swapper/320:20:383
1864099140,14cyclictest0-21swapper/319:45:493
1864099140,0cyclictest0-21swapper/320:10:103
1863899140,14cyclictest0-21swapper/220:20:182
1863899140,14cyclictest0-21swapper/219:51:242
18630991414,0cyclictest0-21swapper/020:20:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional