You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 08:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 13, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2508799270,21cyclictest25530-21apt-get21:17:021
2508999261,24cyclictest0-21swapper/323:12:043
25087992622,4cyclictest0-21swapper/122:48:381
25087992621,5cyclictest0-21swapper/121:25:451
25087992620,5cyclictest30135-21ssh00:15:061
25087992620,5cyclictest18408-21diskmemload00:02:461
25087992619,6cyclictest24389-21ssh21:44:331
2508799260,23cyclictest0-21swapper/121:49:531
2508799260,1cyclictest17021-21munin-run23:05:001
2508799260,1cyclictest0-21swapper/121:56:481
2508699260,0cyclictest0-21swapper/021:14:260
25089992523,1cyclictest0-21swapper/323:59:433
25088992523,1cyclictest16959-21idleruntime-cro23:05:002
25088992523,1cyclictest0-21swapper/221:37:092
2508899250,24cyclictest606-21dbus-daemon21:25:012
2508899250,24cyclictest31913-21ssh23:17:452
2508899250,24cyclictest0-21swapper/221:53:232
25087992523,1cyclictest18408-21diskmemload23:41:571
25087992521,3cyclictest0-21swapper/122:36:511
25087992521,3cyclictest0-21swapper/121:21:121
25087992520,4cyclictest7188-21ssh22:56:371
25087992519,5cyclictest21985-21apt-get20:12:031
2508799250,24cyclictest0-21swapper/123:57:591
2508799250,24cyclictest0-21swapper/123:32:031
2508799250,24cyclictest0-21swapper/122:32:171
2508799250,21cyclictest0-21swapper/123:13:511
2508799250,20cyclictest0-21swapper/100:23:081
2508799250,0cyclictest0-21swapper/100:06:041
2508699250,24cyclictest0-21swapper/000:02:590
2508699250,1cyclictest0-21swapper/021:35:000
2508699250,0cyclictest0-21swapper/000:08:390
25089992421,2cyclictest18419-21latency_hist21:10:003
2508999240,23cyclictest15009-21ssh21:36:333
2508999240,23cyclictest0-21swapper/321:27:073
2508999240,23cyclictest0-21swapper/300:37:133
2508999240,23cyclictest0-21swapper/300:19:373
25088992423,1cyclictest14701-21ssh00:01:452
25088992420,4cyclictest0-21swapper/223:41:032
2508899240,24cyclictest0-21swapper/223:58:462
2508899240,23cyclictest19020-21ssh21:10:282
2508899240,23cyclictest18408-21diskmemload23:38:392
25087992419,0cyclictest0-21swapper/123:53:451
25087992418,5cyclictest1573-21munin-run20:35:011
25087992418,1cyclictest3516-21ssh22:24:021
2508799240,24cyclictest0-21swapper/122:52:221
2508799240,24cyclictest0-21swapper/122:41:171
2508799240,24cyclictest0-21swapper/122:27:221
2508799240,24cyclictest0-21swapper/100:10:361
2508799240,23cyclictest0-21swapper/121:35:281
2508799240,23cyclictest0-21swapper/121:32:181
2508799240,21cyclictest0-21swapper/121:11:461
2508799240,0cyclictest18408-21diskmemload23:36:331
2508799240,0cyclictest18408-21diskmemload23:26:071
2508799240,0cyclictest0-21swapper/123:47:301
2508699243,1cyclictest62550irq/127-eno122:56:480
25086992423,1cyclictest0-21swapper/021:16:590
2508699240,23cyclictest26382-21rm22:44:220
2508699240,23cyclictest0-21swapper/023:05:100
2508699240,1cyclictest0-21swapper/022:12:220
2508699240,0cyclictest0-21swapper/023:55:480
2508699240,0cyclictest0-21swapper/021:57:090
25089992323,0cyclictest18408-21diskmemload23:38:423
25089992323,0cyclictest18408-21diskmemload22:05:003
25089992323,0cyclictest0-21swapper/323:42:233
25089992323,0cyclictest0-21swapper/323:04:303
25089992323,0cyclictest0-21swapper/322:54:343
25089992322,1cyclictest18408-21diskmemload21:55:123
25089992321,1cyclictest0-21swapper/323:27:373
25089992320,2cyclictest21251-21awk22:40:003
2508999230,2cyclictest29632-21/usr/sbin/munin23:17:033
2508999230,23cyclictest9070-21sh22:28:213
2508999230,23cyclictest0-21swapper/322:49:173
2508999230,23cyclictest0-21swapper/322:44:503
2508999230,23cyclictest0-21swapper/321:47:243
2508999230,22cyclictest30786-21diskmemload21:50:233
2508999230,22cyclictest27421-21sh21:17:143
2508999230,22cyclictest19910-21ssh00:06:083
2508999230,22cyclictest16753-21systemctl20:00:003
2508999230,22cyclictest0-21swapper/300:34:473
2508999230,22cyclictest0-21swapper/300:27:093
2508999230,0cyclictest0-21swapper/322:06:303
2508999230,0cyclictest0-21swapper/321:40:243
2508999230,0cyclictest0-21swapper/321:31:003
2508999230,0cyclictest0-21swapper/321:11:383
25088992323,0cyclictest18408-21diskmemload21:41:402
25088992323,0cyclictest0-21swapper/223:14:092
25088992323,0cyclictest0-21swapper/222:38:162
25088992323,0cyclictest0-21swapper/200:19:242
25088992322,1cyclictest18408-21diskmemload23:05:232
2508899230,2cyclictest18192-21rm00:33:002
2508899230,23cyclictest0-21swapper/223:48:362
2508899230,23cyclictest0-21swapper/223:30:462
2508899230,23cyclictest0-21swapper/222:51:192
2508899230,23cyclictest0-21swapper/222:05:412
2508899230,23cyclictest0-21swapper/221:45:572
2508899230,22cyclictest20884-21rm00:36:222
2508899230,22cyclictest0-21swapper/222:26:362
2508899230,22cyclictest0-21swapper/222:20:362
2508899230,20cyclictest0-21swapper/223:29:342
2508899230,1cyclictest12781-21ssh00:28:152
2508899230,0cyclictest18408-21diskmemload23:20:342
2508899230,0cyclictest18408-21diskmemload22:44:162
2508899230,0cyclictest0-21swapper/200:20:442
25087992323,0cyclictest0-21swapper/121:52:551
25087992320,3cyclictest0-21swapper/123:22:461
25087992320,3cyclictest0-21swapper/123:18:301
25087992320,3cyclictest0-21swapper/122:16:291
25087992320,3cyclictest0-21swapper/122:11:401
2508799230,23cyclictest18408-21diskmemload00:30:131
2508799230,23cyclictest0-21swapper/100:36:271
2508799230,23cyclictest0-21swapper/100:28:321
2508799230,22cyclictest0-21swapper/121:07:031
2508799230,0cyclictest0-21swapper/122:07:201
25086992323,0cyclictest18408-21diskmemload22:00:150
25086992323,0cyclictest18408-21diskmemload21:52:500
25086992323,0cyclictest18408-21diskmemload00:21:080
25086992323,0cyclictest0-21swapper/023:52:510
25086992323,0cyclictest0-21swapper/023:49:030
25086992323,0cyclictest0-21swapper/023:42:490
25086992323,0cyclictest0-21swapper/022:29:180
25086992323,0cyclictest0-21swapper/021:46:250
25086992322,1cyclictest0-21swapper/021:26:240
2508699230,2cyclictest30283-21kworker/u8:000:17:110
2508699230,2cyclictest20885-21diskmemload22:39:230
2508699230,23cyclictest0-21swapper/021:20:500
2508699230,23cyclictest0-21swapper/000:31:460
2508699230,22cyclictest17386-21rm21:37:200
2508699230,22cyclictest0-21swapper/023:16:470
2508699230,1cyclictest28028-21ssh00:12:240
2508699230,1cyclictest26477-21ssh23:12:550
2508699230,0cyclictest0-21swapper/023:25:500
2508699230,0cyclictest0-21swapper/023:22:390
25089992222,0cyclictest18408-21diskmemload21:20:053
25089992222,0cyclictest0-21swapper/323:46:273
25089992222,0cyclictest0-21swapper/323:06:003
25089992222,0cyclictest0-21swapper/322:56:303
25089992222,0cyclictest0-21swapper/300:12:173
25089992220,1cyclictest1447-21rm23:20:153
2508999220,21cyclictest10984-21ssh22:30:493
2508999220,21cyclictest0-21swapper/323:30:263
2508999220,21cyclictest0-21swapper/322:20:093
2508999220,21cyclictest0-21swapper/320:52:023
2508999220,21cyclictest0-21swapper/320:20:023
2508999220,21cyclictest0-21swapper/319:52:023
2508999220,21cyclictest0-21swapper/300:20:053
2508999220,1cyclictest18408-21diskmemload00:00:283
2508999220,1cyclictest0-21swapper/322:12:123
25088992222,0cyclictest29266-1kworker/u9:222:01:262
25088992222,0cyclictest0-21swapper/222:57:322
25088992220,1cyclictest9358-21ssh21:31:262
25088992220,0cyclictest0-21swapper/221:15:302
25088992218,4cyclictest19202-21ssh00:05:142
2508899220,1cyclictest31917-21ssh22:48:492
2508899220,0cyclictest18408-21diskmemload21:55:302
2508899220,0cyclictest0-21swapper/222:11:182
2508899220,0cyclictest0-21swapper/221:25:042
25087992222,0cyclictest0-21swapper/122:04:541
2508799220,0cyclictest0-21swapper/119:47:001
25086992220,2cyclictest9533-21perf19:45:010
25086992220,1cyclictest0-21swapper/021:42:030
25086992220,1cyclictest0-21swapper/020:30:010
2508699220,22cyclictest0-21swapper/000:35:260
2508699220,21cyclictest0-21swapper/023:35:190
2508699220,21cyclictest0-21swapper/023:32:090
2508699220,21cyclictest0-21swapper/023:00:060
2508699220,21cyclictest0-21swapper/022:21:450
2508699220,21cyclictest0-21swapper/022:05:030
2508699220,21cyclictest0-21swapper/020:07:030
2508699220,21cyclictest0-21swapper/019:57:030
2508699220,1cyclictest7133-21perf19:40:010
2508699220,1cyclictest0-21swapper/022:50:030
2508699220,1cyclictest0-21swapper/022:32:070
25089992121,0cyclictest27282-21apt-get19:12:493
25089992118,2cyclictest4728-21perf19:35:003
2508999210,21cyclictest0-21swapper/323:51:043
2508999210,1cyclictest7134-21sendmail-msp19:40:013
25088992121,0cyclictest0-21swapper/220:17:032
25088992121,0cyclictest0-21swapper/219:42:022
25088992121,0cyclictest0-21swapper/200:10:042
25088992120,1cyclictest25483-21apt-get19:12:022
2508899210,21cyclictest27138-21ssh22:16:502
2508899210,21cyclictest0-21swapper/223:50:112
2508899210,1cyclictest0-21swapper/222:30:382
25087992121,0cyclictest0-21swapper/120:52:021
25087992119,1cyclictest21544-21cron20:10:001
25086992120,1cyclictest0-21swapper/021:07:030
25089992020,0cyclictest0-21swapper/320:12:033
25089992020,0cyclictest0-21swapper/319:42:023
25089992018,1cyclictest19590-21apt-get20:07:033
25088992020,0cyclictest27929-21apt-get19:17:022
25088992020,0cyclictest0-21swapper/221:10:002
25088992020,0cyclictest0-21swapper/220:42:022
25088992020,0cyclictest0-21swapper/220:20:022
25088992020,0cyclictest0-21swapper/220:02:002
25088992019,1cyclictest4711-21cron19:35:002
25088992019,1cyclictest0-21swapper/220:47:022
2508899200,20cyclictest0-21swapper/221:01:592
2508899200,20cyclictest0-21swapper/220:10:002
2508899200,0cyclictest0-21swapper/220:57:032
25087992020,0cyclictest0-21swapper/119:17:021
25087992018,1cyclictest16754-21awk20:00:001
2508799200,0cyclictest0-21swapper/119:42:021
25086992020,0cyclictest0-21swapper/020:42:030
25086992019,1cyclictest141rcuc/020:40:010
25086992018,1cyclictest32331-21latency_hist19:25:000
2508699200,18cyclictest313-21systemd-journal21:05:000
2508699200,0cyclictest0-21swapper/020:47:030
2508699200,0cyclictest0-21swapper/019:27:010
25089991919,0cyclictest0-21swapper/320:32:023
25088991919,0cyclictest0-21swapper/219:22:022
25087991919,0cyclictest0-21swapper/121:01:591
25087991919,0cyclictest0-21swapper/120:02:001
25087991919,0cyclictest0-21swapper/119:12:021
25087991917,1cyclictest0-21swapper/120:20:001
25086991919,0cyclictest0-21swapper/020:57:030
25086991919,0cyclictest0-21swapper/020:22:020
2508999182,15cyclictest1078-21cat19:27:053
25089991818,0cyclictest30349-21apt-get19:22:023
25089991817,0cyclictest24379-21apt-get20:17:023
25088991817,1cyclictest14355-21sh19:55:012
25087991817,1cyclictest6791-21apt-get20:47:021
2508799180,17cyclictest13646-21munin-plugin-st21:00:001
25086991817,1cyclictest14378-21perf19:55:010
25086991816,1cyclictest23968-21perf20:15:000
25089991717,0cyclictest0-21swapper/320:42:033
25089991717,0cyclictest0-21swapper/320:37:023
25088991717,0cyclictest0-21swapper/220:52:022
25087991717,0cyclictest0-21swapper/119:52:021
25087991715,1cyclictest606-21dbus-daemon20:25:011
2508799170,16cyclictest7184-21latency_hist19:40:011
25086991715,1cyclictest26390-21perf20:20:000
25088991616,0cyclictest31992-21apt-get20:32:022
2508899160,15cyclictest0-21swapper/219:50:012
25087991616,0cyclictest0-21swapper/120:42:031
25087991616,0cyclictest0-21swapper/120:27:011
25087991616,0cyclictest0-21swapper/119:32:011
25086991616,0cyclictest0-21swapper/020:32:020
2508699160,15cyclictest27517-21perf19:15:000
25089991514,0cyclictest0-21swapper/319:17:023
2508999150,1cyclictest31582-21perf20:30:013
25088991515,0cyclictest0-21swapper/220:12:032
25088991514,1cyclictest3988-21wc20:40:012
2508899150,1cyclictest6480-21plymouth19:37:102
2508899150,1cyclictest14948-21cut19:57:042
25087991513,1cyclictest3985-21latency_hist20:40:011
25086991515,0cyclictest17193-21apt-get20:02:000
25089991414,0cyclictest0-21swapper/320:55:013
25089991414,0cyclictest0-21swapper/320:02:543
2508999140,0cyclictest0-21swapper/321:02:523
2508899140,14cyclictest0-21swapper/220:26:012
2508899140,14cyclictest0-21swapper/219:25:432
2508799140,14cyclictest0-21swapper/119:26:131
25086991414,0cyclictest0-21swapper/020:50:400
2508699140,14cyclictest0-21swapper/019:15:390
25089991313,0cyclictest0-21swapper/319:48:473
25086991312,0cyclictest0-21swapper/019:32:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional