You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 11, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1812992922,4cyclictest0-21swapper/321:14:483
181299270,22cyclictest2343-21sh21:17:143
1812992621,5cyclictest27863-21diskmemload23:13:263
1812992620,5cyclictest0-21swapper/300:29:283
181299260,1cyclictest0-21swapper/321:59:593
180399262,23cyclictest4212-21cat21:19:241
1812992523,2cyclictest0-21swapper/300:31:573
1812992522,3cyclictest0-21swapper/323:01:383
1812992522,3cyclictest0-21swapper/322:08:473
1812992521,4cyclictest27863-21diskmemload22:35:103
1812992520,4cyclictest0-21swapper/321:52:253
1812992519,5cyclictest2327-21sh22:47:133
1812992517,5cyclictest27863-21diskmemload21:48:463
181299250,24cyclictest0-21swapper/323:38:243
181299250,24cyclictest0-21swapper/322:55:083
181299250,24cyclictest0-21swapper/321:41:203
181299250,20cyclictest0-21swapper/323:06:473
181299250,1cyclictest0-21swapper/323:15:163
181299250,0cyclictest0-21swapper/323:50:353
181299250,0cyclictest0-21swapper/322:43:063
1808992521,0cyclictest0-21swapper/221:24:352
1803992523,2cyclictest8491-21sh23:24:221
180399250,25cyclictest0-21swapper/123:39:271
180399250,24cyclictest27863-21diskmemload23:08:181
180099251,24cyclictest141rcuc/023:22:390
180099251,23cyclictest27863-21diskmemload21:19:240
180099250,24cyclictest27065-21sh23:09:500
180099250,24cyclictest0-21swapper/000:30:280
1812992421,3cyclictest0-21swapper/322:27:483
1812992420,4cyclictest0-21swapper/323:56:563
1812992420,3cyclictest0-21swapper/300:38:553
1812992420,3cyclictest0-21swapper/300:03:213
181299240,23cyclictest27863-21diskmemload00:14:293
181299240,23cyclictest27863-21diskmemload00:14:293
181299240,0cyclictest27863-21diskmemload23:45:523
181299240,0cyclictest0-21swapper/321:36:513
181299240,0cyclictest0-21swapper/321:28:473
1808992423,1cyclictest0-21swapper/223:54:172
1808992423,1cyclictest0-21swapper/222:33:542
1808992421,2cyclictest0-21swapper/223:43:522
1808992420,3cyclictest0-21swapper/223:17:402
1808992420,3cyclictest0-21swapper/200:30:362
180899240,23cyclictest27863-21diskmemload00:02:312
180899240,23cyclictest0-21swapper/222:24:302
1803992422,1cyclictest428-21rm23:45:471
1803992422,1cyclictest18982-21ssh23:03:141
1803992422,1cyclictest11594-21rm23:26:011
1803992421,2cyclictest28426-21ssh22:10:411
180399241,1cyclictest9031-21ssh22:23:381
180399240,24cyclictest0-21swapper/100:07:341
180399240,23cyclictest662-21cron21:15:011
180399240,23cyclictest0-21swapper/123:51:121
180399240,0cyclictest0-21swapper/100:33:371
1800992423,1cyclictest0-21swapper/021:30:300
1800992422,1cyclictest6002-21sh23:51:120
180099240,23cyclictest27863-21diskmemload22:54:510
180099240,23cyclictest27863-21diskmemload21:37:400
180099240,23cyclictest0-21swapper/000:04:240
180099240,1cyclictest18522-21ssh23:33:160
180099240,0cyclictest27863-21diskmemload21:48:240
1812992323,0cyclictest0-21swapper/322:19:113
1812992321,1cyclictest0-21swapper/322:10:013
1812992321,1cyclictest0-21swapper/321:33:263
1812992320,3cyclictest0-21swapper/323:20:113
1812992319,4cyclictest27863-21diskmemload21:21:213
1812992319,4cyclictest0-21swapper/321:09:243
1812992319,4cyclictest0-21swapper/300:06:313
1812992319,3cyclictest0-21swapper/323:40:113
1812992318,4cyclictest0-21swapper/320:44:243
181299230,2cyclictest8636-21idleruntime-cro20:30:003
181299230,23cyclictest0-21swapper/300:16:093
181299230,22cyclictest0-21swapper/322:21:313
181299230,20cyclictest27863-21diskmemload22:53:273
181299230,0cyclictest0-21swapper/323:25:493
1808992323,0cyclictest0-21swapper/223:48:352
1808992323,0cyclictest0-21swapper/223:36:102
1808992323,0cyclictest0-21swapper/221:30:582
1808992323,0cyclictest0-21swapper/200:20:382
1808992323,0cyclictest0-21swapper/200:10:142
1808992323,0cyclictest0-21swapper/200:10:142
1808992322,1cyclictest7089-21ssh22:51:252
1808992321,1cyclictest0-21swapper/221:45:492
1808992321,1cyclictest0-21swapper/221:35:542
1808992321,1cyclictest0-21swapper/221:26:262
1808992321,1cyclictest0-21swapper/221:16:022
1808992320,2cyclictest32756-21ssh22:14:342
1808992320,2cyclictest27863-21diskmemload21:54:292
1808992320,0cyclictest0-21swapper/223:55:132
1808992319,4cyclictest0-21swapper/223:05:032
180899230,23cyclictest27863-21diskmemload23:31:362
180899230,22cyclictest5900-21ssh23:20:172
180899230,22cyclictest27863-21diskmemload22:46:052
180899230,22cyclictest22828-21sh22:35:172
180899230,22cyclictest0-21swapper/223:01:352
180899230,1cyclictest0-21swapper/223:14:102
180899230,0cyclictest0-21swapper/222:55:152
180899230,0cyclictest0-21swapper/200:25:342
1803992323,0cyclictest27863-21diskmemload22:00:461
1803992323,0cyclictest0-21swapper/123:13:081
1803992323,0cyclictest0-21swapper/122:38:031
1803992323,0cyclictest0-21swapper/122:32:521
1803992323,0cyclictest0-21swapper/122:28:051
1803992322,1cyclictest0-21swapper/100:20:031
1803992321,1cyclictest31410-21idleruntime-cro20:10:011
1803992321,1cyclictest31410-21idleruntime-cro20:10:011
180399231,22cyclictest0-21swapper/120:59:241
180399231,1cyclictest1485-21ssh21:45:591
180399230,2cyclictest17141-21munin-plugin-st22:00:011
180399230,2cyclictest10929-21users22:54:341
180399230,23cyclictest0-21swapper/123:31:511
180399230,23cyclictest0-21swapper/123:15:081
180399230,23cyclictest0-21swapper/121:26:081
180399230,22cyclictest29285-21ssh22:42:031
180399230,22cyclictest28021-21ssh21:40:021
180399230,22cyclictest24196-21ssh00:39:131
180399230,22cyclictest15904-21idleruntime-cro20:45:001
180399230,22cyclictest11973-21ssh22:55:381
180399230,22cyclictest10840-21sh00:25:171
180399230,0cyclictest0-21swapper/121:54:131
180399230,0cyclictest0-21swapper/121:30:301
1800992321,1cyclictest9407-21ntp_states00:24:290
1800992321,1cyclictest11002-21ssh21:54:330
180099231,1cyclictest0-21swapper/021:15:010
180099230,23cyclictest27863-21diskmemload00:06:480
180099230,23cyclictest0-21swapper/023:36:460
180099230,23cyclictest0-21swapper/023:12:480
180099230,23cyclictest0-21swapper/022:14:120
180099230,23cyclictest0-21swapper/022:01:260
180099230,22cyclictest62550irq/127-eno121:27:300
180099230,22cyclictest313-21systemd-journal23:20:000
180099230,22cyclictest28122-21ssh21:40:100
180099230,22cyclictest2137-21rm22:16:580
180099230,22cyclictest17197-21sh23:00:250
180099230,22cyclictest15202-21ssh23:29:300
180099230,22cyclictest12853-21sh22:57:010
180099230,22cyclictest0-21swapper/022:48:390
180099230,1cyclictest660-21ssh00:16:070
180099230,1cyclictest0-21swapper/023:46:100
180099230,0cyclictest27863-21diskmemload21:22:370
180099230,0cyclictest27863-21diskmemload00:25:060
180099230,0cyclictest0-21swapper/022:31:570
180099230,0cyclictest0-21swapper/022:08:570
1812992221,1cyclictest0-21swapper/322:01:453
181299220,21cyclictest0-21swapper/323:33:513
181299220,21cyclictest0-21swapper/322:30:383
181299220,21cyclictest0-21swapper/320:09:243
181299220,21cyclictest0-21swapper/320:09:243
1808992222,0cyclictest0-21swapper/222:00:192
1808992220,1cyclictest6205-21cron20:25:012
1808992220,1cyclictest3851-21awk20:20:012
1808992220,1cyclictest28595-21sh21:10:572
1808992220,1cyclictest0-21swapper/223:25:402
1808992220,1cyclictest0-21swapper/222:15:482
180899220,22cyclictest0-21swapper/222:05:072
180899220,22cyclictest0-21swapper/221:55:592
180899220,21cyclictest27863-21diskmemload00:16:252
180899220,21cyclictest0-21swapper/221:41:292
180899220,21cyclictest0-21swapper/200:06:022
180899220,1cyclictest1398-21awk20:15:012
180899220,0cyclictest0-21swapper/222:41:352
180899220,0cyclictest0-21swapper/222:25:102
1803992222,0cyclictest0-21swapper/100:10:371
1803992222,0cyclictest0-21swapper/100:10:371
1803992221,1cyclictest17356-21ssh00:01:561
1803992221,1cyclictest0-21swapper/122:05:521
1803992221,1cyclictest0-21swapper/121:24:201
180399220,22cyclictest0-21swapper/123:55:561
180399220,22cyclictest0-21swapper/123:40:111
180399220,22cyclictest0-21swapper/122:48:111
180399220,1cyclictest313-21systemd-journal21:10:011
180399220,1cyclictest0-21swapper/122:15:261
180399220,1cyclictest0-21swapper/100:15:021
1800992222,0cyclictest0-21swapper/022:41:040
1800992222,0cyclictest0-21swapper/022:25:190
1800992221,1cyclictest27863-21diskmemload22:21:010
1800992220,1cyclictest606-21dbus-daemon20:10:010
1800992220,1cyclictest606-21dbus-daemon20:10:010
180099221,20cyclictest141rcuc/000:35:010
180099220,22cyclictest0-21swapper/000:10:140
180099220,22cyclictest0-21swapper/000:10:140
180099220,21cyclictest3832-21perf20:20:010
180099220,21cyclictest27876-21cron21:10:010
180099220,21cyclictest27111-21sh23:40:110
180099220,21cyclictest11056-21ssh23:55:440
180099220,21cyclictest0-21swapper/019:24:220
180099220,1cyclictest6986-21perf19:20:010
180099220,1cyclictest0-21swapper/022:36:290
180099220,1cyclictest0-21swapper/021:55:490
1812992119,1cyclictest0-21swapper/319:25:043
181299210,20cyclictest27227-21apt-get20:04:223
1808992120,1cyclictest21514-21ssh00:35:142
1808992118,2cyclictest26595-21sendmail20:00:002
180899210,20cyclictest0-21swapper/220:44:242
180899210,20cyclictest0-21swapper/219:54:242
1803992120,1cyclictest1720-21apt-get19:10:021
180399210,20cyclictest0-21swapper/120:49:231
180399210,0cyclictest2011-21apt-get20:19:221
180399210,0cyclictest0-21swapper/120:34:221
180399210,0cyclictest0-21swapper/119:39:231
180099210,21cyclictest0-21swapper/020:49:230
180099210,21cyclictest0-21swapper/019:54:240
180099210,21cyclictest0-21swapper/019:48:190
180099210,20cyclictest0-21swapper/020:14:230
180099210,20cyclictest0-21swapper/020:04:220
1812992020,0cyclictest18880-21apt-get20:54:243
1812992020,0cyclictest0-21swapper/320:14:233
1812992019,1cyclictest5159-21apt-get19:19:223
181299200,20cyclictest0-21swapper/321:04:253
181299200,1cyclictest14575-21perf19:35:013
181299200,0cyclictest0-21swapper/319:39:233
1808992020,0cyclictest0-21swapper/220:37:002
1808992019,0cyclictest12765-21apt-get19:34:232
1803992020,0cyclictest0-21swapper/120:39:231
1803992020,0cyclictest0-21swapper/120:29:221
1803992020,0cyclictest0-21swapper/119:55:001
180399200,0cyclictest0-21swapper/120:04:221
1800992020,0cyclictest0-21swapper/020:35:000
1800992020,0cyclictest0-21swapper/019:34:230
1812991918,1cyclictest3842-21munin-run20:20:013
1812991918,0cyclictest0-21swapper/319:49:233
1812991915,4cyclictest0-21swapper/319:44:233
181299190,1cyclictest0-21swapper/319:14:293
1808991919,0cyclictest16482-21apt-get20:49:232
1803991919,0cyclictest1407-21awk20:15:011
1803991917,1cyclictest5763-21head19:19:241
1800991919,0cyclictest0-21swapper/020:44:230
1800991919,0cyclictest0-21swapper/020:29:220
181299184,1cyclictest24814-21apt-get19:59:233
1812991818,0cyclictest0-21swapper/320:59:233
181299180,17cyclictest7576-21apt-get19:24:223
1808991818,0cyclictest21272-21apt-get20:59:232
1808991817,1cyclictest17628-21apt-get19:44:232
1808991816,1cyclictest2763-21apt-get19:14:232
1803991818,0cyclictest0-21swapper/119:25:031
1800991818,0cyclictest0-21swapper/020:39:230
1800991818,0cyclictest0-21swapper/019:39:230
1800991818,0cyclictest0-21swapper/019:10:020
181299171,2cyclictest0-21swapper/320:24:253
1808991716,1cyclictest15159-21apt-get19:39:232
1808991715,1cyclictest27877-21perf21:10:012
1808991714,2cyclictest12161-21awk19:30:012
1812991616,0cyclictest0-21swapper/320:34:223
1812991614,1cyclictest18277-21idleruntime-cro20:50:003
181299160,16cyclictest0-21swapper/319:54:333
181299160,15cyclictest0-21swapper/320:39:263
1808991615,1cyclictest0-21swapper/219:49:232
1808991615,1cyclictest0-21swapper/219:19:222
1803991616,0cyclictest20023-21apt-get19:49:231
1803991616,0cyclictest0-21swapper/121:04:251
180399160,15cyclictest7799-21cstates19:24:231
180399160,15cyclictest25432-21head19:59:261
1800991614,1cyclictest0-21swapper/019:59:260
1800991614,1cyclictest0-21swapper/019:44:260
1808991515,0cyclictest0-21swapper/220:54:242
1808991515,0cyclictest0-21swapper/220:34:222
1808991513,1cyclictest0-21swapper/220:10:012
1808991513,1cyclictest0-21swapper/220:10:012
1803991514,1cyclictest0-21swapper/120:24:241
1803991514,1cyclictest0-21swapper/119:34:301
1808991414,0cyclictest0-21swapper/220:25:082
180899140,14cyclictest0-21swapper/221:00:502
180899140,14cyclictest0-21swapper/220:02:392
180899140,14cyclictest0-21swapper/219:21:212
1803991414,0cyclictest0-21swapper/120:50:401
1800991414,0cyclictest0-21swapper/020:55:320
180099140,14cyclictest0-21swapper/021:00:120
180099140,14cyclictest0-21swapper/020:50:180
180099140,0cyclictest0-21swapper/020:20:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional