You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 09:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 29, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1835999260,25cyclictest4093-21ssh21:31:091
1836199250,24cyclictest12759-21diskmemload21:44:143
1836199250,24cyclictest12759-21diskmemload00:03:063
1836199250,24cyclictest0-21swapper/322:22:323
18360992523,1cyclictest10861-21apt-get23:33:222
18360992523,1cyclictest0-21swapper/223:46:012
18360992520,4cyclictest0-21swapper/222:33:282
1836099250,24cyclictest843-21apt-get23:53:232
18359992523,1cyclictest12759-21diskmemload23:48:321
1835999250,24cyclictest18568-21sh22:41:541
18358992523,1cyclictest21204-21awk00:10:000
1835899250,24cyclictest7252-21rm22:31:510
1836199240,23cyclictest3442-21sh23:25:553
1836199240,23cyclictest23670-21apt-get19:23:213
1836199240,23cyclictest12759-21diskmemload23:12:103
1836199240,23cyclictest0-21swapper/323:50:283
1836199240,23cyclictest0-21swapper/322:40:483
1836199240,1cyclictest15187-21apt-get00:05:013
1836199240,0cyclictest0-21swapper/300:28:013
18360992423,1cyclictest7066-21ssh21:33:302
18360992423,1cyclictest0-21swapper/200:07:512
18360992423,0cyclictest0-21swapper/221:52:512
18360992422,1cyclictest32232-1kworker/u9:022:39:122
18360992422,1cyclictest0-21swapper/223:38:042
18360992421,2cyclictest31195-21mailstats22:23:292
18360992420,4cyclictest0-21swapper/221:39:202
1836099240,23cyclictest13898-21sh23:06:352
1836099240,23cyclictest0-21swapper/200:26:392
1836099240,23cyclictest0-21swapper/200:16:572
18359992423,1cyclictest30448-21ssh21:54:151
1835999240,24cyclictest0-21swapper/123:40:091
1835999240,23cyclictest12759-21diskmemload23:13:071
1835999240,0cyclictest0-21swapper/123:52:531
18358992421,2cyclictest3448-21sh23:54:300
18358992420,3cyclictest14406-21rm00:03:560
1835899240,24cyclictest12759-21diskmemload22:02:500
1835899240,24cyclictest0-21swapper/022:53:190
1835899240,24cyclictest0-21swapper/021:53:500
1835899240,23cyclictest29343-21ssh00:18:080
1835899240,1cyclictest606-21dbus-daemon23:00:010
1835899240,1cyclictest0-21swapper/000:26:530
1835899240,0cyclictest12759-21diskmemload22:19:190
1835899240,0cyclictest0-21swapper/022:06:400
18361992323,0cyclictest12759-21diskmemload22:18:163
18361992323,0cyclictest12759-21diskmemload00:11:553
18361992323,0cyclictest0-21swapper/322:35:023
18361992322,1cyclictest0-21swapper/322:08:173
18361992322,1cyclictest0-21swapper/300:39:343
18361992322,1cyclictest0-21swapper/300:15:023
18361992322,0cyclictest0-21swapper/321:25:223
18361992321,1cyclictest16386-21munin-plugin-st20:10:003
18361992320,2cyclictest12759-21diskmemload22:11:193
1836199230,2cyclictest14321-21diskmemload23:35:213
1836199230,23cyclictest12759-21diskmemload00:20:173
1836199230,23cyclictest0-21swapper/323:07:293
1836199230,23cyclictest0-21swapper/322:02:133
1836199230,23cyclictest0-21swapper/321:45:093
1836199230,22cyclictest8489-21grep22:33:223
1836199230,22cyclictest7578-21sh23:00:323
1836199230,22cyclictest29399-21cron23:20:003
1836199230,0cyclictest0-21swapper/323:56:523
1836199230,0cyclictest0-21swapper/322:47:253
18360992323,0cyclictest12759-21diskmemload22:50:362
18360992323,0cyclictest12759-21diskmemload00:02:202
18360992323,0cyclictest0-21swapper/221:55:272
18360992323,0cyclictest0-21swapper/221:49:312
18360992323,0cyclictest0-21swapper/221:20:252
18360992321,1cyclictest0-21swapper/223:40:012
18360992320,2cyclictest18622-21munin-plugin-st21:15:012
18360992320,2cyclictest12476-21awk23:05:002
18360992320,0cyclictest0-21swapper/221:19:172
1836099230,2cyclictest23761-21rm22:46:212
1836099230,2cyclictest21707-21apt-get20:23:202
1836099230,23cyclictest0-21swapper/223:25:552
1836099230,23cyclictest0-21swapper/200:12:122
1836099230,22cyclictest1725-21rm00:22:102
1836099230,22cyclictest12759-21diskmemload00:36:402
1836099230,22cyclictest11864-21sh22:06:562
1836099230,1cyclictest12759-21diskmemload22:10:142
1836099230,0cyclictest12759-21diskmemload22:16:062
1836099230,0cyclictest0-21swapper/221:40:422
1836099230,0cyclictest0-21swapper/221:28:242
18359992323,0cyclictest75-21kswapd000:03:221
18359992323,0cyclictest0-21swapper/122:38:441
18359992321,1cyclictest7129-21sh22:31:411
18359992321,1cyclictest23164-21munin-run19:20:001
18359992321,1cyclictest12770-21munin-run21:10:011
18359992321,1cyclictest0-21swapper/122:52:441
18359992321,1cyclictest0-21swapper/122:46:321
18359992321,1cyclictest0-21swapper/121:48:211
18359992321,1cyclictest0-21swapper/121:15:151
18359992321,1cyclictest0-21swapper/100:26:501
1835999231,1cyclictest12759-21diskmemload21:12:221
1835999230,2cyclictest20427-21ssh00:09:021
1835999230,2cyclictest18160-21perf23:10:001
1835999230,23cyclictest0-21swapper/122:58:031
1835999230,23cyclictest0-21swapper/122:08:231
1835999230,22cyclictest9627-21munin-run00:00:001
1835999230,22cyclictest31831-21sh22:23:591
1835999230,22cyclictest31768-21ssh21:27:271
1835999230,22cyclictest15047-21rm21:40:461
1835999230,0cyclictest12759-21diskmemload22:00:441
1835999230,0cyclictest0-21swapper/123:39:381
1835999230,0cyclictest0-21swapper/122:26:541
1835999230,0cyclictest0-21swapper/122:17:061
1835999230,0cyclictest0-21swapper/121:21:181
18358992323,0cyclictest0-21swapper/023:55:030
18358992323,0cyclictest0-21swapper/023:17:030
18358992323,0cyclictest0-21swapper/023:14:550
18358992323,0cyclictest0-21swapper/023:05:390
18358992323,0cyclictest0-21swapper/021:21:500
18358992322,1cyclictest62550irq/127-eno123:03:270
18358992322,1cyclictest62550irq/127-eno121:46:360
18358992322,1cyclictest0-21swapper/022:29:420
18358992321,1cyclictest15603-21sh21:41:400
18358992320,2cyclictest23124-21sh19:20:000
18358992320,2cyclictest20647-21ssh22:13:500
18358992320,2cyclictest1-21systemd19:40:010
1835899230,23cyclictest12759-21diskmemload23:27:130
1835899230,23cyclictest12759-21diskmemload22:44:210
1835899230,23cyclictest0-21swapper/021:56:570
1835899230,23cyclictest0-21swapper/021:18:220
1835899230,22cyclictest25942-21ssh00:13:510
1835899230,22cyclictest20410-21ssh23:41:080
1835899230,22cyclictest13279-21ssh21:10:170
1835899230,22cyclictest0-21swapper/023:36:450
1835899230,0cyclictest12759-21diskmemload00:37:250
1835899230,0cyclictest0-21swapper/021:32:020
18361992222,0cyclictest0-21swapper/321:51:243
18361992221,1cyclictest0-21swapper/322:58:453
18361992220,1cyclictest0-21swapper/323:40:103
18361992219,2cyclictest27931-21sh19:30:003
18361992219,2cyclictest12753-21cron21:10:013
1836199220,21cyclictest9241-21ssh21:35:383
1836199220,21cyclictest31253-21apt-get19:38:193
1836199220,21cyclictest29852-21ssh23:20:253
1836199220,21cyclictest2928-21ssh21:58:313
1836199220,21cyclictest0-21swapper/323:45:023
1836199220,21cyclictest0-21swapper/321:23:403
1836199220,21cyclictest0-21swapper/320:05:003
1836199220,21cyclictest0-21swapper/300:30:563
1836199220,1cyclictest4445-21apt-get19:48:233
1836199220,1cyclictest13849-21awk23:35:013
1836199220,1cyclictest13064-21sh21:10:013
1836199220,1cyclictest0-21swapper/322:26:473
18360992222,0cyclictest0-21swapper/223:20:232
18360992222,0cyclictest0-21swapper/223:10:302
18360992221,1cyclictest0-21swapper/223:15:292
18360992220,1cyclictest1669-21ssh22:55:012
1836099220,22cyclictest0-21swapper/222:25:412
1836099220,22cyclictest0-21swapper/220:18:232
1836099220,21cyclictest3538-21apt-get19:45:022
1836099220,21cyclictest0-21swapper/222:40:242
1836099220,21cyclictest0-21swapper/222:03:562
1836099220,1cyclictest0-21swapper/223:55:152
18359992222,0cyclictest0-21swapper/123:31:561
18359992222,0cyclictest0-21swapper/123:18:211
18359992222,0cyclictest0-21swapper/121:56:421
18359992222,0cyclictest0-21swapper/100:15:441
18359992221,1cyclictest0-21swapper/123:22:211
18359992220,1cyclictest4153-21apt-get19:45:021
18359992220,1cyclictest0-21swapper/100:35:021
1835999220,21cyclictest7562-21ssh23:00:311
1835999220,21cyclictest738-21cron20:45:001
1835999220,21cyclictest0-21swapper/100:20:191
1835999220,1cyclictest12759-21diskmemload21:35:021
18358992222,0cyclictest0-21swapper/021:25:250
1835899220,2cyclictest27268-21sh23:47:520
1835899220,22cyclictest2550-21ssh00:23:190
1835899220,22cyclictest0-21swapper/022:22:420
1835899220,21cyclictest0-21swapper/020:48:220
1835899220,21cyclictest0-21swapper/019:40:020
1835899220,21cyclictest0-21swapper/019:28:210
1835899220,1cyclictest8548-21ssh23:30:120
1835899220,1cyclictest22926-21ssh22:45:100
1835899220,1cyclictest21178-21sendmail-msp20:20:000
1835899220,1cyclictest11794-21ssh22:35:250
1835899220,1cyclictest10949-21ssh21:37:570
1835899220,0cyclictest0-21swapper/020:43:220
1836199210,21cyclictest0-21swapper/319:30:023
1836199210,20cyclictest0-21swapper/320:53:233
1836199210,20cyclictest0-21swapper/319:18:223
1836199210,1cyclictest0-21swapper/322:50:043
1836199210,0cyclictest8504-21apt-get21:03:203
18360992120,0cyclictest26501-21apt-get20:33:212
18360992119,1cyclictest30745-21idleruntime-cro19:35:002
1836099210,1cyclictest0-21swapper/220:08:202
18359992121,0cyclictest0-21swapper/123:26:291
18359992121,0cyclictest0-21swapper/120:18:221
18359992121,0cyclictest0-21swapper/120:13:211
1835999210,21cyclictest0-21swapper/120:58:231
1835999210,21cyclictest0-21swapper/120:23:201
1835999210,21cyclictest0-21swapper/119:40:021
1835999210,20cyclictest0-21swapper/120:28:221
18358992120,0cyclictest8715-21apt-get19:55:020
1835899210,0cyclictest0-21swapper/020:13:210
18361992016,3cyclictest30802-21sendmail-msp20:40:013
1836199200,0cyclictest0-21swapper/320:48:223
18360992020,0cyclictest0-21swapper/219:38:192
18360992020,0cyclictest0-21swapper/219:18:222
18360992019,1cyclictest3697-21apt-get20:53:232
18360992018,1cyclictest6092-21apt-get20:58:232
1836099200,0cyclictest0-21swapper/220:43:212
18359992020,0cyclictest0-21swapper/119:33:201
18359992020,0cyclictest0-21swapper/119:28:211
18359992020,0cyclictest0-21swapper/119:15:001
18358992020,0cyclictest6841-21apt-get19:53:220
18358992020,0cyclictest0-21swapper/021:03:200
18358992020,0cyclictest0-21swapper/020:38:210
18360991919,0cyclictest0-21swapper/221:05:002
18360991919,0cyclictest0-21swapper/220:05:002
18360991917,1cyclictest20744-21grep19:15:002
18359991919,0cyclictest0-21swapper/120:48:221
18359991919,0cyclictest0-21swapper/119:23:211
18358991919,0cyclictest0-21swapper/020:28:220
18358991919,0cyclictest0-21swapper/020:03:190
18358991919,0cyclictest0-21swapper/019:13:240
18358991918,1cyclictest0-21swapper/021:10:010
18358991918,1cyclictest0-21swapper/020:53:230
18361991818,0cyclictest18862-21apt-get19:13:243
18361991818,0cyclictest0-21swapper/320:13:213
18360991818,0cyclictest0-21swapper/219:58:202
18359991818,0cyclictest0-21swapper/120:38:211
18359991818,0cyclictest0-21swapper/120:03:191
18358991818,0cyclictest0-21swapper/019:48:230
18359991717,0cyclictest0-21swapper/121:03:201
1835999170,14cyclictest793-21lldpd19:57:311
18358991717,0cyclictest0-21swapper/019:30:020
1836199160,15cyclictest28387-21perf20:35:013
1836099160,1cyclictest0-21swapper/221:10:012
1836099160,15cyclictest18594-21unixbench_singl20:13:312
1836099160,15cyclictest0-21swapper/220:48:272
1836099160,15cyclictest0-21swapper/219:23:242
18358991616,0cyclictest0-21swapper/020:23:200
1835899160,0cyclictest0-21swapper/020:58:230
18361991515,0cyclictest0-21swapper/319:40:023
18361991514,0cyclictest0-21swapper/319:58:203
1836199150,1cyclictest31504-21cpuspeed_turbos20:43:223
18360991515,0cyclictest0-21swapper/219:43:202
18360991512,2cyclictest24731-21gltestperf20:28:242
1836199140,14cyclictest0-21swapper/320:56:303
1836199140,14cyclictest0-21swapper/320:22:003
1836199140,14cyclictest0-21swapper/320:15:133
1836199140,14cyclictest0-21swapper/319:51:563
18360991414,0cyclictest0-21swapper/219:25:172
1836099140,14cyclictest0-21swapper/220:38:302
1836099140,14cyclictest0-21swapper/219:53:572
1835999140,0cyclictest0-21swapper/119:36:011
18358991414,0cyclictest0-21swapper/019:23:210
1835899140,14cyclictest0-21swapper/020:33:360
1835899140,0cyclictest0-21swapper/020:09:540
18361991313,0cyclictest0-21swapper/320:27:593
18359991313,0cyclictest0-21swapper/119:51:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional