You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 10:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 31, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20259992624,1cyclictest13824-21diskmemload22:56:052
2025899260,25cyclictest18232-21taskset00:07:131
2026099250,24cyclictest8655-21sh21:33:383
2026099250,24cyclictest0-21swapper/300:16:053
2026099250,1cyclictest17361-21cron20:10:003
2026099250,1cyclictest13824-21diskmemload22:16:093
2025999250,24cyclictest0-21swapper/223:25:122
2025999250,24cyclictest0-21swapper/221:16:042
2025999250,24cyclictest0-21swapper/221:11:462
20258992523,2cyclictest31371-21sh00:19:431
2025899250,24cyclictest0-21swapper/123:23:111
2025799250,24cyclictest15895-21sh23:06:570
2025799250,24cyclictest0-21swapper/000:05:290
20260992424,0cyclictest0-21swapper/321:52:303
20260992422,1cyclictest0-21swapper/300:01:043
2026099240,23cyclictest13824-21diskmemload22:46:493
2026099240,23cyclictest13824-21diskmemload22:02:113
2026099240,23cyclictest0-21swapper/323:40:013
2026099240,1cyclictest3250-21switchtime22:26:143
20259992424,0cyclictest13824-21diskmemload21:22:522
2025999240,23cyclictest20168-21ssh22:12:172
2025999240,23cyclictest0-21swapper/223:36:032
2025999240,23cyclictest0-21swapper/221:46:152
2025999240,23cyclictest0-21swapper/200:33:022
2025999240,23cyclictest0-21swapper/200:28:452
2025999240,23cyclictest0-21swapper/200:11:052
20258992421,2cyclictest929-21ssh23:51:471
20258992421,2cyclictest24956-21sh21:48:111
2025899240,23cyclictest8252-21sh23:59:281
2025899240,23cyclictest0-21swapper/122:11:051
2025899240,1cyclictest5252-21ssh23:26:201
2025899240,1cyclictest29723-21ssh21:52:001
2025899240,1cyclictest0-21swapper/123:31:141
2025899240,0cyclictest0-21swapper/123:05:271
20257992421,2cyclictest11296-21ssh00:31:040
2025799240,24cyclictest0-21swapper/022:59:050
2025799240,23cyclictest0-21swapper/022:53:160
2025799240,0cyclictest0-21swapper/023:26:060
20260992323,0cyclictest0-21swapper/323:16:203
20260992323,0cyclictest0-21swapper/321:24:173
20260992322,1cyclictest13824-21diskmemload22:40:043
20260992321,1cyclictest1855-21rm21:26:503
20260992321,1cyclictest13362-21apt-get22:06:123
20260992321,1cyclictest0-21swapper/322:31:403
20260992321,1cyclictest0-21swapper/300:08:013
20260992320,2cyclictest457-21sh23:22:313
20260992320,2cyclictest19634-21sh00:37:363
2026099230,23cyclictest0-21swapper/322:13:293
2026099230,22cyclictest32004-21ssh22:52:063
2026099230,22cyclictest31540-21sh22:22:523
2026099230,22cyclictest2609-21awk19:40:013
2026099230,22cyclictest0-21swapper/300:00:003
2026099230,1cyclictest0-21swapper/321:00:003
2026099230,0cyclictest0-21swapper/323:44:063
2026099230,0cyclictest0-21swapper/323:32:073
2026099230,0cyclictest0-21swapper/323:28:253
20259992323,0cyclictest0-21swapper/223:56:082
20259992323,0cyclictest0-21swapper/223:50:592
20259992323,0cyclictest0-21swapper/200:16:502
20259992323,0cyclictest0-21swapper/200:02:022
20259992321,1cyclictest0-21swapper/222:40:352
20259992321,1cyclictest0-21swapper/222:36:292
20259992320,2cyclictest29140-21sh22:50:292
2025999230,23cyclictest0-21swapper/223:16:062
2025999230,22cyclictest31956-21sh00:20:062
2025999230,22cyclictest30616-21diskmemload22:21:302
2025999230,22cyclictest2380-21dump-pmu-power23:25:002
2025999230,0cyclictest13824-21diskmemload22:49:032
2025999230,0cyclictest0-21swapper/223:42:192
2025999230,0cyclictest0-21swapper/221:06:032
20258992323,0cyclictest21150-21ssh00:39:541
20258992323,0cyclictest0-21swapper/123:13:061
20258992323,0cyclictest0-21swapper/122:21:131
20258992323,0cyclictest0-21swapper/121:43:561
20258992323,0cyclictest0-21swapper/121:21:381
20258992322,1cyclictest3745-21ssh00:23:441
20258992321,1cyclictest8617-21apt-get00:00:021
2025899230,2cyclictest3076-21sh21:57:251
2025899230,2cyclictest26586-21rm22:47:161
2025899230,23cyclictest0-21swapper/122:53:561
2025899230,23cyclictest0-21swapper/122:27:191
2025899230,23cyclictest0-21swapper/100:13:521
2025899230,22cyclictest7009-21ssh22:30:521
2025899230,22cyclictest4352-21rm21:30:041
2025899230,22cyclictest29817-21basename19:30:001
2025899230,22cyclictest19190-21sh23:40:031
2025899230,22cyclictest0-21swapper/123:16:331
2025899230,0cyclictest13824-21diskmemload23:35:031
2025899230,0cyclictest0-21swapper/122:56:091
2025899230,0cyclictest0-21swapper/122:35:281
2025899230,0cyclictest0-21swapper/121:27:081
20257992323,0cyclictest26150-21ssh22:46:440
20257992323,0cyclictest13824-21diskmemload23:35:240
20257992323,0cyclictest13824-21diskmemload00:22:130
20257992323,0cyclictest0-21swapper/023:57:370
20257992323,0cyclictest0-21swapper/022:30:540
20257992323,0cyclictest0-21swapper/022:25:150
20257992323,0cyclictest0-21swapper/022:06:390
20257992323,0cyclictest0-21swapper/021:38:440
20257992323,0cyclictest0-21swapper/019:26:060
20257992321,1cyclictest29464-21perf20:35:010
20257992321,1cyclictest25432-21irqstats23:16:080
20257992320,2cyclictest31074-21apt-get23:51:060
20257992320,2cyclictest22255-21sh23:41:510
20257992320,2cyclictest19050-21rm23:10:570
20257992320,2cyclictest10295-21ssh22:04:510
2025799230,23cyclictest0-21swapper/022:21:200
2025799230,22cyclictest31348-21ssh21:25:100
2025799230,22cyclictest24501-21ssh21:47:350
2025799230,22cyclictest16860-21ssh21:11:160
2025799230,22cyclictest15006-21munin-run20:05:000
2025799230,22cyclictest13824-21diskmemload23:22:550
2025799230,1cyclictest14395-21ssh00:04:330
2025799230,0cyclictest0-21swapper/022:11:480
2025799230,0cyclictest0-21swapper/021:21:570
20260992222,0cyclictest13824-21diskmemload21:57:353
20260992222,0cyclictest0-21swapper/323:52:423
20260992220,1cyclictest2448-21sh22:56:023
20260992220,1cyclictest22600-21apt-get20:21:043
20260992220,1cyclictest22244-21latency_hist20:20:003
20260992220,1cyclictest0-21swapper/322:36:313
20260992220,1cyclictest0-21swapper/300:30:433
2026099220,22cyclictest4153-21ssh00:24:163
2026099220,21cyclictest26128-21sleep00:15:003
2026099220,21cyclictest21949-21expr21:46:053
2026099220,21cyclictest21127-21apt-get21:16:043
2026099220,21cyclictest10550-21sh23:02:113
2026099220,21cyclictest0-21swapper/323:10:373
2026099220,21cyclictest0-21swapper/321:36:273
2026099220,21cyclictest0-21swapper/320:36:053
2026099220,21cyclictest0-21swapper/300:27:303
2026099220,1cyclictest13824-21diskmemload23:06:343
2026099220,0cyclictest13824-21diskmemload21:10:063
2026099220,0cyclictest0-21swapper/321:42:043
20259992220,1cyclictest0-21swapper/223:45:132
20259992220,1cyclictest0-21swapper/222:05:192
20259992220,1cyclictest0-21swapper/222:00:352
2025999220,21cyclictest606-21dbus-daemon20:10:002
2025999220,21cyclictest32537-21ssh21:55:452
2025999220,21cyclictest26622-21ssh21:50:082
2025999220,21cyclictest24995-21apt-get20:26:052
2025999220,21cyclictest13824-21diskmemload23:10:012
2025999220,21cyclictest13824-21diskmemload22:25:212
2025999220,21cyclictest13824-21diskmemload00:36:072
2025999220,21cyclictest0-21swapper/222:31:092
2025999220,21cyclictest0-21swapper/222:15:292
2025999220,21cyclictest0-21swapper/221:25:182
2025999220,1cyclictest0-21swapper/223:33:572
2025999220,1cyclictest0-21swapper/223:07:442
2025999220,1cyclictest0-21swapper/223:00:072
2025999220,1cyclictest0-21swapper/221:40:142
2025999220,1cyclictest0-21swapper/220:01:052
2025999220,0cyclictest0-21swapper/200:05:482
20258992222,0cyclictest0-21swapper/121:15:171
20258992222,0cyclictest0-21swapper/121:10:051
20258992221,1cyclictest15331-21apt-get20:06:041
20258992220,1cyclictest8412-21ssh22:02:061
20258992220,1cyclictest24944-21ssh22:16:171
20258992220,1cyclictest0-21swapper/122:40:331
20258992220,1cyclictest0-21swapper/121:35:571
2025899220,21cyclictest4581-21apt-get20:51:041
2025899220,21cyclictest11239-21ssh22:05:131
2025899220,21cyclictest0-21swapper/123:46:151
2025899220,21cyclictest0-21swapper/123:00:371
2025899220,1cyclictest5760-21ssh00:26:051
2025899220,1cyclictest0-21swapper/100:30:251
20257992222,0cyclictest13824-21diskmemload21:15:150
20257992221,1cyclictest13824-21diskmemload23:30:010
20257992221,1cyclictest13824-21diskmemload21:42:490
20257992220,1cyclictest25917-21/usr/sbin/munin23:46:060
20257992220,1cyclictest20398-21runrttasks22:41:280
20257992220,1cyclictest0-21swapper/020:40:000
2025799220,2cyclictest2333-21ssh21:56:190
2025799220,22cyclictest0-21swapper/022:15:410
2025799220,21cyclictest4321-21ssh21:30:020
2025799220,21cyclictest13824-21diskmemload00:25:510
2025799220,21cyclictest10117-21ssh23:01:290
2025799220,1cyclictest25679-21sh00:14:300
2025799220,1cyclictest15949-21ssh00:35:010
2025799220,1cyclictest0-21swapper/021:05:000
2025799220,0cyclictest0-21swapper/000:15:370
2026099210,20cyclictest11463-21munin-plugin-st21:05:003
2026099210,20cyclictest0-21swapper/319:30:023
2026099210,0cyclictest0-21swapper/323:45:373
2026099210,0cyclictest0-21swapper/320:11:043
20259992121,0cyclictest0-21swapper/221:36:002
20259992121,0cyclictest0-21swapper/220:21:042
20259992121,0cyclictest0-21swapper/220:11:042
2025999210,21cyclictest0-21swapper/221:30:252
2025999210,20cyclictest0-21swapper/220:31:042
2025999210,20cyclictest0-21swapper/219:16:032
20258992121,0cyclictest0-21swapper/120:21:041
20258992120,1cyclictest0-21swapper/120:11:041
20258992119,1cyclictest7382-21apt19:50:011
20258992119,1cyclictest313-21systemd-journal20:30:011
20257992121,0cyclictest2186-21apt-get20:46:040
20257992121,0cyclictest17723-21apt-get20:11:040
2025799210,21cyclictest0-21swapper/022:35:120
2025799210,1cyclictest2591-21turbostat19:40:010
2025799210,0cyclictest0-21swapper/020:26:050
20260992018,1cyclictest0-21swapper/321:06:023
2026099200,20cyclictest0-21swapper/320:26:053
2026099200,20cyclictest0-21swapper/320:00:023
2026099200,0cyclictest4257-21perf20:50:003
20259992020,0cyclictest0-21swapper/219:56:032
20259992020,0cyclictest0-21swapper/219:31:032
20259992019,0cyclictest0-21swapper/219:41:042
2025999200,20cyclictest0-21swapper/219:51:032
2025999200,0cyclictest0-21swapper/220:16:042
2025999200,0cyclictest0-21swapper/219:21:042
20258992020,0cyclictest0-21swapper/120:16:031
20258992019,1cyclictest11785-21apt-get21:06:031
20258992018,1cyclictest27416-21grep19:25:001
2025899200,0cyclictest0-21swapper/120:36:051
20257992020,0cyclictest0-21swapper/020:06:050
20257992019,1cyclictest0-21swapper/019:31:040
20260991919,0cyclictest0-21swapper/319:46:043
20260991917,1cyclictest12210-21awk20:00:003
20259991919,0cyclictest0-21swapper/221:01:042
20259991917,1cyclictest2599-21perf19:40:012
20258991919,0cyclictest0-21swapper/119:11:051
20258991917,1cyclictest0-21swapper/120:35:011
20257991919,0cyclictest0-21swapper/020:21:030
20257991918,1cyclictest22928-21apt19:16:040
2025799190,18cyclictest9018-21cron21:00:000
20260991817,1cyclictest0-21swapper/319:21:043
20260991816,1cyclictest6648-21awk20:55:003
20259991818,0cyclictest0-21swapper/220:56:042
20259991818,0cyclictest0-21swapper/220:51:052
20259991818,0cyclictest0-21swapper/220:41:032
20259991816,2cyclictest29787-21apt-get20:36:052
20258991818,0cyclictest2935-21apt-get19:41:041
20258991818,0cyclictest0-21swapper/120:01:051
20258991817,0cyclictest7723-21apt-get19:51:041
20257991818,0cyclictest0-21swapper/020:16:040
2025799180,17cyclictest5330-21apt-get19:46:040
20260991717,0cyclictest0-21swapper/319:41:043
20260991717,0cyclictest0-21swapper/319:26:063
20259991717,0cyclictest27744-21apt-get19:26:062
20259991717,0cyclictest0-21swapper/219:46:042
20258991717,0cyclictest0-21swapper/120:46:031
20257991716,1cyclictest0-21swapper/021:06:030
20257991715,2cyclictest6635-21basename20:55:000
2025899160,15cyclictest29799-21apt-get19:30:011
2025899160,15cyclictest0-21swapper/120:56:101
20260991515,0cyclictest20537-21apt-get19:11:053
20260991515,0cyclictest0-21swapper/320:31:043
20257991515,0cyclictest10119-21apt-get19:56:030
20257991515,0cyclictest0-21swapper/019:21:040
2026099140,14cyclictest0-21swapper/320:40:543
2026099140,14cyclictest0-21swapper/319:50:263
2026099140,14cyclictest0-21swapper/319:15:563
2025999140,14cyclictest0-21swapper/220:47:042
2025999140,0cyclictest0-21swapper/219:10:462
20258991414,0cyclictest0-21swapper/119:15:341
2025899140,14cyclictest0-21swapper/121:00:101
2025899140,14cyclictest0-21swapper/119:57:251
20257991414,0cyclictest0-21swapper/019:50:410
2025799140,14cyclictest0-21swapper/020:40:060
2025799140,14cyclictest0-21swapper/019:41:330
2025799140,0cyclictest0-21swapper/019:11:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional