You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 08:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri Dec 05, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
153162306272,21sleep20-21swapper/219:08:492
151792269235,22sleep10-21swapper/119:07:071
131872261227,22sleep00-21swapper/019:05:020
152402258223,23sleep30-21swapper/319:07:503
94222600,0sleep00-21swapper/021:55:020
87372580,0sleep10-21swapper/100:37:161
45472580,0sleep30-21swapper/300:34:203
308112540,0sleep20-21swapper/221:47:262
247612530,0sleep10-21swapper/122:04:481
303302200,0sleep00-21swapper/020:50:220
167602200,0sleep20-21swapper/223:52:562
127622200,0sleep20-21swapper/222:18:262
310182190,0sleep30-21swapper/322:30:523
206872190,0sleep30-21swapper/322:01:203
144232180,0sleep20-21swapper/221:57:522
304172170,0sleep00-21swapper/019:40:150
242102140,0sleep10-21swapper/123:11:551
228072140,0sleep10-21swapper/123:34:521
52892120,0sleep10-21swapper/119:55:211
1550999105,5cyclictest12-21ksoftirqd/022:20:000
31098290,0sleep30-21swapper/321:26:133
155219994,3cyclictest19982-21systemd-journal20:31:273
155219994,3cyclictest19982-21systemd-journal20:17:203
155179990,8cyclictest17251-21sh21:38:582
155139994,3cyclictest7661-21lldpd19:45:141
155099993,4cyclictest7661-21lldpd22:45:360
155219984,3cyclictest7661-21lldpd21:11:183
155219983,3cyclictest19982-21systemd-journal00:18:543
155219980,7cyclictest13577-21ssh22:41:173
155179985,2cyclictest508-21dbus-daemon21:01:352
155179984,3cyclictest30654-21snmpd22:42:222
155179984,3cyclictest19982-21systemd-journal22:02:402
155179983,3cyclictest19982-21systemd-journal23:58:032
155179983,3cyclictest19982-21systemd-journal23:44:432
155179983,3cyclictest19982-21systemd-journal22:08:462
155179983,3cyclictest19982-21systemd-journal00:20:002
155139985,2cyclictest25528-21sshd21:44:291
155139984,3cyclictest9829-21apt-get21:55:171
155139984,3cyclictest508-21dbus-daemon20:06:311
155139984,3cyclictest508-21dbus-daemon00:25:011
155139984,3cyclictest19982-21systemd-journal23:41:471
155139984,3cyclictest19982-21systemd-journal21:16:271
155139984,3cyclictest14152-21grep20:15:171
155139983,3cyclictest19982-21systemd-journal19:44:481
155099983,3cyclictest19982-21systemd-journal19:35:010
155099980,2cyclictest2643-21diskstats23:20:130
3773270,0sleep10-21swapper/121:05:161
155219976,1cyclictest34-21ksoftirqd/321:00:003
155219974,2cyclictest7490-21idleruntime-cro22:15:013
155219974,2cyclictest10471-21run-parts23:25:203
155219973,3cyclictest508-21dbus-daemon23:35:213
155219973,3cyclictest4790-21pmu-power21:30:243
155219973,3cyclictest19982-21systemd-journal23:09:283
155219973,3cyclictest19982-21systemd-journal20:21:423
155219973,3cyclictest19982-21systemd-journal19:56:333
155219973,3cyclictest0-21swapper/300:25:473
155219973,3cyclictest0-21swapper/300:25:473
155219973,2cyclictest19982-21systemd-journal19:11:003
155219972,3cyclictest502-21systemd-logind00:09:443
155219972,3cyclictest19982-21systemd-journal00:22:533
155219970,7cyclictest0-21swapper/321:43:463
155219970,2cyclictest30929-21df_inode23:40:143
155219970,2cyclictest19982-21systemd-journal22:54:293
155179974,2cyclictest15914-21latency_hist23:30:012
155179973,3cyclictest508-21dbus-daemon23:06:452
155179973,3cyclictest508-21dbus-daemon21:20:002
155179973,3cyclictest25659-21systemctl20:40:202
155179973,3cyclictest19982-21systemd-journal22:22:422
155179973,3cyclictest19982-21systemd-journal19:28:582
155179973,3cyclictest0-21swapper/200:02:392
155179973,2cyclictest502-21systemd-logind23:31:222
155179973,1cyclictest0-21swapper/222:48:262
155179973,1cyclictest0-21swapper/221:22:462
155179973,1cyclictest0-21swapper/200:06:542
155179972,3cyclictest19982-21systemd-journal23:12:542
155179972,3cyclictest19982-21systemd-journal19:57:192
155139976,1cyclictest22-21ksoftirqd/121:55:011
155139974,2cyclictest29931-21sshd22:07:391
155139974,2cyclictest19982-21systemd-journal23:17:031
155139974,2cyclictest17502-21sh20:25:001
155139973,3cyclictest737-21memory22:55:191
155139973,3cyclictest7151-21grep20:00:171
155139973,3cyclictest19982-21systemd-journal22:18:281
155139973,3cyclictest19982-21systemd-journal20:45:001
155139973,3cyclictest1-21systemd22:31:421
155139973,3cyclictest0-21swapper/121:22:161
155139973,3cyclictest0-21swapper/100:34:371
155139973,2cyclictest20523-21systemd-udevd23:36:191
155139973,1cyclictest0-21swapper/123:22:351
155139973,1cyclictest0-21swapper/123:07:061
155139973,1cyclictest0-21swapper/121:12:311
155139972,4cyclictest8248-21gltestperf00:10:161
155139972,3cyclictest19982-21systemd-journal23:29:171
155139972,3cyclictest19982-21systemd-journal22:22:411
155139972,3cyclictest19982-21systemd-journal19:36:271
155139972,3cyclictest19982-21systemd-journal00:00:001
155139971,5cyclictest22391-21fschecks_count22:25:161
155139970,6cyclictest23989-21ntpq19:25:161
155099975,1cyclictest0-21swapper/020:00:200
155099974,2cyclictest18159-21irqstats19:15:000
155099974,2cyclictest1-21systemd00:00:010
155099973,3cyclictest508-21dbus-daemon23:42:370
155099973,3cyclictest508-21dbus-daemon21:05:450
155099973,3cyclictest14747-21awk20:15:200
155099973,3cyclictest0-21swapper/023:26:210
155099973,3cyclictest0-21swapper/022:58:210
155099973,3cyclictest0-21swapper/022:52:370
155099973,3cyclictest0-21swapper/022:35:280
155099973,3cyclictest0-21swapper/022:28:340
155099973,3cyclictest0-21swapper/000:12:510
155099973,1cyclictest0-21swapper/023:30:220
155099972,3cyclictest508-21dbus-daemon21:16:350
155099972,3cyclictest19982-21systemd-journal21:35:470
155099972,3cyclictest19982-21systemd-journal20:45:010
155099972,3cyclictest19982-21systemd-journal20:26:390
155099972,3cyclictest19982-21systemd-journal00:22:540
9453260,0sleep20-21swapper/200:10:292
155219963,2cyclictest904-21sed19:45:223
155219963,2cyclictest8507-21rm22:15:143
155219963,2cyclictest668-21runrttasks22:55:093
155219963,2cyclictest4234-21wc22:35:173
155219963,2cyclictest30654-21snmpd00:35:013
155219963,2cyclictest28444-21unixbench-2d20:45:223
155219963,2cyclictest26786-21sh22:28:233
155219963,2cyclictest19982-21systemd-journal19:37:443
155219963,2cyclictest18716-21grep19:15:133
155219963,2cyclictest17557-21cron22:45:033
155219963,2cyclictest1390-21cpuspeed_turbos21:00:173
155219963,2cyclictest11628-21expr21:35:123
155219963,1cyclictest0-21swapper/321:50:323
155219962,3cyclictest7520-21cat23:00:153
155219962,3cyclictest5462-21expr23:45:153
155219962,3cyclictest5164-21ntpd23:55:203
155219962,3cyclictest508-21dbus-daemon22:21:423
155219962,3cyclictest508-21dbus-daemon20:00:003
155219962,3cyclictest3204-21wc19:50:193
155219962,3cyclictest30654-21snmpd23:50:433
155219962,3cyclictest30654-21snmpd20:50:253
155219962,3cyclictest30654-21snmpd19:34:273
155219962,3cyclictest25858-21ls22:05:153
155219962,3cyclictest23939-21sshd20:37:113
155219962,3cyclictest23939-21sshd20:37:113
155219962,3cyclictest23772-21sshd21:21:273
155219962,3cyclictest19982-21systemd-journal21:55:273
155219962,3cyclictest18178-21cut20:25:153
155219962,3cyclictest16915-21fw_packets23:30:163
155219962,3cyclictest14820-21grep21:15:223
155219962,2cyclictest31519-21sshd19:42:153
155219962,1cyclictest0-21swapper/323:15:053
155219962,1cyclictest0-21swapper/300:10:153
155219961,3cyclictest19982-21systemd-journal20:09:003
155219961,1cyclictest5500-21diskmemload23:11:483
155219960,6cyclictest0-21swapper/323:21:273
155219960,5cyclictest26977-21expr21:45:173
155219960,5cyclictest24846-21df20:40:153
155219960,4cyclictest26400-40gzip00:00:013
155219960,2cyclictest11032-21/usr/sbin/munin20:10:213
155179963,2cyclictest9188-21expr20:05:152
155179963,2cyclictest668-21runrttasks21:25:542
155179963,2cyclictest30654-21snmpd19:31:332
155179963,2cyclictest22119-21ls19:20:192
155179963,2cyclictest20562-21idleruntime-cro19:20:012
155179963,2cyclictest19982-21systemd-journal22:35:282
155179963,2cyclictest11736-21in:imuxsock20:00:012
155179962,3cyclictest7547-21awk21:10:202
155179962,3cyclictest6304-21cat00:35:202
155179962,3cyclictest32310-21cat00:30:142
155179962,3cyclictest30654-21snmpd22:27:172
155179962,3cyclictest30654-21snmpd20:59:012
155179962,3cyclictest30654-21snmpd19:42:202
155179962,3cyclictest29635-21cat22:30:202
155179962,3cyclictest28485-21sed23:15:152
155179962,3cyclictest27000-21ls00:25:192
155179962,3cyclictest27000-21ls00:25:192
155179962,3cyclictest2590-21cat19:50:152
155179962,3cyclictest24373-21ntpq23:35:182
155179962,3cyclictest21706-21cat00:20:162
155179962,3cyclictest19982-21systemd-journal20:50:002
155179962,3cyclictest19660-21cat21:40:142
155179962,3cyclictest18666-21netstat20:25:172
155179962,3cyclictest13648-21expr20:15:132
155179962,3cyclictest0-21swapper/223:46:102
155179962,3cyclictest0-21swapper/222:50:142
155179962,1cyclictest0-21swapper/223:00:552
155179962,1cyclictest0-21swapper/222:12:112
155179962,1cyclictest0-21swapper/221:30:012
155179961,3cyclictest19982-21systemd-journal19:45:132
155179961,2cyclictest5196-21ssh21:51:462
155179960,5cyclictest3274-21ntp_states23:20:192
155179960,5cyclictest16967-21/usr/sbin/munin20:20:232
155179960,3cyclictest17708-21munin-run19:15:012
155179960,0cyclictest4888-21ssh22:58:372
155139966,0cyclictest0-21swapper/120:10:151
155139964,1cyclictest5500-21diskmemload22:35:131
155139964,1cyclictest19188-21hddtemp_smartct19:15:151
155139963,2cyclictest8852-21ssh23:47:101
155139963,2cyclictest508-21dbus-daemon22:45:281
155139963,2cyclictest3339-21rm00:06:041
155139963,2cyclictest30654-21snmpd21:46:041
155139963,2cyclictest2355-21proc_pri21:00:241
155139963,2cyclictest22384-21grep20:35:131
155139963,2cyclictest22384-21grep20:35:131
155139963,2cyclictest22-21ksoftirqd/120:50:191
155139963,2cyclictest19222-21unixbench_multi20:25:201
155139963,2cyclictest15454-21grep00:15:201
155139963,2cyclictest13672-21grep23:50:181
155139963,2cyclictest0-21swapper/123:57:331
155139962,3cyclictest984-21seq20:59:471
155139962,3cyclictest7926-21cut23:00:191
155139962,3cyclictest508-21dbus-daemon20:45:191
155139962,3cyclictest3012-21grep19:50:191
155139962,3cyclictest29022-21grep21:25:161
155139962,3cyclictest25499-21cat19:30:121
155139962,3cyclictest21630-21load19:20:151
155139962,3cyclictest20642-21cat20:30:211
155139962,3cyclictest17135-21cat19:10:211
155139962,1cyclictest0-21swapper/100:26:101
155139962,1cyclictest0-21swapper/100:26:101
155139961,4cyclictest12088-21wc21:35:141
155139961,4cyclictest0-21swapper/122:11:551
155139961,3cyclictest19982-21systemd-journal21:32:011
155139960,4cyclictest19982-21systemd-journal22:42:071
155139960,2cyclictest26470-21ntp_states22:50:191
155099965,1cyclictest14347-21apt-get00:15:140
155099963,2cyclictest939-21taskset20:59:120
155099963,2cyclictest7674-21memory23:00:170
155099963,2cyclictest668-21runrttasks19:51:150
155099963,2cyclictest5500-21diskmemload21:12:150
155099963,2cyclictest5474-21ssh00:35:100
155099963,2cyclictest30654-21snmpd21:50:040
155099963,2cyclictest30654-21snmpd20:35:280
155099963,2cyclictest30654-21snmpd20:35:280
155099963,2cyclictest30654-21snmpd19:35:120
155099963,2cyclictest18667-21load22:00:150
155099963,2cyclictest16315-21grep19:10:150
155099962,3cyclictest6053-21cat23:45:170
155099962,3cyclictest508-21dbus-daemon22:30:010
155099962,3cyclictest508-21dbus-daemon20:11:300
155099962,3cyclictest4043-21apt19:55:140
155099962,3cyclictest30654-21snmpd21:45:130
155099962,3cyclictest30654-21snmpd21:27:280
155099962,3cyclictest30654-21snmpd21:00:110
155099962,3cyclictest30654-21snmpd20:05:100
155099962,3cyclictest30654-21snmpd19:47:040
155099962,3cyclictest30654-21snmpd19:25:110
155099962,3cyclictest29741-11brltty23:05:050
155099962,3cyclictest20380-21df20:30:200
155099962,3cyclictest16198-21cat20:20:150
155099962,3cyclictest1516-21cat22:10:170
155099962,3cyclictest11075-21cat22:40:160
155099962,3cyclictest0-21swapper/023:55:090
155099962,3cyclictest0-21swapper/022:20:050
155099962,3cyclictest0-21swapper/021:40:250
155099962,3cyclictest0-21swapper/021:20:040
155099962,3cyclictest0-21swapper/000:30:060
155099962,1cyclictest0-21swapper/023:35:080
155099962,1cyclictest0-21swapper/023:16:470
155099962,1cyclictest0-21swapper/000:25:080
155099962,1cyclictest0-21swapper/000:25:080
155099961,3cyclictest7661-21lldpd20:41:170
155099961,2cyclictest23492-21ssh23:11:160
155099960,4cyclictest19982-21systemd-journal23:50:080
155099960,3cyclictest3382-21rm21:30:020
155099960,3cyclictest2818-21ssh00:05:340
155099960,3cyclictest26603-21rm22:05:190
155219952,2cyclictest30654-21snmpd21:05:133
155219951,3cyclictest23150-21/usr/sbin/munin19:25:133
155219951,3cyclictest20840-21apt-get19:20:123
155179953,1cyclictest11032-21/usr/sbin/munin20:10:142
155179952,2cyclictest29940-21taskset20:50:182
155179952,2cyclictest20695-21uname20:30:222
155179951,3cyclictest28127-21gltestperf19:35:142
155179951,2cyclictest19982-21systemd-journal21:05:202
155179950,3cyclictest19982-21systemd-journal20:35:182
155179950,3cyclictest19982-21systemd-journal20:35:172
155099951,3cyclictest21267-21/usr/sbin/munin19:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional