You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 04:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Thu Nov 27, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135492323291,20sleep20-21swapper/219:09:352
135432315246,23sleep10-21swapper/119:09:301
133622277244,21sleep00-21swapper/019:07:070
134112260225,22sleep30-21swapper/319:07:473
314262680,0sleep00-21swapper/023:20:190
63102610,0sleep30-21swapper/300:10:273
272822610,0sleep00-21swapper/023:18:100
229172590,1sleep20-21swapper/221:45:592
50792580,0sleep10-21swapper/122:40:141
195892200,0sleep20-21swapper/222:28:232
250672160,0sleep20-21swapper/221:25:192
45642150,0sleep10-21swapper/122:18:051
57422140,0sleep00-21swapper/000:36:380
275552140,0chrt0-21swapper/000:27:500
267292140,0sleep20-21swapper/200:01:482
175582140,0sleep30-21swapper/323:33:233
127512100,1sleep30-21swapper/320:15:203
21479290,0sleep30-21swapper/322:07:213
9286280,0sleep20-21swapper/223:05:192
137009984,2cyclictest19982-21systemd-journal19:16:443
137009983,3cyclictest19982-21systemd-journal21:49:213
137009983,3cyclictest19982-21systemd-journal20:26:123
137009983,3cyclictest19982-21systemd-journal00:00:003
136959985,2cyclictest28-21ksoftirqd/223:05:002
136959984,3cyclictest19982-21systemd-journal23:41:132
136959984,3cyclictest19982-21systemd-journal23:21:442
136959984,3cyclictest19982-21systemd-journal20:50:012
136959982,3cyclictest18202-21perf22:50:002
136959982,3cyclictest15374-21munin-run21:20:012
136959982,3cyclictest15374-21munin-run21:20:012
136919984,3cyclictest19982-21systemd-journal21:31:171
136919984,3cyclictest19982-21systemd-journal20:50:351
136919983,3cyclictest19982-21systemd-journal22:51:111
136919983,3cyclictest19982-21systemd-journal22:07:231
136919982,3cyclictest2259-21apt19:54:591
136869987,1cyclictest12-21ksoftirqd/000:00:000
136869983,3cyclictest19982-21systemd-journal22:23:200
136869983,3cyclictest19982-21systemd-journal20:28:550
30051270,0sleep10-21swapper/121:00:201
26324270,0sleep1211rcuc/121:49:011
137009974,2cyclictest508-21dbus-daemon23:21:383
137009974,2cyclictest508-21dbus-daemon19:22:103
137009974,2cyclictest508-21dbus-daemon19:22:093
137009973,3cyclictest7661-21lldpd21:28:543
137009973,3cyclictest30654-21snmpd20:38:543
137009973,3cyclictest30654-21snmpd19:25:283
137009973,3cyclictest0-21swapper/323:09:073
137009973,2cyclictest19982-21systemd-journal21:10:123
137009973,1cyclictest0-21swapper/323:00:133
137009971,4cyclictest19982-21systemd-journal21:36:553
137009970,7cyclictest0-21swapper/323:39:593
137009970,6cyclictest15374-21grep19:10:203
137009970,3cyclictest24220-21/usr/sbin/munin20:50:183
136959975,1cyclictest24955-21sh23:16:032
136959974,2cyclictest28019-21sendmail-msp19:40:012
136959974,2cyclictest22904-21systemctl23:59:592
136959973,3cyclictest9847-21cat23:50:182
136959973,3cyclictest5358-21idleruntime-cro21:35:012
136959973,3cyclictest508-21dbus-daemon21:05:002
136959973,3cyclictest29741-11brltty20:03:522
136959973,3cyclictest1945-21ntpq21:10:162
136959973,2cyclictest19982-21systemd-journal19:22:102
136959973,2cyclictest19982-21systemd-journal19:22:102
136959973,1cyclictest4070-21perf00:09:592
136959973,1cyclictest0-21swapper/221:52:572
136959972,3cyclictest19982-21systemd-journal23:10:202
136959972,3cyclictest19982-21systemd-journal22:31:292
136959972,3cyclictest17049-21dump-pmu-power22:05:002
136959971,3cyclictest14104-21munin-run22:25:012
136959970,4cyclictest8627-21basename23:50:002
136959970,4cyclictest28455-21munin-run21:00:002
136959970,2cyclictest18648-21ssh21:21:032
136919974,2cyclictest472-21diskmemload23:00:201
136919973,3cyclictest920-21awk21:10:111
136919973,3cyclictest508-21dbus-daemon20:56:521
136919973,3cyclictest508-21dbus-daemon19:35:551
136919973,3cyclictest32316-21sshd19:48:191
136919973,3cyclictest30654-21snmpd19:14:421
136919973,3cyclictest19982-21systemd-journal23:06:431
136919973,3cyclictest19982-21systemd-journal20:05:331
136919973,3cyclictest0-21swapper/123:49:401
136919973,3cyclictest0-21swapper/123:41:021
136919973,3cyclictest0-21swapper/122:14:051
136919973,1cyclictest0-21swapper/100:23:341
136919973,1cyclictest0-21swapper/100:09:161
136919972,3cyclictest23512-21cron19:30:011
136919972,3cyclictest19982-21systemd-journal20:37:151
136919970,3cyclictest16735-21/usr/sbin/munin19:15:191
136919970,1cyclictest22134-21ssh21:24:171
136869974,2cyclictest51950irq/137-enp4s0-22:10:140
136869974,2cyclictest508-21dbus-daemon20:09:440
136869974,2cyclictest12-21ksoftirqd/020:50:010
136869974,2cyclictest11702-21expr22:00:220
136869973,3cyclictest508-21dbus-daemon23:15:010
136869973,3cyclictest508-21dbus-daemon21:10:010
136869973,3cyclictest32156-21cat21:30:170
136869973,3cyclictest29741-11brltty22:37:240
136869973,3cyclictest2158-21df_inode23:45:120
136869973,3cyclictest0-21swapper/023:40:490
136869973,3cyclictest0-21swapper/022:57:280
136869973,3cyclictest0-21swapper/021:49:140
136869973,2cyclictest19982-21systemd-journal20:55:010
136869973,1cyclictest0-21swapper/022:05:150
136869973,1cyclictest0-21swapper/021:57:110
136869972,3cyclictest7661-21lldpd00:21:440
136869972,3cyclictest19982-21systemd-journal21:17:430
136869972,3cyclictest19982-21systemd-journal21:17:430
136869972,3cyclictest19982-21systemd-journal20:03:530
136869971,3cyclictest15308-21rm00:17:510
136869971,2cyclictest18869-21ssh21:43:530
136869971,1cyclictest1-21systemd21:11:280
137009966,0cyclictest0-21swapper/323:25:473
137009963,2cyclictest7434-21cut20:05:143
137009963,2cyclictest34-21ksoftirqd/321:00:113
137009963,2cyclictest28276-21smart_sda23:40:173
137009963,2cyclictest24842-21sh22:10:123
137009963,2cyclictest22271-21sh22:52:113
137009963,2cyclictest17939-21ssh21:20:263
137009963,2cyclictest14004-21expr20:20:113
137009963,2cyclictest0-21swapper/300:22:463
137009963,1cyclictest0-21swapper/300:27:533
137009963,1cyclictest0-21swapper/300:17:313
137009962,3cyclictest9379-21expr20:10:143
137009962,3cyclictest7921-21cat22:20:143
137009962,3cyclictest30821-21df_inode00:05:133
137009962,3cyclictest30654-21snmpd23:10:403
137009962,3cyclictest30654-21snmpd22:45:253
137009962,3cyclictest30654-21snmpd21:50:093
137009962,3cyclictest30654-21snmpd21:40:173
137009962,3cyclictest30654-21snmpd19:46:313
137009962,3cyclictest28578-21expr19:40:133
137009962,3cyclictest22020-21apt-get20:45:123
137009962,3cyclictest17264-21df20:30:093
137009962,3cyclictest16855-21expr23:55:143
137009962,3cyclictest14650-21ls22:25:133
137009962,3cyclictest10150-21apt-get22:00:133
137009962,3cyclictest0-21swapper/321:59:173
137009962,3cyclictest0-21swapper/321:18:373
137009962,3cyclictest0-21swapper/321:18:373
137009962,2cyclictest19982-21systemd-journal22:57:203
137009962,1cyclictest0-21swapper/322:40:553
137009962,1cyclictest0-21swapper/322:35:223
137009962,1cyclictest0-21swapper/300:38:573
137009962,1cyclictest0-21swapper/300:32:353
137009961,3cyclictest19982-21systemd-journal23:45:003
137009961,3cyclictest19982-21systemd-journal20:44:563
137009961,2cyclictest32662-21ssh21:30:303
137009961,2cyclictest32186-21apt-get22:15:103
137009960,6cyclictest0-21swapper/323:16:163
137009960,5cyclictest9992-21/usr/sbin/munin23:50:193
137009960,0cyclictest0-21swapper/322:31:183
136959966,0cyclictest0-21swapper/200:20:532
136959963,2cyclictest8113-21sh21:35:522
136959963,2cyclictest30654-21snmpd19:55:512
136959963,2cyclictest30654-21snmpd00:35:092
136959963,2cyclictest30195-21ssh22:35:182
136959963,2cyclictest25390-21sshd19:30:552
136959963,2cyclictest19982-21systemd-journal20:21:242
136959963,2cyclictest12109-21grep00:15:162
136959963,2cyclictest11736-21in:imuxsock23:31:362
136959963,2cyclictest11736-21in:imuxsock19:53:022
136959962,3cyclictest5498-21ntpq00:10:152
136959962,3cyclictest508-21dbus-daemon23:30:012
136959962,3cyclictest508-21dbus-daemon22:07:482
136959962,3cyclictest30654-21snmpd19:25:072
136959962,3cyclictest30654-21snmpd19:19:182
136959962,3cyclictest30654-21snmpd00:26:122
136959962,3cyclictest29741-11brltty20:15:092
136959962,3cyclictest25286-21grep22:10:152
136959962,3cyclictest24917-21cat20:50:142
136959962,3cyclictest13916-21cat21:40:152
136959962,3cyclictest1-21systemd20:38:302
136959962,3cyclictest10166-21ntp_kernel_pll_20:10:172
136959962,3cyclictest0-21swapper/223:37:162
136959962,1cyclictest0-21swapper/222:43:352
136959962,1cyclictest0-21swapper/221:59:002
136959961,3cyclictest19982-21systemd-journal22:15:192
136959961,3cyclictest19982-21systemd-journal20:30:102
136959960,5cyclictest25788-21awk22:55:122
136959960,4cyclictest21572-21sshd22:51:312
136919963,3cyclictest27901-21apt-get21:50:111
136919963,2cyclictest508-21dbus-daemon00:25:531
136919963,2cyclictest502-21systemd-logind21:55:421
136919963,2cyclictest12076-21hwlatdetect20:15:171
136919963,2cyclictest11621-21fschecks_count00:15:151
136919963,2cyclictest10713-21ssh22:21:591
136919962,3cyclictest9339-21cat23:50:151
136919962,3cyclictest508-21dbus-daemon21:40:401
136919962,3cyclictest3188-21cat19:55:161
136919962,3cyclictest30654-21snmpd23:30:411
136919962,3cyclictest30654-21snmpd21:09:091
136919962,3cyclictest30654-21snmpd20:20:261
136919962,3cyclictest30654-21snmpd20:03:521
136919962,3cyclictest30654-21snmpd19:31:041
136919962,3cyclictest29921-21expr00:30:131
136919962,3cyclictest24267-21memory00:00:161
136919962,3cyclictest23760-21cat21:25:121
136919962,3cyclictest22716-21expr23:15:121
136919962,3cyclictest22518-21cat22:30:181
136919962,3cyclictest20490-21uname23:35:151
136919962,3cyclictest1-21systemd20:13:541
136919962,3cyclictest0-21swapper/123:26:451
136919962,3cyclictest0-21swapper/100:35:391
136919962,1cyclictest0-21swapper/123:56:221
136919962,1cyclictest0-21swapper/123:20:481
136919962,1cyclictest0-21swapper/123:12:501
136919962,1cyclictest0-21swapper/122:55:221
136919962,1cyclictest0-21swapper/122:45:411
136919962,1cyclictest0-21swapper/122:25:091
136919962,1cyclictest0-21swapper/122:03:371
136919962,1cyclictest0-21swapper/100:10:001
136919961,4cyclictest0-21swapper/121:35:241
136919961,3cyclictest19982-21systemd-journal20:29:201
136919960,6cyclictest0-21swapper/121:17:471
136919960,6cyclictest0-21swapper/121:17:471
136919960,6cyclictest0-21swapper/120:46:151
136919960,5cyclictest30531-21smart_sda22:35:191
136869966,0cyclictest0-21swapper/021:35:090
136869964,1cyclictest30714-21perf21:05:010
136869963,2cyclictest708-21tune2fs19:50:140
136869963,2cyclictest6550-21ssh00:10:410
136869963,2cyclictest356-21sh23:00:040
136869963,2cyclictest32255-21cpuspeed22:15:120
136869963,2cyclictest30638-21cstates00:05:120
136869963,2cyclictest27778-21sh21:50:070
136869963,2cyclictest21624-21ssh22:30:060
136869963,2cyclictest1-21systemd23:50:220
136869962,3cyclictest4293-21cat22:40:120
136869962,3cyclictest32016-21awk19:45:200
136869962,3cyclictest30654-21snmpd22:45:580
136869962,3cyclictest30654-21snmpd20:42:380
136869962,3cyclictest30654-21snmpd19:43:520
136869962,3cyclictest30654-21snmpd19:30:300
136869962,3cyclictest30654-21snmpd19:28:270
136869962,3cyclictest30654-21snmpd19:20:570
136869962,3cyclictest30654-21snmpd19:20:570
136869962,3cyclictest30654-21snmpd19:15:450
136869962,3cyclictest30654-21snmpd19:10:090
136869962,3cyclictest30654-21snmpd00:30:150
136869962,3cyclictest26468-21basename20:55:110
136869962,3cyclictest26362-21expr19:35:130
136869962,3cyclictest20234-21fschecks_count23:35:120
136869962,3cyclictest0-21swapper/023:05:300
136869962,3cyclictest0-21swapper/000:00:070
136869962,1cyclictest0-21swapper/022:25:450
136869961,3cyclictest19982-21systemd-journal21:23:080
136869961,2cyclictest8992-21ssh23:27:180
136869961,2cyclictest12361-21rm23:30:050
136869960,3cyclictest23299-21rm21:25:070
136869960,3cyclictest19042-21df_inode22:50:140
137009953,1cyclictest26479-21apt-get20:55:113
137009953,1cyclictest24208-21kworker/3:219:35:143
137009952,2cyclictest5064-21expr20:00:153
137009952,2cyclictest31216-21cat21:05:123
137009952,2cyclictest30654-21snmpd19:50:013
137009951,2cyclictest19982-21systemd-journal19:55:013
137009950,3cyclictest19982-21systemd-journal19:30:063
136959952,2cyclictest668-21runrttasks19:10:152
136959952,2cyclictest30654-21snmpd20:05:072
136959952,2cyclictest30033-21chrt19:42:412
136959951,3cyclictest31093-21/usr/sbin/munin19:45:142
136959951,3cyclictest30935-21/usr/sbin/munin21:05:122
136959951,3cyclictest29504-21ssh00:30:032
136959951,3cyclictest19788-21apt20:40:082
136959951,3cyclictest16016-21mktemp20:25:022
136919952,2cyclictest30654-21snmpd20:30:021
136919952,2cyclictest28847-21hddtemp_smartct19:40:131
136919952,2cyclictest20372-21head20:40:101
136919952,2cyclictest19006-21acpi19:20:151
136919952,2cyclictest19006-21acpi19:20:151
136869952,2cyclictest9547-21expr20:10:150
136869952,2cyclictest19268-21chrt20:37:000
136869952,2cyclictest17560-21cat20:30:100
136869952,2cyclictest14170-21fschecks_time20:20:130
136869951,3cyclictest5164-21ntpd19:55:190
136869951,3cyclictest19982-21systemd-journal20:15:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional