You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 11:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Fri Nov 28, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258432292221,20sleep20-21swapper/219:08:382
255862268234,22sleep10-21swapper/119:05:441
256182264233,19sleep30-21swapper/319:06:103
258512258225,21sleep00-21swapper/019:08:440
292112630,0sleep30-21swapper/323:06:523
201472620,0sleep30-21swapper/321:34:003
16692620,1sleep30-21swapper/321:20:513
60172610,4sleep10-21swapper/100:23:061
160902580,0sleep00-21swapper/021:52:400
132622570,1sleep10-21swapper/100:29:351
225882560,0sleep30-21swapper/323:46:243
127922190,0sleep10-21swapper/121:00:191
224172170,0sleep10-21swapper/121:13:411
147202160,0sleep30-21swapper/321:51:273
7432140,0sleep00-21swapper/021:42:150
194002140,0sleep10-21swapper/100:08:241
190642130,0sleep10-21swapper/122:15:361
2605999109,1cyclictest28-21ksoftirqd/222:10:012
2605999109,1cyclictest28-21ksoftirqd/200:19:592
29026290,0sleep10-21swapper/123:06:411
26167290,0sleep00-21swapper/000:13:440
260599994,3cyclictest19982-21systemd-journal20:05:342
6799280,0sleep20-21swapper/219:35:192
27505280,0sleep00-21swapper/022:21:240
260649984,3cyclictest7661-21lldpd22:41:053
260649983,3cyclictest19982-21systemd-journal23:34:353
260649983,3cyclictest19982-21systemd-journal21:15:133
260649983,3cyclictest19982-21systemd-journal20:57:433
260649983,3cyclictest19982-21systemd-journal19:32:113
260599985,2cyclictest8953-1kworker/u9:122:55:012
260599984,3cyclictest19982-21systemd-journal21:34:012
260599984,2cyclictest19982-21systemd-journal20:24:202
260599983,3cyclictest502-21systemd-logind22:44:572
260559983,4cyclictest30654-21snmpd21:16:431
260559983,3cyclictest21636-21awk20:10:001
260559983,3cyclictest19982-21systemd-journal20:56:521
260559983,3cyclictest19982-21systemd-journal19:44:431
260509984,3cyclictest508-21dbus-daemon21:15:390
260509983,3cyclictest7661-21lldpd22:12:080
260509983,3cyclictest19982-21systemd-journal22:40:010
260509983,3cyclictest19982-21systemd-journal21:21:050
260509983,3cyclictest19982-21systemd-journal20:27:160
260509983,3cyclictest19982-21systemd-journal20:07:380
260509982,3cyclictest938-21munin-run19:25:010
260509980,7cyclictest21526-21ssh22:17:450
11230280,0chrt0-21swapper/220:55:202
9338270,1sleep2271rcuc/223:37:062
5059270,1sleep20-21swapper/222:28:342
4396270,0sleep10-21swapper/121:45:131
260649975,1cyclictest34-21ksoftirqd/319:50:013
260649974,2cyclictest34-21ksoftirqd/320:20:133
260649973,3cyclictest508-21dbus-daemon00:00:003
260649973,3cyclictest30654-21snmpd19:48:133
260649973,3cyclictest19982-21systemd-journal21:01:033
260649973,3cyclictest19982-21systemd-journal20:16:173
260649973,3cyclictest19982-21systemd-journal20:02:323
260649973,3cyclictest19982-21systemd-journal00:08:223
260649973,3cyclictest1-21systemd19:20:013
260649973,3cyclictest0-21swapper/322:51:493
260649973,1cyclictest0-21swapper/323:53:313
260649973,1cyclictest0-21swapper/323:14:053
260649973,1cyclictest0-21swapper/322:23:583
260649973,1cyclictest0-21swapper/321:14:283
260649973,1cyclictest0-21swapper/300:25:193
260649973,1cyclictest0-21swapper/300:11:443
260649972,4cyclictest11736-21in:imuxsock00:23:213
260649972,3cyclictest19982-21systemd-journal23:38:193
260649972,3cyclictest19982-21systemd-journal22:36:103
260649972,3cyclictest19982-21systemd-journal00:03:183
260649971,3cyclictest19982-21systemd-journal00:35:303
260599976,1cyclictest28-21ksoftirqd/220:05:012
260599973,3cyclictest8390-21cat20:50:182
260599973,3cyclictest25647-21ntpq22:20:172
260599973,3cyclictest19982-21systemd-journal21:02:422
260599973,3cyclictest19982-21systemd-journal20:27:372
260599973,3cyclictest0-21swapper/222:31:422
260599973,1cyclictest0-21swapper/222:47:102
260599973,1cyclictest0-21swapper/222:37:402
260599973,1cyclictest0-21swapper/200:01:512
260599972,3cyclictest19982-21systemd-journal23:23:442
260599972,3cyclictest19982-21systemd-journal23:23:442
260599972,3cyclictest19982-21systemd-journal23:01:132
260559973,3cyclictest30654-21snmpd20:13:191
260559973,3cyclictest19982-21systemd-journal23:44:111
260559973,3cyclictest19982-21systemd-journal20:05:001
260559973,3cyclictest19816-21apt-get23:45:141
260559973,3cyclictest0-21swapper/100:13:151
260559973,1cyclictest0-21swapper/123:54:351
260559973,1cyclictest0-21swapper/121:56:021
260559971,4cyclictest19982-21systemd-journal00:37:101
260559970,7cyclictest0-21swapper/123:00:161
260509974,2cyclictest508-21dbus-daemon23:10:000
260509973,3cyclictest6741-21ntpq23:35:170
260509973,3cyclictest6408-21ntpq20:45:160
260509973,3cyclictest502-21systemd-logind00:30:530
260509973,3cyclictest19982-21systemd-journal20:41:160
260509973,3cyclictest0-21swapper/000:15:080
260509973,1cyclictest0-21swapper/023:29:090
260509973,1cyclictest0-21swapper/022:34:350
260509973,1cyclictest0-21swapper/021:26:150
260509973,1cyclictest0-21swapper/000:36:080
260509972,3cyclictest19982-21systemd-journal22:02:530
260509972,3cyclictest19982-21systemd-journal20:54:470
260509972,3cyclictest19982-21systemd-journal00:03:180
260509970,3cyclictest19982-21systemd-journal23:18:070
18995270,0sleep20-21swapper/221:10:292
18423270,1sleep20-21swapper/200:33:522
260649963,2cyclictest30654-21snmpd22:46:073
260649963,2cyclictest29170-21cstates20:25:143
260649963,2cyclictest27729-21ssh23:27:543
260649963,2cyclictest19167-21sh21:55:113
260649963,2cyclictest15312-21plymouth00:30:223
260649963,2cyclictest13892-21ssh23:40:183
260649963,2cyclictest11780-21ssh23:16:593
260649963,2cyclictest11736-21in:imuxsock19:10:553
260649963,2cyclictest0-21swapper/323:22:333
260649963,2cyclictest0-21swapper/323:22:333
260649963,1cyclictest0-21swapper/322:01:343
260649963,1cyclictest0-21swapper/321:40:043
260649962,3cyclictest7962-21expr20:50:153
260649962,3cyclictest5550-21cat20:45:133
260649962,3cyclictest5089-21cat21:45:153
260649962,3cyclictest32433-21awk19:20:223
260649962,3cyclictest30654-21snmpd23:00:323
260649962,3cyclictest30654-21snmpd22:55:203
260649962,3cyclictest30654-21snmpd22:15:583
260649962,3cyclictest30654-21snmpd22:05:123
260649962,3cyclictest30654-21snmpd21:35:253
260649962,3cyclictest30654-21snmpd21:27:033
260649962,3cyclictest30654-21snmpd20:06:383
260649962,3cyclictest30654-21snmpd19:36:243
260649962,3cyclictest1-21systemd22:10:203
260649961,3cyclictest7661-21lldpd20:31:453
260649961,3cyclictest19982-21systemd-journal22:27:503
260649961,1cyclictest668-21runrttasks00:15:343
260599964,2cyclictest28-21ksoftirqd/220:00:012
260599964,2cyclictest28-21ksoftirqd/219:35:012
260599964,1cyclictest6836-21/usr/sbin/munin21:25:202
260599964,1cyclictest32221-21df21:20:132
260599963,2cyclictest3335-21sh23:55:482
260599963,2cyclictest31072-21sh21:40:262
260599963,2cyclictest26212-21latency_hist22:00:012
260599963,2cyclictest17694-21hddtemp_smartct22:15:142
260599963,2cyclictest17508-21sh21:53:552
260599963,2cyclictest15926-21sh23:41:422
260599963,2cyclictest11736-21in:imuxsock19:25:052
260599963,2cyclictest11736-21in:imuxsock19:25:052
260599963,2cyclictest11409-21sh00:27:292
260599962,3cyclictest508-21dbus-daemon20:38:072
260599962,3cyclictest32555-21tr19:20:212
260599962,3cyclictest30654-21snmpd23:47:302
260599962,3cyclictest30654-21snmpd23:30:072
260599962,3cyclictest30654-21snmpd21:59:212
260599962,3cyclictest30654-21snmpd21:47:242
260599962,3cyclictest30654-21snmpd19:50:262
260599962,3cyclictest30654-21snmpd19:18:332
260599962,3cyclictest26451-21hostname23:05:162
260599962,3cyclictest19982-21systemd-journal19:42:132
260599962,3cyclictest15269-21grep21:05:162
260599962,3cyclictest12784-21date22:55:212
260599962,3cyclictest11613-21sed19:45:192
260599962,3cyclictest0-21swapper/223:11:282
260599962,1cyclictest0-21swapper/223:50:122
260599962,1cyclictest0-21swapper/223:25:112
260599962,1cyclictest0-21swapper/223:15:582
260599962,1cyclictest0-21swapper/222:10:072
260599962,1cyclictest0-21swapper/221:35:042
260599962,1cyclictest0-21swapper/221:19:292
260599962,1cyclictest0-21swapper/200:06:262
260599961,4cyclictest19982-21systemd-journal20:45:012
260599961,3cyclictest19982-21systemd-journal20:33:062
260599960,6cyclictest0-21swapper/200:11:552
260599960,4cyclictest25937-21sshd20:17:342
260599960,0cyclictest0-21swapper/200:35:242
260599960,0cyclictest0-21swapper/200:20:132
260559966,0cyclictest0-21swapper/121:30:181
260559963,2cyclictest8849-21grep23:15:141
260559963,2cyclictest727-21sh22:25:191
260559963,2cyclictest30853-21seq20:29:041
260559963,2cyclictest30654-21snmpd19:16:151
260559963,2cyclictest29741-11brltty19:50:581
260559963,2cyclictest29741-11brltty19:38:271
260559963,2cyclictest2847-21chrt20:38:341
260559963,2cyclictest28403-21sh22:00:221
260559963,2cyclictest21652-21sh21:35:081
260559963,2cyclictest16711-21awk23:20:181
260559963,2cyclictest16711-21awk23:20:171
260559962,3cyclictest8336-21cat00:00:151
260559962,3cyclictest7535-21ssh22:30:151
260559962,3cyclictest4449-21grep19:30:181
260559962,3cyclictest30654-21snmpd22:10:331
260559962,3cyclictest30654-21snmpd20:15:071
260559962,3cyclictest30654-21snmpd19:56:051
260559962,3cyclictest27240-21fw_packets20:20:161
260559962,3cyclictest23055-21apt-get23:25:131
260559962,3cyclictest21450-21cut22:40:011
260559962,3cyclictest12819-21ntpq21:50:211
260559962,1cyclictest0-21swapper/123:56:371
260559962,1cyclictest0-21swapper/123:31:581
260559962,1cyclictest0-21swapper/122:56:001
260559962,1cyclictest0-21swapper/122:50:371
260559962,1cyclictest0-21swapper/122:46:281
260559962,1cyclictest0-21swapper/122:40:471
260559962,1cyclictest0-21swapper/122:20:101
260559962,1cyclictest0-21swapper/122:05:211
260559962,1cyclictest0-21swapper/121:25:091
260559962,1cyclictest0-21swapper/100:31:101
260559962,1cyclictest0-21swapper/100:15:581
260559961,2cyclictest31888-21ssh21:41:091
260559960,6cyclictest0-21swapper/121:20:121
260559960,5cyclictest26517-21expr19:10:141
260559960,5cyclictest1191-21df_inode23:10:131
260559960,2cyclictest7661-21lldpd23:36:161
260509964,1cyclictest17754-21gltestperf21:10:150
260509963,2cyclictest668-21runrttasks20:35:140
260509963,2cyclictest3869-21ssh22:05:400
260509963,2cyclictest30654-21snmpd20:04:160
260509963,2cyclictest27548-21missed_timers20:20:190
260509963,2cyclictest22480-21sh21:56:430
260509963,2cyclictest2162-21ssh22:48:300
260509963,2cyclictest19982-21systemd-journal19:45:330
260509963,2cyclictest15521-21sshd23:41:190
260509963,2cyclictest13599-21ntp_kernel_pll_19:50:190
260509963,2cyclictest0-21swapper/023:31:350
260509963,2cyclictest0-21swapper/022:50:550
260509963,1cyclictest0-21swapper/023:20:170
260509963,1cyclictest0-21swapper/023:20:170
260509962,3cyclictest7661-21lldpd23:00:200
260509962,3cyclictest508-21dbus-daemon23:57:060
260509962,3cyclictest32295-21expr22:25:140
260509962,3cyclictest30654-21snmpd21:03:580
260509962,3cyclictest30654-21snmpd20:31:480
260509962,3cyclictest30654-21snmpd20:15:230
260509962,3cyclictest30654-21snmpd19:55:100
260509962,3cyclictest30654-21snmpd00:24:310
260509962,3cyclictest26947-21cat19:10:160
260509962,3cyclictest26426-21sh21:37:560
260509962,3cyclictest19892-21cat23:45:130
260509962,3cyclictest15092-21smartctl22:35:160
260509962,3cyclictest14876-21cat00:05:120
260509962,3cyclictest10716-21cat20:55:150
260509962,3cyclictest0-21swapper/021:30:070
260509962,1cyclictest0-21swapper/023:50:540
260509962,1cyclictest0-21swapper/021:46:310
260509961,3cyclictest19982-21systemd-journal19:25:310
260509961,3cyclictest19982-21systemd-journal19:25:310
260509961,2cyclictest701-21ssh23:10:090
260509961,2cyclictest10408-21ssh00:26:150
260509960,4cyclictest19982-21systemd-journal20:13:050
260509960,3cyclictest13955-21rm22:56:100
2178260,0sleep30-21swapper/320:35:183
260649953,1cyclictest668-21runrttasks20:40:053
260649952,2cyclictest7037-21sh22:30:093
260649952,2cyclictest30654-21snmpd20:10:113
260649951,3cyclictest1856-21cat19:25:163
260649951,3cyclictest1856-21cat19:25:163
260649950,4cyclictest7862-21taskset19:40:013
260649950,4cyclictest14887-21apt-get19:55:133
260649950,3cyclictest7661-21lldpd21:05:023
260599952,2cyclictest6300-21cat20:45:172
260599952,2cyclictest27129-21cat19:10:182
260599952,2cyclictest22334-21tune2fs20:10:142
260559953,1cyclictest0-21swapper/120:50:111
260559952,2cyclictest5443-21seq20:45:011
260559952,2cyclictest3225-21chrt20:40:101
260559952,2cyclictest31788-21gltestperf20:30:151
260559952,2cyclictest10291-21expr19:45:121
260559950,3cyclictest19982-21systemd-journal21:05:001
260559950,3cyclictest19982-21systemd-journal19:20:051
260559950,1cyclictest0-21swapper/119:25:151
260559950,1cyclictest0-21swapper/119:25:141
260509952,2cyclictest8259-21expr19:40:130
260509951,3cyclictest3983-21sed19:30:150
260509951,3cyclictest29464-21cat19:15:140
260509951,3cyclictest11736-21in:imuxsock19:35:070
260509950,3cyclictest19982-21systemd-journal21:05:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional