You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Jun 28, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127512320251,22sleep10-21swapper/107:09:021
126192272237,21sleep30-21swapper/307:07:193
125482263232,20sleep00-21swapper/007:06:220
127322261227,22sleep20-21swapper/207:08:472
22032610,0sleep20-21swapper/209:35:452
100112570,0sleep10-21swapper/109:15:221
311262550,0sleep10-21swapper/109:33:351
65062530,0sleep10-21swapper/111:54:151
250802240,0sleep10-21swapper/109:28:351
228912210,0sleep00-21swapper/012:24:090
131772190,1sleep20-21swapper/207:10:172
276562180,0sleep30-21swapper/312:06:303
126112160,0sleep20-21swapper/209:17:552
74632150,0sleep30-21swapper/311:28:553
311442110,0sleep00-21swapper/012:29:130
322622100,0sleep20-21swapper/210:28:242
3176290,1sleep30-21swapper/312:11:223
129369994,3cyclictest19982-21systemd-journal09:23:072
129279998,1cyclictest12-21ksoftirqd/012:05:000
3576280,0sleep0131rcuc/010:30:530
129409985,2cyclictest34-21ksoftirqd/308:50:013
129409984,3cyclictest19982-21systemd-journal12:23:463
129409984,3cyclictest19982-21systemd-journal11:32:413
129409984,3cyclictest19982-21systemd-journal11:32:413
129409983,3cyclictest19982-21systemd-journal11:08:153
129409983,3cyclictest19982-21systemd-journal09:25:013
129369984,3cyclictest19982-21systemd-journal11:56:452
129369983,3cyclictest19982-21systemd-journal12:30:002
129369982,3cyclictest31088-21sendmail10:00:002
129369981,4cyclictest21559-21awk10:20:012
129369981,4cyclictest14504-21dump-pmu-power11:35:012
129369981,4cyclictest14504-21dump-pmu-power11:35:012
129319984,3cyclictest19982-21systemd-journal11:34:401
129319984,3cyclictest19982-21systemd-journal11:34:401
129319983,3cyclictest19982-21systemd-journal11:05:011
129279983,3cyclictest19982-21systemd-journal07:17:080
5648270,0sleep10-21swapper/110:33:151
129409974,2cyclictest508-21dbus-daemon09:59:263
129409974,2cyclictest19982-21systemd-journal11:53:413
129409973,3cyclictest7661-21lldpd11:46:273
129409973,3cyclictest508-21dbus-daemon07:58:513
129409973,3cyclictest30654-21snmpd08:25:393
129409973,3cyclictest30654-21snmpd08:23:363
129409973,3cyclictest19982-21systemd-journal11:45:013
129409973,3cyclictest19982-21systemd-journal10:29:563
129409973,3cyclictest19982-21systemd-journal08:41:023
129409973,3cyclictest19982-21systemd-journal07:45:433
129409973,3cyclictest0-21swapper/310:16:463
129409972,4cyclictest1-21systemd12:27:063
129409972,3cyclictest19982-21systemd-journal07:51:213
129409971,3cyclictest19982-21systemd-journal12:31:173
129409971,2cyclictest19982-21systemd-journal08:53:053
129409970,6cyclictest0-21swapper/312:36:183
129409970,4cyclictest19982-21systemd-journal11:00:453
129369974,2cyclictest1287-21sshd10:01:092
129369973,3cyclictest7389-21awk09:40:202
129369973,3cyclictest30654-21snmpd10:38:202
129369973,3cyclictest29741-11brltty11:39:342
129369973,3cyclictest29741-11brltty11:19:322
129369973,3cyclictest19982-21systemd-journal12:01:472
129369973,3cyclictest19982-21systemd-journal11:54:342
129369973,3cyclictest19982-21systemd-journal08:37:142
129369973,3cyclictest19982-21systemd-journal08:11:402
129369973,1cyclictest141rcu_preempt10:50:002
129369973,1cyclictest0-21swapper/212:35:272
129369973,1cyclictest0-21swapper/212:20:102
129369973,1cyclictest0-21swapper/209:10:462
129369970,5cyclictest19982-21systemd-journal11:23:432
129319974,2cyclictest508-21dbus-daemon09:58:351
129319974,2cyclictest12340-21munin-plugin-st09:45:011
129319973,3cyclictest508-21dbus-daemon10:41:331
129319973,3cyclictest508-21dbus-daemon10:15:171
129319973,3cyclictest2258-21diskmemload10:14:161
129319973,3cyclictest19982-21systemd-journal11:26:381
129319973,3cyclictest16458-21cut07:15:161
129319973,3cyclictest0-21swapper/112:14:471
129319973,2cyclictest20723-1kworker/u9:109:50:471
129319973,2cyclictest19982-21systemd-journal12:38:221
129319973,1cyclictest0-21swapper/111:45:261
129319972,3cyclictest502-21systemd-logind11:12:021
129319972,3cyclictest19982-21systemd-journal10:59:561
129319971,2cyclictest22-21ksoftirqd/112:30:221
129319970,2cyclictest10391-21munin-run10:10:011
129279974,2cyclictest21392-21memory09:25:170
129279974,2cyclictest19982-21systemd-journal12:31:410
129279973,3cyclictest508-21dbus-daemon09:22:410
129279973,3cyclictest19982-21systemd-journal09:56:560
129279973,3cyclictest19982-21systemd-journal08:35:490
129279973,3cyclictest19982-21systemd-journal08:25:010
129279973,3cyclictest19982-21systemd-journal07:35:290
129279973,3cyclictest0-21swapper/011:05:150
129279973,3cyclictest0-21swapper/009:53:340
129279973,1cyclictest0-21swapper/010:57:420
129279972,3cyclictest19982-21systemd-journal11:34:070
129279972,3cyclictest19982-21systemd-journal11:34:070
129279972,3cyclictest19982-21systemd-journal10:37:230
129279970,6cyclictest19982-21systemd-journal09:43:590
129279970,1cyclictest0-21swapper/009:10:210
129409966,0cyclictest0-21swapper/310:20:013
129409963,2cyclictest6626-21rm09:40:163
129409963,2cyclictest508-21dbus-daemon09:12:413
129409963,2cyclictest31187-21seq10:55:073
129409963,2cyclictest30654-21snmpd11:20:503
129409963,2cyclictest30654-21snmpd09:45:123
129409963,2cyclictest30654-21snmpd09:36:203
129409963,2cyclictest29294-21ssh09:31:253
129409963,2cyclictest27315-21cpuspeed07:40:143
129409963,2cyclictest23214-21grep07:30:153
129409963,2cyclictest21044-21grep07:25:153
129409963,2cyclictest16970-21sh12:00:163
129409963,2cyclictest16347-21ssh10:41:383
129409963,2cyclictest14861-21ssh11:35:113
129409963,2cyclictest13239-21cat07:10:193
129409963,2cyclictest12219-21sh10:38:423
129409963,2cyclictest11736-21in:imuxsock08:37:393
129409963,2cyclictest11736-21in:imuxsock07:22:333
129409962,3cyclictest964-21cat09:05:173
129409962,3cyclictest9000-21cat11:55:163
129409962,3cyclictest7661-21lldpd07:35:203
129409962,3cyclictest6357-21diskstats08:05:173
129409962,3cyclictest508-21dbus-daemon07:15:273
129409962,3cyclictest30654-21snmpd10:06:123
129409962,3cyclictest30654-21snmpd09:20:073
129409962,3cyclictest30654-21snmpd09:00:243
129409962,3cyclictest25560-21wc10:50:193
129409962,3cyclictest24204-21grep11:15:333
129409962,3cyclictest19516-21expr09:50:173
129409962,3cyclictest18614-21grep08:30:233
129409962,3cyclictest11372-21perl10:10:163
129409962,3cyclictest11069-21cat08:15:193
129409962,3cyclictest0-21swapper/311:10:473
129409962,3cyclictest0-21swapper/309:16:023
129409961,3cyclictest19982-21systemd-journal08:57:143
129409961,3cyclictest19982-21systemd-journal08:10:463
129409961,3cyclictest19982-21systemd-journal08:00:383
129409960,5cyclictest1432-21sshd10:01:163
129409960,2cyclictest2636-21run-parts10:30:203
129409960,1cyclictest19194-21apt-get10:45:153
129369963,2cyclictest668-21runrttasks08:52:402
129369963,2cyclictest25789-21rm11:43:272
129369963,2cyclictest2573-21ssh12:10:552
129369963,2cyclictest25580-21/usr/sbin/munin12:05:202
129369963,2cyclictest23334-21if_enp4s007:30:172
129369963,2cyclictest19853-21tr09:50:172
129369963,2cyclictest15645-21sh07:15:012
129369963,2cyclictest13742-21hostname09:45:172
129369963,2cyclictest11736-21in:imuxsock08:56:242
129369963,2cyclictest11736-21in:imuxsock07:45:552
129369962,3cyclictest8747-21df12:15:182
129369962,3cyclictest7238-21sshd10:06:122
129369962,3cyclictest508-21dbus-daemon11:12:272
129369962,3cyclictest508-21dbus-daemon09:05:002
129369962,3cyclictest508-21dbus-daemon08:25:012
129369962,3cyclictest4947-21expr11:00:192
129369962,3cyclictest30654-21snmpd10:52:252
129369962,3cyclictest30654-21snmpd10:20:042
129369962,3cyclictest30654-21snmpd08:48:372
129369962,3cyclictest30654-21snmpd07:29:202
129369962,3cyclictest28849-21sshd07:40:342
129369962,3cyclictest23497-21seq08:44:422
129369962,3cyclictest20938-21df_inode09:25:162
129369962,3cyclictest19982-21systemd-journal11:26:422
129369962,3cyclictest15545-21cat08:25:192
129369962,3cyclictest11949-21awk08:15:242
129369962,1cyclictest0-21swapper/210:40:122
129369962,1cyclictest0-21swapper/210:33:072
129369961,4cyclictest29741-11brltty08:05:062
129369961,3cyclictest19982-21systemd-journal09:07:402
129369961,2cyclictest3007-21ssh10:58:452
129369961,1cyclictest0-21swapper/212:30:132
129369960,3cyclictest20215-21awk07:25:002
129369960,3cyclictest15747-21taskset11:09:342
129369960,0cyclictest0-21swapper/210:11:282
129369960,0cyclictest0-21swapper/209:30:182
129319966,0cyclictest0-21swapper/107:20:171
129319963,2cyclictest9007-21interrupts11:55:171
129319963,2cyclictest29741-11brltty08:00:051
129319963,2cyclictest27253-21ssh12:06:121
129319963,2cyclictest22555-21sh11:15:121
129319963,2cyclictest22-21ksoftirqd/109:05:011
129319963,2cyclictest21768-21cat11:40:121
129319963,2cyclictest21549-21rm10:45:591
129319963,2cyclictest20443-21find07:25:131
129319963,2cyclictest1980-21cut07:55:151
129319963,2cyclictest18622-21grep08:30:231
129319963,2cyclictest16160-21ssh12:20:051
129319963,2cyclictest15166-21cstates11:35:151
129319963,2cyclictest14608-21apt09:20:121
129319963,2cyclictest1-21systemd07:45:541
129319963,2cyclictest11688-21switchtime08:15:241
129319962,3cyclictest8677-21expr12:15:181
129319962,3cyclictest30654-21snmpd11:04:441
129319962,3cyclictest30654-21snmpd09:10:051
129319962,3cyclictest30654-21snmpd08:56:101
129319962,3cyclictest30654-21snmpd08:52:301
129319962,3cyclictest30654-21snmpd08:45:271
129319962,3cyclictest30654-21snmpd08:26:521
129319962,3cyclictest27329-21cat07:40:141
129319962,3cyclictest14758-21sshd07:10:401
129319962,3cyclictest13048-21df_inode08:20:171
129319962,3cyclictest0-21swapper/112:25:591
129319962,3cyclictest0-21swapper/110:50:441
129319962,3cyclictest0-21swapper/110:36:171
129319962,1cyclictest0-21swapper/110:21:551
129319962,1cyclictest0-21swapper/110:01:421
129319962,1cyclictest0-21swapper/109:38:101
129319960,6cyclictest0-21swapper/109:46:541
129319960,6cyclictest0-21swapper/108:40:221
129319960,3cyclictest411-21rm11:22:501
129319960,3cyclictest17350-21grep12:00:191
129279966,0cyclictest0-21swapper/012:35:540
129279963,2cyclictest8418-21ssh09:15:040
129279963,2cyclictest5480-21ssh10:05:180
129279963,2cyclictest5423-21sh11:26:290
129279963,2cyclictest31346-21taskset07:48:520
129279963,2cyclictest30654-21snmpd09:06:410
129279963,2cyclictest25300-21tr12:05:190
129279963,2cyclictest2258-21diskmemload11:45:550
129279963,2cyclictest18064-21ntp_states08:30:190
129279963,2cyclictest14980-21sh09:45:380
129279963,2cyclictest13762-21sh10:40:100
129279963,2cyclictest11736-21in:imuxsock08:48:040
129279962,3cyclictest9969-21awk12:15:240
129279962,3cyclictest7661-21lldpd11:40:570
129279962,3cyclictest7657-21sshd08:06:410
129279962,3cyclictest30654-21snmpd11:20:170
129279962,3cyclictest30654-21snmpd10:00:190
129279962,3cyclictest30654-21snmpd08:55:430
129279962,3cyclictest30654-21snmpd08:51:400
129279962,3cyclictest30654-21snmpd08:41:150
129279962,3cyclictest30654-21snmpd08:00:300
129279962,3cyclictest30654-21snmpd07:55:360
129279962,3cyclictest30654-21snmpd07:50:110
129279962,3cyclictest30654-21snmpd07:20:050
129279962,3cyclictest29506-21grep10:25:250
129279962,3cyclictest27544-21cat09:30:200
129279962,3cyclictest19897-21cat10:45:180
129279962,3cyclictest16962-21cat10:15:160
129279962,3cyclictest15559-21cat08:25:180
129279962,3cyclictest13260-21sshd10:11:170
129279962,3cyclictest10787-21expr08:15:180
129279962,3cyclictest0-21swapper/010:50:480
129279962,1cyclictest0-21swapper/012:13:130
129279962,1cyclictest0-21swapper/011:52:460
129279962,1cyclictest0-21swapper/011:39:300
129279962,1cyclictest0-21swapper/011:15:080
129279961,3cyclictest19982-21systemd-journal11:57:410
129279961,3cyclictest19982-21systemd-journal07:40:040
129279961,3cyclictest19982-21systemd-journal07:12:580
129279961,2cyclictest3280-21ssh09:36:490
129279960,4cyclictest19982-21systemd-journal08:10:570
129409952,2cyclictest8957-21sed12:15:183
129369952,2cyclictest4418-21cat08:00:172
129369952,2cyclictest32104-21sh07:50:202
129369952,2cyclictest28529-21grep11:45:182
129369952,2cyclictest17779-21cat08:30:172
129369952,2cyclictest1731-21expr07:55:142
129369951,3cyclictest25913-21/usr/sbin/munin07:35:212
129319953,1cyclictest0-21swapper/110:25:051
129319952,2cyclictest8465-21expr08:10:141
129319952,2cyclictest476-21cat09:05:161
129319952,2cyclictest398-21sendmail_mailqu07:50:301
129319952,2cyclictest24970-21cat07:35:161
129319952,2cyclictest22669-21basename07:30:141
129319951,2cyclictest19982-21systemd-journal08:05:071
129319950,5cyclictest0-21swapper/108:35:051
129279952,2cyclictest22513-21tune2fs10:20:160
129279952,2cyclictest20850-21sh07:25:150
129279951,3cyclictest5416-21cat11:00:220
129279951,3cyclictest31174-21cat09:00:190
129279951,3cyclictest16819-21cpuspeed_turbos11:10:160
129279950,3cyclictest23640-21ntpq07:30:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional