You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 15:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Wed Nov 19, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157642294260,22sleep10-21swapper/107:06:461
160262280214,20sleep00-21swapper/007:09:510
156712263230,21sleep20-21swapper/207:05:352
140562262229,20sleep30-21swapper/307:05:043
284592670,0sleep10-21swapper/109:57:211
31052620,1sleep20-21swapper/209:00:232
211882590,0sleep20-21swapper/211:41:332
187172550,0sleep00-21swapper/010:44:530
217612240,0sleep30-21swapper/310:46:153
157252200,0sleep30-21swapper/312:05:003
103302190,0sleep10-21swapper/110:10:141
315842180,0sleep10-21swapper/112:17:521
116312180,1sleep00-21swapper/012:00:210
269632160,0sleep20-21swapper/211:18:342
187892160,0sleep30-21swapper/309:20:223
207382150,0sleep10-21swapper/109:22:561
190012140,0sleep10-21swapper/112:34:381
148752140,0sleep30-21swapper/310:40:233
124792140,0sleep20-21swapper/210:39:462
20272110,0sleep10-21swapper/109:35:141
1614599119,1cyclictest12-21ksoftirqd/012:20:010
1614999107,2cyclictest22-21ksoftirqd/107:55:011
11752100,1sleep31174-21munin-run11:25:003
19030290,0sleep10-21swapper/110:17:021
161579994,3cyclictest19982-21systemd-journal10:09:123
161579994,3cyclictest19982-21systemd-journal10:02:573
161539997,1cyclictest28-21ksoftirqd/210:50:012
161539993,3cyclictest19982-21systemd-journal12:33:442
161499994,3cyclictest19982-21systemd-journal08:07:221
161459996,2cyclictest12-21ksoftirqd/010:25:010
161459995,4cyclictest121ksoftirqd/007:50:010
161459994,3cyclictest19982-21systemd-journal09:04:550
8501280,0sleep00-21swapper/011:01:580
30595280,0sleep10-21swapper/111:21:021
161579985,2cyclictest30654-21snmpd09:01:403
161579980,7cyclictest6799-21seq11:56:493
161539984,3cyclictest19982-21systemd-journal08:49:352
161539984,3cyclictest15415-21cron10:15:012
161539982,4cyclictest28-21ksoftirqd/207:52:502
161499985,2cyclictest22-21ksoftirqd/107:15:021
161499984,2cyclictest19982-21systemd-journal11:15:321
161499983,3cyclictest19982-21systemd-journal10:00:341
161499983,3cyclictest19982-21systemd-journal08:32:191
161499983,3cyclictest19982-21systemd-journal08:12:481
161459987,1cyclictest12-21ksoftirqd/009:10:000
161459984,3cyclictest19982-21systemd-journal11:26:220
161459982,3cyclictest19342-21munin-run12:35:000
161459980,7cyclictest18484-21ssh11:40:020
161579975,1cyclictest20525-21ls08:30:013
161579975,1cyclictest0-21swapper/307:30:223
161579974,2cyclictest508-21dbus-daemon12:28:313
161579973,3cyclictest508-21dbus-daemon12:36:283
161579973,3cyclictest508-21dbus-daemon08:06:573
161579973,3cyclictest30654-21snmpd08:37:093
161579973,3cyclictest2464-21memory12:20:193
161579973,3cyclictest21907-21gdbus10:25:073
161579973,3cyclictest19982-21systemd-journal11:31:223
161579973,3cyclictest19982-21systemd-journal11:05:563
161579973,3cyclictest1939-21find09:35:133
161579973,3cyclictest1-21systemd11:43:533
161579973,3cyclictest11736-21in:imuxsock08:02:473
161579973,3cyclictest0-21swapper/311:03:283
161579973,2cyclictest19982-21systemd-journal11:13:263
161579973,1cyclictest0-21swapper/312:18:443
161579973,1cyclictest0-21swapper/311:53:113
161579972,3cyclictest7661-21lldpd09:40:453
161579972,3cyclictest19982-21systemd-journal11:46:243
161579972,3cyclictest19982-21systemd-journal10:52:333
161579971,4cyclictest19982-21systemd-journal08:12:543
161539974,2cyclictest508-21dbus-daemon11:46:492
161539974,2cyclictest28-21ksoftirqd/209:10:012
161539974,2cyclictest11736-21in:imuxsock09:52:312
161539973,3cyclictest9133-21grep11:30:212
161539973,3cyclictest508-21dbus-daemon07:44:252
161539973,3cyclictest508-21dbus-daemon07:20:022
161539973,3cyclictest30654-21snmpd10:15:592
161539973,3cyclictest30654-21snmpd09:39:522
161539973,3cyclictest22720-21pluginstate11:15:002
161539973,3cyclictest17317-21ntp_states07:10:182
161539973,3cyclictest16017-21cron08:20:012
161539973,3cyclictest13706-21perl10:40:162
161539973,3cyclictest0-21swapper/212:22:112
161539973,3cyclictest0-21swapper/210:27:372
161539972,3cyclictest19982-21systemd-journal12:01:502
161539972,3cyclictest19982-21systemd-journal10:20:532
161539972,3cyclictest19982-21systemd-journal08:12:532
161539970,4cyclictest24981-21ls08:40:002
161539970,4cyclictest22097-21sh09:24:592
161539970,1cyclictest5975-21diskmemload09:40:402
161499975,1cyclictest19187-21dump-pmu-power09:50:011
161499974,2cyclictest508-21dbus-daemon07:55:411
161499973,3cyclictest30654-21snmpd07:25:211
161499973,3cyclictest2328-21ntpq10:30:191
161499973,3cyclictest19982-21systemd-journal11:59:341
161499973,3cyclictest19982-21systemd-journal09:17:511
161499973,3cyclictest19982-21systemd-journal09:03:161
161499973,3cyclictest19982-21systemd-journal07:35:001
161499973,1cyclictest0-21swapper/110:37:471
161499973,1cyclictest0-21swapper/110:28:101
161499972,3cyclictest19982-21systemd-journal09:25:481
161499972,3cyclictest19982-21systemd-journal09:05:331
161499972,3cyclictest19982-21systemd-journal08:26:081
161499971,3cyclictest12131-21munin-run09:15:001
161459974,2cyclictest4832-21head11:55:170
161459973,3cyclictest8555-21ntpq11:30:170
161459973,3cyclictest3837-21ntpq07:50:170
161459973,3cyclictest19982-21systemd-journal08:43:410
161459973,3cyclictest19982-21systemd-journal07:31:550
161459973,3cyclictest17870-21users08:20:210
161459973,3cyclictest0-21swapper/012:27:140
161459973,3cyclictest0-21swapper/010:47:070
161459973,3cyclictest0-21swapper/009:37:550
161459973,2cyclictest19982-21systemd-journal11:54:180
161459973,1cyclictest0-21swapper/009:31:350
161459972,3cyclictest7661-21lldpd07:20:410
161459972,3cyclictest19982-21systemd-journal11:11:210
161459971,3cyclictest32196-21rm11:23:090
161459971,3cyclictest25976-21turbostat07:30:010
161459971,3cyclictest24154-21rm09:53:550
161459970,4cyclictest27934-21idleruntime-cro09:30:000
10426270,0sleep30-21swapper/310:37:383
161579966,0cyclictest0-21swapper/310:20:423
161579964,1cyclictest4791-21memory09:05:173
161579963,3cyclictest5308-21ssh11:27:463
161579963,2cyclictest508-21dbus-daemon08:54:553
161579963,2cyclictest508-21dbus-daemon08:16:583
161579963,2cyclictest3634-21sh10:31:163
161579963,2cyclictest34-21ksoftirqd/307:25:163
161579963,2cyclictest20022-21memory07:15:183
161579963,2cyclictest19645-21chrt12:07:573
161579963,2cyclictest15616-21sshd09:18:073
161579963,2cyclictest1483-21sendmail09:00:003
161579963,2cyclictest11738-21rs:main3
161579963,2cyclictest11736-21in:imuxsock10:15:023
161579962,3cyclictest7326-21expr09:10:173
161579962,3cyclictest508-21dbus-daemon08:48:143
161579962,3cyclictest508-21dbus-daemon07:15:023
161579962,3cyclictest30654-21snmpd12:13:463
161579962,3cyclictest30654-21snmpd09:50:343
161579962,3cyclictest30654-21snmpd08:42:453
161579962,3cyclictest30654-21snmpd07:57:533
161579962,3cyclictest30654-21snmpd07:42:153
161579962,3cyclictest30654-21snmpd07:35:243
161579962,3cyclictest23073-21find11:15:143
161579962,3cyclictest17461-21which08:20:203
161579962,3cyclictest1694-21awk07:45:183
161579962,3cyclictest15171-21mailstats09:45:253
161579962,3cyclictest0-21swapper/310:56:563
161579962,3cyclictest0-21swapper/310:56:563
161579962,1cyclictest0-21swapper/309:56:333
161579961,4cyclictest27927-21turbostat09:30:003
161579961,4cyclictest14193-21expr12:30:143
161579960,6cyclictest0-21swapper/311:35:093
161579960,5cyclictest2872-21/usr/sbin/munin07:50:153
161579960,0cyclictest0-21swapper/307:20:163
161539964,1cyclictest5304-21apt-get11:00:152
161539963,2cyclictest7704-21apt-config12:25:022
161539963,2cyclictest5218-21cat11:55:222
161539963,2cyclictest508-21dbus-daemon09:25:472
161539963,2cyclictest32692-21awk10:55:192
161539963,2cyclictest32692-21awk10:55:192
161539963,2cyclictest30232-21logger07:37:342
161539963,2cyclictest20763-21ntpq12:35:192
161539963,2cyclictest18665-21grep08:25:132
161539963,2cyclictest15067-21ssh11:35:322
161539963,2cyclictest1356-21irqstats07:45:162
161539963,2cyclictest12748-21expr09:15:132
161539963,2cyclictest11736-21in:imuxsock08:34:042
161539963,2cyclictest0-21swapper/209:56:302
161539962,3cyclictest7099-21cat09:10:162
161539962,3cyclictest30654-21snmpd10:00:322
161539962,3cyclictest30654-21snmpd09:45:352
161539962,3cyclictest30654-21snmpd08:08:052
161539962,3cyclictest30654-21snmpd07:55:142
161539962,3cyclictest27080-21cat07:30:182
161539962,3cyclictest22861-21timerwakeupswit07:20:222
161539962,3cyclictest22247-21expr12:10:132
161539962,3cyclictest19982-21systemd-journal11:08:262
161539962,3cyclictest16924-21cat12:05:172
161539962,1cyclictest27239-21perf08:45:002
161539962,1cyclictest0-21swapper/212:15:232
161539962,1cyclictest0-21swapper/211:50:302
161539962,1cyclictest0-21swapper/211:26:262
161539962,1cyclictest0-21swapper/211:20:012
161539962,1cyclictest0-21swapper/210:30:082
161539961,4cyclictest52150irq/139-enp4s0-08:55:192
161539961,4cyclictest0-21swapper/210:50:122
161539961,3cyclictest19982-21systemd-journal10:05:352
161539960,4cyclictest19982-21systemd-journal09:30:472
161539960,3cyclictest9351-21munin-run08:05:012
161499963,2cyclictest668-21runrttasks10:51:581
161499963,2cyclictest6536-21mailstats11:00:211
161499963,2cyclictest32643-21ssh11:51:261
161499963,2cyclictest32437-21kernelversion10:55:181
161499963,2cyclictest32437-21kernelversion10:55:181
161499963,2cyclictest30654-21snmpd10:46:001
161499963,2cyclictest19209-21basename07:15:141
161499963,2cyclictest19054-21df_inode11:40:141
161499963,2cyclictest18017-21if_enp4s011:10:161
161499963,1cyclictest0-21swapper/111:46:181
161499963,1cyclictest0-21swapper/111:26:181
161499962,3cyclictest8939-21ntpq09:40:211
161499962,3cyclictest7533-21apt-config12:25:021
161499962,3cyclictest357-21needreboot08:55:181
161499962,3cyclictest31490-21cat07:40:161
161499962,3cyclictest30654-21snmpd12:06:391
161499962,3cyclictest30654-21snmpd12:00:091
161499962,3cyclictest30654-21snmpd11:07:501
161499962,3cyclictest30654-21snmpd09:53:111
161499962,3cyclictest30654-21snmpd08:00:261
161499962,3cyclictest30654-21snmpd07:21:461
161499962,3cyclictest28412-21ntpq08:45:171
161499962,3cyclictest25925-21cat08:40:191
161499962,3cyclictest20292-21fschecks_time12:35:161
161499962,3cyclictest19982-21systemd-journal08:52:011
161499962,3cyclictest14846-21awk10:40:231
161499962,3cyclictest0-21swapper/111:35:311
161499962,2cyclictest19982-21systemd-journal12:12:411
161499962,1cyclictest0-21swapper/112:21:431
161499962,1cyclictest0-21swapper/110:20:031
161499961,3cyclictest19982-21systemd-journal09:30:051
161499960,4cyclictest19982-21systemd-journal11:32:381
161459964,1cyclictest14753-21irqstats08:15:170
161459963,2cyclictest7275-21wc09:10:160
161459963,2cyclictest508-21dbus-daemon10:35:290
161459963,2cyclictest29830-21grep08:50:130
161459963,2cyclictest18523-21/usr/sbin/munin08:25:170
161459963,2cyclictest14216-21sh09:15:370
161459963,2cyclictest13323-21cpu11:35:130
161459962,3cyclictest508-21dbus-daemon10:25:070
161459962,3cyclictest30654-21snmpd11:05:180
161459962,3cyclictest30654-21snmpd08:10:280
161459962,3cyclictest30526-21cron07:40:010
161459962,3cyclictest27992-21fw_packets08:45:140
161459962,3cyclictest2446-21cat12:20:200
161459962,3cyclictest23618-21perl11:15:170
161459962,3cyclictest23246-21cat08:35:140
161459962,3cyclictest11903-21sshd09:43:130
161459962,3cyclictest10876-21cat10:10:160
161459962,3cyclictest0-21swapper/012:36:070
161459962,3cyclictest0-21swapper/010:55:220
161459962,3cyclictest0-21swapper/010:55:220
161459962,3cyclictest0-21swapper/010:30:020
161459962,3cyclictest0-21swapper/009:59:370
161459961,4cyclictest14538-21gltestperf09:45:180
161459961,3cyclictest502-21systemd-logind08:30:190
161459961,3cyclictest19982-21systemd-journal12:10:360
161459961,3cyclictest19982-21systemd-journal10:50:290
161459961,3cyclictest19982-21systemd-journal10:00:250
161459961,3cyclictest19982-21systemd-journal07:10:120
161459961,2cyclictest8771-21ssh10:08:390
161459960,6cyclictest0-21swapper/009:21:350
161459960,6cyclictest0-21swapper/008:00:150
161459960,6cyclictest0-21swapper/007:16:350
161459960,3cyclictest27277-21rm11:46:590
161459960,3cyclictest17892-21rm12:05:400
161459960,2cyclictest17726-21rm10:15:350
161579952,2cyclictest30654-21snmpd08:30:113
161579950,4cyclictest10583-21diskstats10:10:153
161539952,2cyclictest30654-21snmpd08:15:142
161539952,2cyclictest11736-21in:imuxsock07:25:042
161539951,3cyclictest29788-21cat08:50:122
161499953,1cyclictest28917-21fschecks_time07:35:171
161499952,2cyclictest970-21expr07:45:141
161499952,2cyclictest4477-21cp10:05:011
161499952,2cyclictest30654-21snmpd08:35:021
161499952,2cyclictest16860-21head08:20:151
161499952,2cyclictest14151-21ls08:15:151
161459952,2cyclictest9945-21expr08:05:120
161459952,2cyclictest30654-21snmpd08:55:030
161459951,3cyclictest5101-21/usr/sbin/munin07:55:130
161459951,3cyclictest29041-21cut07:35:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional