You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-29 - 01:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Tue May 28, 2024 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209652306272,21sleep20-21swapper/207:08:342
210162282218,21sleep00-21swapper/007:09:090
208552263231,19sleep30-21swapper/307:07:113
209412261227,22sleep10-21swapper/107:08:171
180942640,1sleep10-21swapper/111:00:181
104602590,0sleep10-21swapper/110:54:411
185812520,0sleep10-21swapper/111:52:151
148682190,0sleep30-21swapper/310:09:503
65522170,0sleep10-21swapper/110:02:001
59402160,0sleep00-21swapper/012:06:520
89742140,0sleep10-21swapper/107:50:291
151642140,0sleep30-21swapper/310:34:173
151642140,0sleep30-21swapper/310:34:173
106802130,0sleep30-21swapper/312:10:193
124282120,0sleep30-21swapper/311:47:493
29428290,0sleep10-21swapper/112:24:071
212119995,3cyclictest19982-21systemd-journal11:49:492
212119994,3cyclictest508-21dbus-daemon08:50:002
212029992,4cyclictest9094-21munin-run09:05:010
25238280,1sleep20-21swapper/207:15:192
212159984,3cyclictest508-21dbus-daemon08:09:573
212159983,3cyclictest19982-21systemd-journal10:44:443
212159983,3cyclictest19982-21systemd-journal10:11:473
212159982,5cyclictest508-21dbus-daemon10:35:343
212119984,3cyclictest19982-21systemd-journal08:05:222
212119983,3cyclictest19982-21systemd-journal12:04:002
212119983,3cyclictest19982-21systemd-journal11:56:052
212119983,3cyclictest19982-21systemd-journal11:11:312
212119983,3cyclictest19982-21systemd-journal10:35:022
212119983,3cyclictest19982-21systemd-journal10:35:022
212119983,3cyclictest19982-21systemd-journal10:14:312
212059984,3cyclictest19982-21systemd-journal11:50:001
212059984,3cyclictest19982-21systemd-journal09:04:301
212059983,3cyclictest19982-21systemd-journal10:17:131
212059980,7cyclictest13142-21ssh10:32:131
212059980,7cyclictest13142-21ssh10:32:131
212029984,3cyclictest19982-21systemd-journal09:56:320
212029983,3cyclictest19982-21systemd-journal08:50:520
212029982,3cyclictest21200-21turbostat10:15:020
212159974,2cyclictest508-21dbus-daemon08:39:113
212159973,3cyclictest5802-21cron11:17:003
212159973,3cyclictest508-21dbus-daemon10:18:533
212159973,3cyclictest508-21dbus-daemon07:26:343
212159973,3cyclictest19982-21systemd-journal08:24:343
212159973,3cyclictest19982-21systemd-journal07:19:333
212159973,3cyclictest13388-21snmpd08:51:523
212159973,3cyclictest0-21swapper/311:50:133
212159973,3cyclictest0-21swapper/309:43:443
212159973,2cyclictest19982-21systemd-journal11:22:173
212159973,1cyclictest0-21swapper/310:28:023
212159973,1cyclictest0-21swapper/309:47:373
212159972,3cyclictest19982-21systemd-journal11:30:253
212159972,3cyclictest19982-21systemd-journal10:48:063
212159970,3cyclictest23339-21latency_hist12:20:003
212119975,2cyclictest28-21ksoftirqd/208:45:002
212119975,1cyclictest0-21swapper/211:53:422
212119974,2cyclictest508-21dbus-daemon09:15:002
212119974,2cyclictest19982-21systemd-journal09:23:312
212119974,2cyclictest13388-21snmpd11:42:492
212119973,3cyclictest3461-21cat12:05:162
212119973,3cyclictest29741-11brltty07:37:512
212119973,3cyclictest19982-21systemd-journal12:25:172
212119973,3cyclictest19982-21systemd-journal12:25:172
212119973,3cyclictest19982-21systemd-journal11:00:322
212119973,3cyclictest19982-21systemd-journal10:39:382
212119973,3cyclictest13388-21snmpd08:23:402
212119973,1cyclictest0-21swapper/212:33:582
212119973,1cyclictest0-21swapper/211:07:372
212119972,3cyclictest19982-21systemd-journal10:24:352
212119972,3cyclictest19982-21systemd-journal09:08:222
212119972,1cyclictest0-21swapper/210:44:442
212119970,7cyclictest52150irq/139-enp4s0-10:07:292
212059974,2cyclictest11736-21in:imuxsock11:55:141
212059973,3cyclictest9366-21apt-get09:05:161
212059973,3cyclictest26315-21sendmail-msp07:20:011
212059973,3cyclictest25221-21ntpq09:50:191
212059973,3cyclictest19116-21gdbus11:45:001
212059973,3cyclictest17372-21cron09:15:011
212059973,3cyclictest13388-21snmpd10:41:321
212059973,3cyclictest0-21swapper/111:31:271
212059973,1cyclictest0-21swapper/112:15:091
212059973,1cyclictest0-21swapper/109:38:521
212059973,1cyclictest0-21swapper/109:24:321
212059972,4cyclictest22-21ksoftirqd/111:25:251
212059972,4cyclictest0-21swapper/110:25:111
212059972,3cyclictest19982-21systemd-journal12:40:001
212059972,3cyclictest19982-21systemd-journal08:14:091
212059972,3cyclictest19982-21systemd-journal07:46:361
212059971,2cyclictest16969-21lldpd11:20:051
212029974,2cyclictest502-21systemd-logind11:12:160
212029974,2cyclictest19982-21systemd-journal11:22:420
212029973,3cyclictest5908-21cut08:55:240
212029973,3cyclictest508-21dbus-daemon10:09:180
212029973,3cyclictest508-21dbus-daemon07:55:000
212029973,3cyclictest4632-21users10:25:260
212029973,3cyclictest28340-21packagekitd08:35:010
212029973,3cyclictest19982-21systemd-journal12:00:150
212029973,3cyclictest13388-21snmpd08:01:520
212029973,3cyclictest13388-21snmpd07:59:190
212029973,3cyclictest13388-21snmpd07:28:410
212029973,3cyclictest0-21swapper/010:47:370
212029973,3cyclictest0-21swapper/009:51:260
212029973,1cyclictest0-21swapper/012:11:550
212029973,1cyclictest0-21swapper/010:16:140
212029972,3cyclictest19982-21systemd-journal11:09:470
212029972,3cyclictest19982-21systemd-journal09:30:280
212029970,4cyclictest26292-21readlink07:20:000
212029970,4cyclictest22854-21idleruntime-cro09:20:000
212159966,0cyclictest0-21swapper/312:20:083
212159966,0cyclictest0-21swapper/310:00:433
212159964,1cyclictest668-21runrttasks10:20:113
212159963,2cyclictest6716-21ssh10:50:293
212159963,2cyclictest6597-21systemctl07:45:263
212159963,2cyclictest5333-21ssh12:30:093
212159963,2cyclictest501-21sh09:30:033
212159963,2cyclictest30655-21sh12:25:053
212159963,2cyclictest30655-21sh12:25:053
212159963,2cyclictest2951-21uname11:40:203
212159963,2cyclictest27095-21tail07:20:183
212159963,2cyclictest19605-21cat08:15:183
212159963,2cyclictest1913-21uname07:35:223
212159963,2cyclictest18112-21sh11:00:183
212159963,2cyclictest16351-21cron08:10:013
212159963,2cyclictest11736-21in:imuxsock08:03:173
212159963,1cyclictest0-21swapper/312:35:283
212159962,3cyclictest7815-21cat09:00:173
212159962,3cyclictest7719-21apt07:50:123
212159962,3cyclictest5115-21expr08:55:123
212159962,3cyclictest28117-21cut11:35:133
212159962,3cyclictest23392-21cat09:20:113
212159962,3cyclictest22114-21expr11:55:103
212159962,3cyclictest16969-21lldpd11:14:263
212159962,3cyclictest13388-21snmpd11:05:153
212159962,3cyclictest13388-21snmpd09:56:073
212159962,3cyclictest13388-21snmpd09:36:563
212159962,3cyclictest13388-21snmpd08:30:223
212159962,3cyclictest13388-21snmpd08:26:063
212159962,3cyclictest13206-21timerandwakeup09:10:243
212159962,3cyclictest11900-21cat10:55:153
212159962,1cyclictest0-21swapper/312:00:023
212159961,3cyclictest19982-21systemd-journal12:05:033
212159961,3cyclictest19982-21systemd-journal09:15:023
212159960,5cyclictest28106-21apt-get09:25:123
212159960,5cyclictest24131-21cat09:50:103
212159960,5cyclictest16076-21memory11:25:203
212119963,2cyclictest668-21runrttasks08:31:372
212119963,2cyclictest5201-21ssh10:26:022
212119963,2cyclictest30414-21tr09:55:152
212119963,2cyclictest29978-21sshd08:35:302
212119963,2cyclictest28-21ksoftirqd/209:25:222
212119963,2cyclictest13388-21snmpd11:31:372
212119963,2cyclictest13388-21snmpd09:16:502
212119963,2cyclictest13388-21snmpd07:55:022
212119963,2cyclictest12977-21ntp_kernel_pll_09:40:212
212119962,3cyclictest7043-21cat09:35:162
212119962,3cyclictest508-21dbus-daemon07:42:312
212119962,3cyclictest24001-21cat08:25:162
212119962,3cyclictest21967-21grep07:10:152
212119962,3cyclictest17487-21cat12:15:152
212119962,3cyclictest13388-21snmpd11:38:522
212119962,3cyclictest13388-21snmpd09:45:492
212119962,3cyclictest13388-21snmpd08:57:462
212119962,3cyclictest13388-21snmpd08:00:452
212119962,3cyclictest13388-21snmpd07:52:082
212119962,3cyclictest13388-21snmpd07:47:202
212119962,3cyclictest13388-21snmpd07:25:052
212119962,3cyclictest13388-21snmpd07:22:282
212119962,1cyclictest0-21swapper/212:22:572
212119962,1cyclictest0-21swapper/211:26:102
212119962,1cyclictest0-21swapper/211:21:042
212119962,1cyclictest0-21swapper/211:17:212
212119962,1cyclictest0-21swapper/210:55:582
212119961,3cyclictest19982-21systemd-journal10:50:012
212119961,2cyclictest2555-21ssh09:30:382
212119960,6cyclictest0-21swapper/212:10:482
212119960,6cyclictest0-21swapper/210:15:042
212119960,5cyclictest0-21swapper/209:50:112
212119960,4cyclictest19982-21systemd-journal08:11:132
212119960,3cyclictest483-21ssh10:46:042
212119960,0cyclictest0-21swapper/210:02:332
212059964,1cyclictest3252-21gltestperf08:50:131
212059963,2cyclictest5454-21ssh12:06:231
212059963,2cyclictest508-21dbus-daemon08:35:261
212059963,2cyclictest2579-21sh11:15:061
212059963,2cyclictest17873-21sh10:11:161
212059963,2cyclictest1633-21memory07:35:181
212059963,2cyclictest15878-21cron10:35:021
212059963,2cyclictest13388-21snmpd07:56:021
212059963,2cyclictest13388-21snmpd07:20:201
212059963,2cyclictest11736-21in:imuxsock12:11:061
212059963,2cyclictest11736-21in:imuxsock07:34:551
212059962,3cyclictest32265-21seq09:29:261
212059962,3cyclictest30622-21cat11:10:321
212059962,3cyclictest29361-21smart_sda11:35:221
212059962,3cyclictest19982-21systemd-journal11:06:111
212059962,3cyclictest19982-21systemd-journal07:14:561
212059962,3cyclictest13464-21cat08:00:241
212059962,3cyclictest13388-21snmpd12:32:321
212059962,3cyclictest13388-21snmpd10:07:161
212059962,3cyclictest13388-21snmpd09:30:081
212059962,3cyclictest13388-21snmpd08:59:191
212059962,3cyclictest13388-21snmpd08:46:311
212059962,3cyclictest13388-21snmpd08:44:581
212059962,3cyclictest13388-21snmpd07:42:231
212059962,3cyclictest0-21swapper/112:28:311
212059962,3cyclictest0-21swapper/112:28:311
212059961,3cyclictest19982-21systemd-journal08:20:481
212059960,6cyclictest0-21swapper/110:20:481
212059960,6cyclictest0-21swapper/109:40:221
212059960,5cyclictest29431-21cat07:25:161
212059960,3cyclictest18780-21cat09:15:211
212059960,3cyclictest11144-21/usr/sbin/munin10:55:211
212059960,2cyclictest17850-21/usr/sbin/munin09:45:191
212059960,0cyclictest0-21swapper/110:45:121
212059960,0cyclictest0-21swapper/109:55:241
212029966,0cyclictest0-21swapper/008:18:430
212029964,1cyclictest13268-21cut12:35:190
212029963,2cyclictest668-21runrttasks11:40:150
212029963,2cyclictest668-21runrttasks08:23:180
212029963,2cyclictest668-21runrttasks08:08:140
212029963,2cyclictest5678-21cat12:30:140
212029963,2cyclictest508-21dbus-daemon10:20:580
212029963,2cyclictest27906-21cat07:20:270
212029963,2cyclictest16969-21lldpd11:50:280
212029963,2cyclictest11715-21sh11:47:040
212029963,2cyclictest11316-21diskmemload11:56:450
212029963,2cyclictest0-21swapper/009:35:060
212029962,3cyclictest9926-21expr09:05:180
212029962,3cyclictest537-21gdbus07:42:200
212029962,3cyclictest508-21dbus-daemon08:34:090
212029962,3cyclictest17830-21expr11:00:160
212029962,3cyclictest13388-21snmpd11:32:520
212029962,3cyclictest13388-21snmpd11:19:510
212029962,3cyclictest13388-21snmpd10:57:480
212029962,3cyclictest13388-21snmpd10:33:050
212029962,3cyclictest13388-21snmpd10:33:050
212029962,3cyclictest13388-21snmpd09:25:110
212029962,3cyclictest13388-21snmpd07:30:050
212029962,3cyclictest12633-21cat09:40:170
212029962,3cyclictest0-21swapper/010:50:110
212029962,3cyclictest0-21swapper/009:45:220
212029962,2cyclictest2898-21turbostat07:40:000
212029962,2cyclictest19982-21systemd-journal08:41:400
212029962,1cyclictest0-21swapper/010:35:120
212029962,1cyclictest0-21swapper/010:01:010
212029962,1cyclictest0-21swapper/009:21:160
212029961,3cyclictest19982-21systemd-journal12:15:160
212029961,2cyclictest738-21ssh12:25:570
212029961,2cyclictest738-21ssh12:25:570
212029960,6cyclictest0-21swapper/011:36:430
212029960,4cyclictest13509-21sshd09:10:300
212029960,2cyclictest378-21/usr/sbin/munin08:45:230
212029960,0cyclictest0-21swapper/012:21:350
212029960,0cyclictest0-21swapper/010:40:040
212159953,1cyclictest563-21grep08:45:103
212159952,2cyclictest9588-21expr09:05:163
212159952,2cyclictest21948-21tail07:10:153
212159952,2cyclictest13388-21snmpd07:40:033
212159952,2cyclictest10961-21pmu-power07:55:213
212159951,2cyclictest19982-21systemd-journal07:30:003
212159950,4cyclictest23053-21kworker/3:208:40:123
212119952,2cyclictest3046-21sh08:50:112
212119952,2cyclictest19052-21cat08:15:142
212119952,2cyclictest12459-21expr12:35:122
212119951,3cyclictest7793-21if_enp4s009:00:172
212119951,3cyclictest31248-21expr07:30:152
212059953,1cyclictest277512sleep112:00:021
212059952,2cyclictest26105-21expr08:30:121
212059952,2cyclictest22-21ksoftirqd/108:25:171
212059951,3cyclictest19518-21cat08:15:161
212059951,3cyclictest13388-21snmpd08:05:191
212029952,2cyclictest5634-21expr07:45:140
212029952,2cyclictest17028-21entropy08:10:150
212029952,2cyclictest13388-21snmpd07:10:020
212029951,3cyclictest19982-21systemd-journal08:25:060
212029950,4cyclictest16036-21sed11:25:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional