You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-19 - 01:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sat Oct 18, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
64832321291,19sleep20-21swapper/207:09:192
62242280216,21sleep10-21swapper/107:05:561
63442265231,22sleep30-21swapper/307:07:313
63462262229,21sleep00-21swapper/007:07:310
53092670,0sleep10-21swapper/110:13:001
237252590,0sleep30-21swapper/309:33:443
89182580,0sleep00-21swapper/010:42:020
173852580,0sleep00-21swapper/009:55:420
200332570,0sleep00-21swapper/009:30:130
96212550,0sleep30-21swapper/310:42:503
140402530,0sleep20-21swapper/211:39:512
40152220,0sleep10-21swapper/109:15:291
35452170,0sleep10-21swapper/111:04:581
229402170,0sleep20-21swapper/212:35:002
190582170,0sleep00-21swapper/008:45:200
307572150,0sleep20-21swapper/211:52:192
665699140,11cyclictest29293-21/usr/sbin/munin12:15:182
665699140,11cyclictest21031-21sh09:59:562
665699140,11cyclictest17411-21ssh12:06:532
82182130,0sleep10-21swapper/110:41:141
665699131,9cyclictest28839-21diskmemload10:18:082
665699130,8cyclictest2679-21uname08:10:162
665699130,8cyclictest17572-21ssh11:42:042
665699130,10cyclictest7554-21ssh11:34:502
665699130,10cyclictest556-21ssh10:09:592
665699130,10cyclictest3800-21ssh10:11:172
665699130,10cyclictest3210-21ssh11:04:282
665699130,10cyclictest24251-21ssh10:55:142
665699130,10cyclictest23549-21ssh12:10:572
665699130,10cyclictest23352-21ssh10:00:342
665699130,10cyclictest15938-21ssh12:29:442
665699130,10cyclictest12643-21sh12:03:572
665699130,10cyclictest12023-21ssh09:22:552
665699130,10cyclictest11343-21wc11:10:232
52932130,0sleep20-21swapper/212:20:472
171982130,0sleep10-21swapper/110:49:311
665699122,5cyclictest5891-21ssh09:45:572
665699122,5cyclictest4923-21hostname11:05:172
665699121,7cyclictest30654-21snmpd07:25:172
665699121,6cyclictest21068-21/usr/sbin/munin07:40:162
665699120,9cyclictest7970-21ssh10:41:022
665699120,9cyclictest5998-21ssh11:59:052
665699120,9cyclictest32240-21ssh09:40:382
665699120,9cyclictest28770-21ssh09:37:532
665699120,9cyclictest28590-21grep07:55:182
665699120,9cyclictest28480-21sh10:31:282
665699120,9cyclictest26456-21ssh12:36:572
665699120,9cyclictest26117-21ssh11:23:182
665699120,9cyclictest25326-21ssh11:48:252
665699120,9cyclictest23840-21chrt08:57:332
665699120,9cyclictest22885-21sh10:26:462
665699120,9cyclictest17932-21sh10:50:032
665699120,9cyclictest17489-21ssh11:15:262
665699120,9cyclictest15972-21ssh09:25:572
665699120,9cyclictest14266-21ssh10:46:112
665699120,9cyclictest13536-21ssh10:20:102
665699120,9cyclictest11601-21ssh09:50:472
665699120,7cyclictest5021-21ssh09:16:352
665699120,7cyclictest28746-21ssh11:25:162
665699120,7cyclictest23003-21ssh09:32:462
665699120,7cyclictest19840-21mailstats07:35:212
665699120,7cyclictest1768-21ssh09:14:262
665699120,7cyclictest1538-21ssh10:35:352
665699120,6cyclictest29741-11brltty08:49:502
665699120,1cyclictest29945-21apt-get08:00:122
665699120,10cyclictest19853-21apt-get08:50:122
665699110,8cyclictest18002-21taskset07:30:242
665699110,6cyclictest5190-21ntp_states08:15:302
665699110,6cyclictest14045-21cut08:35:182
665099119,1cyclictest12-21ksoftirqd/009:40:010
246172110,1sleep30-21swapper/310:02:133
665699102,7cyclictest173042chrt08:44:272
665699100,6cyclictest7712-21wc07:10:182
665699100,6cyclictest26865-21wc07:50:222
665699100,6cyclictest26411-21taskset09:02:422
665699100,6cyclictest13634-21runrttasks07:21:172
665699100,6cyclictest10650-21awk07:15:172
665699100,5cyclictest9083-21diskstats08:25:142
665699100,1cyclictest26865-21apt-get09:05:132
665099109,1cyclictest12-21ksoftirqd/011:35:000
665099108,1cyclictest12-21ksoftirqd/011:40:000
665099107,2cyclictest12-21ksoftirqd/011:30:000
66569990,8cyclictest23470-21cat07:45:152
66569990,8cyclictest11892-21ntp_states08:30:222
66569990,0cyclictest0-21swapper/208:05:162
66509998,1cyclictest12-21ksoftirqd/012:29:590
66509997,2cyclictest12-21ksoftirqd/010:30:000
66509997,2cyclictest12-21ksoftirqd/008:40:000
66509997,1cyclictest12-21ksoftirqd/012:19:590
66509994,3cyclictest19982-21systemd-journal10:22:260
66509994,3cyclictest19982-21systemd-journal08:32:180
66509994,3cyclictest19982-21systemd-journal07:51:240
66609984,3cyclictest7742-21cron11:39:563
66609983,3cyclictest19982-21systemd-journal12:16:253
66569980,7cyclictest6964-21fschecks_time08:20:162
66529986,1cyclictest0-21swapper/109:26:041
66529984,3cyclictest30191-21dump-pmu-power09:40:021
66529984,3cyclictest19982-21systemd-journal09:30:171
66529982,3cyclictest13943-21munin-run07:25:011
66509987,1cyclictest12-21ksoftirqd/012:34:590
66509987,1cyclictest12-21ksoftirqd/010:55:010
66509987,1cyclictest12-21ksoftirqd/010:20:010
66509987,1cyclictest12-21ksoftirqd/010:05:020
66509987,1cyclictest12-21ksoftirqd/009:25:010
66509987,1cyclictest12-21ksoftirqd/007:15:010
66509986,2cyclictest12-21ksoftirqd/011:25:000
66509986,2cyclictest12-21ksoftirqd/008:05:000
66509986,1cyclictest131rcuc/011:10:150
66509985,2cyclictest12-21ksoftirqd/009:00:010
66509984,3cyclictest7661-21lldpd10:32:110
66509984,3cyclictest508-21dbus-daemon11:07:300
66509983,3cyclictest19982-21systemd-journal11:17:460
66509983,1cyclictest141rcu_preempt12:00:130
66509982,4cyclictest12-21ksoftirqd/010:56:220
66509982,3cyclictest29665-21munin-run08:00:000
66509981,2cyclictest12-21ksoftirqd/008:25:130
29649280,3sleep334-21ksoftirqd/311:25:223
66609974,2cyclictest508-21dbus-daemon07:16:473
66609974,2cyclictest34-21ksoftirqd/307:35:003
66609974,2cyclictest26840-21/usr/sbin/munin09:05:183
66609974,2cyclictest23061-21grep11:20:213
66609974,2cyclictest11736-21in:imuxsock12:20:303
66609974,2cyclictest11736-21in:imuxsock08:54:503
66609973,3cyclictest4458-21sshd09:15:543
66609973,3cyclictest30654-21snmpd11:56:083
66609973,3cyclictest30654-21snmpd11:12:303
66609973,3cyclictest19982-21systemd-journal10:26:373
66609973,3cyclictest17353-21cron08:45:013
66609973,3cyclictest14558-21cat10:20:183
66609973,3cyclictest0-21swapper/311:54:473
66609973,3cyclictest0-21swapper/311:33:423
66609973,3cyclictest0-21swapper/309:27:463
66609973,1cyclictest0-21swapper/310:56:443
66609973,1cyclictest0-21swapper/310:11:303
66609972,3cyclictest7661-21lldpd10:53:123
66609972,3cyclictest19982-21systemd-journal12:34:173
66609972,3cyclictest19982-21systemd-journal08:45:483
66609970,3cyclictest19982-21systemd-journal12:10:293
66529974,2cyclictest11736-21in:imuxsock10:52:451
66529973,3cyclictest508-21dbus-daemon07:57:401
66529973,3cyclictest23237-21apt-get07:45:141
66529973,3cyclictest19982-21systemd-journal11:07:301
66529973,3cyclictest10639-21cut09:50:191
66529973,1cyclictest0-21swapper/112:39:591
66529972,3cyclictest7661-21lldpd08:51:061
66529972,3cyclictest19982-21systemd-journal08:00:421
66529971,4cyclictest19982-21systemd-journal12:23:011
66529971,2cyclictest19982-21systemd-journal09:24:561
66509976,1cyclictest12-21ksoftirqd/012:10:000
66509976,1cyclictest12-21ksoftirqd/011:05:010
66509976,1cyclictest12-21ksoftirqd/010:40:000
66509976,1cyclictest12-21ksoftirqd/009:50:010
66509976,1cyclictest12-21ksoftirqd/007:15:010
66509975,2cyclictest12-21ksoftirqd/009:25:010
66509974,1cyclictest12-21ksoftirqd/011:50:150
66509973,3cyclictest508-21dbus-daemon12:13:000
66509973,3cyclictest19982-21systemd-journal09:44:440
66509973,3cyclictest19982-21systemd-journal09:10:010
66509973,3cyclictest19982-21systemd-journal08:05:150
66509973,3cyclictest17025-21tail07:30:160
66509973,3cyclictest10548-21ntpq09:50:170
66509973,3cyclictest0-21swapper/012:39:190
66509973,2cyclictest19982-21systemd-journal07:25:120
66509972,3cyclictest19982-21systemd-journal10:07:010
66509971,4cyclictest29741-11brltty09:04:010
26737270,0chrt0-21swapper/011:49:580
66609966,0cyclictest0-21swapper/310:17:453
66609964,1cyclictest28839-21diskmemload10:35:163
66609964,1cyclictest22097-21grep11:45:163
66609963,2cyclictest8211-21cat07:10:233
66609963,2cyclictest4870-21proc_pri09:45:193
66609963,2cyclictest4684-21fschecks_time08:15:163
66609963,2cyclictest23259-21ssh12:35:133
66609963,2cyclictest14498-21sh10:46:283
66609963,2cyclictest13418-21expr08:35:143
66609963,2cyclictest12252-21ssh12:26:003
66609962,3cyclictest8455-21expr09:20:133
66609962,3cyclictest7626-21expr12:00:133
66609962,3cyclictest508-21dbus-daemon09:56:353
66609962,3cyclictest508-21dbus-daemon07:54:453
66609962,3cyclictest4993-21cat11:05:173
66609962,3cyclictest31193-21cat11:00:183
66609962,3cyclictest30654-21snmpd09:36:213
66609962,3cyclictest30654-21snmpd08:30:013
66609962,3cyclictest30654-21snmpd07:55:313
66609962,3cyclictest23898-21cat07:45:173
66609962,3cyclictest19982-21systemd-journal09:00:013
66609962,3cyclictest13561-21sshd07:20:303
66609962,3cyclictest1-21systemd08:06:013
66609962,3cyclictest0-21swapper/312:05:193
66609962,2cyclictest19982-21systemd-journal10:05:423
66609962,1cyclictest0-21swapper/311:15:013
66609962,1cyclictest0-21swapper/309:43:453
66609961,3cyclictest502-21systemd-logind08:25:373
66609961,3cyclictest19982-21systemd-journal08:20:153
66609961,3cyclictest19982-21systemd-journal08:11:023
66609960,6cyclictest0-21swapper/307:25:153
66609960,4cyclictest19982-21systemd-journal09:51:103
66609960,3cyclictest27891-21rm10:30:533
66609960,3cyclictest1842-21ssh09:14:293
66609960,2cyclictest20988-21/usr/sbin/munin07:40:183
66609960,2cyclictest15733-21cut11:40:203
66529964,1cyclictest31387-21needreboot09:40:171
66529964,1cyclictest28201-21needreboot11:50:181
66529963,2cyclictest5680-21ssh09:45:421
66529963,2cyclictest508-21dbus-daemon10:25:011
66529963,2cyclictest508-21dbus-daemon08:25:381
66529963,2cyclictest30654-21snmpd10:15:301
66529963,2cyclictest26170-21rm10:55:411
66529963,2cyclictest17356-21ssh12:06:511
66529963,2cyclictest11736-21in:imuxsock08:55:501
66529963,2cyclictest10506-21grep12:25:181
66529962,3cyclictest8370-21grep11:35:161
66529962,3cyclictest508-21dbus-daemon09:00:001
66529962,3cyclictest4335-21sshd11:31:161
66529962,3cyclictest397-21cat08:05:171
66529962,3cyclictest30654-21snmpd12:15:361
66529962,3cyclictest30654-21snmpd11:40:011
66529962,3cyclictest30654-21snmpd09:13:481
66529962,3cyclictest30654-21snmpd09:05:171
66529962,3cyclictest30654-21snmpd08:46:411
66529962,3cyclictest30654-21snmpd07:35:331
66529962,3cyclictest30654-21snmpd07:31:031
66529962,3cyclictest29741-11brltty08:42:191
66529962,3cyclictest28371-21expr11:25:141
66529962,3cyclictest26281-21grep10:30:171
66529962,3cyclictest26244-21cat07:50:171
66529962,3cyclictest22998-21timerwakeupswit10:00:211
66529962,3cyclictest19982-21systemd-journal11:45:011
66529962,3cyclictest16470-21ntpq09:55:191
66529962,3cyclictest1-21systemd08:33:331
66529962,2cyclictest21265-21awk12:10:151
66529962,1cyclictest0-21swapper/112:31:491
66529962,1cyclictest0-21swapper/111:59:301
66529962,1cyclictest0-21swapper/111:15:261
66529962,1cyclictest0-21swapper/111:11:501
66529962,1cyclictest0-21swapper/110:35:171
66529962,1cyclictest0-21swapper/110:05:421
66529961,3cyclictest19982-21systemd-journal11:21:071
66529961,3cyclictest19982-21systemd-journal07:26:241
66529961,2cyclictest10299-21ssh12:01:461
66529960,5cyclictest13613-21/usr/sbin/munin10:20:221
66509965,1cyclictest12-21ksoftirqd/007:50:000
66509963,2cyclictest2945-21awk10:10:230
66509963,2cyclictest13198-21awk10:45:210
66509963,2cyclictest12-21ksoftirqd/011:42:340
66509962,3cyclictest3371-21expr12:20:120
66509962,3cyclictest30654-21snmpd07:40:530
66509962,3cyclictest2639-21cat08:10:170
66509962,3cyclictest2303-21ntpq11:55:170
66509962,3cyclictest19982-21systemd-journal09:15:160
66509962,1cyclictest12-21ksoftirqd/009:11:310
66509961,3cyclictest19982-21systemd-journal08:23:330
66509960,4cyclictest19982-21systemd-journal08:15:120
66509960,1cyclictest141rcu_preempt08:40:130
66609953,1cyclictest668-21runrttasks07:35:033
66609951,3cyclictest19982-21systemd-journal08:00:093
66609951,3cyclictest1-21systemd08:55:153
66529953,1cyclictest8972-21munin-node07:15:021
66529953,1cyclictest13358-21cstates08:35:151
66529952,2cyclictest30654-21snmpd08:20:081
66529952,2cyclictest21219-21cat07:40:161
66529952,2cyclictest2032-21cat08:10:131
66529951,3cyclictest508-21dbus-daemon08:15:121
66529951,2cyclictest19982-21systemd-journal07:10:061
66509952,2cyclictest20798-21ntp_offset08:50:160
66509952,2cyclictest12-21ksoftirqd/007:35:200
66509951,2cyclictest19982-21systemd-journal07:20:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional