You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 00:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Sat Jul 05, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325152307274,20sleep20-21swapper/207:06:332
324922298264,22sleep10-21swapper/107:06:161
3032265228,21sleep30-21swapper/307:09:513
325692256222,22sleep00-21swapper/007:07:150
259412650,0sleep00-21swapper/009:39:030
286172610,0sleep00-21swapper/011:39:480
130382590,0sleep00-21swapper/012:09:470
277962570,0sleep30-21swapper/310:57:433
232562570,0sleep30-21swapper/311:55:253
213622540,0sleep30-21swapper/310:53:223
175332540,0sleep10-21swapper/110:25:131
318802190,0sleep00-21swapper/011:21:020
91272130,0sleep30-21swapper/311:07:203
434991310,2cyclictest13327-21apt-get12:10:023
49822120,0sleep30-21swapper/309:20:563
43499124,3cyclictest508-21dbus-daemon10:33:403
42399127,3cyclictest13870-21apt-get12:10:020
43499117,3cyclictest4845-21awk12:05:003
43499116,3cyclictest19982-21systemd-journal12:25:283
43499112,6cyclictest31243-21gltestperf11:00:173
43499111,7cyclictest8866-21ssh12:06:313
43499111,7cyclictest12528-21ssh11:49:473
43099118,2cyclictest28-21ksoftirqd/207:35:012
62892100,0sleep20-21swapper/209:22:282
43499106,3cyclictest18141-21grep10:25:173
43499106,2cyclictest19982-21systemd-journal10:40:013
43499105,4cyclictest1-21systemd09:38:103
43499102,6cyclictest0-21swapper/312:18:303
43499102,2cyclictest32249-21ntpq08:15:183
43499101,7cyclictest16210-21sh11:51:163
43499101,6cyclictest5471-21ssh09:48:543
43499101,6cyclictest27993-21ssh12:38:163
43499101,6cyclictest16634-21ssh10:24:273
43499101,5cyclictest30192-21ssh09:41:493
42399105,3cyclictest19982-21systemd-journal07:17:090
42399102,5cyclictest7703-21sh10:16:130
42399100,7cyclictest3312-21ssh10:40:160
4349997,1cyclictest24301-21apt-get08:00:143
4349997,1cyclictest14522-21apt-get08:50:143
4349996,2cyclictest22016-21test07:55:013
4349996,2cyclictest12570-21cron09:55:013
4349995,3cyclictest9760-21awk08:40:013
4349995,3cyclictest3815-21awk10:40:203
4349995,3cyclictest0-21swapper/307:10:143
4349995,2cyclictest19982-21systemd-journal10:19:543
4349994,4cyclictest21845-21gltestperf11:35:173
4349994,3cyclictest19982-21systemd-journal12:33:243
4349994,3cyclictest19982-21systemd-journal08:44:463
4349992,5cyclictest21640-21ssh10:00:593
4349992,3cyclictest30532-21ssh09:15:203
4349991,6cyclictest4582-21ssh11:44:593
4349991,5cyclictest23166-21diskmemload09:55:593
4349991,5cyclictest19399-21ssh11:14:053
4349991,5cyclictest19236-21ssh09:33:133
4349991,5cyclictest12921-21ssh10:47:043
4349991,4cyclictest4961-21/usr/sbin/munin11:25:203
4349991,4cyclictest15195-21ssh11:30:373
4309994,3cyclictest19982-21systemd-journal12:30:282
4269995,3cyclictest30654-21snmpd09:43:311
4239996,1cyclictest29052-21apt-get08:10:130
4239995,3cyclictest19982-21systemd-journal09:16:280
4239992,2cyclictest22875-21expr12:15:150
4239990,6cyclictest8153-21sh11:06:250
4239990,6cyclictest13162-21ssh09:28:300
4349986,1cyclictest8885-21ssh09:25:143
4349985,2cyclictest4042-21gltestperf07:15:163
4349985,2cyclictest31192-21ssh12:20:163
4349985,2cyclictest29645-21smartctl08:10:163
4349985,2cyclictest2689-21sshd08:20:273
4349985,2cyclictest25758-21sh10:05:133
4349985,2cyclictest23170-21munin-run09:10:003
4349985,2cyclictest21507-21ls07:55:013
4349985,2cyclictest15592-21perl07:40:163
4349985,1cyclictest19982-21systemd-journal08:10:013
4349984,3cyclictest6613-21sed07:20:203
4349984,3cyclictest12937-21irqstats08:45:163
4349984,3cyclictest12316-21wc07:35:013
4349983,4cyclictest15626-1kworker/u9:111:20:143
4349983,4cyclictest13828-21sshd07:35:253
4349983,3cyclictest19982-21systemd-journal08:32:153
4349982,2cyclictest24460-21ssh11:16:393
4349981,3cyclictest18302-21sshd08:55:213
4349981,2cyclictest26721-21ssh09:12:063
4309984,3cyclictest19982-21systemd-journal09:18:212
4309984,2cyclictest19982-21systemd-journal09:08:322
4309981,4cyclictest17064-21basename07:45:012
4309981,4cyclictest12657-21basename11:30:002
4309980,7cyclictest31498-21ntp_states12:20:182
4269984,3cyclictest19982-21systemd-journal12:28:481
4269983,3cyclictest19982-21systemd-journal12:17:581
4269983,3cyclictest19982-21systemd-journal10:54:231
4239986,1cyclictest7244-21ntpq12:25:170
4239984,3cyclictest19982-21systemd-journal11:10:520
4239983,3cyclictest19982-21systemd-journal09:45:350
4239982,4cyclictest12-21ksoftirqd/008:25:150
4239982,1cyclictest5609-21sort08:30:140
4239982,1cyclictest16245-21awk07:40:200
4239981,5cyclictest0-21swapper/010:01:370
4239981,2cyclictest28008-21awk08:05:200
4239981,2cyclictest23589-21grep09:10:130
4239981,1cyclictest0-21swapper/009:31:440
4239980,6cyclictest28245-21ssh10:34:290
4239980,6cyclictest16768-21ssh11:31:510
4239980,5cyclictest25599-21ssh11:57:160
4239980,5cyclictest16008-21ssh11:51:070
4239980,5cyclictest1211-21ssh12:02:110
4349975,1cyclictest18984-21apt-get09:00:113
4349974,2cyclictest4170-21sed08:25:183
4349974,2cyclictest17827-21grep07:45:153
4349973,3cyclictest8010-21/usr/sbin/munin07:25:143
4349973,3cyclictest32269-21fschecks_time10:10:163
4309975,1cyclictest21077-21ssh10:00:242
4309974,2cyclictest4471-21cron11:25:002
4309974,2cyclictest19982-21systemd-journal11:41:232
4309974,2cyclictest11736-21in:imuxsock10:08:132
4309973,3cyclictest31095-21grep11:00:172
4309973,3cyclictest19982-21systemd-journal12:37:092
4309973,3cyclictest19982-21systemd-journal11:10:002
4309973,2cyclictest19982-21systemd-journal12:00:002
4309973,1cyclictest0-21swapper/210:11:092
4309972,3cyclictest502-21systemd-logind09:02:172
4309972,3cyclictest19982-21systemd-journal08:12:222
4309972,1cyclictest0-21swapper/211:47:552
4309972,1cyclictest0-21swapper/211:20:002
4309971,4cyclictest19982-21systemd-journal07:55:072
4309971,3cyclictest2644-21awk07:15:012
4269974,2cyclictest508-21dbus-daemon12:22:331
4269974,2cyclictest508-21dbus-daemon11:10:241
4269974,2cyclictest508-21dbus-daemon10:37:001
4269974,2cyclictest508-21dbus-daemon07:15:291
4269974,2cyclictest29741-11brltty12:05:021
4269974,2cyclictest19982-21systemd-journal11:00:001
4269974,2cyclictest19982-21systemd-journal09:17:181
4269973,3cyclictest508-21dbus-daemon08:50:111
4269973,3cyclictest29741-11brltty11:54:111
4269973,3cyclictest22747-21expr12:35:151
4269973,1cyclictest0-21swapper/112:14:091
4269973,1cyclictest0-21swapper/111:41:531
4269973,1cyclictest0-21swapper/110:41:531
4269973,1cyclictest0-21swapper/109:58:301
4269972,3cyclictest19982-21systemd-journal08:00:011
4269971,5cyclictest0-21swapper/112:31:181
4269971,3cyclictest14821-21munin-plugin-st07:40:011
4269970,7cyclictest0-21swapper/111:39:351
4269970,2cyclictest26808-21munin-run09:40:011
4239976,1cyclictest131rcuc/012:22:180
4239975,1cyclictest31278-21apt-get08:15:120
4239975,1cyclictest12988-21apt-get09:55:130
4239974,2cyclictest508-21dbus-daemon07:24:150
4239974,2cyclictest23166-21diskmemload11:25:130
4239973,3cyclictest508-21dbus-daemon08:54:460
4239973,3cyclictest31644-21ntp_kernel_pll_11:00:200
4239973,3cyclictest27675-21diskstats09:40:160
4239973,3cyclictest19982-21systemd-journal10:05:450
4239973,3cyclictest13621-21needreboot07:35:170
4239973,1cyclictest0-21swapper/010:46:330
4239972,4cyclictest12-21ksoftirqd/011:16:040
4239972,3cyclictest19982-21systemd-journal09:20:000
4239972,3cyclictest141rcu_preempt10:25:380
4239971,5cyclictest17286-21/usr/sbin/munin07:45:130
4239971,5cyclictest0-21swapper/008:55:120
4239971,4cyclictest12-21ksoftirqd/007:56:570
4239971,4cyclictest0-21swapper/012:35:390
4239971,4cyclictest0-21swapper/010:51:180
4239971,4cyclictest0-21swapper/010:36:070
4239971,2cyclictest9342-21ssh09:51:150
4239971,2cyclictest22785-21runrttasks09:05:310
4239971,2cyclictest20085-21gltestperf07:50:170
4239971,2cyclictest14131-21ssh12:30:020
4239971,2cyclictest0-21swapper/011:45:080
4239970,5cyclictest31326-21ssh11:40:300
4239970,5cyclictest14129-21ssh10:21:390
4309963,2cyclictest7435-21ssh10:15:552
4309963,2cyclictest508-21dbus-daemon09:50:172
4309963,2cyclictest32200-21ssh12:01:022
4309963,2cyclictest30654-21snmpd10:56:212
4309963,2cyclictest30654-21snmpd08:18:162
4309963,2cyclictest24349-21tail10:30:172
4309963,2cyclictest21782-21ls09:35:162
4309963,2cyclictest18795-21rm10:50:582
4309963,2cyclictest16733-21ssh09:30:242
4309963,2cyclictest12984-21apt-get11:10:152
4309963,2cyclictest11736-21in:imuxsock07:45:192
4309962,3cyclictest7234-21sed07:20:252
4309962,3cyclictest30654-21snmpd12:25:042
4309962,3cyclictest30654-21snmpd10:45:412
4309962,3cyclictest30654-21snmpd09:55:042
4309962,3cyclictest30654-21snmpd09:45:282
4309962,3cyclictest30654-21snmpd08:37:342
4309962,3cyclictest30654-21snmpd07:25:392
4309962,3cyclictest28405-21sshd08:05:252
4309962,3cyclictest21986-21if_enp4s011:35:172
4309962,3cyclictest19982-21systemd-journal08:30:012
4309962,3cyclictest19538-21apt-get07:50:152
4309962,3cyclictest17397-21if_err_enp4s008:55:142
4309962,3cyclictest14002-21expr11:50:172
4309962,3cyclictest13828-21ls11:30:172
4309962,1cyclictest0-21swapper/212:17:292
4309962,1cyclictest0-21swapper/212:05:012
4309962,1cyclictest0-21swapper/210:40:132
4309962,1cyclictest0-21swapper/209:26:192
4309962,1cyclictest0-21swapper/209:10:392
4309961,3cyclictest19982-21systemd-journal10:35:462
4309961,3cyclictest19982-21systemd-journal08:46:512
4309961,3cyclictest19982-21systemd-journal07:38:012
4309961,2cyclictest16267-21ssh12:10:412
4309960,6cyclictest0-21swapper/210:25:182
4309960,6cyclictest0-21swapper/207:19:562
4309960,3cyclictest13410-21ssh10:20:512
4309960,0cyclictest0-21swapper/209:41:102
4269963,2cyclictest9811-21ssh11:47:391
4269963,2cyclictest9009-21grep08:35:221
4269963,2cyclictest8699-21sh11:06:591
4269963,2cyclictest6721-21sh09:50:071
4269963,2cyclictest668-21runrttasks08:20:521
4269963,2cyclictest5660-21cpuspeed_turbos08:30:141
4269963,2cyclictest29476-21fschecks_count08:10:151
4269963,2cyclictest2879-21cpuspeed_turbos09:20:131
4269963,2cyclictest15140-21cpuspeed_turbos09:30:141
4269963,2cyclictest13546-21ls08:45:201
4269963,2cyclictest12189-21apt-get07:35:011
4269962,3cyclictest7661-21lldpd08:41:251
4269962,3cyclictest31950-21cat08:15:161
4269962,3cyclictest30654-21snmpd11:01:391
4269962,3cyclictest30654-21snmpd10:48:411
4269962,3cyclictest30654-21snmpd10:17:351
4269962,3cyclictest30654-21snmpd09:10:331
4269962,3cyclictest30654-21snmpd08:56:531
4269962,3cyclictest30654-21snmpd08:05:451
4269962,3cyclictest30353-21cat12:00:161
4269962,3cyclictest27056-21sensors10:05:201
4269962,3cyclictest20742-21seq09:02:351
4269962,3cyclictest14789-21grep11:30:221
4269962,3cyclictest1-21systemd11:15:481
4269962,3cyclictest0-21swapper/111:56:101
4269962,3cyclictest0-21swapper/111:20:541
4269962,1cyclictest0-21swapper/111:26:151
4269962,1cyclictest0-21swapper/110:33:441
4269962,1cyclictest0-21swapper/110:11:361
4269962,1cyclictest0-21swapper/109:45:071
4269962,1cyclictest0-21swapper/109:26:311
4269961,4cyclictest0-21swapper/107:50:201
4269960,6cyclictest0-21swapper/110:01:331
4269960,5cyclictest5760-21/usr/sbin/munin07:20:241
4269960,5cyclictest12529-21/usr/sbin/munin10:20:211
4269960,2cyclictest7985-21/usr/sbin/munin07:25:161
4239963,2cyclictest1281-21expr08:20:140
4239962,3cyclictest508-21dbus-daemon07:25:050
4239962,3cyclictest30654-21snmpd08:45:280
4239962,3cyclictest30654-21snmpd07:10:140
4239962,3cyclictest22009-21packagekitd08:00:070
4239962,3cyclictest10009-21/usr/sbin/munin08:40:160
4239961,1cyclictest29741-11brltty09:02:420
4239961,1cyclictest12-21ksoftirqd/008:35:160
4239961,1cyclictest0-21swapper/010:55:060
4239960,4cyclictest0-21swapper/007:32:230
4239960,2cyclictest31588-21runrttasks10:10:020
4309952,2cyclictest6533-21open_inodes08:30:192
4309952,2cyclictest24749-21/usr/sbin/munin08:00:162
4309952,2cyclictest14712-21ls08:50:152
4309951,3cyclictest30654-21snmpd08:20:072
4309951,3cyclictest10731-21/usr/sbin/munin08:40:202
4269952,2cyclictest508-21dbus-daemon08:00:061
4269952,2cyclictest3844-21head08:25:161
4269952,2cyclictest17842-21expr07:45:151
4269951,3cyclictest508-21dbus-daemon09:05:121
4269951,2cyclictest19982-21systemd-journal07:10:041
4269950,3cyclictest19982-21systemd-journal07:40:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional