You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 12:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Sun Dec 14, 2025 00:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10456992219,2cyclictest15539-21php7.023:09:002
1045599220,4cyclictest0-21swapper/120:52:161
10456992017,2cyclictest0-21swapper/220:59:142
1045699200,16cyclictest0-21swapper/200:33:372
10455992017,2cyclictest19095-21grep22:17:131
10454992017,2cyclictest32278-21cron21:45:010
1045699192,15cyclictest0-21swapper/223:59:022
10456991917,1cyclictest0-21swapper/222:57:162
10456991916,2cyclictest23213-21processes21:27:142
1045699190,1cyclictest0-21swapper/223:42:082
1045699190,18cyclictest0-21swapper/222:12:102
10455991916,1cyclictest0-21swapper/123:07:181
1045599191,16cyclictest21884-21grep21:27:081
1045599191,16cyclictest17608-21nfsd419:22:131
1045599190,18cyclictest0-21swapper/119:46:491
1045599190,18cyclictest0-21swapper/119:46:481
1045699182,1cyclictest265682chrt21:34:342
1045699182,1cyclictest26196-21cpuspeed_turbos22:32:112
10456991816,1cyclictest3978-21H222:02:192
10456991814,3cyclictest3991-21H222:02:192
1045599182,15cyclictest12281-21ntpq19:12:121
10455991816,1cyclictest21-21ksoftirqd/123:48:431
10455991815,2cyclictest602-21grep19:52:091
10455991815,2cyclictest16580-21chrt23:10:421
10455991814,3cyclictest3989-21H222:02:191
1045599180,3cyclictest32194-21md.daily21:44:301
1045599180,3cyclictest1522-21lxd21:50:481
1045599180,1cyclictest0-21swapper/119:30:301
1045599180,17cyclictest455-21plymouthd21:22:081
1045599180,15cyclictest4099-21H222:02:191
10454991815,1cyclictest0-21swapper/022:59:400
1045499181,2cyclictest1603-21cat21:47:100
1045499181,16cyclictest3642-21nfsd422:47:140
1045499180,3cyclictest29585-21fschecks_count20:42:100
1045499180,16cyclictest3985-21H222:02:190
1045499180,16cyclictest3985-21H222:02:190
10456991715,1cyclictest0-21swapper/200:35:042
10456991715,1cyclictest0-21swapper/200:35:032
10456991714,2cyclictest7178-21/usr/sbin/munin23:52:102
10456991714,2cyclictest5202-21http_loadtime23:47:112
10456991714,2cyclictest3989-21H222:02:192
10456991714,2cyclictest24372-21smtpd19:35:122
10456991714,2cyclictest24244-21awk20:32:102
10456991714,2cyclictest23896-21chrt19:34:132
10456991714,2cyclictest12233-21cat22:07:102
10456991713,3cyclictest3985-21H222:02:192
10456991713,3cyclictest2007-21systemd-journal20:39:012
1045699170,2cyclictest4035-21H222:02:192
1045699170,2cyclictest399-20systemd-journal00:25:502
1045699170,2cyclictest30268-21sed23:35:022
1045699170,2cyclictest27316-21grep21:37:082
1045699170,2cyclictest15262-21munin-run00:04:592
1045699170,2cyclictest12321-21nvmesmart_nvme019:12:132
1045699170,1cyclictest0-21swapper/223:02:132
1045699170,16cyclictest7709-21ntp_kernel_err21:57:142
1045699170,16cyclictest5415-21cstates22:52:092
1045699170,16cyclictest399-20systemd-journal22:25:362
1045699170,16cyclictest3989-21H222:02:192
1045699170,16cyclictest3989-21H222:02:192
1045699170,16cyclictest3985-21H222:02:192
1045699170,16cyclictest28642-21proxymap22:35:412
1045699170,16cyclictest22991-21latency_hist20:30:002
1045699170,16cyclictest21077-21chrt19:27:472
1045699170,16cyclictest19474-21switchtime22:17:152
1045699170,16cyclictest15450-21expr20:17:072
1045699170,16cyclictest1525-21lxd21:16:482
1045699170,16cyclictest14177-21fschecks_count21:12:112
1045699170,16cyclictest13061-21fschecks_count20:12:102
1045699170,16cyclictest0-21swapper/220:52:322
1045699170,16cyclictest0-21swapper/220:22:462
10455991715,1cyclictest214482sleep100:16:101
10455991714,2cyclictest9954-21cpu23:57:101
10455991714,2cyclictest9076-21/usr/sbin/munin22:02:121
10455991714,2cyclictest8566-21ntpq23:52:121
10455991714,2cyclictest7725-21nfsd420:02:121
10455991714,2cyclictest32556-21grep00:37:101
10455991714,2cyclictest32556-21grep00:37:101
10455991714,2cyclictest27264-21cat00:27:091
10455991714,2cyclictest19316-21smartctl20:22:161
10455991714,2cyclictest18788-21/usr/sbin/munin00:12:131
10455991714,2cyclictest1863-21nfsd421:47:111
10455991714,2cyclictest18573-21latency_hist00:10:001
10455991713,3cyclictest0-21swapper/119:27:421
1045599171,15cyclictest11832-21nfsd423:02:151
1045599170,2cyclictest4440-21chrt22:48:081
1045599170,2cyclictest3985-21H222:02:191
1045599170,2cyclictest3985-21H222:02:191
1045599170,2cyclictest26536-21expr20:37:111
1045599170,2cyclictest24170-21sshd00:20:571
1045599170,2cyclictest16434-21cpuspeed_turbos21:17:091
1045599170,2cyclictest15277-21cron00:05:001
1045599170,1cyclictest0-21swapper/119:42:091
1045599170,16cyclictest9475-21chrt20:06:311
1045599170,16cyclictest5890-21sed22:52:101
1045599170,16cyclictest4274-21cut19:57:101
1045599170,16cyclictest3980-21H222:02:191
1045599170,16cyclictest30935-21postgres20:42:311
1045599170,16cyclictest29716-21sort22:37:121
1045599170,16cyclictest26916-21chrt23:27:321
1045599170,16cyclictest2340-21kernelversion23:42:111
1045599170,16cyclictest23305-21chrt20:31:531
1045599170,16cyclictest22988-21latency_hist22:25:001
1045599170,16cyclictest22035-21tr20:27:151
1045599170,16cyclictest14047-21sed22:09:001
1045599170,16cyclictest13941-21pzem_current20:12:151
1045599170,16cyclictest1133-21snapd20:16:481
1045599170,16cyclictest0-21swapper/123:21:071
1045599170,16cyclictest0-21swapper/122:30:591
1045599170,16cyclictest0-21swapper/120:57:101
1045599170,15cyclictest3991-21H222:02:191
10454991715,1cyclictest9-21ksoftirqd/000:31:560
10454991714,2cyclictest9804-21hddtemp_smartct22:02:100
10454991714,2cyclictest4099-21H222:02:190
10454991714,2cyclictest4099-21H222:02:190
10454991714,2cyclictest3990-21H222:02:190
10454991714,2cyclictest3707-21master23:25:160
10454991714,2cyclictest3286-21latency20:52:130
10454991714,2cyclictest31568-21ntp_states19:47:140
10454991714,2cyclictest31568-21ntp_states19:47:140
10454991714,2cyclictest17708-21anvil22:15:400
10454991714,2cyclictest15378-21cat22:12:100
10454991714,2cyclictest14739-21ntpq23:07:120
10454991714,2cyclictest1457-21chrt20:48:500
10454991714,2cyclictest1142-21snapd20:31:490
1045499171,15cyclictest4099-21H222:02:190
1045499171,15cyclictest4099-21H222:02:190
1045499171,15cyclictest14057-21switchtime20:12:170
1045499170,2cyclictest7788-21anvil21:00:290
1045499170,2cyclictest2847-21dbus-daemon22:20:400
1045499170,2cyclictest28197-21latency_hist22:35:000
1045499170,2cyclictest22674-21cat00:17:120
1045499170,2cyclictest20539-21/usr/sbin/munin21:22:140
1045499170,2cyclictest1142-21snapd19:57:000
1045499170,1cyclictest4099-21H222:02:190
1045499170,1cyclictest3985-21H222:02:190
1045499170,1cyclictest0-21swapper/020:23:360
1045499170,16cyclictest870-21systemd-logind23:36:490
1045499170,16cyclictest5030-21sshd22:50:460
1045499170,16cyclictest3985-21H222:02:190
1045499170,16cyclictest3053-21systemd-logind23:42:500
1045499170,16cyclictest30386-21swap22:37:150
1045499170,16cyclictest29861-21perf23:35:000
1045499170,16cyclictest23198-21ntp_offset19:32:130
1045499170,16cyclictest14151-21munin-run22:10:000
1045499170,16cyclictest1140-21snapd20:39:290
1045499170,15cyclictest4035-21H222:02:190
1045499170,15cyclictest4035-21H222:02:190
10456991614,1cyclictest4035-21H222:02:192
10456991614,1cyclictest0-21swapper/222:01:002
10456991614,1cyclictest0-21swapper/220:42:102
10456991614,1cyclictest0-21swapper/200:12:092
10456991613,2cyclictest28004-21lxd22:40:302
10456991613,2cyclictest2007-21systemd-journal20:00:172
1045699160,1cyclictest20220-21nfsd421:22:112
1045699160,1cyclictest0-21swapper/223:22:142
1045699160,1cyclictest0-21swapper/219:50:132
1045699160,1cyclictest0-21swapper/200:20:132
1045699160,15cyclictest4099-21H222:02:192
1045699160,15cyclictest3985-21H222:02:192
1045699160,15cyclictest3985-21H222:02:192
1045699160,15cyclictest3983-21H222:02:192
1045699160,15cyclictest31451-21ntp_kernel_err21:42:132
1045699160,15cyclictest28828-21ntp_kernel_pll_19:42:142
1045699160,15cyclictest21645-21tr00:17:092
1045699160,15cyclictest16298-21apt-get23:10:012
1045699160,15cyclictest10151-21lxd23:26:302
1045699160,15cyclictest0-21swapper/223:17:102
1045699160,15cyclictest0-21swapper/222:49:362
1045699160,15cyclictest0-21swapper/220:47:082
10455991614,1cyclictest0-21swapper/123:17:101
10455991613,2cyclictest30553-21cnf-update-db23:35:021
10455991613,2cyclictest27937-21expr23:32:081
10455991613,2cyclictest13930-21expr19:17:081
1045599160,2cyclictest504-21expr22:42:121
1045599160,1cyclictest2802-21Xwayland19:36:331
1045599160,1cyclictest0-21swapper/122:57:101
1045599160,16cyclictest0-21swapper/121:35:171
1045599160,15cyclictest8939-21sed21:02:121
1045599160,15cyclictest4099-21H222:02:191
1045599160,15cyclictest0-21swapper/121:12:091
1045599160,15cyclictest0-21swapper/120:47:141
10454991614,1cyclictest27611-21forks00:27:110
10454991614,1cyclictest0-21swapper/020:02:090
10454991614,1cyclictest0-21swapper/019:15:250
10454991614,1cyclictest0-21swapper/019:10:000
10454991614,1cyclictest0-21swapper/000:22:110
10454991614,1cyclictest0-21swapper/000:14:350
10454991613,2cyclictest3979-21H222:02:190
10454991613,2cyclictest2069-21systemd-udevd23:00:500
10454991613,2cyclictest20336-21if_err_enp1s023:17:120
10454991613,2cyclictest13101-21wc00:02:090
1045499161,1cyclictest0-21swapper/023:10:270
1045499161,14cyclictest0-21swapper/020:56:490
1045499160,15cyclictest3991-21H222:02:190
1045499160,15cyclictest3983-21H222:02:190
1045499160,15cyclictest3053-21systemd-logind23:50:490
1045499160,15cyclictest24078-21latency_hist21:30:010
1045499160,15cyclictest22230-21/usr/sbin/munin23:22:050
1045499160,15cyclictest11095-21cat21:07:110
1045499160,15cyclictest11095-21cat21:07:110
1045499160,15cyclictest0-21swapper/021:16:120
1045499160,15cyclictest0-21swapper/020:27:100
1045499160,15cyclictest0-21swapper/020:07:090
1045499160,15cyclictest0-21swapper/000:07:140
1045699150,1cyclictest0-21swapper/223:35:052
1045499150,1cyclictest6312-21timerwakeupswit23:47:180
1045499150,14cyclictest0-21swapper/019:37:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional