You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 18:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Tue Dec 23, 2025 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272772287256,21sleep10-21swapper/107:05:391
275792286255,21sleep20-21swapper/207:09:342
273042256227,19sleep30-21swapper/307:06:013
272862253203,15sleep00-21swapper/007:05:460
97442610,1sleep20-21swapper/211:15:172
9182200,0sleep30-21swapper/307:20:153
277219994,3cyclictest275-21systemd-journal07:40:020
277329982,5cyclictest1462-21kworker/3:109:25:133
277269984,3cyclictest27574-21apt10:45:011
277219985,2cyclictest131rcuc/009:40:100
20321280,0sleep30-21swapper/310:25:203
10838280,0sleep20-21swapper/207:40:192
9440270,0sleep00-21swapper/012:25:570
437270,0sleep20-21swapper/207:20:012
277329974,2cyclictest504-21dbus-daemon09:35:003
277329973,3cyclictest658-21snmpd11:14:583
277329973,3cyclictest275-21systemd-journal10:15:013
277329970,6cyclictest32252-21munin-node10:55:133
277299973,3cyclictest30446-21diskstats10:50:172
277299973,3cyclictest275-21systemd-journal12:04:462
277299973,3cyclictest275-21systemd-journal11:36:482
277299973,3cyclictest19319-21diskstats10:25:142
277299973,3cyclictest10946-21ntpq10:05:172
277269975,1cyclictest22-21ksoftirqd/108:10:011
277269973,3cyclictest3786-21ntpq07:25:151
277269973,3cyclictest275-21systemd-journal08:48:481
277219976,1cyclictest12-21ksoftirqd/011:30:000
277219973,3cyclictest658-21snmpd08:54:470
277219973,3cyclictest504-21dbus-daemon07:45:020
277219973,3cyclictest275-21systemd-journal09:15:010
277219973,3cyclictest13827-21basename07:50:010
277219970,1cyclictest141rcu_preempt11:45:130
2536270,0sleep00-21swapper/008:35:140
277329963,2cyclictest9635-21sshd10:03:343
277329963,2cyclictest7127-21cat08:45:163
277329963,2cyclictest658-21snmpd12:05:143
277329963,2cyclictest658-21snmpd09:50:473
277329963,2cyclictest658-21snmpd08:00:593
277329963,2cyclictest504-21dbus-daemon12:31:013
277329963,2cyclictest4731-21uniq11:05:133
277329963,2cyclictest34-21ksoftirqd/309:20:003
277329963,2cyclictest275-21systemd-journal11:35:013
277329963,2cyclictest275-21systemd-journal11:35:013
277329963,2cyclictest27496-21sort11:55:133
277329963,2cyclictest2573-21tune2fs11:00:143
277329963,2cyclictest17338-21cron09:10:003
277329963,2cyclictest16268-21tail09:05:173
277329962,3cyclictest658-21snmpd11:41:463
277329962,3cyclictest658-21snmpd11:28:233
277329962,3cyclictest658-21snmpd10:31:443
277329962,3cyclictest658-21snmpd10:22:063
277329962,3cyclictest658-21snmpd10:18:083
277329962,3cyclictest658-21snmpd09:40:443
277329962,3cyclictest658-21snmpd09:01:133
277329962,3cyclictest658-21snmpd08:50:173
277329962,3cyclictest658-21snmpd08:11:473
277329962,3cyclictest658-21snmpd07:35:253
277329962,3cyclictest560-21gdbus10:40:003
277329962,3cyclictest560-21gdbus08:35:013
277329962,3cyclictest560-21gdbus08:20:013
277329962,3cyclictest4429-21sshd07:25:233
277329962,3cyclictest29711-21hddtemp_smartct12:00:143
277329962,3cyclictest27576-21awk09:30:193
277329962,3cyclictest2647-21if_enp4s008:35:163
277329962,3cyclictest2582-11brltty08:27:333
277329961,4cyclictest0-21swapper/310:05:213
277329960,5cyclictest5738-21tr09:55:153
277299963,2cyclictest658-21snmpd10:41:262
277299963,2cyclictest658-21snmpd07:25:072
277299963,2cyclictest504-21dbus-daemon11:45:052
277299963,2cyclictest504-21dbus-daemon09:56:272
277299963,2cyclictest504-21dbus-daemon07:53:212
277299963,2cyclictest275-21systemd-journal09:19:562
277299963,2cyclictest21559-21memory08:05:172
277299962,3cyclictest8296-21sshd11:12:332
277299962,3cyclictest658-21snmpd12:21:392
277299962,3cyclictest658-21snmpd12:19:512
277299962,3cyclictest658-21snmpd11:40:132
277299962,3cyclictest658-21snmpd11:09:252
277299962,3cyclictest658-21snmpd10:31:172
277299962,3cyclictest658-21snmpd10:16:102
277299962,3cyclictest658-21snmpd09:30:572
277299962,3cyclictest658-21snmpd09:20:512
277299962,3cyclictest658-21snmpd08:39:032
277299962,3cyclictest658-21snmpd08:26:312
277299962,3cyclictest658-21snmpd07:59:032
277299962,3cyclictest658-21snmpd07:34:552
277299962,3cyclictest658-21snmpd07:22:582
277299962,3cyclictest470-21cat10:55:182
277299962,3cyclictest3721-21df09:50:132
277299962,3cyclictest27540-21cat11:55:142
277299962,3cyclictest275-21systemd-journal09:00:342
277299962,3cyclictest24615-21cat09:25:152
277299962,3cyclictest2135-21sed12:10:182
277299961,3cyclictest29717-21munin-run08:25:012
277299960,3cyclictest23261-21/usr/sbin/munin08:10:142
277299960,2cyclictest27921-21/usr/sbin/munin07:10:192
277269966,0cyclictest0-21swapper/111:35:411
277269963,2cyclictest8171-21needreboot07:35:161
277269963,2cyclictest658-21snmpd11:21:241
277269963,2cyclictest658-21snmpd10:59:551
277269963,2cyclictest658-21snmpd07:50:421
277269963,2cyclictest658-21snmpd07:46:421
277269963,2cyclictest6440-21cat12:20:141
277269963,2cyclictest501-21in:imuxsock11:49:201
277269963,2cyclictest501-21in:imuxsock10:50:241
277269963,2cyclictest4664-21expr11:05:131
277269963,2cyclictest275-21systemd-journal07:32:561
277269963,2cyclictest20888-21cat11:40:151
277269963,2cyclictest15425-21/usr/sbin/munin11:30:121
277269963,2cyclictest15425-21/usr/sbin/munin11:30:121
277269962,3cyclictest658-21snmpd12:35:391
277269962,3cyclictest658-21snmpd12:30:061
277269962,3cyclictest658-21snmpd12:16:211
277269962,3cyclictest658-21snmpd12:02:181
277269962,3cyclictest658-21snmpd11:55:531
277269962,3cyclictest658-21snmpd10:47:451
277269962,3cyclictest658-21snmpd10:25:291
277269962,3cyclictest658-21snmpd10:01:131
277269962,3cyclictest658-21snmpd09:36:481
277269962,3cyclictest658-21snmpd09:25:211
277269962,3cyclictest658-21snmpd08:20:151
277269962,3cyclictest658-21snmpd07:44:031
277269962,3cyclictest275-21systemd-journal11:00:281
277269962,3cyclictest20140-21ls09:15:121
277269962,3cyclictest17382-21cat10:20:161
277269962,3cyclictest16294-21seq10:18:331
277269962,3cyclictest1235-21cat12:10:131
277269960,5cyclictest29524-21runrttasks07:10:261
277269960,2cyclictest930-21expr07:20:141
277269960,2cyclictest3570-21expr09:50:121
277219963,3cyclictest12-21ksoftirqd/008:00:100
277219963,2cyclictest658-21snmpd09:15:310
277219963,2cyclictest504-21dbus-daemon07:59:110
277219963,2cyclictest3515-21cat07:25:140
277219963,2cyclictest12936-21cat12:35:150
277219963,2cyclictest12601-21taskset11:20:450
277219962,3cyclictest658-21snmpd12:34:120
277219962,3cyclictest658-21snmpd12:12:380
277219962,3cyclictest658-21snmpd11:53:470
277219962,3cyclictest658-21snmpd11:38:530
277219962,3cyclictest658-21snmpd11:32:170
277219962,3cyclictest658-21snmpd11:32:160
277219962,3cyclictest658-21snmpd11:15:450
277219962,3cyclictest658-21snmpd11:08:030
277219962,3cyclictest658-21snmpd10:49:090
277219962,3cyclictest658-21snmpd10:36:480
277219962,3cyclictest658-21snmpd10:22:570
277219962,3cyclictest658-21snmpd10:06:530
277219962,3cyclictest658-21snmpd10:03:520
277219962,3cyclictest658-21snmpd09:58:070
277219962,3cyclictest658-21snmpd09:53:580
277219962,3cyclictest658-21snmpd08:45:010
277219962,3cyclictest658-21snmpd08:41:100
277219962,3cyclictest658-21snmpd08:30:330
277219962,3cyclictest658-21snmpd08:27:000
277219962,3cyclictest658-21snmpd08:15:270
277219962,3cyclictest658-21snmpd08:12:560
277219962,3cyclictest4030-21cat12:15:150
277219962,3cyclictest27168-21expr11:55:120
277219962,3cyclictest25812-21cat10:40:120
277219962,3cyclictest21902-21which08:05:190
277219962,3cyclictest1412-21expr09:45:110
277219960,3cyclictest275-21systemd-journal09:22:310
12291260,0sleep00-21swapper/010:10:130
6056250,4sleep31-21systemd07:30:203
277329953,1cyclictest4069-21cut12:15:153
277329952,2cyclictest7914-21sort12:25:123
277329952,2cyclictest658-21snmpd11:45:043
277329952,2cyclictest658-21snmpd11:15:043
277329952,2cyclictest658-21snmpd08:05:083
277329952,2cyclictest6386-21grep12:20:133
277329952,2cyclictest5101-21cat08:40:163
277329952,2cyclictest30729-21uniq07:15:023
277329952,2cyclictest27913-21chrt07:10:103
277329952,2cyclictest26307-21uname10:40:143
277329952,2cyclictest24794-21cpuspeed_turbos11:50:133
277329952,2cyclictest22765-21cat09:20:133
277329952,2cyclictest1799-21cat12:10:143
277329952,2cyclictest16669-21expr07:55:133
277329952,2cyclictest14488-21sort07:50:123
277329952,2cyclictest12494-21expr12:35:143
277329952,2cyclictest12274-21fschecks_count07:45:143
277329952,2cyclictest11335-21expr11:20:143
277329952,2cyclictest11187-21cat08:55:133
277329952,2cyclictest10293-21if_err_enp4s007:40:143
277329951,3cyclictest30702-21if_enp4s010:50:183
277329951,3cyclictest28508-21cat10:45:143
277329951,3cyclictest27449-21cron08:20:013
277329951,3cyclictest18350-21cat11:35:193
277329951,3cyclictest1727-21/usr/sbin/munin09:45:143
277299953,1cyclictest13883-21taskset10:11:082
277299952,2cyclictest9364-21/usr/sbin/munin10:00:202
277299952,2cyclictest8855-21cut08:50:132
277299952,2cyclictest7971-21cat07:35:152
277299952,2cyclictest7854-21wc08:45:192
277299952,2cyclictest658-21snmpd12:30:362
277299952,2cyclictest658-21snmpd11:25:072
277299952,2cyclictest658-21snmpd11:00:072
277299952,2cyclictest658-21snmpd09:35:122
277299952,2cyclictest658-21snmpd08:40:062
277299952,2cyclictest658-21snmpd08:32:402
277299952,2cyclictest31582-21expr09:40:122
277299952,2cyclictest24867-21expr11:50:132
277299952,2cyclictest23729-21cat10:35:122
277299952,2cyclictest18554-21ntp_kernel_pll_09:10:162
277299952,2cyclictest1791-21cat09:45:142
277299952,2cyclictest17379-21cat10:20:162
277299952,2cyclictest15691-21expr09:05:132
277299952,2cyclictest1-21systemd08:15:032
277299951,3cyclictest658-21snmpd12:25:092
277299951,3cyclictest31742-21grep12:05:142
277299951,3cyclictest15928-21grep11:30:142
277299951,3cyclictest15928-21grep11:30:142
277299951,3cyclictest11823-21sshd07:45:012
277299951,3cyclictest11412-21tune2fs08:55:142
277299950,4cyclictest295342sleep210:46:502
277299950,4cyclictest12831-21chrt11:23:302
277299950,4cyclictest12818-21expr12:35:162
277299950,3cyclictest275-21systemd-journal08:00:022
277269953,2cyclictest11328-21sed10:05:201
277269953,1cyclictest8670-21cat12:25:171
277269953,1cyclictest663-21runrttasks08:00:041
277269953,1cyclictest23216-21grep09:20:171
277269952,3cyclictest12017-21kworker/1:109:00:181
277269952,3cyclictest12017-21kworker/1:108:50:131
277269952,2cyclictest9124-21expr11:15:111
277269952,2cyclictest7014-21fschecks_time11:10:131
277269952,2cyclictest658-21snmpd09:30:121
277269952,2cyclictest658-21snmpd08:30:151
277269952,2cyclictest5946-21diskstats09:55:141
277269952,2cyclictest31313-21awk09:40:101
277269952,2cyclictest275-21systemd-journal10:37:281
277269952,2cyclictest25322-21cat11:50:161
277269952,2cyclictest23978-21uname08:10:161
277269952,2cyclictest2171-21tr08:35:121
277269952,2cyclictest21439-21expr10:30:131
277269952,2cyclictest2136-21ls09:45:161
277269952,2cyclictest15773-21chrt09:05:151
277269952,2cyclictest13434-21cstates11:25:121
277269952,2cyclictest13014-21cat10:10:151
277269952,2cyclictest10992-21cpuspeed08:55:121
277269951,3cyclictest31546-21wc12:05:131
277269951,3cyclictest25757-21expr08:15:121
277269951,3cyclictest16427-21expr07:55:131
277269951,3cyclictest0-21swapper/108:25:061
277269951,1cyclictest17590-21/usr/sbin/munin09:10:201
277269950,1cyclictest31176-21diskstats07:15:121
277219952,2cyclictest6765-21expr11:10:120
277219952,2cyclictest658-21snmpd10:15:080
277219952,2cyclictest658-21snmpd08:55:080
277219952,2cyclictest658-21snmpd07:30:050
277219952,2cyclictest5835-21expr12:20:100
277219952,2cyclictest32090-21cat07:15:180
277219952,2cyclictest31841-21/usr/sbin/munin12:05:140
277219952,2cyclictest3115-21cut11:00:180
277219952,2cyclictest30278-21expr10:50:170
277219952,2cyclictest29898-21missed_timers09:35:170
277219952,2cyclictest28784-21awk08:20:180
277219952,2cyclictest27198-21cat09:30:160
277219952,2cyclictest21602-21wc11:40:210
277219952,2cyclictest21344-21cat10:30:130
277219952,2cyclictest1937-21cat07:20:210
277219952,2cyclictest13823-21cat09:00:160
277219951,3cyclictest658-21snmpd12:00:050
277219951,3cyclictest658-21snmpd10:55:030
277219951,3cyclictest658-21snmpd10:25:090
277219951,3cyclictest28328-21df_inode07:10:160
277219951,3cyclictest16454-21which09:05:190
277219951,3cyclictest15281-21smart_sda07:50:180
277269941,2cyclictest4207-21seq08:40:061
277219940,3cyclictest24286-21sshd09:25:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional