You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 08:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Thu Dec 25, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
224282319288,21sleep10-21swapper/119:08:411
224062313289,16sleep20-21swapper/219:08:262
222962282251,20sleep00-21swapper/019:06:590
222312256225,21sleep30-21swapper/319:06:273
90562540,0sleep10-21swapper/119:50:001
269182170,0sleep20-21swapper/220:25:212
22633991110,1cyclictest22-21ksoftirqd/120:15:001
22633991110,1cyclictest22-21ksoftirqd/100:35:011
2263399109,1cyclictest22-21ksoftirqd/121:45:021
2263399109,1cyclictest22-21ksoftirqd/100:00:001
2263399108,1cyclictest22-21ksoftirqd/122:30:011
2263399107,2cyclictest22-21ksoftirqd/122:20:011
2263399107,1cyclictest11145-21idleruntime-cro19:55:001
2262999103,2cyclictest22428-21grep21:30:150
2262999102,3cyclictest658-21snmpd22:03:270
2262999102,2cyclictest17034-21grep20:05:190
2262999100,3cyclictest8272-21turbostat20:59:590
2262999100,3cyclictest275-21systemd-journal19:11:390
226339998,1cyclictest22-21ksoftirqd/119:25:021
226339998,1cyclictest211rcuc/100:00:001
226339997,2cyclictest22-21ksoftirqd/123:45:011
226339996,2cyclictest22-21ksoftirqd/123:00:001
226339996,2cyclictest22-21ksoftirqd/120:59:591
226339996,2cyclictest22-21ksoftirqd/120:00:001
226299993,2cyclictest25110-21turbostat.cron20:29:560
226299992,3cyclictest658-21snmpd21:54:220
226299992,2cyclictest658-21snmpd20:49:540
226299991,3cyclictest658-21snmpd23:20:150
226299991,2cyclictest31212-21basename00:15:010
226299990,3cyclictest9467-21awk21:00:160
226299990,3cyclictest9188-21apt23:25:140
226299990,3cyclictest8403-21tune2fs00:35:120
226299990,3cyclictest275-21systemd-journal20:24:380
226299990,3cyclictest23465-21ntpq23:55:160
226299990,3cyclictest2231-21ntpq00:20:160
226299990,3cyclictest20184-21latency_hist23:50:000
226299990,3cyclictest18466-21latency_hist22:35:010
226299990,3cyclictest10965-21grep22:15:190
226299990,2cyclictest6361-21systemd-udevd19:41:100
226299990,2cyclictest504-21dbus-daemon21:15:000
226299990,2cyclictest28315-21munin-run21:45:020
226299990,2cyclictest275-21systemd-journal23:38:190
226299990,2cyclictest275-21systemd-journal22:52:230
226299990,2cyclictest24507-40mandb00:00:000
226299990,2cyclictest23239-21munin-plugin-st22:45:010
226379987,1cyclictest28-21ksoftirqd/200:00:012
226379986,2cyclictest28-21ksoftirqd/219:15:002
226339987,1cyclictest22-21ksoftirqd/123:15:011
226339987,1cyclictest22-21ksoftirqd/121:30:011
226339987,1cyclictest22-21ksoftirqd/120:25:011
226339987,1cyclictest22-21ksoftirqd/119:35:011
226339987,1cyclictest22-21ksoftirqd/119:15:011
226339986,1cyclictest22-21ksoftirqd/123:20:011
226339986,1cyclictest22-21ksoftirqd/120:40:011
226339986,1cyclictest22-21ksoftirqd/119:25:011
226299982,1cyclictest419-21cstates19:30:110
226299982,1cyclictest15283-21cpuspeed_turbos21:15:130
226299982,1cyclictest12734-21pmu-power22:20:170
226299981,2cyclictest31223-21expr20:35:190
226299981,2cyclictest28113-21grep20:30:150
226299981,2cyclictest25781-21/usr/sbin/munin19:15:130
226299981,2cyclictest19041-21cat20:10:160
226299980,3cyclictest990-21fschecks_count21:55:140
226299980,3cyclictest7521-21expr22:10:120
226299980,3cyclictest4773-21cut20:50:170
226299980,3cyclictest4397-21/usr/sbin/munin23:15:210
226299980,3cyclictest32453-21sort20:40:110
226299980,3cyclictest29680-21/usr/sbin/munin21:45:180
226299980,3cyclictest2864-21df19:35:130
226299980,3cyclictest27801-21date00:05:150
226299980,3cyclictest25770-21sshd21:36:380
226299980,3cyclictest2174-21find23:10:120
226299980,3cyclictest20515-21cat23:50:120
226299980,3cyclictest18818-21cmp22:35:020
226299980,3cyclictest17449-21cpu21:20:110
226299980,3cyclictest14415-21expr22:25:120
226299980,3cyclictest13990-21/usr/sbin/munin20:00:140
226299980,3cyclictest12463-21sshd21:07:000
226299980,3cyclictest10102-21ntpq19:50:160
226299980,2cyclictest353-21cut23:05:140
226299980,2cyclictest31550-21grep00:15:120
226299980,2cyclictest30885-21grep19:25:120
226299980,2cyclictest29892-21sh19:25:010
226299980,2cyclictest28330-21/usr/sbin/munin22:55:150
226299980,2cyclictest275-21systemd-journal00:30:070
226299980,2cyclictest23472-21/usr/sbin/munin22:45:120
226299980,2cyclictest20567-21/usr/sbin/munin20:15:140
226299980,2cyclictest20061-21grep21:25:130
226299980,2cyclictest16249-21df_inode23:40:130
226299980,2cyclictest11797-21sort19:55:150
226419974,2cyclictest34-21ksoftirqd/320:05:013
226419973,3cyclictest7907-21ntpq23:20:163
226419973,3cyclictest658-21snmpd22:23:173
226419973,3cyclictest658-21snmpd21:47:363
226419973,3cyclictest275-21systemd-journal21:59:373
226419973,3cyclictest275-21systemd-journal21:27:373
226419973,3cyclictest275-21systemd-journal19:51:493
226379976,1cyclictest28-21ksoftirqd/222:00:022
226379975,1cyclictest28-21ksoftirqd/221:40:002
226379973,3cyclictest504-21dbus-daemon22:30:022
226379973,3cyclictest17068-21smart_sda23:40:202
226379971,3cyclictest1584-21cron20:45:002
226339976,1cyclictest22-21ksoftirqd/120:55:001
226339976,1cyclictest22-21ksoftirqd/120:00:011
226339976,1cyclictest22-21ksoftirqd/119:15:011
226339975,2cyclictest22-21ksoftirqd/123:10:011
226339974,2cyclictest22-21ksoftirqd/122:25:011
226339973,3cyclictest504-21dbus-daemon20:30:011
226339973,3cyclictest1608-21grep20:45:001
226339972,3cyclictest22-21ksoftirqd/122:40:141
226339972,3cyclictest22-21ksoftirqd/121:16:321
226339972,1cyclictest22-21ksoftirqd/123:45:161
226339971,4cyclictest22-21ksoftirqd/123:20:161
226339971,4cyclictest22-21ksoftirqd/100:35:141
226339970,4cyclictest1029-21turbostat00:20:001
226299970,2cyclictest7272-21expr19:45:120
226299970,2cyclictest3735-21expr00:25:130
226299970,2cyclictest30951-21cat23:00:160
226299970,2cyclictest275-21systemd-journal22:05:110
226299970,2cyclictest11759-21cat23:30:130
226419963,2cyclictest658-21snmpd20:31:423
226419963,2cyclictest658-21snmpd19:21:463
226419963,2cyclictest501-21in:imuxsock22:25:023
226419963,2cyclictest4474-21awk23:15:133
226419963,2cyclictest27783-21wc22:55:013
226419963,2cyclictest275-21systemd-journal23:12:273
226419963,2cyclictest275-21systemd-journal21:11:233
226419962,3cyclictest658-21snmpd23:55:313
226419962,3cyclictest658-21snmpd22:41:293
226419962,3cyclictest658-21snmpd21:41:353
226419962,3cyclictest658-21snmpd19:59:573
226419962,3cyclictest658-21snmpd19:45:093
226419962,3cyclictest658-21snmpd19:30:053
226419962,3cyclictest658-21snmpd00:32:223
226419962,3cyclictest658-21snmpd00:22:163
226419962,3cyclictest5562-21grep20:50:213
226419962,3cyclictest504-21dbus-daemon19:18:093
226419962,3cyclictest3684-21cat22:00:173
226419962,3cyclictest3162-21cat19:35:153
226419962,3cyclictest31512-21cat00:15:123
226419962,3cyclictest31284-21fw_packets21:50:143
226419962,3cyclictest29906-21cat00:10:163
226419962,3cyclictest26126-21ls00:00:233
226419962,3cyclictest19394-21expr22:35:143
226419962,3cyclictest18880-21grep20:10:153
226419962,3cyclictest10241-21sshd21:02:013
226419961,3cyclictest275-21systemd-journal20:37:313
226419960,5cyclictest22276-21basename23:55:013
226419960,3cyclictest25962-21seq20:25:153
226419960,3cyclictest22735-21cut20:20:003
226419960,2cyclictest9391-21cstates23:25:153
226379966,0cyclictest0-21swapper/222:30:262
226379963,2cyclictest8239-21taskset20:59:562
226379963,2cyclictest658-21snmpd22:11:042
226379963,2cyclictest504-21dbus-daemon22:54:022
226379963,2cyclictest501-21in:imuxsock21:05:002
226379963,2cyclictest4437-21ntpq00:25:162
226379963,2cyclictest275-21systemd-journal21:53:552
226379963,2cyclictest275-21systemd-journal00:02:562
226379963,2cyclictest21657-21diskstats22:40:132
226379962,3cyclictest6645-21seq22:05:462
226379962,3cyclictest658-21snmpd23:34:462
226379962,3cyclictest658-21snmpd23:20:232
226379962,3cyclictest658-21snmpd22:47:042
226379962,3cyclictest658-21snmpd22:20:172
226379962,3cyclictest275-21systemd-journal22:55:172
226379962,3cyclictest23999-21latency_hist21:35:002
226379962,3cyclictest15427-21cat21:15:132
226379962,3cyclictest13278-11brltty19:17:442
226379962,3cyclictest1-21systemd22:37:222
226379962,3cyclictest11548-21memory21:05:162
226379962,2cyclictest275-21systemd-journal00:20:052
226379962,1cyclictest141rcu_preempt19:56:492
226379960,3cyclictest29911-21idleruntime-cro19:25:002
226379960,3cyclictest2244-21perf19:35:012
226379960,1cyclictest275-21systemd-journal20:51:572
226379960,0cyclictest0-21swapper/219:25:042
226339965,1cyclictest22-21ksoftirqd/121:35:011
226339963,2cyclictest5834-11brltty21:35:091
226339963,2cyclictest14566-21awk23:35:181
226339963,1cyclictest22-21ksoftirqd/121:45:191
226339963,0cyclictest141rcu_preempt23:30:131
226339962,3cyclictest658-21snmpd23:50:211
226339962,3cyclictest658-21snmpd22:08:371
226339962,3cyclictest658-21snmpd21:21:011
226339962,3cyclictest658-21snmpd00:05:481
226339962,3cyclictest275-21systemd-journal23:02:491
226339962,3cyclictest24555-21which22:45:171
226339962,1cyclictest22-21ksoftirqd/123:25:181
226339962,1cyclictest141rcu_preempt19:40:201
226339961,3cyclictest22-21ksoftirqd/121:10:031
226339961,3cyclictest22-21ksoftirqd/120:45:171
226339961,3cyclictest22-21ksoftirqd/120:15:191
226339961,2cyclictest4762-21cat00:25:191
226339961,2cyclictest22-21ksoftirqd/119:35:151
226339961,1cyclictest22-21ksoftirqd/121:50:141
226339960,6cyclictest0-21swapper/121:00:001
226339960,4cyclictest22-21ksoftirqd/121:05:141
226339960,4cyclictest22-21ksoftirqd/120:30:171
226339960,4cyclictest22-21ksoftirqd/100:10:141
226339960,4cyclictest0-21swapper/122:12:541
226339960,4cyclictest0-21swapper/120:05:211
226339960,1cyclictest0-21swapper/122:35:201
226419953,1cyclictest31096-21ntp_kernel_pll_23:00:163
226419953,1cyclictest27360-21expr00:05:143
226419953,1cyclictest11156-21fschecks_count21:05:143
226419952,3cyclictest18845-21kworker/3:019:10:123
226419952,2cyclictest7358-21cpuspeed_turbos22:10:113
226419952,2cyclictest658-21snmpd23:35:183
226419952,2cyclictest658-21snmpd00:25:013
226419952,2cyclictest5702-21cat22:05:143
226419952,2cyclictest34-21ksoftirqd/321:15:153
226419952,2cyclictest32658-21expr23:05:123
226419952,2cyclictest32228-21expr20:40:103
226419952,2cyclictest30434-21/usr/sbin/munin19:25:143
226419952,2cyclictest28220-21expr22:55:143
226419952,2cyclictest2528-21cat20:45:153
226419952,2cyclictest24731-21switchtime22:45:203
226419952,2cyclictest18084-21/usr/sbin/munin23:45:123
226419952,2cyclictest16503-21awk22:30:153
226419952,2cyclictest16416-21gltestperf23:40:143
226419952,2cyclictest11668-21ls23:30:133
226419951,3cyclictest9739-21ls22:15:123
226419951,3cyclictest658-21snmpd20:55:323
226419951,3cyclictest5078-21expr19:40:133
226419951,3cyclictest24087-21find21:35:113
226419951,3cyclictest22262-21df_inode21:30:133
226419951,3cyclictest18308-21tr21:20:143
226419951,3cyclictest17117-21ntpq20:05:203
226419950,4cyclictest8544-21sed00:35:113
226419950,4cyclictest23418-21expr20:20:123
226379953,1cyclictest7039-21cat19:45:132
226379953,1cyclictest3432-21ntp_offset19:35:172
226379953,1cyclictest2791-21hddtemp_smartct23:10:142
226379953,1cyclictest26925-21tail21:40:142
226379953,1cyclictest14630-21cut23:35:182
226379952,2cyclictest9830-21chrt00:39:022
226379952,2cyclictest9404-21expr19:50:132
226379952,2cyclictest9175-21find23:25:132
226379952,2cyclictest7599-21sshd00:33:542
226379952,2cyclictest658-21snmpd23:50:492
226379952,2cyclictest583-21chrt00:15:202
226379952,2cyclictest5536-21/usr/sbin/munin23:15:182
226379952,2cyclictest30013-21cstates20:35:132
226379952,2cyclictest29601-21cat00:10:132
226379952,2cyclictest28-21ksoftirqd/200:08:282
226379952,2cyclictest2538-21cron22:00:022
226379952,2cyclictest23324-21tr20:20:122
226379952,2cyclictest21178-21tail20:15:142
226379952,2cyclictest19842-21tr21:25:112
226379952,2cyclictest18724-21expr20:10:132
226379952,2cyclictest17954-21grep21:20:122
226379952,2cyclictest14062-21tr20:00:152
226379952,2cyclictest13338-21expr21:10:132
226379952,2cyclictest10150-21cat22:15:152
226379951,3cyclictest658-21snmpd20:45:102
226379951,3cyclictest658-21snmpd20:05:052
226379951,3cyclictest310-21/usr/sbin/munin23:05:132
226379951,3cyclictest28263-21seq20:30:152
226379951,3cyclictest19042-21ntp_states23:45:172
226379950,3cyclictest275-21systemd-journal21:45:102
226379950,2cyclictest304-21systemd-udevd19:41:112
226339952,2cyclictest1257-21cat21:55:161
226339951,1cyclictest141rcu_preempt22:00:221
226339950,3cyclictest0-21swapper/122:50:151
226339950,3cyclictest0-21swapper/100:20:121
226339950,2cyclictest0-21swapper/122:30:161
226379940,3cyclictest275-21systemd-journal23:00:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional