You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 12:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Dec 20, 2025 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253972317291,17sleep10-21swapper/119:08:551
252422316289,17sleep20-21swapper/219:06:552
252552277246,21sleep00-21swapper/019:07:040
233062261227,22sleep30-21swapper/319:05:023
15602590,0sleep00-21swapper/020:35:210
216342570,0sleep10-21swapper/122:35:141
203282530,0sleep10-21swapper/123:45:001
123512160,0sleep00-21swapper/019:50:120
246862100,1sleep024662-21munin-run23:55:000
8699290,0sleep00-21swapper/019:40:190
255899994,3cyclictest275-21systemd-journal22:50:010
14340290,0sleep00-21swapper/019:55:120
255999983,3cyclictest275-21systemd-journal21:42:573
255959986,2cyclictest28-21ksoftirqd/223:10:002
255919980,1cyclictest275-21systemd-journal00:22:521
255899987,1cyclictest12-21ksoftirqd/000:00:020
12750280,1sleep20-21swapper/219:50:152
255999973,3cyclictest275-21systemd-journal22:06:223
255999973,3cyclictest15758-21cron23:39:563
255999973,3cyclictest15758-21cron23:39:553
255999970,3cyclictest6704-21/usr/sbin/munin20:50:123
255959973,3cyclictest275-21systemd-journal22:36:232
255959972,3cyclictest501-21in:imuxsock19:20:012
255919975,1cyclictest11510-21sshd19:45:591
255919973,3cyclictest31685-21dump-pmu-power00:09:591
255919973,3cyclictest275-21systemd-journal21:01:261
255919972,3cyclictest18008-21awk23:40:001
255919972,3cyclictest18008-21awk23:40:001
255899975,1cyclictest12-21ksoftirqd/021:10:000
255899975,1cyclictest12-21ksoftirqd/019:15:010
255899973,3cyclictest275-21systemd-journal00:10:000
255899972,4cyclictest12-21ksoftirqd/020:21:060
255899972,3cyclictest3720-21turbostat00:20:000
255899970,4cyclictest23371-21turbostat22:40:000
255999966,0cyclictest0-21swapper/323:55:173
255999964,1cyclictest31808-21grep22:55:223
255999963,2cyclictest8038-21if_err_enp4s019:40:153
255999963,2cyclictest658-21snmpd22:31:453
255999963,2cyclictest4253-21latency_hist20:45:003
255999963,2cyclictest34-21ksoftirqd/319:45:023
255999963,2cyclictest275-21systemd-journal00:28:173
255999963,2cyclictest17506-21taskset21:10:273
255999963,2cyclictest13486-21awk22:15:183
255999963,2cyclictest13236-21latency_hist21:05:003
255999963,2cyclictest1-21systemd19:10:113
255999963,1cyclictest24489-21sshd23:53:063
255999962,3cyclictest674-21lldpd20:59:483
255999962,3cyclictest658-21snmpd23:16:213
255999962,3cyclictest658-21snmpd23:02:363
255999962,3cyclictest658-21snmpd22:54:593
255999962,3cyclictest658-21snmpd22:37:123
255999962,3cyclictest658-21snmpd22:26:023
255999962,3cyclictest658-21snmpd22:20:313
255999962,3cyclictest658-21snmpd21:51:013
255999962,3cyclictest658-21snmpd21:48:013
255999962,3cyclictest658-21snmpd21:24:543
255999962,3cyclictest658-21snmpd20:30:583
255999962,3cyclictest658-21snmpd20:17:043
255999962,3cyclictest658-21snmpd19:57:513
255999962,3cyclictest658-21snmpd00:35:053
255999962,3cyclictest658-21snmpd00:05:433
255999962,3cyclictest504-21dbus-daemon21:20:013
255999962,3cyclictest4901-21netstat00:20:173
255999962,3cyclictest4218-21cat21:55:153
255999962,3cyclictest3593-21cat19:30:153
255999962,3cyclictest275-21systemd-journal00:01:363
255999962,3cyclictest24017-21df22:40:153
255999962,3cyclictest14470-21cat23:30:163
255999962,3cyclictest10609-21sh22:10:143
255999962,3cyclictest0-21swapper/323:12:263
255999960,5cyclictest3081-21timerandwakeup00:15:193
255999960,2cyclictest13559-21grep19:50:193
255959966,0cyclictest0-21swapper/200:15:132
255959964,1cyclictest11539-21/usr/sbin/munin23:25:152
255959963,2cyclictest9046-21cron23:20:012
255959963,2cyclictest504-21dbus-daemon20:56:402
255959963,2cyclictest24657-21cat21:30:002
255959962,3cyclictest658-21snmpd23:56:552
255959962,3cyclictest658-21snmpd23:12:452
255959962,3cyclictest658-21snmpd22:40:112
255959962,3cyclictest658-21snmpd22:19:292
255959962,3cyclictest658-21snmpd22:08:172
255959962,3cyclictest658-21snmpd22:00:282
255959962,3cyclictest658-21snmpd21:51:312
255959962,3cyclictest658-21snmpd21:20:002
255959962,3cyclictest658-21snmpd21:06:482
255959962,3cyclictest658-21snmpd20:40:492
255959962,3cyclictest658-21snmpd20:25:242
255959962,3cyclictest658-21snmpd19:45:392
255959962,3cyclictest658-21snmpd19:40:302
255959962,3cyclictest658-21snmpd19:25:082
255959962,3cyclictest658-21snmpd19:22:522
255959962,3cyclictest658-21snmpd00:37:262
255959962,3cyclictest658-21snmpd00:32:022
255959962,3cyclictest658-21snmpd00:07:342
255959962,3cyclictest32651-21cat23:00:132
255959962,3cyclictest31718-21cat21:45:132
255959962,3cyclictest29875-21sed21:40:122
255959962,3cyclictest28611-21expr22:50:132
255959962,3cyclictest275-21systemd-journal22:31:482
255959962,3cyclictest275-21systemd-journal20:00:022
255959962,3cyclictest24926-21date23:55:012
255959962,3cyclictest21068-21cat21:20:132
255959962,3cyclictest15379-21irqstats22:20:142
255959962,3cyclictest1-21systemd21:10:012
255959960,3cyclictest6482-21grep20:50:002
255919966,0cyclictest0-21swapper/122:30:031
255919964,1cyclictest7216-21cpuspeed_turbos23:15:161
255919963,2cyclictest658-21snmpd21:36:111
255919963,2cyclictest658-21snmpd21:32:021
255919963,2cyclictest23209-21hddtemp_smartct21:25:141
255919963,2cyclictest22055-21sshd21:21:211
255919963,2cyclictest1886-21chrt20:38:341
255919963,2cyclictest13021-21sed22:15:151
255919962,3cyclictest658-21snmpd23:48:521
255919962,3cyclictest658-21snmpd23:33:391
255919962,3cyclictest658-21snmpd23:25:571
255919962,3cyclictest658-21snmpd23:22:031
255919962,3cyclictest658-21snmpd22:46:471
255919962,3cyclictest658-21snmpd21:56:081
255919962,3cyclictest658-21snmpd21:16:051
255919962,3cyclictest658-21snmpd21:12:441
255919962,3cyclictest658-21snmpd20:53:411
255919962,3cyclictest658-21snmpd20:34:341
255919962,3cyclictest658-21snmpd20:20:181
255919962,3cyclictest658-21snmpd20:15:061
255919962,3cyclictest658-21snmpd20:08:451
255919962,3cyclictest658-21snmpd20:01:271
255919962,3cyclictest658-21snmpd19:38:331
255919962,3cyclictest658-21snmpd19:38:331
255919962,3cyclictest658-21snmpd19:30:261
255919962,3cyclictest275-21systemd-journal22:30:001
255919962,3cyclictest13750-21cat21:05:131
255919961,4cyclictest275-21systemd-journal19:10:521
255919961,3cyclictest275-21systemd-journal23:10:011
255919960,5cyclictest27199-40ogrotate00:00:011
255899963,2cyclictest663-21runrttasks20:49:300
255899963,2cyclictest658-21snmpd22:15:130
255899963,2cyclictest658-21snmpd21:25:080
255899963,2cyclictest5752-21chrt22:00:010
255899963,2cyclictest28910-21taskset21:38:430
255899963,2cyclictest275-21systemd-journal23:25:000
255899963,2cyclictest275-21systemd-journal23:01:390
255899963,2cyclictest12-21ksoftirqd/000:25:000
255899963,2cyclictest11027-21df_inode00:35:120
255899962,3cyclictest658-21snmpd23:41:580
255899962,3cyclictest658-21snmpd23:34:000
255899962,3cyclictest658-21snmpd23:10:120
255899962,3cyclictest658-21snmpd23:09:300
255899962,3cyclictest658-21snmpd22:40:450
255899962,3cyclictest658-21snmpd21:40:060
255899962,3cyclictest658-21snmpd21:00:310
255899962,3cyclictest658-21snmpd20:58:040
255899962,3cyclictest658-21snmpd20:12:240
255899962,3cyclictest658-21snmpd19:31:540
255899962,3cyclictest658-21snmpd19:16:160
255899962,3cyclictest658-21snmpd00:12:270
255899962,3cyclictest5277-21expr19:35:160
255899962,3cyclictest5277-21expr19:35:150
255899962,3cyclictest504-21dbus-daemon23:50:000
255899962,3cyclictest504-21dbus-daemon20:55:000
255899962,3cyclictest28078-21awk22:50:110
255899962,3cyclictest275-21systemd-journal21:59:130
255899962,3cyclictest20679-21expr21:20:110
255899962,3cyclictest1986-21cat21:50:170
255899962,3cyclictest16899-21ntpq21:10:170
255899962,3cyclictest10372-21tune2fs19:45:150
255899962,3cyclictest10232-21apt22:10:130
255899961,3cyclictest141rcu_preempt19:20:570
255899960,6cyclictest0-21swapper/000:00:200
255899960,0cyclictest0-21swapper/023:15:200
255999953,1cyclictest663-21runrttasks00:10:113
255999953,1cyclictest21170-21grep20:10:133
255999952,3cyclictest3212-21kworker/3:222:45:123
255999952,2cyclictest9337-21awk23:20:113
255999952,2cyclictest658-21snmpd23:05:093
255999952,2cyclictest658-21snmpd20:00:073
255999952,2cyclictest6461-21interrupts22:00:143
255999952,2cyclictest4489-21/usr/sbin/munin20:45:113
255999952,2cyclictest31947-21gpgv20:35:003
255999952,2cyclictest31403-21tail19:20:123
255999952,2cyclictest29675-21pmu-power19:15:203
255999952,2cyclictest28174-21sort20:25:133
255999952,2cyclictest25650-21ls21:30:173
255999952,2cyclictest20684-21cat23:45:143
255999952,2cyclictest19484-21cat20:05:173
255999952,2cyclictest13566-21tr21:05:133
255999952,2cyclictest13100-21awk23:25:223
255999951,3cyclictest5645-21/usr/sbin/munin19:35:163
255999951,3cyclictest5645-21/usr/sbin/munin19:35:163
255999951,3cyclictest1391-21cut19:25:153
255999950,4cyclictest27317-21cat21:35:143
255999950,3cyclictest275-21systemd-journal00:30:023
255999950,1cyclictest19059-21memory23:40:183
255959953,1cyclictest663-21runrttasks22:45:202
255959953,1cyclictest25979-21fschecks_time20:20:152
255959953,1cyclictest20858-21sh23:45:142
255959953,1cyclictest0-21swapper/222:10:232
255959952,2cyclictest658-21snmpd23:20:042
255959952,2cyclictest658-21snmpd20:10:032
255959952,2cyclictest658-21snmpd19:10:072
255959952,2cyclictest5463-21ls19:35:152
255959952,2cyclictest5463-21ls19:35:152
255959952,2cyclictest4583-21hddtemp_smartct00:20:152
255959952,2cyclictest3931-21df21:55:132
255959952,2cyclictest31574-21sshd20:31:082
255959952,2cyclictest30483-21grep22:55:142
255959952,2cyclictest2921-21dpkg19:30:122
255959952,2cyclictest19382-21grep23:40:202
255959952,2cyclictest17223-21smart_sda23:35:192
255959952,2cyclictest17223-21smart_sda23:35:192
255959952,2cyclictest17192-21expr22:25:142
255959952,2cyclictest16599-21cpu20:00:132
255959952,2cyclictest14145-21cat23:30:142
255959952,2cyclictest11867-21cat21:00:162
255959951,3cyclictest7770-21tr20:50:162
255959951,3cyclictest6275-21cat00:25:122
255959951,3cyclictest569-21gdbus00:00:012
255959951,3cyclictest32559-21ls00:10:142
255959951,3cyclictest27028-21seq21:35:022
255959951,3cyclictest24801-21/usr/sbin/munin20:15:222
255959951,3cyclictest18976-21expr20:05:152
255959950,1cyclictest32441-21/usr/sbin/munin20:35:132
255919955,0cyclictest0-21swapper/119:25:021
255919953,1cyclictest10811-21grep22:10:161
255919952,3cyclictest27892-21kworker/1:021:50:181
255919952,2cyclictest9082-21cut20:55:151
255919952,2cyclictest8902-21tune2fs00:30:171
255919952,2cyclictest658-21snmpd23:50:071
255919952,2cyclictest658-21snmpd23:12:251
255919952,2cyclictest658-21snmpd22:50:411
255919952,2cyclictest658-21snmpd00:25:031
255919952,2cyclictest5913-21cat20:45:201
255919952,2cyclictest5767-21find22:00:121
255919952,2cyclictest32552-21grep23:00:141
255919952,2cyclictest31624-21cat19:20:141
255919952,2cyclictest2959-21cat20:40:131
255919952,2cyclictest29465-21cut21:40:111
255919952,2cyclictest29152-21fschecks_time19:15:151
255919952,2cyclictest28919-21sensors_temp20:25:181
255919952,2cyclictest27453-21cups-browsed00:00:011
255919952,2cyclictest24250-21hwlatdetect22:40:151
255919952,2cyclictest21784-21latency20:10:151
255919952,2cyclictest0-21swapper/100:10:131
255919951,3cyclictest658-21snmpd00:15:021
255919951,3cyclictest491-21systemd-logind22:20:081
255919951,2cyclictest275-21systemd-journal21:47:071
255919950,5cyclictest0-21swapper/122:05:171
255919950,5cyclictest0-21swapper/119:40:051
255919950,4cyclictest30278-21taskset22:55:111
255899953,1cyclictest6419-21cat00:25:140
255899953,1cyclictest2488-21taskset19:28:020
255899953,1cyclictest23256-21apt-get20:15:130
255899952,2cyclictest9105-21cat00:30:170
255899952,2cyclictest9042-21head22:05:170
255899952,2cyclictest658-21snmpd21:45:440
255899952,2cyclictest658-21snmpd21:30:110
255899952,2cyclictest658-21snmpd21:15:020
255899952,2cyclictest658-21snmpd20:40:320
255899952,2cyclictest30547-21expr22:55:150
255899952,2cyclictest19263-21fschecks_time20:05:150
255899952,2cyclictest17499-21expr22:25:150
255899952,2cyclictest14666-21chrt22:20:070
255899951,3cyclictest658-21snmpd23:35:010
255899951,3cyclictest658-21snmpd23:35:010
255899951,3cyclictest31131-21grep20:30:200
255899951,3cyclictest28229-21grep20:25:150
255899951,3cyclictest19749-21grep22:30:150
255899951,3cyclictest11867-21cat23:25:140
14620250,0sleep10-21swapper/119:55:131
255999940,3cyclictest25470-21taskset20:20:123
255999940,3cyclictest22581-21runrttasks21:25:023
255959940,3cyclictest24803-21taskset21:30:052
255919940,3cyclictest12118-21/usr/sbin/munin19:50:111
255919940,3cyclictest10699-21awk00:35:131
255899940,3cyclictest16589-21apt-get20:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional