You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 13:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Sep 18, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2739726665,0sleep30-21swapper/307:29:073
2750224334,0sleep20-21swapper/207:30:222
2757223329,0sleep10-21swapper/107:31:091
2757622824,0sleep00-21swapper/007:31:120
278059983,0cyclictest403-21awk07:58:190
278059983,0cyclictest3524-21snmpd12:07:040
278059983,0cyclictest3524-21snmpd09:04:180
278059983,0cyclictest1602-21awk09:48:190
278059973,0cyclictest17233-21sadc08:33:040
278059972,0cyclictest3524-21snmpd09:00:250
278059972,0cyclictest30428-21awk11:58:200
278059972,0cyclictest26754-21tr12:53:170
278059972,0cyclictest25586-21sh12:51:230
278059972,0cyclictest20907-21awk10:18:180
278059972,0cyclictest18423-21awk07:48:190
278059972,0cyclictest15740-21sh11:10:000
278059972,0cyclictest14705-21tune2fs08:53:160
278059972,0cyclictest10970-21crond13:03:040
278059971,0cyclictest26445-21cut08:38:210
278059970,0cyclictest9495-21cut12:23:210
278059970,0cyclictest9368-21sh09:53:150
278059970,0cyclictest6224-21sh10:28:210
278059970,0cyclictest5679-21cut11:23:220
278059970,0cyclictest30149-21sed10:43:050
278059970,0cyclictest28722-21ssh10:39:230
278059970,0cyclictest28196-21munin-node08:18:160
278059970,0cyclictest27917-21diskstats11:38:170
278059970,0cyclictest26513-21ssh11:36:040
278059970,0cyclictest19305-21grep09:18:230
278059970,0cyclictest16591-21kthreadcore11:48:220
278059970,0cyclictest1150-21cat12:38:160
278059970,0cyclictest0-21swapper/010:10:000
278059970,0cyclictest0-21swapper/009:33:260
278059970,0cyclictest0-21swapper/009:08:170
8305060,0irq/26-0000:00:27964-21latency_hist08:18:043
339960,0migration/36907-21sh09:33:083
339960,0migration/33067-21runrttasks10:24:263
339960,0migration/330589-21munin-node09:43:273
339960,0migration/324860-21cpuspeed_turbos12:33:163
339960,0migration/324183-21sh11:14:483
339960,0migration/321340-21fschecks_count11:53:173
339960,0migration/312958-21kthreadcore11:28:223
329960,0watchdog/311516-21sh11:46:433
29815060,0irq/29-eth0-tx-18970-21cut12:08:222
29805060,0irq/28-eth0-rx-16726-21sh09:55:253
29805060,0irq/28-eth0-rx-15861-21df09:38:153
29805060,0irq/28-eth0-rx-15210-21if_err_eth1.212:08:193
278059961,0cyclictest32375-21cut11:03:140
278059961,0cyclictest10450-21df_abs07:43:160
278059961,0cyclictest0-21swapper/008:23:150
278059960,0cyclictest9303-21latency_hist12:43:040
278059960,0cyclictest7494-21tune2fs08:48:140
278059960,0cyclictest7125-21fschecks_count08:03:150
278059960,0cyclictest6508-21sh10:48:090
278059960,0cyclictest6508-21sh10:48:090
278059960,0cyclictest3638-21sh11:43:070
278059960,0cyclictest3250-21irqbalance10:03:100
278059960,0cyclictest32374-21sed09:28:180
278059960,0cyclictest3237-21df_abs07:38:170
278059960,0cyclictest32283-21forks08:43:170
278059960,0cyclictest31280-21aten_r1power_fr12:18:160
278059960,0cyclictest28366-21sh10:23:140
278059960,0cyclictest28170-21aten2.4-expect07:33:140
278059960,0cyclictest25680-21cut11:18:150
278059960,0cyclictest25133-21tune2fs07:53:160
278059960,0cyclictest25118-21cpuspeed_turbos09:23:160
278059960,0cyclictest24560-21sh12:33:050
278059960,0cyclictest24519-21cpuspeed_turbos09:43:170
278059960,0cyclictest23816-21cut10:58:170
278059960,0cyclictest22578-21ls12:13:040
278059960,0cyclictest21030-21aten2.4-expect08:13:140
278059960,0cyclictest20909-21aten2.4-expect11:53:150
278059960,0cyclictest18612-21uniq09:58:200
278059960,0cyclictest17757-21tr08:33:160
278059960,0cyclictest17056-21chrt11:13:120
278059960,0cyclictest16019-21sh12:28:150
278059960,0cyclictest15796-21cpuspeed_turbos09:38:150
278059960,0cyclictest15089-21ssh10:53:070
278059960,0cyclictest14119-21ssh12:08:110
278059960,0cyclictest14106-21grep08:08:160
278059960,0cyclictest13538-21tr10:33:160
278059960,0cyclictest11292-21fschecks_time09:13:160
278059960,0cyclictest11181-21latency_hist10:13:040
278059960,0cyclictest10618-21cpu11:28:170
8305050,0irq/26-0000:00:0-21swapper/309:13:183
339950,0migration/39553-21aten_r1power_vo12:43:153
339950,0migration/38879-21kthreadcore08:03:203
339950,0migration/37569-21kthreadcore10:28:213
339950,0migration/34663-21kthreadcore07:38:213
339950,0migration/329723-21kthreadcore11:18:213
339950,0migration/328464-21kthreadcore12:53:223
339950,0migration/328059-21ksmtuned09:02:513
339950,0migration/327257-21kthreadcore10:38:223
339950,0migration/32616-21kthreadcore11:03:193
339950,0migration/326011-21diskmemload11:34:343
339950,0migration/325391-21kthreadcore10:58:223
339950,0migration/32517-21kthreadcore08:43:223
339950,0migration/323483-21munin-node07:48:243
339950,0migration/321844-21kthreadcore09:58:243
339950,0migration/318852-21kthreadcore10:53:213
339950,0migration/314789-21munin-node08:08:183
339950,0migration/313609-21munin-node10:33:173
339950,0migration/31270-21fschecks_count12:38:173
329950,0watchdog/39592-21ssh12:59:003
329950,0watchdog/320897-1kworker/3:0H10:08:313
329950,0watchdog/319808-21kthreadcore09:18:233
329950,0watchdog/316805-21cut10:13:233
329950,0watchdog/312891-21kthreadcore08:28:233
329950,0watchdog/30-21swapper/312:23:153
29815050,0irq/29-eth0-tx-9413-21munin-node12:43:242
29815050,0irq/29-eth0-tx-32476-21ssh12:36:592
29815050,0irq/29-eth0-tx-27144-21ssh10:20:182
29815050,0irq/29-eth0-tx-24272-21munin-node09:43:152
29815050,0irq/29-eth0-tx-16024-21munin-node12:28:222
29815050,0irq/29-eth0-tx-14157-21kthreadcore10:13:222
29815050,0irq/29-eth0-tx-0-21swapper/212:39:202
29805050,0irq/28-eth0-rx-8057-21chrt09:50:213
29805050,0irq/28-eth0-rx-28849-21kthreadcore10:03:203
29805050,0irq/28-eth0-rx-21879-21cut10:18:203
29805050,0irq/28-eth0-rx-20834-21cut08:33:213
29805050,0irq/28-eth0-rx-1968-21taskset11:39:063
29805050,0irq/28-eth0-rx-13253-21hwlatdetect11:48:183
29805050,0irq/28-eth0-rx-12519-21cut11:08:213
29805050,0irq/28-eth0-rx-0-21swapper/312:48:163
29805050,0irq/28-eth0-rx-0-21swapper/312:28:223
29805050,0irq/28-eth0-rx-0-21swapper/312:18:213
29805050,0irq/28-eth0-rx-0-21swapper/312:15:133
29805050,0irq/28-eth0-rx-0-21swapper/312:03:163
29805050,0irq/28-eth0-rx-0-21swapper/311:58:183
29805050,0irq/28-eth0-rx-0-21swapper/310:43:153
29805050,0irq/28-eth0-rx-0-21swapper/308:48:183
278079955,0cyclictest6670-21diskmemload11:47:302
278079955,0cyclictest0-21swapper/211:15:302
278079955,0cyclictest0-21swapper/210:23:472
278079950,0cyclictest0-21swapper/211:35:312
278079950,0cyclictest0-21swapper/210:52:382
278079950,0cyclictest0-21swapper/210:52:382
278079950,0cyclictest0-21swapper/209:55:242
278079950,0cyclictest0-21swapper/208:23:302
278069954,0cyclictest3524-21snmpd09:32:031
278069950,0cyclictest0-21swapper/112:33:551
278069950,0cyclictest0-21swapper/112:09:291
278069950,0cyclictest0-21swapper/109:55:001
278069950,0cyclictest0-21swapper/108:03:041
259950,0migration/27520-21kthreadcore11:23:222
259950,0migration/24860-21missed_timers12:18:242
259950,0migration/232312-21aten_r1power_fr11:03:132
259950,0migration/228216-21timerwakeupswit10:38:282
259950,0migration/222673-21sh10:55:562
259950,0migration/216854-21kthreadcore10:33:222
259950,0migration/215510-21sh09:38:102
259950,0migration/213106-21kthreadcore11:28:222
259950,0migration/210348-21sh13:01:142
249950,0watchdog/21916-21ntp_offset09:03:232
19150,0ktimersoftd/10-21swapper/112:40:191
179950,0migration/14994-21kthreadcore09:08:221
179950,0migration/14541-21kthreadcore07:38:211
179950,0migration/124989-21kthreadcore08:13:211
179950,0migration/116482-21kthreadcore11:48:221
169950,0watchdog/16793-21cat10:48:151
169950,0watchdog/16793-21cat10:48:151
169950,0watchdog/123746-21yum11:13:311
169950,0watchdog/112892-21kthreadcore08:28:231
339940,0migration/332007-21kthreadcore09:03:213
339940,0migration/329542-21kthreadcore07:53:213
339940,0migration/325715-21kthreadcore08:13:213
329940,0watchdog/34078-21if_err_eth008:23:193
329940,0watchdog/30-21swapper/311:24:553
329940,0watchdog/30-21swapper/310:48:153
329940,0watchdog/30-21swapper/310:48:153
329940,0watchdog/30-21swapper/309:08:233
29815040,0irq/29-eth0-tx-0-21swapper/212:48:452
29815040,0irq/29-eth0-tx-0-21swapper/212:03:072
29815040,0irq/29-eth0-tx-0-21swapper/210:43:162
29815040,0irq/29-eth0-tx-0-21swapper/209:48:192
29805040,0irq/28-eth0-rx-0-21swapper/308:53:193
278079944,0cyclictest0-21swapper/212:53:052
278079943,0cyclictest9736-21awk11:08:192
278079943,0cyclictest6345-21sadc08:03:032
278079943,0cyclictest3571-21lldpd08:53:292
278079943,0cyclictest3571-21lldpd07:39:282
278079943,0cyclictest3524-21snmpd09:02:032
278079943,0cyclictest3524-21snmpd08:48:182
278079943,0cyclictest3524-21snmpd08:40:032
278079943,0cyclictest3524-21snmpd08:10:022
278079943,0cyclictest3524-21snmpd07:55:472
278079943,0cyclictest3524-21snmpd07:49:472
278079943,0cyclictest27482-21munin-node11:38:172
278079943,0cyclictest25882-21awk09:23:192
278079943,0cyclictest22150-21awk08:13:192
278079943,0cyclictest21913-21awk11:53:192
278069944,0cyclictest0-21swapper/110:18:391
278069943,0cyclictest3250-21irqbalance12:00:011
278069943,0cyclictest3250-21irqbalance11:29:411
278069943,0cyclictest3250-21irqbalance11:23:211
278069943,0cyclictest3250-21irqbalance10:43:211
278069943,0cyclictest3250-21irqbalance10:33:401
278069943,0cyclictest3250-21irqbalance10:27:101
278069943,0cyclictest3250-21irqbalance10:09:101
278069943,0cyclictest3250-21irqbalance10:03:501
278069943,0cyclictest3250-21irqbalance08:48:101
278069943,0cyclictest3250-21irqbalance08:43:201
278069943,0cyclictest3250-21irqbalance07:48:301
278069943,0cyclictest29497-21awk09:03:191
278069943,0cyclictest27569-21awk12:53:201
278069943,0cyclictest25867-21awk09:23:191
278069943,0cyclictest24779-21awk10:58:201
278069943,0cyclictest22855-21awk10:38:191
278069943,0cyclictest22158-21awk08:58:191
278069943,0cyclictest17089-21awk12:28:191
278069943,0cyclictest11453-21awk09:13:181
278069943,0cyclictest10586-21awk12:43:191
259940,0migration/29971-21kthreadcore12:23:212
259940,0migration/26874-21kthreadcore10:28:212
259940,0migration/23766-21fschecks_count09:08:182
259940,0migration/23591-21fschecks_time10:08:172
259940,0migration/230878-21kthreadcore07:33:202
259940,0migration/230406-21kthreadcore08:18:202
259940,0migration/229897-21kthreadcore10:03:202
259940,0migration/224335-21kthreadcore12:13:212
259940,0migration/221419-21kthreadcore09:18:232
259940,0migration/219594-21kthreadcore08:33:202
259940,0migration/219561-21kthreadcore09:58:232
259940,0migration/215294-21kthreadcore11:48:212
259940,0migration/212752-21processes08:03:232
259940,0migration/212100-21kthreadcore08:28:222
259940,0migration/210662-21kthreadcore09:33:232
249940,0watchdog/2380-21idleruntime08:43:192
249940,0watchdog/229296-21sh11:58:072
249940,0watchdog/20-21swapper/211:18:312
249940,0watchdog/20-21swapper/210:58:232
179940,0migration/19043-21fschecks_count11:08:161
179940,0migration/17651-21kthreadcore12:58:231
179940,0migration/132239-21munin-node11:03:131
179940,0migration/132191-21munin-node12:18:191
179940,0migration/131962-21kthreadcore11:38:231
179940,0migration/130684-21timerandwakeup09:43:291
179940,0migration/129790-21taskset12:14:451
179940,0migration/128527-21kthreadcore08:38:211
179940,0migration/128342-21kthreadcore11:18:211
179940,0migration/122042-21kthreadcore09:58:241
179940,0migration/120578-21runrttasks08:54:341
179940,0migration/119255-21sh10:17:151
179940,0migration/117442-21latency_hist08:33:041
179940,0migration/116099-21sh10:53:171
179940,0migration/115970-21kthreadcore08:08:211
179940,0migration/113389-21kthreadcore07:43:211
179940,0migration/113068-21kthreadcore12:23:221
179940,0migration/110800-21kthreadcore12:03:241
169940,0watchdog/14810-21aten_r1power_vo10:28:151
169940,0watchdog/124890-21memory11:33:231
169940,0watchdog/10-21swapper/109:18:231
8305030,0irq/26-0000:00:0-21swapper/309:23:123
329930,0watchdog/30-21swapper/309:28:233
329930,0watchdog/30-21swapper/307:58:313
329930,0watchdog/30-21swapper/307:43:233
29805030,0irq/28-eth0-rx-0-21swapper/308:38:453
29805030,0irq/28-eth0-rx-0-21swapper/307:33:213
278079932,0cyclictest11364-21grep09:13:162
278079930,0cyclictest6032-21sed09:28:302
278069932,0cyclictest3250-21irqbalance07:53:101
278069932,0cyclictest31647-21sed07:58:031
278069932,0cyclictest27119-21sensors11:53:261
278069931,0cyclictest31538-21kthreadcore07:33:201
278069931,0cyclictest28965-21cut08:18:171
278069930,0cyclictest9323-21cut09:33:221
278069930,0cyclictest4589-21perl11:43:171
169930,0watchdog/116707-21if_eth1.309:38:191
169930,0watchdog/10-21swapper/112:48:201
169930,0watchdog/10-21swapper/109:48:151
169930,0watchdog/10-21swapper/108:23:151
249920,0watchdog/20-21swapper/207:43:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional