You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 21:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri Nov 28, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3199424637,0sleep10-21swapper/106:17:571
3187224645,0sleep20-21swapper/206:16:342
3203524028,0sleep30-21swapper/306:18:273
3175823824,0sleep00-21swapper/006:15:110
322009970,0cyclictest0-21swapper/209:24:502
329970,0watchdog/30-21swapper/308:49:473
329970,0watchdog/30-21swapper/307:54:553
29935070,0irq/33-eth0-tx-0-21swapper/007:39:450
29935070,0irq/33-eth0-tx-0-21swapper/006:39:080
29935070,0irq/33-eth0-tx-0-21swapper/006:29:440
29925070,0irq/32-eth0-rx-0-21swapper/311:32:373
29925070,0irq/32-eth0-rx-0-21swapper/308:54:493
8315060,0irq/26-0000:00:10778-21crond06:49:312
4160,0ktimersoftd/016900-21kthreadcore10:34:510
322009960,0cyclictest0-21swapper/211:20:332
321999960,0cyclictest0-21swapper/111:27:001
321999960,0cyclictest0-21swapper/108:25:511
329960,0watchdog/34786-21kthreadcore11:44:503
329960,0watchdog/30-21swapper/311:42:423
329960,0watchdog/30-21swapper/311:35:223
329960,0watchdog/30-21swapper/311:27:193
329960,0watchdog/30-21swapper/311:09:353
329960,0watchdog/30-21swapper/311:08:393
329960,0watchdog/30-21swapper/311:00:233
329960,0watchdog/30-21swapper/310:46:593
329960,0watchdog/30-21swapper/310:42:033
329960,0watchdog/30-21swapper/310:10:553
329960,0watchdog/30-21swapper/310:07:593
329960,0watchdog/30-21swapper/309:35:073
329960,0watchdog/30-21swapper/309:32:353
329960,0watchdog/30-21swapper/309:25:433
329960,0watchdog/30-21swapper/309:24:273
329960,0watchdog/30-21swapper/309:10:073
329960,0watchdog/30-21swapper/308:42:593
329960,0watchdog/30-21swapper/308:30:233
329960,0watchdog/30-21swapper/308:24:513
329960,0watchdog/30-21swapper/307:14:473
329960,0watchdog/30-21swapper/307:09:553
329960,0watchdog/30-21swapper/306:29:593
29935060,0irq/33-eth0-tx-11309-21latency_hist08:19:300
29935060,0irq/33-eth0-tx-0-21swapper/008:10:210
29935060,0irq/33-eth0-tx-0-21swapper/007:19:480
29935060,0irq/33-eth0-tx-0-21swapper/007:19:480
29935060,0irq/33-eth0-tx-0-21swapper/006:59:490
29925060,0irq/32-eth0-rx-0-21swapper/310:56:253
29925060,0irq/32-eth0-rx-0-21swapper/309:57:133
29925060,0irq/32-eth0-rx-0-21swapper/309:54:153
29925060,0irq/32-eth0-rx-0-21swapper/309:42:463
29925060,0irq/32-eth0-rx-0-21swapper/309:07:563
29925060,0irq/32-eth0-rx-0-21swapper/308:48:003
29925060,0irq/32-eth0-rx-0-21swapper/308:34:463
149960,0migration/011134-21sh10:31:450
339950,0migration/36332-21munin-node06:19:583
339950,0migration/36034-21kthreadcore10:29:473
339950,0migration/332545-21kthreadcore07:24:503
339950,0migration/330445-21munin-node08:09:563
339950,0migration/330020-21munin-node06:39:463
339950,0migration/328837-21kthreadcore09:44:463
339950,0migration/324055-21fschecks_time11:19:453
339950,0migration/318427-21latency_hist07:39:313
322009950,0cyclictest0-21swapper/211:33:482
322009950,0cyclictest0-21swapper/211:14:152
322009950,0cyclictest0-21swapper/211:07:572
322009950,0cyclictest0-21swapper/210:09:082
322009950,0cyclictest0-21swapper/208:56:562
321999955,0cyclictest0-21swapper/111:33:181
321999955,0cyclictest0-21swapper/110:36:141
321999955,0cyclictest0-21swapper/110:11:191
321999955,0cyclictest0-21swapper/109:41:221
321999955,0cyclictest0-21swapper/108:07:431
321999955,0cyclictest0-21swapper/106:25:051
321999950,0cyclictest0-21swapper/111:41:211
321999950,0cyclictest0-21swapper/110:50:251
321999950,0cyclictest0-21swapper/110:01:421
329950,0watchdog/324461-21kthreadcore09:59:513
329950,0watchdog/313494-21grep07:34:473
329950,0watchdog/30-21swapper/311:15:113
329950,0watchdog/30-21swapper/310:49:593
329950,0watchdog/30-21swapper/310:36:153
329950,0watchdog/30-21swapper/310:25:353
329950,0watchdog/30-21swapper/310:19:593
329950,0watchdog/30-21swapper/309:14:313
329950,0watchdog/30-21swapper/308:59:433
329950,0watchdog/30-21swapper/308:15:393
329950,0watchdog/30-21swapper/308:05:153
329950,0watchdog/30-21swapper/307:59:473
329950,0watchdog/30-21swapper/307:49:313
329950,0watchdog/30-21swapper/307:44:353
329950,0watchdog/30-21swapper/307:31:553
329950,0watchdog/30-21swapper/307:04:393
329950,0watchdog/30-21swapper/306:59:313
329950,0watchdog/30-21swapper/306:56:033
329950,0watchdog/30-21swapper/306:51:433
329950,0watchdog/30-21swapper/306:44:473
329950,0watchdog/30-21swapper/306:24:473
29935050,0irq/33-eth0-tx-4069-21munin-node07:29:500
29935050,0irq/33-eth0-tx-22968-21kthreadcore08:24:502
29935050,0irq/33-eth0-tx-2275-21cat11:24:472
29935050,0irq/33-eth0-tx-22201-21munin-node08:04:500
29935050,0irq/33-eth0-tx-11254-21ssh10:49:522
29935050,0irq/33-eth0-tx-0-21swapper/211:35:402
29935050,0irq/33-eth0-tx-0-21swapper/210:58:322
29935050,0irq/33-eth0-tx-0-21swapper/210:12:512
29935050,0irq/33-eth0-tx-0-21swapper/209:54:472
29935050,0irq/33-eth0-tx-0-21swapper/209:44:372
29935050,0irq/33-eth0-tx-0-21swapper/008:19:470
29935050,0irq/33-eth0-tx-0-21swapper/007:34:410
29935050,0irq/33-eth0-tx-0-21swapper/006:45:380
29935050,0irq/33-eth0-tx-0-21swapper/006:39:530
29925050,0irq/32-eth0-rx-23399-21irqrtprio07:19:543
29925050,0irq/32-eth0-rx-23399-21irqrtprio07:19:543
29925050,0irq/32-eth0-rx-16345-21kthreadcore08:19:473
29925050,0irq/32-eth0-rx-0-21swapper/310:15:423
29925050,0irq/32-eth0-rx-0-21swapper/306:34:413
259950,0migration/231333-21kthreadcore08:29:482
259950,0migration/229538-21aten_r1power_vo08:09:522
259950,0migration/225680-21kthreadcore06:34:492
259950,0migration/223442-21cpu09:04:452
259950,0migration/223288-21kernelversion10:59:482
259950,0migration/222362-21kthreadcore09:39:502
259950,0migration/218315-21kthreadcore11:14:522
259950,0migration/217560-21kthreadcore08:59:502
259950,0migration/214992-21sh09:16:502
259950,0migration/210255-21smart_sda10:29:542
19150,0ktimersoftd/10-21swapper/111:03:301
179950,0migration/131668-21irqcore08:49:481
179950,0migration/128420-21unixbench_singl08:44:581
179950,0migration/127827-21latency07:19:561
179950,0migration/127827-21latency07:19:561
179950,0migration/12153-21munin-node09:49:421
179950,0migration/115949-21kthreadcore10:14:491
169950,0watchdog/116216-21grep07:59:471
149950,0migration/09210-21kthreadcore07:09:500
149950,0migration/08118-21kthreadcore11:09:480
149950,0migration/07305-21kthreadcore10:49:490
149950,0migration/0709-21latency10:04:480
149950,0migration/05755-21kthreadcore06:19:500
149950,0migration/032727-21latency_hist07:49:310
149950,0migration/030623-21cpuspeed_turbos08:49:440
149950,0migration/029893-21kthreadcore09:24:500
149950,0migration/028449-21taskset11:00:060
149950,0migration/02720-21kthreadcore07:04:460
149950,0migration/025116-21fschecks_count11:39:470
149950,0migration/023981-21fschecks_time11:19:450
149950,0migration/021065-21sendmail_mailtr11:14:560
149950,0migration/019823-21hddtemp_smartct09:59:460
149950,0migration/019159-21kthreadcore07:59:490
149950,0migration/018022-21df_abs09:39:450
149950,0migration/017742-21kthreadcore08:39:490
149950,0migration/017346-21sh09:55:280
149950,0migration/013845-21munin-node10:54:470
8315040,0irq/26-0000:00:0-21swapper/211:44:302
322009943,0cyclictest5377-21awk08:14:482
322009943,0cyclictest5221-21awk07:29:482
322009943,0cyclictest3826-21sadc07:29:312
322009943,0cyclictest3262-21irqbalance10:39:442
322009943,0cyclictest23871-21snmpd08:06:112
322009943,0cyclictest23871-21snmpd07:46:112
322009943,0cyclictest23871-21snmpd07:10:112
322009943,0cyclictest23871-21snmpd07:06:112
322009943,0cyclictest17225-21awk09:19:492
322009943,0cyclictest12922-21awk10:14:472
321999944,0cyclictest0-21swapper/109:05:161
321999943,0cyclictest8854-21awk07:54:451
321999943,0cyclictest3599-21lldpd11:04:341
321999943,0cyclictest3599-21lldpd07:32:091
321999943,0cyclictest30111-21awk10:44:471
321999943,0cyclictest26495-21awk06:59:471
321999943,0cyclictest24609-21sort06:54:571
321999943,0cyclictest24286-21sadc11:39:301
321999943,0cyclictest23871-21snmpd07:41:111
321999943,0cyclictest23871-21snmpd07:38:111
321999943,0cyclictest23871-21snmpd06:31:111
321999943,0cyclictest1571-21awk07:49:461
321999943,0cyclictest10244-21awk09:34:471
321989944,0cyclictest0-21swapper/010:15:180
321989944,0cyclictest0-21swapper/009:30:310
321989943,0cyclictest7760-21awk08:54:480
321989943,0cyclictest32764-21awk11:24:450
321989943,0cyclictest27170-21awk09:44:440
321989943,0cyclictest22854-21awk08:44:480
321989943,0cyclictest21084-21awk08:24:480
321989943,0cyclictest1661-21awk11:44:490
321989940,0cyclictest14741-21munin-node07:14:490
321989940,0cyclictest0-21swapper/009:18:230
321989940,0cyclictest0-21swapper/008:32:020
29935040,0irq/33-eth0-tx-14382-21munin-node08:39:462
29935040,0irq/33-eth0-tx-0-21swapper/211:40:532
29935040,0irq/33-eth0-tx-0-21swapper/210:44:372
29935040,0irq/33-eth0-tx-0-21swapper/210:34:502
29935040,0irq/33-eth0-tx-0-21swapper/210:24:462
29935040,0irq/33-eth0-tx-0-21swapper/209:50:322
29935040,0irq/33-eth0-tx-0-21swapper/209:34:452
29935040,0irq/33-eth0-tx-0-21swapper/209:29:362
29935040,0irq/33-eth0-tx-0-21swapper/208:34:502
29935040,0irq/33-eth0-tx-0-21swapper/007:24:410
29935040,0irq/33-eth0-tx-0-21swapper/006:54:530
259940,0migration/28731-21gltestperf07:54:442
259940,0migration/27906-21fschecks_count06:24:472
259940,0migration/24184-21kthreadcore09:09:502
259940,0migration/23377-21kthreadcore06:19:502
259940,0migration/230335-21irqrtprio06:39:492
259940,0migration/229490-21kthreadcore06:59:502
259940,0migration/222608-21fschecks_count07:19:502
259940,0migration/222608-21fschecks_count07:19:502
259940,0migration/221904-21aten_r1power_vo08:44:442
259940,0migration/221297-21kthreadcore09:59:502
259940,0migration/220959-21sendmail_mailtr07:14:542
259940,0migration/220408-21munin-node10:19:432
259940,0migration/217687-21kthreadcore07:59:482
259940,0migration/216851-21munin-node06:49:512
249940,0watchdog/224847-21taskset06:55:272
249940,0watchdog/218465-21ssh08:20:512
249940,0watchdog/20-21swapper/208:49:472
249940,0watchdog/20-21swapper/207:49:552
179940,0migration/17497-21gltestperf08:54:461
179940,0migration/16226-21runrttasks11:09:331
179940,0migration/131113-21kthreadcore06:39:501
179940,0migration/130041-21fschecks_time07:24:461
179940,0migration/128622-21irqcore10:04:461
179940,0migration/12443-21kthreadcore09:29:481
179940,0migration/121087-21timerandwakeup07:14:571
179940,0migration/120387-21kthreadcore08:59:511
179940,0migration/119032-21kthreadcore11:14:521
179940,0migration/117775-21runrttasks06:52:131
179940,0migration/116420-21kthreadcore08:19:471
179940,0migration/11509-21runrttasks09:48:521
179940,0migration/114390-21taskset07:13:171
179940,0migration/113107-21kthreadcore09:14:491
169940,0watchdog/15236-21kthreadcore07:04:471
169940,0watchdog/123125-21ssh09:20:591
169940,0watchdog/113468-21cut08:39:431
169940,0watchdog/112735-21ssh08:38:431
169940,0watchdog/10-21swapper/111:44:501
169940,0watchdog/10-21swapper/110:24:471
149940,0migration/05019-21runrttasks11:06:320
149940,0migration/04230-21kthreadcore09:49:480
149940,0migration/030823-21kthreadcore10:24:470
149940,0migration/028009-21kthreadcore09:04:510
149940,0migration/019146-21kthreadcore11:34:450
149940,0migration/016452-21kthreadcore08:59:500
149940,0migration/013164-21latency_hist08:39:300
149940,0migration/012681-21kthreadcore09:34:500
149940,0migration/010551-21kthreadcore11:29:480
322009932,0cyclictest23871-21snmpd07:34:412
322009932,0cyclictest23871-21snmpd06:29:562
322009930,0cyclictest20306-21grep07:39:502
321999932,0cyclictest5619-21grep06:44:481
321999932,0cyclictest5500-21processes09:09:531
321999932,0cyclictest30474-21awk08:09:561
321999932,0cyclictest24509-21cut10:19:491
321999932,0cyclictest24195-21hwlatdetect11:19:461
321999932,0cyclictest23871-21snmpd10:32:161
321999932,0cyclictest23871-21snmpd08:31:541
321999932,0cyclictest23871-21snmpd08:16:511
321989933,0cyclictest8421-21awk06:24:490
321989933,0cyclictest31397-21kworker/0:109:19:330
321989933,0cyclictest31397-21kworker/0:109:10:130
321989933,0cyclictest31397-21kworker/0:107:54:370
321989933,0cyclictest12763-21kworker/0:010:44:310
321989933,0cyclictest12763-21kworker/0:010:19:330
321989933,0cyclictest12174-21awk06:49:490
321989932,0cyclictest6952-21tr10:09:510
321989932,0cyclictest21607-21grep10:39:450
321989930,0cyclictest438-21munin-node07:49:460
179930,0migration/132435-21aten_r1power_cu06:19:421
179930,0migration/122952-21irqcore06:34:471
169930,0watchdog/10-21swapper/110:54:511
169930,0watchdog/10-21swapper/110:41:271
169930,0watchdog/10-21swapper/109:54:431
169930,0watchdog/10-21swapper/109:24:351
169920,0watchdog/10-21swapper/107:44:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional