You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 18:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Nov 27, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1731624029,0sleep30-21swapper/306:16:133
1745323829,0sleep20-21swapper/206:17:482
1759023723,0sleep00-21swapper/006:19:260
1728123525,0sleep10-21swapper/106:15:471
17675991414,0cyclictest15041-21sensors09:04:590
29935080,0irq/33-eth0-tx-0-21swapper/008:19:530
329970,0watchdog/315609-21ssh09:05:383
29935070,0irq/33-eth0-tx-0-21swapper/006:19:470
29925070,0irq/32-eth0-rx-0-21swapper/309:26:043
29925070,0irq/32-eth0-rx-0-21swapper/308:46:193
339960,0migration/331560-21fschecks_time08:39:503
339960,0migration/318497-21sh09:46:383
329960,0watchdog/330416-21grep09:14:543
329960,0watchdog/30-21swapper/311:36:503
329960,0watchdog/30-21swapper/311:33:583
329960,0watchdog/30-21swapper/311:17:223
329960,0watchdog/30-21swapper/311:01:023
329960,0watchdog/30-21swapper/310:56:503
329960,0watchdog/30-21swapper/310:44:423
329960,0watchdog/30-21swapper/310:24:343
329960,0watchdog/30-21swapper/310:04:543
329960,0watchdog/30-21swapper/310:00:143
329960,0watchdog/30-21swapper/309:50:463
329960,0watchdog/30-21swapper/309:39:503
329960,0watchdog/30-21swapper/309:36:103
329960,0watchdog/30-21swapper/309:21:343
329960,0watchdog/30-21swapper/309:10:343
329960,0watchdog/30-21swapper/308:54:383
329960,0watchdog/30-21swapper/308:36:353
329960,0watchdog/30-21swapper/308:00:153
329960,0watchdog/30-21swapper/307:56:473
329960,0watchdog/30-21swapper/307:21:553
329960,0watchdog/30-21swapper/306:59:513
329960,0watchdog/30-21swapper/306:19:513
29935060,0irq/33-eth0-tx-22831-21if_err_eth1.211:44:492
29925060,0irq/32-eth0-rx-23723-21kthreadcore10:09:523
29925060,0irq/32-eth0-rx-0-21swapper/311:43:223
29925060,0irq/32-eth0-rx-0-21swapper/311:26:213
29925060,0irq/32-eth0-rx-0-21swapper/311:04:443
29925060,0irq/32-eth0-rx-0-21swapper/310:41:113
29925060,0irq/32-eth0-rx-0-21swapper/310:37:203
29925060,0irq/32-eth0-rx-0-21swapper/310:16:493
29925060,0irq/32-eth0-rx-0-21swapper/308:59:583
29925060,0irq/32-eth0-rx-0-21swapper/308:52:083
29925060,0irq/32-eth0-rx-0-21swapper/308:30:103
29925060,0irq/32-eth0-rx-0-21swapper/308:27:123
176769960,0cyclictest0-21swapper/109:54:551
176759960,0cyclictest0-21swapper/011:03:270
149960,0migration/07623-21munin-node09:19:570
149960,0migration/04945-21taskset08:40:000
149960,0migration/023025-21idleruntime08:14:470
8315050,0irq/26-0000:00:0-21swapper/209:29:492
4150,0ktimersoftd/00-21swapper/010:37:310
4150,0ktimersoftd/00-21swapper/009:49:590
4150,0ktimersoftd/00-21swapper/009:34:560
339950,0migration/322288-21cpuspeed_turbos08:14:443
339950,0migration/318801-21fschecks_count09:29:483
339950,0migration/317097-21sh11:20:223
329950,0watchdog/315732-21munin-node08:09:473
329950,0watchdog/30-21swapper/311:09:423
329950,0watchdog/30-21swapper/311:09:423
329950,0watchdog/30-21swapper/310:49:543
329950,0watchdog/30-21swapper/310:29:383
329950,0watchdog/30-21swapper/310:19:423
329950,0watchdog/30-21swapper/309:54:383
329950,0watchdog/30-21swapper/308:20:313
329950,0watchdog/30-21swapper/307:51:553
329950,0watchdog/30-21swapper/307:45:513
329950,0watchdog/30-21swapper/307:35:073
329950,0watchdog/30-21swapper/307:29:553
329950,0watchdog/30-21swapper/307:24:553
329950,0watchdog/30-21swapper/307:18:233
329950,0watchdog/30-21swapper/307:09:513
329950,0watchdog/30-21swapper/307:05:033
329950,0watchdog/30-21swapper/306:54:353
329950,0watchdog/30-21swapper/306:44:393
329950,0watchdog/30-21swapper/306:40:233
329950,0watchdog/30-21swapper/306:35:113
329950,0watchdog/30-21swapper/306:32:313
329950,0watchdog/30-21swapper/306:25:353
29935050,0irq/33-eth0-tx-9984-21munin-node09:25:012
29935050,0irq/33-eth0-tx-5336-21munin-node08:24:492
29935050,0irq/33-eth0-tx-32624-21kthreadcore09:54:542
29935050,0irq/33-eth0-tx-26674-21munin-node09:34:492
29935050,0irq/33-eth0-tx-18040-21munin-node07:04:570
29935050,0irq/33-eth0-tx-10848-21munin-node06:59:540
29935050,0irq/33-eth0-tx-10673-21cut09:04:542
29935050,0irq/33-eth0-tx-10314-21munin-node11:19:482
29935050,0irq/33-eth0-tx-0-21swapper/211:30:482
29935050,0irq/33-eth0-tx-0-21swapper/210:49:272
29935050,0irq/33-eth0-tx-0-21swapper/210:04:372
29935050,0irq/33-eth0-tx-0-21swapper/209:52:032
29935050,0irq/33-eth0-tx-0-21swapper/208:52:022
29935050,0irq/33-eth0-tx-0-21swapper/208:40:282
29935050,0irq/33-eth0-tx-0-21swapper/007:49:470
29935050,0irq/33-eth0-tx-0-21swapper/007:44:450
29935050,0irq/33-eth0-tx-0-21swapper/007:24:540
29935050,0irq/33-eth0-tx-0-21swapper/006:55:340
29935050,0irq/33-eth0-tx-0-21swapper/006:31:020
29925050,0irq/32-eth0-rx-0-21swapper/311:44:363
29925050,0irq/32-eth0-rx-0-21swapper/308:04:453
29925050,0irq/32-eth0-rx-0-21swapper/307:39:463
29925050,0irq/32-eth0-rx-0-21swapper/306:49:483
259950,0migration/231877-21munin-node09:14:582
259950,0migration/229699-21sh08:36:512
259950,0migration/228192-21kthreadcore06:24:532
259950,0migration/226439-21gltestperf07:54:522
259950,0migration/225843-21sh11:25:322
259950,0migration/22308-21kthreadcore08:59:522
259950,0migration/222069-21munin-node08:14:432
259950,0migration/21714-21aten_r1power_vo11:14:452
249950,0watchdog/26958-21kthreadcore10:19:502
249950,0watchdog/231915-21kthreadcore07:34:512
249950,0watchdog/218040-21munin-node07:04:552
249950,0watchdog/213607-21ntp_states08:04:552
249950,0watchdog/20-21swapper/210:24:502
19150,0ktimersoftd/10-21swapper/111:13:541
19150,0ktimersoftd/10-21swapper/111:13:541
19150,0ktimersoftd/10-21swapper/110:37:311
176779955,0cyclictest0-21swapper/210:39:532
176779955,0cyclictest0-21swapper/210:09:562
176779955,0cyclictest0-21swapper/210:02:122
176779955,0cyclictest0-21swapper/209:40:462
176779955,0cyclictest0-21swapper/209:19:482
176779950,0cyclictest0-21swapper/211:42:472
176769955,0cyclictest0-21swapper/108:54:511
176769950,0cyclictest0-21swapper/111:08:231
176759954,0cyclictest30516-21kthreadcore07:34:500
176759950,0cyclictest0-21swapper/011:43:200
179950,0migration/19708-21munin-run09:24:341
179950,0migration/16143-21kthreadcore09:39:521
179950,0migration/13203-21munin-node10:14:591
179950,0migration/131775-21munin-node07:09:581
179950,0migration/128566-21taskset10:13:251
179950,0migration/117142-21kthreadcore10:44:541
179950,0migration/111379-21kthreadcore07:19:521
169950,0watchdog/16321-21processes07:14:551
169950,0watchdog/12530-21grep10:54:541
169950,0watchdog/115281-21kthreadcore09:24:541
169950,0watchdog/111583-21wc10:19:541
149950,0migration/09161-21kthreadcore08:44:490
149950,0migration/07243-21aten_r1power_fr06:34:470
149950,0migration/06537-21kthreadcore09:39:530
149950,0migration/04920-21munin-node07:39:490
149950,0migration/04223-21aten_r1power_po09:59:450
149950,0migration/029750-21kthreadcore11:29:500
149950,0migration/029459-21fschecks_time06:49:500
149950,0migration/029271-21kthreadcore09:14:540
149950,0migration/02817-21munin-node11:14:500
149950,0migration/026798-21kernelversion07:09:490
149950,0migration/02657-21kthreadcore07:14:510
149950,0migration/026527-21munin-node07:54:540
149950,0migration/026230-21sh09:34:000
149950,0migration/025619-21kthreadcore10:09:530
149950,0migration/024915-21fschecks_count08:54:470
149950,0migration/024891-21kthreadcore08:34:520
149950,0migration/023664-21sh11:05:120
149950,0migration/020882-21kthreadcore08:49:530
149950,0migration/020635-21munin-node08:09:510
149950,0migration/017510-21kthreadcore10:44:540
149950,0migration/017308-21kthreadcore08:29:530
149950,0migration/015360-21kthreadcore10:04:520
149950,0migration/011969-21kthreadcore09:24:530
149950,0migration/011090-21taskset11:35:270
29935040,0irq/33-eth0-tx-7589-21munin-node08:04:520
29935040,0irq/33-eth0-tx-22405-21telnet10:29:482
29935040,0irq/33-eth0-tx-14090-21ssh08:45:362
29935040,0irq/33-eth0-tx-0-21swapper/211:09:582
29935040,0irq/33-eth0-tx-0-21swapper/211:09:582
29935040,0irq/33-eth0-tx-0-21swapper/211:05:062
29935040,0irq/33-eth0-tx-0-21swapper/211:00:412
29935040,0irq/33-eth0-tx-0-21swapper/209:09:462
29935040,0irq/33-eth0-tx-0-21swapper/208:54:362
29935040,0irq/33-eth0-tx-0-21swapper/208:20:102
29935040,0irq/33-eth0-tx-0-21swapper/006:44:560
29935040,0irq/33-eth0-tx-0-21swapper/006:39:470
259940,0migration/28940-21kernelversion07:19:512
259940,0migration/27706-21fschecks_count06:34:492
259940,0migration/27663-21kthreadcore07:39:522
259940,0migration/26722-21timerandwakeup08:00:012
259940,0migration/26536-21kthreadcore06:54:522
259940,0migration/25088-21kthreadcore06:29:532
259940,0migration/23459-21munin-node10:15:002
259940,0migration/223851-21latency_hist10:49:342
259940,0migration/221840-21aten_r1power_fr07:29:452
259940,0migration/214885-21munin-node08:29:502
259940,0migration/211518-21fschecks_time06:59:512
249940,0watchdog/27156-21tr11:34:502
249940,0watchdog/228772-21munin-node06:50:032
249940,0watchdog/217891-21munin-node06:19:472
249940,0watchdog/214969-21tr07:44:512
249940,0watchdog/214851-21kthreadcore09:44:542
249940,0watchdog/20-21swapper/208:09:512
249940,0watchdog/20-21swapper/206:39:472
176779943,0cyclictest31978-21awk10:34:532
176779943,0cyclictest23871-21snmpd07:10:172
176779943,0cyclictest19440-21awk07:49:502
176779943,0cyclictest1135-21awk10:54:532
176769944,0cyclictest0-21swapper/109:17:231
176769943,0cyclictest8111-21awk10:39:491
176769943,0cyclictest3599-21lldpd11:45:181
176769943,0cyclictest3599-21lldpd11:39:471
176769943,0cyclictest3599-21lldpd11:00:091
176769943,0cyclictest3599-21lldpd08:30:331
176769943,0cyclictest29836-21awk06:49:521
176769943,0cyclictest26146-21awk06:24:511
176769943,0cyclictest25010-21awk10:49:491
176769943,0cyclictest23871-21snmpd07:56:321
176769943,0cyclictest23364-21awk10:29:511
176769943,0cyclictest20885-21awk09:49:521
176769943,0cyclictest20023-21awk11:24:501
176769943,0cyclictest19226-21awk07:04:541
176769943,0cyclictest15512-21awk06:39:501
176769940,0cyclictest0-21swapper/109:32:221
176759944,0cyclictest0-21swapper/010:43:160
176759943,0cyclictest6554-21awk10:19:490
176759943,0cyclictest6425-21awk08:24:510
176759943,0cyclictest29152-21awk09:54:520
176759943,0cyclictest22863-21awk07:29:500
176759943,0cyclictest19399-21sadc09:49:340
179940,0migration/16231-21kthreadcore09:59:511
179940,0migration/14618-21fschecks_count11:34:461
179940,0migration/14229-21kthreadcore07:59:541
179940,0migration/131185-21kthreadcore08:19:531
179940,0migration/127740-21kthreadcore08:14:501
179940,0migration/126402-21kthreadcore06:44:531
179940,0migration/121025-21kthreadcore07:49:511
179940,0migration/120693-21kthreadcore09:09:531
179940,0migration/116881-21kthreadcore07:24:521
179940,0migration/11627-21kthreadcore08:39:541
179940,0migration/115360-21kthreadcore07:44:511
179940,0migration/113761-21runrttasks06:35:101
179940,0migration/113419-21fschecks_time10:04:481
179940,0migration/112509-21sh08:26:141
179940,0migration/11229-21fschecks_time08:59:481
179940,0migration/111550-21cpuspeed_turbos09:44:491
169940,0watchdog/167582sleep106:32:511
169940,0watchdog/129006-21diskmemload10:25:301
169940,0watchdog/128764-21python08:34:591
169940,0watchdog/127749-21taskset07:29:551
169940,0watchdog/12304-21ssh09:39:101
169940,0watchdog/12149-21chrt11:30:261
169940,0watchdog/117938-21munin-node06:19:471
169940,0watchdog/117355-21runrttasks11:21:101
169940,0watchdog/116913-21if_eth108:49:501
169940,0watchdog/112208-21kthreadcore09:04:541
149940,0migration/07158-21sh10:56:210
149940,0migration/021918-21kthreadcore09:09:530
249930,0watchdog/21616-21kthreadcore07:14:512
176779932,0cyclictest23871-21snmpd07:27:322
176779932,0cyclictest22716-21awk06:44:512
176769932,0cyclictest8041-21sensors11:14:551
176769932,0cyclictest4685-21awk06:54:491
176769932,0cyclictest14808-21munin-node08:09:441
176769930,0cyclictest0-21swapper/107:42:101
176769930,0cyclictest0-21swapper/107:00:141
176759933,0cyclictest6372-21kworker/0:011:44:340
176759933,0cyclictest6372-21kworker/0:011:24:360
176759933,0cyclictest6372-21kworker/0:011:19:340
176759933,0cyclictest6372-21kworker/0:011:09:360
176759933,0cyclictest6372-21kworker/0:011:09:360
176759933,0cyclictest11658-21kworker/0:210:49:380
176759933,0cyclictest11658-21kworker/0:210:29:340
176759933,0cyclictest11658-21kworker/0:210:24:400
176759933,0cyclictest11658-21kworker/0:210:14:370
176759933,0cyclictest11658-21kworker/0:208:59:350
176759933,0cyclictest11658-21kworker/0:207:59:370
176759933,0cyclictest11658-21kworker/0:207:19:390
176759933,0cyclictest11658-21kworker/0:206:24:350
169930,0watchdog/10-21swapper/108:49:181
169930,0watchdog/10-21swapper/108:04:551
169930,0watchdog/10-21swapper/107:34:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional