You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Jun 16, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2431925545,0sleep30-21swapper/306:28:523
2418525041,0sleep10-21swapper/106:27:181
2432124241,0sleep00-21swapper/006:28:530
2431324129,0sleep20-21swapper/206:28:472
329980,0watchdog/30-21swapper/309:14:493
329970,0watchdog/35112-21kthreadcore10:09:533
329970,0watchdog/310256-21missed_timers07:49:533
329970,0watchdog/30-21swapper/311:02:173
329970,0watchdog/30-21swapper/309:34:533
329970,0watchdog/30-21swapper/308:29:493
29925070,0irq/32-eth0-rx-30356-21grep09:24:533
29925070,0irq/32-eth0-rx-0-21swapper/309:07:453
29925070,0irq/32-eth0-rx-0-21swapper/308:44:533
329960,0watchdog/31100-21pmu-power10:04:573
329960,0watchdog/30-21swapper/311:49:573
329960,0watchdog/30-21swapper/311:45:453
329960,0watchdog/30-21swapper/311:21:093
329960,0watchdog/30-21swapper/311:16:213
329960,0watchdog/30-21swapper/311:12:533
329960,0watchdog/30-21swapper/311:05:013
329960,0watchdog/30-21swapper/310:57:533
329960,0watchdog/30-21swapper/310:50:093
329960,0watchdog/30-21swapper/310:38:373
329960,0watchdog/30-21swapper/310:27:253
329960,0watchdog/30-21swapper/310:14:573
329960,0watchdog/30-21swapper/310:01:013
329960,0watchdog/30-21swapper/309:50:013
329960,0watchdog/30-21swapper/309:47:093
329960,0watchdog/30-21swapper/309:40:373
329960,0watchdog/30-21swapper/308:56:133
329960,0watchdog/30-21swapper/308:41:133
329960,0watchdog/30-21swapper/308:35:013
329960,0watchdog/30-21swapper/308:25:133
329960,0watchdog/30-21swapper/308:14:533
329960,0watchdog/30-21swapper/307:04:453
29925060,0irq/32-eth0-rx-7889-21sed09:30:033
29925060,0irq/32-eth0-rx-31211-21sh08:49:493
29925060,0irq/32-eth0-rx-0-21swapper/311:42:103
29925060,0irq/32-eth0-rx-0-21swapper/311:35:023
29925060,0irq/32-eth0-rx-0-21swapper/311:29:383
29925060,0irq/32-eth0-rx-0-21swapper/311:26:233
244539960,0cyclictest0-21swapper/210:56:472
244529960,0cyclictest0-21swapper/106:29:531
244519966,0cyclictest29438-21diskmemload11:55:390
11107260,0sleep30-21swapper/309:54:533
339950,0migration/323646-21kthreadcore10:39:553
339950,0migration/319562-21fschecks_time07:59:493
339950,0migration/315412-21munin-node06:44:503
339950,0migration/312979-21rt-features06:39:573
339950,0migration/310738-21timerandwakeup10:30:043
329950,0watchdog/321070-21munin-node08:19:573
329950,0watchdog/30-21swapper/311:54:413
329950,0watchdog/30-21swapper/310:44:413
329950,0watchdog/30-21swapper/309:09:333
329950,0watchdog/30-21swapper/308:10:333
329950,0watchdog/30-21swapper/308:04:533
329950,0watchdog/30-21swapper/307:55:213
329950,0watchdog/30-21swapper/307:44:573
329950,0watchdog/30-21swapper/307:40:293
329950,0watchdog/30-21swapper/307:36:213
329950,0watchdog/30-21swapper/307:26:173
329950,0watchdog/30-21swapper/307:19:573
329950,0watchdog/30-21swapper/307:16:053
329950,0watchdog/30-21swapper/307:11:053
329950,0watchdog/30-21swapper/306:54:383
329950,0watchdog/30-21swapper/306:50:343
329950,0watchdog/30-21swapper/306:34:463
29935050,0irq/33-eth0-tx-9680-21munin-node09:34:512
29935050,0irq/33-eth0-tx-4344-21munin-node07:49:530
29935050,0irq/33-eth0-tx-32419-21munin-node09:09:552
29935050,0irq/33-eth0-tx-29438-21diskmemload10:07:282
29935050,0irq/33-eth0-tx-26059-21sed11:39:322
29935050,0irq/33-eth0-tx-24168-21chrt09:22:162
29935050,0irq/33-eth0-tx-13309-21memory08:54:542
29935050,0irq/33-eth0-tx-12632-21tune2fs10:14:492
29935050,0irq/33-eth0-tx-0-21swapper/210:36:362
29935050,0irq/33-eth0-tx-0-21swapper/210:31:242
29935050,0irq/33-eth0-tx-0-21swapper/209:58:032
29935050,0irq/33-eth0-tx-0-21swapper/008:29:550
29925050,0irq/32-eth0-rx-6816-21kthreadcore06:59:513
29925050,0irq/32-eth0-rx-0-21swapper/310:19:463
29925050,0irq/32-eth0-rx-0-21swapper/309:19:493
29925050,0irq/32-eth0-rx-0-21swapper/308:59:333
29925050,0irq/32-eth0-rx-0-21swapper/307:30:013
29925050,0irq/32-eth0-rx-0-21swapper/306:29:443
259950,0migration/29271-21kthreadcore07:49:522
259950,0migration/24007-21kthreadcore09:29:542
259950,0migration/230018-21runrttasks11:03:202
259950,0migration/223378-21kthreadcore06:49:512
259950,0migration/215524-21kthreadcore07:54:552
244539955,0cyclictest83150irq/26-0000:00:08:40:232
244539955,0cyclictest0-21swapper/211:09:522
244539955,0cyclictest0-21swapper/210:20:412
244539955,0cyclictest0-21swapper/210:10:542
244539955,0cyclictest0-21swapper/209:03:162
244539955,0cyclictest0-21swapper/207:14:572
244539950,0cyclictest0-21swapper/211:25:282
244539950,0cyclictest0-21swapper/210:53:282
244539950,0cyclictest0-21swapper/207:25:222
244529954,0cyclictest13015-21iostat_ios10:14:521
244519950,0cyclictest0-21swapper/011:09:460
244519950,0cyclictest0-21swapper/009:06:290
249950,0watchdog/223584-21kthreadcore07:59:532
249950,0watchdog/223491-21cut08:44:492
19150,0ktimersoftd/10-21swapper/109:13:251
179950,0migration/127165-21latency_hist10:04:331
179950,0migration/120814-21kthreadcore09:39:551
179950,0migration/117465-21needreboot07:54:561
179950,0migration/114102-21munin-node08:14:571
179950,0migration/11180-21fschecks_time11:24:491
169950,0watchdog/19544-21cut07:29:531
169950,0watchdog/130769-21aten_r1power_cu11:04:491
149950,0migration/09857-21irqcore09:14:520
149950,0migration/08284-21cpuspeed_turbos08:14:480
149950,0migration/07344-21runrttasks11:25:190
149950,0migration/06923-21taskset09:10:190
149950,0migration/05511-21latency_hist08:34:330
149950,0migration/05384-21latency06:34:540
149950,0migration/04119-21fschecks_time06:59:470
149950,0migration/032367-21munin-node11:39:530
149950,0migration/03117-21sh11:44:480
149950,0migration/030223-21missed_timers11:19:550
149950,0migration/028206-21kthreadcore08:04:550
149950,0migration/027901-21sh10:41:310
149950,0migration/027011-21latency06:49:520
149950,0migration/026299-21sh09:44:400
149950,0migration/021405-21kthreadcore09:59:530
149950,0migration/020909-21kthreadcore07:59:530
149950,0migration/019848-21kthreadcore07:09:520
149950,0migration/017433-21unixbench_singl09:55:060
149950,0migration/016792-21kthreadcore07:34:510
149950,0migration/015461-21kthreadcore10:54:530
149950,0migration/013904-21timerwakeupswit08:55:000
8315040,0irq/26-0000:00:0-21swapper/211:14:332
29935040,0irq/33-eth0-tx-29026-21ssh10:44:462
29935040,0irq/33-eth0-tx-0-21swapper/211:54:462
29935040,0irq/33-eth0-tx-0-21swapper/211:44:462
29935040,0irq/33-eth0-tx-0-21swapper/211:39:322
29935040,0irq/33-eth0-tx-0-21swapper/211:30:212
29935040,0irq/33-eth0-tx-0-21swapper/211:19:322
29935040,0irq/33-eth0-tx-0-21swapper/210:42:042
29935040,0irq/33-eth0-tx-0-21swapper/209:59:352
29935040,0irq/33-eth0-tx-0-21swapper/209:49:422
29935040,0irq/33-eth0-tx-0-21swapper/209:24:362
29935040,0irq/33-eth0-tx-0-21swapper/209:14:432
29935040,0irq/33-eth0-tx-0-21swapper/209:04:442
29935040,0irq/33-eth0-tx-0-21swapper/208:49:422
29935040,0irq/33-eth0-tx-0-21swapper/208:31:022
29935040,0irq/33-eth0-tx-0-21swapper/007:24:460
29935040,0irq/33-eth0-tx-0-21swapper/007:07:390
259940,0migration/29309-21irqcore08:14:532
259940,0migration/27134-21irqrtprio08:34:532
259940,0migration/26744-21kthreadcore06:59:512
259940,0migration/226537-21fschecks_count08:04:512
259940,0migration/220749-21kthreadcore07:09:532
259940,0migration/214534-21fschecks_count06:44:472
259940,0migration/212623-21kthreadcore07:29:542
244539944,0cyclictest0-21swapper/209:44:342
244539943,0cyclictest7881-21awk06:39:512
244539943,0cyclictest578-21awk06:34:512
244539943,0cyclictest3599-21lldpd08:28:262
244539943,0cyclictest29274-21awk10:24:492
244539943,0cyclictest21937-21sadc07:39:332
244539943,0cyclictest19235-21sed09:39:542
244539943,0cyclictest16429-21awk08:19:552
244539940,0cyclictest0-21swapper/206:32:332
244529943,0cyclictest7851-21awk06:39:511
244529943,0cyclictest5328-21awk10:29:541
244529943,0cyclictest3599-21lldpd11:14:521
244529943,0cyclictest3599-21lldpd08:35:091
244529943,0cyclictest3599-21lldpd07:50:241
244529943,0cyclictest3262-21irqbalance11:51:071
244529943,0cyclictest3262-21irqbalance11:10:471
244529943,0cyclictest3262-21irqbalance10:59:571
244529943,0cyclictest3262-21irqbalance10:34:371
244529943,0cyclictest3262-21irqbalance09:54:471
244529943,0cyclictest3262-21irqbalance07:39:371
244529943,0cyclictest3262-21irqbalance07:24:571
244529943,0cyclictest3262-21irqbalance07:19:571
244529943,0cyclictest3262-21irqbalance07:14:571
244529943,0cyclictest3262-21irqbalance07:09:471
244529943,0cyclictest3262-21irqbalance07:01:271
244529943,0cyclictest3262-21irqbalance06:54:471
244529943,0cyclictest25256-21awk09:04:501
244529943,0cyclictest23871-21snmpd11:38:241
244529943,0cyclictest23871-21snmpd11:21:531
244529943,0cyclictest23871-21snmpd10:55:531
244529943,0cyclictest23871-21snmpd07:48:381
244529943,0cyclictest21793-21awk10:39:521
244529943,0cyclictest21370-21awk11:54:511
244529943,0cyclictest1799-21awk08:09:531
244529943,0cyclictest16125-21awk07:34:491
244529940,0cyclictest0-21swapper/110:06:491
244519944,0cyclictest0-21swapper/010:30:120
244519944,0cyclictest0-21swapper/008:44:340
244519944,0cyclictest0-21swapper/006:39:330
244519943,0cyclictest3599-21lldpd11:00:500
244519943,0cyclictest3599-21lldpd10:15:360
244519943,0cyclictest3599-21lldpd08:50:100
244519943,0cyclictest3599-21lldpd08:44:100
244519943,0cyclictest3262-21irqbalance11:50:170
244519943,0cyclictest3262-21irqbalance11:34:370
244519943,0cyclictest3262-21irqbalance10:51:270
244519943,0cyclictest3262-21irqbalance10:24:370
244519943,0cyclictest3262-21irqbalance10:23:570
244519943,0cyclictest3262-21irqbalance09:19:470
244519943,0cyclictest3262-21irqbalance06:47:270
244519943,0cyclictest30938-21kworker/0:107:44:520
244519943,0cyclictest25794-21awk06:29:490
244519943,0cyclictest2293-21awk09:29:520
244519943,0cyclictest1902-21awk08:09:530
244519943,0cyclictest13376-21awk10:34:500
249940,0watchdog/230761-21aten_r1power_cu11:04:492
249940,0watchdog/211938-21diskstats11:49:492
179940,0migration/18005-21sh09:30:141
179940,0migration/17836-21kthreadcore09:49:541
179940,0migration/131034-21kthreadcore10:24:511
179940,0migration/122520-21irqcore06:49:501
179940,0migration/122089-21kthreadcore07:59:531
179940,0migration/122077-21kthreadcore10:19:541
179940,0migration/115234-21taskset08:19:351
179940,0migration/114387-21kthreadcore07:04:521
179940,0migration/114138-21aten2.4-expect06:44:451
169940,0watchdog/132422-21ssh09:44:571
169940,0watchdog/123871-21snmpd10:53:211
169940,0watchdog/122892-21ntpq09:19:571
169940,0watchdog/121062-21ssh08:40:211
169940,0watchdog/111483-21cut09:14:531
169940,0watchdog/10-21swapper/110:09:531
169940,0watchdog/10-21swapper/109:34:531
169940,0watchdog/10-21swapper/108:59:531
169940,0watchdog/10-21swapper/108:54:531
169940,0watchdog/10-21swapper/108:50:011
169940,0watchdog/10-21swapper/108:44:531
149940,0migration/02889-21fschecks_count09:49:490
149940,0migration/026421-21irqrtprio07:14:500
149940,0migration/018592-21fschecks_count09:39:510
149940,0migration/016247-21unixbench-2d09:35:010
149940,0migration/013683-21kthreadcore07:54:550
149940,0migration/010462-21irqcore11:29:540
4130,0ktimersoftd/02952-21runrttasks06:58:480
29935030,0irq/33-eth0-tx-0-21swapper/007:39:530
244539932,0cyclictest3599-21lldpd07:39:482
244539932,0cyclictest3599-21lldpd07:21:442
244539932,0cyclictest30528-21awk07:44:492
244539932,0cyclictest1829-21awk08:09:532
244539930,0cyclictest531-21cut06:54:512
244539930,0cyclictest12864-21tr07:04:512
244529932,0cyclictest3262-21irqbalance09:24:371
244529932,0cyclictest23871-21snmpd11:41:541
244529932,0cyclictest23525-21awk08:24:531
244529931,0cyclictest2643-21kthreadcore06:34:531
244529930,0cyclictest3116-21diskstats11:44:481
244529930,0cyclictest29925-21grep10:44:501
244529930,0cyclictest26839-21grep08:04:511
244519933,0cyclictest0-21swapper/011:14:400
244519933,0cyclictest0-21swapper/008:27:040
244519933,0cyclictest0-21swapper/007:21:200
244519932,0cyclictest8859-21awk07:29:520
244519932,0cyclictest4201-21perl10:09:490
244519932,0cyclictest3599-21lldpd10:48:480
244519932,0cyclictest3262-21irqbalance11:09:070
244519932,0cyclictest28450-21awk10:04:510
244519932,0cyclictest16822-21awk08:59:510
244519930,0cyclictest26068-21munin-node09:24:490
244519930,0cyclictest0-21swapper/008:19:510
169930,0watchdog/10-21swapper/111:32:251
169930,0watchdog/10-21swapper/108:29:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional