You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 15:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 15, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
678825040,0sleep20-21swapper/206:52:232
658624434,0sleep30-21swapper/306:50:123
650723423,0sleep00-21swapper/006:49:210
31323425,0sleep10-21swapper/106:47:461
68879966,0cyclictest0-21swapper/208:52:572
68859966,0cyclictest0-21swapper/012:02:080
68859966,0cyclictest0-21swapper/008:22:500
339960,0migration/328860-21kthreadcore10:32:533
339960,0migration/325605-21sh11:51:163
339960,0migration/325463-21sh10:29:173
339960,0migration/318098-21sh10:46:303
339960,0migration/317596-21sh12:06:383
339960,0migration/317383-21sh11:45:433
339960,0migration/313544-21sh09:33:133
29725060,0irq/27-eth0-tx-0-21swapper/211:19:502
29715060,0irq/26-eth0-rx-4572-21kthreadcore10:17:533
29715060,0irq/26-eth0-rx-2364-21chrt09:56:463
29715060,0irq/26-eth0-rx-18840-21aten_r1power_fr10:47:473
29715060,0irq/26-eth0-rx-0-21swapper/311:22:533
149960,0migration/09721-21sh11:01:060
149960,0migration/09079-21sh12:20:420
149960,0migration/08991-21sh10:38:370
149960,0migration/04574-21sh09:26:210
149960,0migration/024067-21rt-features11:47:580
149960,0migration/016753-21sh11:03:120
8215050,0irq/24-0000:00:0-21swapper/209:47:362
68879955,0cyclictest0-21swapper/211:56:442
68879953,0cyclictest3514-21snmpd09:37:372
68879950,0cyclictest0-21swapper/212:16:362
68879950,0cyclictest0-21swapper/212:05:432
68869954,0cyclictest3514-21snmpd08:17:521
68869954,0cyclictest3514-21snmpd08:12:521
68859955,0cyclictest0-21swapper/011:15:000
68859950,0cyclictest0-21swapper/010:44:060
68859950,0cyclictest0-21swapper/009:10:180
339950,0migration/39583-21kthreadcore06:52:533
339950,0migration/39019-21munin-node08:03:003
339950,0migration/37598-21munin-node12:17:563
339950,0migration/36909-21proc_pri07:12:553
339950,0migration/36847-21kthreadcore11:57:543
339950,0migration/36034-21kthreadcore07:37:543
339950,0migration/35306-21kthreadcore10:57:543
339950,0migration/3427-21kthreadcore07:32:553
339950,0migration/33895-21sh09:24:253
339950,0migration/332610-21runrttasks09:51:153
339950,0migration/332462-21munin-node07:07:583
339950,0migration/330133-21kthreadcore10:52:523
339950,0migration/329121-21kthreadcore08:42:563
339950,0migration/328471-21taskset07:53:563
339950,0migration/323677-21needreboot12:07:553
339950,0migration/321769-21taskset07:48:373
339950,0migration/321259-21latency_hist09:02:373
339950,0migration/320986-21fschecks_time07:02:493
339950,0migration/319166-21aten_r1power_en10:07:483
339950,0migration/315262-21kthreadcore10:02:543
339950,0migration/310875-21runrttasks09:27:513
29725050,0irq/27-eth0-tx-2932-21munin-node09:57:492
29725050,0irq/27-eth0-tx-28130-21if_eth1.210:12:522
29725050,0irq/27-eth0-tx-25442-21date09:12:372
29725050,0irq/27-eth0-tx-25294-21ssh11:30:022
29725050,0irq/27-eth0-tx-19594-21perl10:27:512
29725050,0irq/27-eth0-tx-19414-21ssh12:07:522
29725050,0irq/27-eth0-tx-18330-21munin-node11:47:492
29725050,0irq/27-eth0-tx-11047-21munin-node10:02:502
29725050,0irq/27-eth0-tx-0-21swapper/211:59:092
29725050,0irq/27-eth0-tx-0-21swapper/211:33:002
29725050,0irq/27-eth0-tx-0-21swapper/211:10:152
29725050,0irq/27-eth0-tx-0-21swapper/210:26:022
29725050,0irq/27-eth0-tx-0-21swapper/209:34:562
29715050,0irq/26-eth0-rx-7344-21kthreadcore09:57:503
29715050,0irq/26-eth0-rx-31382-21kthreadcore12:12:543
29715050,0irq/26-eth0-rx-27800-21grep10:12:503
29715050,0irq/26-eth0-rx-23830-21sh09:44:013
29715050,0irq/26-eth0-rx-2162-21munin-node11:37:473
29715050,0irq/26-eth0-rx-11394-21if_err_eth011:02:513
29715050,0irq/26-eth0-rx-0-21swapper/311:52:493
29715050,0irq/26-eth0-rx-0-21swapper/311:27:533
29715050,0irq/26-eth0-rx-0-21swapper/311:15:293
29715050,0irq/26-eth0-rx-0-21swapper/309:12:503
29715050,0irq/26-eth0-rx-0-21swapper/309:08:333
29715050,0irq/26-eth0-rx-0-21swapper/309:00:493
259950,0migration/27532-21kthreadcore10:57:552
259950,0migration/227461-21fschecks_time10:52:492
249950,0watchdog/21950-21needreboot07:57:552
149950,0migration/09970-21munin-node08:27:570
149950,0migration/09188-21taskset11:19:550
149950,0migration/04805-21kthreadcore08:02:540
149950,0migration/04661-21taskset08:48:340
149950,0migration/0425-21sh11:33:480
149950,0migration/031307-21kthreadcore10:52:530
149950,0migration/027296-21kthreadcore08:17:540
149950,0migration/026308-21aten_r1power_en12:12:470
149950,0migration/02481-21taskset09:21:100
149950,0migration/022676-21munin-node07:52:470
149950,0migration/021719-21kthreadcore10:07:540
149950,0migration/021669-21kthreadcore10:27:540
149950,0migration/021513-21timerwakeupswit07:48:010
149950,0migration/020431-21kthreadcore11:07:540
149950,0migration/018688-21taskset10:07:150
149950,0migration/018256-21aten_r1power_en12:07:470
149950,0migration/017779-21irqcore08:12:540
149950,0migration/015675-21kthreadcore06:57:530
149950,0migration/015335-21kthreadcore11:42:550
149950,0migration/014183-21taskset07:19:520
149950,0migration/012253-21kthreadcore10:22:540
149950,0migration/011536-21kthreadcore07:42:550
149950,0migration/010661-21latency09:27:500
149950,0migration/010384-21cpuspeed_turbos12:02:480
8215040,0irq/24-0000:00:0-21swapper/209:02:372
68879943,0cyclictest3556-21lldpd08:33:392
68879943,0cyclictest3514-21snmpd10:47:382
68879943,0cyclictest3514-21snmpd09:27:372
68879943,0cyclictest3514-21snmpd09:18:372
68879943,0cyclictest3514-21snmpd08:17:372
68879943,0cyclictest3514-21snmpd07:08:072
68879943,0cyclictest31803-21awk08:47:512
68879943,0cyclictest27893-21awk10:32:512
68879943,0cyclictest16635-21awk07:47:532
68879940,0cyclictest0-21swapper/210:37:582
68879940,0cyclictest0-21swapper/208:40:452
68879940,0cyclictest0-21swapper/208:06:432
68869944,0cyclictest0-21swapper/110:23:591
68869943,0cyclictest8990-21awk07:17:551
68869943,0cyclictest3556-21lldpd12:12:421
68869943,0cyclictest3556-21lldpd12:04:421
68869943,0cyclictest3556-21lldpd10:53:421
68869943,0cyclictest3556-21lldpd07:54:101
68869943,0cyclictest3514-21snmpd11:50:531
68869943,0cyclictest3514-21snmpd11:02:531
68869943,0cyclictest3514-21snmpd11:00:381
68869943,0cyclictest3514-21snmpd08:23:521
68869943,0cyclictest3514-21snmpd08:07:521
68869943,0cyclictest3241-21irqbalance11:38:151
68869943,0cyclictest3241-21irqbalance11:32:451
68869943,0cyclictest3241-21irqbalance10:38:451
68869943,0cyclictest3241-21irqbalance10:33:451
68869943,0cyclictest3241-21irqbalance10:17:451
68869943,0cyclictest3241-21irqbalance10:13:051
68869943,0cyclictest3241-21irqbalance10:10:351
68869943,0cyclictest3241-21irqbalance09:33:251
68869943,0cyclictest3241-21irqbalance09:22:051
68869943,0cyclictest3241-21irqbalance08:53:051
68869943,0cyclictest3241-21irqbalance08:43:251
68869943,0cyclictest3241-21irqbalance08:32:551
68869943,0cyclictest3241-21irqbalance08:28:451
68869943,0cyclictest3121-21awk07:37:521
68869943,0cyclictest2849-21awk11:57:511
68869943,0cyclictest2743-21awk12:17:501
68869943,0cyclictest26431-21awk09:12:471
68869943,0cyclictest19771-21awk10:47:511
68869943,0cyclictest18537-21awk08:37:511
68869943,0cyclictest16254-21awk09:37:511
68869943,0cyclictest11918-21awk10:02:521
68869943,0cyclictest11351-21awk11:22:511
68859944,0cyclictest0-21swapper/011:30:270
68859944,0cyclictest0-21swapper/009:36:180
68859943,0cyclictest3556-21lldpd11:37:410
68859943,0cyclictest3556-21lldpd09:56:410
68859943,0cyclictest27921-21awk10:32:510
68859943,0cyclictest26266-21awk09:47:510
68859943,0cyclictest22222-21awk07:27:520
68859943,0cyclictest2151-21awk07:12:500
68859943,0cyclictest16343-21awk09:37:510
339940,0migration/3614-21sh11:34:203
339940,0migration/35267-21taskset08:52:453
339940,0migration/311962-21kthreadcore08:07:553
29725040,0irq/27-eth0-tx-7396-21ssh12:17:542
29725040,0irq/27-eth0-tx-5020-21diskmemload11:43:122
29725040,0irq/27-eth0-tx-5020-21diskmemload09:12:432
29725040,0irq/27-eth0-tx-13177-21munin-node08:57:562
29725040,0irq/27-eth0-tx-0-21swapper/211:38:392
29725040,0irq/27-eth0-tx-0-21swapper/211:22:512
29725040,0irq/27-eth0-tx-0-21swapper/211:02:402
29725040,0irq/27-eth0-tx-0-21swapper/210:42:582
29725040,0irq/27-eth0-tx-0-21swapper/210:08:012
29725040,0irq/27-eth0-tx-0-21swapper/209:54:272
29725040,0irq/27-eth0-tx-0-21swapper/209:47:392
29725040,0irq/27-eth0-tx-0-21swapper/209:22:512
29725040,0irq/27-eth0-tx-0-21swapper/008:52:520
29725040,0irq/27-eth0-tx-0-21swapper/008:42:500
29725040,0irq/27-eth0-tx-0-21swapper/008:32:510
29725040,0irq/27-eth0-tx-0-21swapper/007:22:460
29725040,0irq/27-eth0-tx-0-21swapper/006:52:490
29715040,0irq/26-eth0-rx-9118-21ssh11:19:423
29715040,0irq/26-eth0-rx-14095-21cut07:42:553
29715040,0irq/26-eth0-rx-0-21swapper/311:07:443
29715040,0irq/26-eth0-rx-0-21swapper/310:39:013
29715040,0irq/26-eth0-rx-0-21swapper/310:22:363
29715040,0irq/26-eth0-rx-0-21swapper/309:37:383
29715040,0irq/26-eth0-rx-0-21swapper/309:20:433
29715040,0irq/26-eth0-rx-0-21swapper/308:27:493
259940,0migration/29881-21proc_pri08:27:562
259940,0migration/26406-21kthreadcore07:37:552
259940,0migration/232502-21switchtime11:12:582
259940,0migration/231600-21kthreadcore08:22:542
259940,0migration/225909-21munin-node07:02:562
259940,0migration/224340-21kthreadcore07:27:542
259940,0migration/224250-21latency_hist08:42:372
259940,0migration/216654-21taskset08:12:462
259940,0migration/21612-21munin-node07:33:022
259940,0migration/21196-21latency_hist07:12:372
249940,0watchdog/20-21swapper/210:17:552
249940,0watchdog/20-21swapper/207:52:512
249940,0watchdog/20-21swapper/207:42:552
249940,0watchdog/20-21swapper/207:17:512
19140,0ktimersoftd/10-21swapper/109:24:141
179940,0migration/13219-21latency_hist08:02:371
179940,0migration/130919-21latency_hist08:47:371
179940,0migration/12990-21fschecks_time11:17:511
179940,0migration/118609-21munin-node11:07:471
179940,0migration/116284-21fschecks_time07:47:511
179940,0migration/115605-21kthreadcore08:57:531
179940,0migration/114490-21kthreadcore10:42:551
179940,0migration/111625-21kthreadcore07:42:551
169940,0watchdog/13195-21kthreadcore07:12:511
169940,0watchdog/125032-21ssh10:28:031
169940,0watchdog/124882-21ssh12:09:301
169940,0watchdog/124337-21sort11:27:581
169940,0watchdog/115968-21processes11:42:581
169940,0watchdog/10-21swapper/111:14:021
169940,0watchdog/10-21swapper/110:00:071
169940,0watchdog/10-21swapper/109:27:551
169940,0watchdog/10-21swapper/107:57:551
149940,0migration/032730-21kthreadcore07:32:550
149940,0migration/021885-21runrttasks09:04:090
149940,0migration/019672-21sh08:58:560
149940,0migration/011910-21kthreadcore08:07:550
8215030,0irq/24-0000:00:0-21swapper/206:57:522
68879932,0cyclictest3556-21lldpd06:57:092
68869933,0cyclictest3556-21lldpd09:42:411
68869933,0cyclictest3556-21lldpd07:22:391
68869933,0cyclictest3556-21lldpd07:07:391
68869932,0cyclictest7931-21awk06:52:511
68869932,0cyclictest3556-21lldpd09:52:411
68869932,0cyclictest3556-21lldpd09:08:121
68869932,0cyclictest3556-21lldpd07:03:391
68869932,0cyclictest22207-21awk07:27:521
68859933,0cyclictest6070-21kworker/0:210:12:540
68859933,0cyclictest6070-21kworker/0:209:57:440
68859933,0cyclictest6070-21kworker/0:209:43:020
68859933,0cyclictest20991-21kworker/0:108:37:400
68859933,0cyclictest20991-21kworker/0:107:57:380
68859933,0cyclictest20991-21kworker/0:107:07:510
68859933,0cyclictest20991-21kworker/0:107:02:390
68859933,0cyclictest16499-21kworker/0:011:53:240
68859933,0cyclictest16499-21kworker/0:010:47:440
68859932,0cyclictest3676-21awk10:17:510
68859932,0cyclictest26003-21grep09:12:450
68859932,0cyclictest11327-21awk11:22:510
339930,0migration/319860-21ksmtuned06:59:243
29725030,0irq/27-eth0-tx-0-21swapper/007:37:490
29715030,0irq/26-eth0-rx-0-21swapper/308:48:123
29715030,0irq/26-eth0-rx-0-21swapper/308:37:473
29715030,0irq/26-eth0-rx-0-21swapper/308:33:123
29715030,0irq/26-eth0-rx-0-21swapper/308:24:033
29715030,0irq/26-eth0-rx-0-21swapper/308:17:423
29715030,0irq/26-eth0-rx-0-21swapper/308:13:423
29715030,0irq/26-eth0-rx-0-21swapper/307:57:523
29715030,0irq/26-eth0-rx-0-21swapper/307:23:103
29715030,0irq/26-eth0-rx-0-21swapper/307:19:003
249930,0watchdog/20-21swapper/208:07:552
249930,0watchdog/20-21swapper/207:22:512
179930,0migration/118536-21kthreadcore06:57:541
169930,0watchdog/10-21swapper/111:52:421
169930,0watchdog/10-21swapper/109:47:391
169930,0watchdog/10-21swapper/109:02:511
169930,0watchdog/10-21swapper/107:32:551
29715020,0irq/26-eth0-rx-0-21swapper/307:27:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional