You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Mar 23, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/306:55:503
1158324938,0sleep00-21swapper/006:56:290
1176623930,0sleep20-21swapper/206:58:392
1182623324,0sleep10-21swapper/106:59:181
8215060,0irq/24-0000:00:1493-21munin-run08:05:332
339960,0migration/37678-21sh11:19:173
339960,0migration/3717-21sh09:11:463
339960,0migration/37050-21sh12:00:033
339960,0migration/325449-21kthreadcore12:10:473
339960,0migration/317740-21sh09:04:243
339960,0migration/317471-21sh09:43:333
339960,0migration/316332-21sh10:43:563
339960,0migration/315407-21sh11:02:293
339960,0migration/314599-21sh11:21:023
29725060,0irq/27-eth0-tx-27453-21munin-node08:00:540
29715060,0irq/26-eth0-rx-26132-21iostat_ios10:50:483
149960,0migration/030958-21sh11:53:420
149960,0migration/029813-21sh12:11:350
149960,0migration/023137-21sh11:27:500
149960,0migration/015948-21sh10:21:390
149960,0migration/015839-21taskset10:42:300
120119965,0cyclictest10152-21perf09:40:332
120119960,0cyclictest0-21swapper/209:45:452
120039966,0cyclictest0-21swapper/110:20:041
120029960,0cyclictest10180-21diskmemload10:37:440
8215050,0irq/24-0000:00:24074-21dump-pmu-power11:30:332
35150,0ktimersoftd/30-21swapper/310:20:453
339950,0migration/38648-21kthreadcore12:20:483
339950,0migration/38452-21aten_r1power_cu08:10:443
339950,0migration/35335-21latency11:35:513
339950,0migration/332366-21kthreadcore08:25:523
339950,0migration/332179-21diskmemload10:11:133
339950,0migration/329338-21kthreadcore09:50:513
339950,0migration/329022-21kthreadcore08:00:493
339950,0migration/32803-21munin-node08:30:453
339950,0migration/326590-21kthreadcore11:10:493
339950,0migration/325145-21kthreadcore07:55:523
339950,0migration/324603-21kthreadcore08:20:503
339950,0migration/324512-21munin-node09:25:543
339950,0migration/323988-21diskmemload11:09:163
339950,0migration/320948-21switchtime12:25:563
339950,0migration/320330-21fschecks_count07:30:473
339950,0migration/315937-21idleruntime08:15:473
339950,0migration/315206-21timerwakeupswit08:35:563
339950,0migration/310047-21taskset08:59:123
29725050,0irq/27-eth0-tx-6559-21runrttasks10:14:312
29725050,0irq/27-eth0-tx-24990-21ssh10:29:542
29725050,0irq/27-eth0-tx-23446-21munin-node12:10:422
29725050,0irq/27-eth0-tx-1889-21ssh09:14:372
29725050,0irq/27-eth0-tx-18866-21munin-node07:05:530
29725050,0irq/27-eth0-tx-18397-21diskstats10:05:462
29725050,0irq/27-eth0-tx-10426-21munin-node09:00:542
29725050,0irq/27-eth0-tx-10426-21munin-node09:00:510
29725050,0irq/27-eth0-tx-0-21swapper/209:58:522
29725050,0irq/27-eth0-tx-0-21swapper/209:20:442
29725050,0irq/27-eth0-tx-0-21swapper/007:58:170
29725050,0irq/27-eth0-tx-0-21swapper/007:38:130
29715050,0irq/26-eth0-rx-7820-21df12:00:443
29715050,0irq/26-eth0-rx-5332-21cut10:15:523
29715050,0irq/26-eth0-rx-24593-21grep11:30:453
29715050,0irq/26-eth0-rx-23028-21ssh11:48:473
29715050,0irq/26-eth0-rx-18931-21fschecks_count09:05:473
29715050,0irq/26-eth0-rx-16507-21sensors09:20:543
29715050,0irq/26-eth0-rx-13017-21port_sshpriv07:45:553
29715050,0irq/26-eth0-rx-10016-21kthreadcore11:40:523
29715050,0irq/26-eth0-rx-0-21swapper/312:15:433
29715050,0irq/26-eth0-rx-0-21swapper/312:09:363
29715050,0irq/26-eth0-rx-0-21swapper/312:09:363
29715050,0irq/26-eth0-rx-0-21swapper/311:54:173
29715050,0irq/26-eth0-rx-0-21swapper/311:25:503
29715050,0irq/26-eth0-rx-0-21swapper/311:00:123
29715050,0irq/26-eth0-rx-0-21swapper/310:31:073
29715050,0irq/26-eth0-rx-0-21swapper/310:26:363
29715050,0irq/26-eth0-rx-0-21swapper/310:00:443
29715050,0irq/26-eth0-rx-0-21swapper/309:45:503
29715050,0irq/26-eth0-rx-0-21swapper/309:35:453
29715050,0irq/26-eth0-rx-0-21swapper/309:17:363
29715050,0irq/26-eth0-rx-0-21swapper/308:50:503
27150,0ktimersoftd/20-21swapper/212:26:242
27150,0ktimersoftd/20-21swapper/208:20:562
259950,0migration/27725-21fschecks_time12:20:452
259950,0migration/226378-21sh09:30:202
259950,0migration/213304-21kthreadcore10:00:502
179950,0migration/14643-21kthreadcore10:55:511
179950,0migration/125934-21aten_r1power_cu10:10:451
179950,0migration/124103-21sh09:05:541
179950,0migration/12395-21latency_hist09:15:331
179950,0migration/113247-21kthreadcore09:40:511
149950,0migration/09216-21hddtemp_smartct08:10:470
149950,0migration/08518-21sh10:18:200
149950,0migration/07316-21latency_hist12:00:330
149950,0migration/07026-21latency_hist12:20:330
149950,0migration/05505-21kthreadcore08:05:500
149950,0migration/05339-21kthreadcore09:15:500
149950,0migration/04560-21kthreadcore07:40:510
149950,0migration/032766-21sh10:12:590
149950,0migration/032764-21kthreadcore12:15:480
149950,0migration/031130-21kthreadcore08:25:510
149950,0migration/029797-21munin-node08:50:460
149950,0migration/028514-21kthreadcore10:50:500
149950,0migration/028078-21kthreadcore07:10:490
149950,0migration/024528-21kthreadcore07:30:510
149950,0migration/024328-21kthreadcore08:45:510
149950,0migration/023720-21sh10:26:060
149950,0migration/023002-21switchtime10:45:560
149950,0migration/021946-21timerwakeupswit08:40:570
149950,0migration/020270-21kthreadcore09:45:490
149950,0migration/019837-21kernelversion09:05:510
149950,0migration/018189-21sh09:24:500
149950,0migration/018161-21cpu10:05:450
149950,0migration/017728-21kthreadcore07:50:530
149950,0migration/016882-21taskset10:03:050
149950,0migration/016632-21kthreadcore07:25:520
149950,0migration/014400-21timerwakeupswit11:20:560
149950,0migration/013957-21kthreadcore08:35:510
149950,0migration/013573-21unixbench_multi12:00:550
149950,0migration/012254-21aten_r1power_en07:00:440
149950,0migration/010105-21taskset08:59:540
149950,0migration/010064-21sh09:40:210
120119950,0cyclictest0-21swapper/211:51:242
120119950,0cyclictest0-21swapper/207:45:462
120039955,0cyclictest10180-21diskmemload11:54:021
120039955,0cyclictest0-21swapper/110:25:161
120039954,0cyclictest3556-21lldpd11:18:581
120039950,0cyclictest0-21swapper/112:19:251
120039950,0cyclictest0-21swapper/111:22:401
120039950,0cyclictest0-21swapper/110:07:181
120039950,0cyclictest0-21swapper/109:37:301
120029955,0cyclictest0-21swapper/011:32:550
120029954,0cyclictest11496-21irqcore09:40:500
120029950,0cyclictest0-21swapper/009:58:480
120029950,0cyclictest0-21swapper/008:15:510
120029950,0cyclictest0-21swapper/007:20:500
8215040,0irq/24-0000:00:9180-21perf08:35:332
8215040,0irq/24-0000:00:0-21swapper/207:55:342
4140,0ktimersoftd/00-21swapper/011:47:540
339940,0migration/331016-21kthreadcore07:35:523
339940,0migration/329308-21kthreadcore07:10:503
339940,0migration/323559-21kthreadcore07:05:513
339940,0migration/317776-21fschecks_time10:45:463
339940,0migration/311614-21kthreadcore07:20:523
29725040,0irq/27-eth0-tx-8743-21munin-node11:00:472
29725040,0irq/27-eth0-tx-26702-21ssh09:30:382
29725040,0irq/27-eth0-tx-24307-21ssh11:30:372
29725040,0irq/27-eth0-tx-13804-21ssh11:20:492
29725040,0irq/27-eth0-tx-10180-21diskmemload11:11:082
29725040,0irq/27-eth0-tx-0-21swapper/212:15:532
29725040,0irq/27-eth0-tx-0-21swapper/212:05:392
29725040,0irq/27-eth0-tx-0-21swapper/212:05:392
29725040,0irq/27-eth0-tx-0-21swapper/211:45:542
29725040,0irq/27-eth0-tx-0-21swapper/211:38:112
29725040,0irq/27-eth0-tx-0-21swapper/211:06:272
29725040,0irq/27-eth0-tx-0-21swapper/210:56:392
29725040,0irq/27-eth0-tx-0-21swapper/210:50:502
29725040,0irq/27-eth0-tx-0-21swapper/210:41:032
29725040,0irq/27-eth0-tx-0-21swapper/210:35:372
29725040,0irq/27-eth0-tx-0-21swapper/210:31:402
29725040,0irq/27-eth0-tx-0-21swapper/209:40:492
29715040,0irq/26-eth0-rx-27556-21idleruntime09:30:473
29715040,0irq/26-eth0-rx-14659-21kthreadcore07:00:503
29715040,0irq/26-eth0-rx-0-21swapper/310:36:103
29715040,0irq/26-eth0-rx-0-21swapper/310:09:453
29715040,0irq/26-eth0-rx-0-21swapper/309:55:483
259940,0migration/26560-21timerandwakeup07:40:562
259940,0migration/23250-21kthreadcore11:15:502
259940,0migration/214977-21kthreadcore07:25:522
259940,0migration/213487-21sh12:00:552
249940,0watchdog/23170-21runrttasks08:52:162
249940,0watchdog/216685-21fschecks_time08:40:482
249940,0watchdog/20-21swapper/210:15:512
249940,0watchdog/20-21swapper/209:05:482
249940,0watchdog/20-21swapper/207:55:522
179940,0migration/18408-21if_eth107:45:491
179940,0migration/17933-21kthreadcore07:20:511
179940,0migration/131188-21kthreadcore07:35:521
179940,0migration/131000-21timerandwakeup10:50:551
179940,0migration/127524-21sh09:30:471
179940,0migration/126945-21kthreadcore11:30:501
179940,0migration/125156-21fschecks_count11:10:461
179940,0migration/123685-21kthreadcore08:20:501
179940,0migration/121273-21kthreadcore07:30:501
179940,0migration/116069-21fschecks_time12:05:461
179940,0migration/116069-21fschecks_time12:05:461
179940,0migration/115269-21cpu12:25:451
179940,0migration/114214-21kthreadcore10:40:501
179940,0migration/111496-21sh09:20:461
179940,0migration/111364-21if_eth109:00:481
179940,0migration/110606-21kthreadcore12:00:491
169940,0watchdog/17967-21munin-node11:40:511
169940,0watchdog/1769-21kthreadcore08:25:521
169940,0watchdog/132074-21ssh10:32:111
169940,0watchdog/124738-21irqstats12:10:471
169940,0watchdog/119626-21munin-node07:50:561
169940,0watchdog/119430-21interrupts09:45:481
169940,0watchdog/110180-21diskmemload12:20:431
169940,0watchdog/10-21swapper/111:35:511
169940,0watchdog/10-21swapper/108:40:481
149940,0migration/021251-21kthreadcore11:05:500
120119943,0cyclictest9306-21awk08:10:482
120119943,0cyclictest8859-21awk11:40:502
120119943,0cyclictest3556-21lldpd09:52:282
120119943,0cyclictest3556-21lldpd09:16:282
120119943,0cyclictest3556-21lldpd08:25:592
120119943,0cyclictest3556-21lldpd07:30:582
120119943,0cyclictest3514-21snmpd10:21:012
120119943,0cyclictest3514-21snmpd08:06:002
120119943,0cyclictest3514-21snmpd07:25:002
120119943,0cyclictest3514-21snmpd07:10:452
120119943,0cyclictest3241-21irqbalance08:45:422
120119943,0cyclictest3241-21irqbalance07:05:422
120119943,0cyclictest3241-21irqbalance07:00:522
120119943,0cyclictest18125-21awk10:45:482
120119943,0cyclictest16069-21awk08:15:482
120039943,0cyclictest9645-21awk11:00:481
120039943,0cyclictest565-21awk07:15:491
120039943,0cyclictest3556-21lldpd08:40:291
120039943,0cyclictest3556-21lldpd08:14:291
120039943,0cyclictest3514-21snmpd11:57:011
120039943,0cyclictest3514-21snmpd11:26:011
120039943,0cyclictest3514-21snmpd10:39:011
120039943,0cyclictest3514-21snmpd10:25:461
120039943,0cyclictest3514-21snmpd10:02:001
120039943,0cyclictest3514-21snmpd09:52:301
120039943,0cyclictest2928-21awk09:55:501
120039943,0cyclictest2596-21awk08:05:481
120039943,0cyclictest21670-21awk07:55:491
120039943,0cyclictest19652-21awk09:25:481
120039943,0cyclictest16776-21awk11:45:461
120039943,0cyclictest1605-21awk07:40:481
120029944,0cyclictest0-21swapper/011:16:220
120029943,0cyclictest8923-21awk11:40:500
120029943,0cyclictest6256-21sadc07:20:330
120029943,0cyclictest3514-21snmpd11:12:010
120029940,0cyclictest0-21swapper/009:34:030
29725030,0irq/27-eth0-tx-31860-21munin-node11:55:542
29715030,0irq/26-eth0-rx-0-21swapper/308:45:463
29715030,0irq/26-eth0-rx-0-21swapper/307:25:463
29715030,0irq/26-eth0-rx-0-21swapper/307:15:463
249930,0watchdog/20-21swapper/208:55:522
179930,0migration/116929-21kthreadcore07:00:511
169930,0watchdog/18878-21kthreadcore08:55:521
169930,0watchdog/10-21swapper/110:45:471
169930,0watchdog/10-21swapper/109:11:481
120119933,0cyclictest3556-21lldpd07:37:282
120119932,0cyclictest546-21awk07:15:492
120119930,0cyclictest9796-21diskstats08:35:472
120039933,0cyclictest3556-21lldpd07:27:281
120039933,0cyclictest10180-21diskmemload11:05:571
120039932,0cyclictest3691-21awk08:30:491
120039932,0cyclictest3556-21lldpd08:20:281
120039932,0cyclictest3556-21lldpd07:12:271
120039932,0cyclictest30251-21awk08:50:481
120039932,0cyclictest27748-21grep08:00:441
120039932,0cyclictest23585-21awk08:45:481
120029933,0cyclictest5502-21kworker/0:209:25:350
120029933,0cyclictest5502-21kworker/0:209:10:590
120029933,0cyclictest5502-21kworker/0:208:30:390
120029933,0cyclictest5502-21kworker/0:208:20:350
120029933,0cyclictest5502-21kworker/0:207:45:350
120029933,0cyclictest19514-21kworker/0:111:35:420
120029933,0cyclictest19514-21kworker/0:111:00:440
120029933,0cyclictest19514-21kworker/0:110:55:360
120029933,0cyclictest19514-21kworker/0:110:30:450
120029933,0cyclictest16284-21kworker/0:212:25:340
120029933,0cyclictest16284-21kworker/0:212:05:520
120029933,0cyclictest16284-21kworker/0:212:05:520
120029932,0cyclictest27364-21awk09:50:490
29715020,0irq/26-eth0-rx-0-21swapper/308:40:553
29715020,0irq/26-eth0-rx-0-21swapper/308:05:533
29715020,0irq/26-eth0-rx-0-21swapper/307:50:483
29715020,0irq/26-eth0-rx-0-21swapper/307:41:173
120039921,0cyclictest6559-21runrttasks07:05:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional