You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 15:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Mar 13, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/306:57:053
1234723723,0sleep00-21swapper/006:58:390
1228223526,0sleep20-21swapper/206:57:532
1232223228,0sleep10-21swapper/106:58:201
4160,0ktimersoftd/00-21swapper/012:00:500
35160,0ktimersoftd/30-21swapper/312:00:503
339960,0migration/39581-21sh10:20:523
339960,0migration/325579-21sh09:27:583
339960,0migration/315041-21sh12:23:363
29715060,0irq/26-eth0-rx-25859-21ssh10:10:523
29715060,0irq/26-eth0-rx-19910-21kthreadcore08:41:473
29715060,0irq/26-eth0-rx-0-21swapper/309:54:163
126649960,0cyclictest0-21swapper/012:12:190
35150,0ktimersoftd/30-21swapper/309:08:113
339950,0migration/39203-21runrttasks09:17:083
339950,0migration/37228-21aten2.4-expect07:21:403
339950,0migration/36210-21switchtime07:16:533
339950,0migration/35497-21kthreadcore07:41:463
339950,0migration/331570-21munin-node11:11:523
339950,0migration/327785-21needreboot08:21:463
339950,0migration/324075-21diskmemload11:08:193
339950,0migration/321954-21latency12:06:473
339950,0migration/321147-21kthreadcore11:46:463
339950,0migration/318035-21taskset09:45:193
339950,0migration/31205-21latency_hist07:41:303
339950,0migration/311239-21idleruntime10:01:423
339950,0migration/31026-21munin-node12:16:453
29725050,0irq/27-eth0-tx-9210-21ssh09:58:502
29725050,0irq/27-eth0-tx-362-21munin-node07:16:440
29725050,0irq/27-eth0-tx-17705-21idleruntime11:46:432
29725050,0irq/27-eth0-tx-0-21swapper/212:06:522
29725050,0irq/27-eth0-tx-0-21swapper/211:41:512
29725050,0irq/27-eth0-tx-0-21swapper/210:46:292
29725050,0irq/27-eth0-tx-0-21swapper/007:51:420
29715050,0irq/26-eth0-rx-9867-21date08:36:303
29715050,0irq/26-eth0-rx-9844-21if_eth1.311:41:443
29715050,0irq/26-eth0-rx-9335-21smartctl12:01:423
29715050,0irq/26-eth0-rx-32490-21latency09:11:473
29715050,0irq/26-eth0-rx-26759-21entropy10:11:413
29715050,0irq/26-eth0-rx-2672-21irqcore10:36:453
29715050,0irq/26-eth0-rx-18740-21ssh10:46:453
29715050,0irq/26-eth0-rx-10738-21tr07:46:463
29715050,0irq/26-eth0-rx-0-21swapper/312:26:463
29715050,0irq/26-eth0-rx-0-21swapper/312:11:413
29715050,0irq/26-eth0-rx-0-21swapper/311:51:563
29715050,0irq/26-eth0-rx-0-21swapper/311:39:553
29715050,0irq/26-eth0-rx-0-21swapper/311:35:073
29715050,0irq/26-eth0-rx-0-21swapper/311:26:483
29715050,0irq/26-eth0-rx-0-21swapper/311:21:453
29715050,0irq/26-eth0-rx-0-21swapper/311:01:333
29715050,0irq/26-eth0-rx-0-21swapper/310:51:403
29715050,0irq/26-eth0-rx-0-21swapper/309:57:043
29715050,0irq/26-eth0-rx-0-21swapper/309:34:333
29715050,0irq/26-eth0-rx-0-21swapper/309:01:333
29715050,0irq/26-eth0-rx-0-21swapper/308:51:473
259950,0migration/28898-21latency_hist08:11:302
259950,0migration/28269-21aten_r1power_cu12:21:392
259950,0migration/27269-21sh12:19:262
259950,0migration/2512-21sh10:34:112
259950,0migration/231254-21kthreadcore08:26:452
259950,0migration/228615-21kthreadcore09:51:432
259950,0migration/226915-21kthreadcore11:11:462
259950,0migration/226123-21latency_hist10:11:302
259950,0migration/218166-21fschecks_time11:06:422
249950,0watchdog/224895-21ssh10:50:002
249950,0watchdog/222180-21ssh12:26:512
249950,0watchdog/20-21swapper/210:28:042
179950,0migration/18419-21cpuspeed_turbos07:46:411
179950,0migration/16196-21proc_pri11:56:481
179950,0migration/14500-21kthreadcore12:16:481
179950,0migration/131802-21runrttasks12:15:051
179950,0migration/125152-21kthreadcore08:46:461
179950,0migration/123508-21switchtime10:46:521
179950,0migration/122959-21sh12:07:361
179950,0migration/117870-21kthreadcore08:16:471
179950,0migration/116749-21sh11:05:131
179950,0migration/114832-21munin-node11:41:511
179950,0migration/110768-21fschecks_time10:21:431
169950,0watchdog/1699-21unixbench-2d09:11:521
169950,0watchdog/126574-21diskstats07:11:411
149950,0migration/09125-21taskset11:21:320
149950,0migration/08578-21taskset11:20:360
149950,0migration/08578-21taskset11:20:360
149950,0migration/05492-21diskmemload12:16:480
149950,0migration/04684-21kthreadcore10:56:460
149950,0migration/029044-21kthreadcore10:11:450
149950,0migration/027868-21gltestperf07:36:430
149950,0migration/023509-21missed_timers10:26:470
149950,0migration/02219-21sh09:15:310
149950,0migration/022022-21kthreadcore09:06:470
149950,0migration/019795-21kthreadcore10:46:460
149950,0migration/019429-21kthreadcore08:41:470
149950,0migration/012848-21latency_hist07:01:300
149950,0migration/010207-21kthreadcore12:21:450
126669955,0cyclictest0-21swapper/209:04:432
126669954,0cyclictest11354-21awk10:01:432
126669950,0cyclictest0-21swapper/211:24:152
126669950,0cyclictest0-21swapper/209:50:552
126669950,0cyclictest0-21swapper/209:22:422
126659954,0cyclictest19374-21tail10:06:441
126659950,0cyclictest0-21swapper/112:28:451
126659950,0cyclictest0-21swapper/110:59:501
126649955,0cyclictest0-21swapper/011:06:060
126649955,0cyclictest0-21swapper/010:45:360
126649954,0cyclictest3514-21snmpd09:31:430
126649950,0cyclictest0-21swapper/009:28:590
8215040,0irq/24-0000:00:12607-21latency_hist07:01:302
339940,0migration/326978-21idleruntime07:11:423
339940,0migration/319069-21kthreadcore08:16:483
339940,0migration/315679-21sendmail_mailst08:36:523
29725040,0irq/27-eth0-tx-8243-21ssh10:38:022
29725040,0irq/27-eth0-tx-710-21munin-node11:36:472
29725040,0irq/27-eth0-tx-29966-21ssh12:11:462
29725040,0irq/27-eth0-tx-10788-21diskmemload10:56:432
29725040,0irq/27-eth0-tx-0-21swapper/211:57:052
29725040,0irq/27-eth0-tx-0-21swapper/211:27:262
29725040,0irq/27-eth0-tx-0-21swapper/211:16:342
29725040,0irq/27-eth0-tx-0-21swapper/211:16:342
29725040,0irq/27-eth0-tx-0-21swapper/211:01:382
29725040,0irq/27-eth0-tx-0-21swapper/210:21:342
29725040,0irq/27-eth0-tx-0-21swapper/210:17:542
29725040,0irq/27-eth0-tx-0-21swapper/209:41:332
29725040,0irq/27-eth0-tx-0-21swapper/209:36:462
29725040,0irq/27-eth0-tx-0-21swapper/209:26:332
29725040,0irq/27-eth0-tx-0-21swapper/209:06:332
29725040,0irq/27-eth0-tx-0-21swapper/007:46:400
29715040,0irq/26-eth0-rx-3682-21kthreadcore08:06:463
29715040,0irq/26-eth0-rx-0-21swapper/311:16:463
29715040,0irq/26-eth0-rx-0-21swapper/311:16:463
29715040,0irq/26-eth0-rx-0-21swapper/310:56:463
29715040,0irq/26-eth0-rx-0-21swapper/310:41:343
29715040,0irq/26-eth0-rx-0-21swapper/310:31:453
29715040,0irq/26-eth0-rx-0-21swapper/310:26:553
29715040,0irq/26-eth0-rx-0-21swapper/310:21:413
29715040,0irq/26-eth0-rx-0-21swapper/309:46:493
29715040,0irq/26-eth0-rx-0-21swapper/309:36:303
29715040,0irq/26-eth0-rx-0-21swapper/309:21:463
29715040,0irq/26-eth0-rx-0-21swapper/308:11:403
29715040,0irq/26-eth0-rx-0-21swapper/307:51:463
29715040,0irq/26-eth0-rx-0-21swapper/307:01:453
259940,0migration/2743-21df_abs07:16:432
259940,0migration/225019-21kthreadcore07:56:462
259940,0migration/224628-21kthreadcore07:06:472
259940,0migration/223410-21aten_r1power_en08:46:412
259940,0migration/217288-21fschecks_time08:41:432
259940,0migration/213610-21idleruntime-cro07:26:302
249940,0watchdog/29314-21grep08:11:402
249940,0watchdog/230001-21munin-node08:51:442
249940,0watchdog/22867-21munin-node09:16:482
249940,0watchdog/214739-21munin-node07:51:442
249940,0watchdog/20-21swapper/212:01:392
249940,0watchdog/20-21swapper/208:21:442
249940,0watchdog/20-21swapper/207:36:442
179940,0migration/18552-21pmu-power09:16:491
179940,0migration/18472-21taskset08:07:341
179940,0migration/1680-21taskset10:13:371
179940,0migration/15269-21kthreadcore07:41:461
179940,0migration/129775-21kthreadcore08:01:461
179940,0migration/128852-21kthreadcore07:36:461
179940,0migration/127839-21irqcore09:51:421
179940,0migration/127226-21kthreadcore11:31:461
179940,0migration/122923-21taskset08:44:041
179940,0migration/122174-21kthreadcore07:31:461
179940,0migration/120124-21fschecks_time07:06:431
179940,0migration/119648-21runrttasks09:26:411
179940,0migration/117350-21kthreadcore07:26:471
179940,0migration/117132-21taskset09:01:531
179940,0migration/115562-21switchtime10:41:511
179940,0migration/112690-21kthreadcore11:21:451
179940,0migration/112573-21kthreadcore10:01:451
169940,0watchdog/19316-21cpuspeed_turbos08:11:401
169940,0watchdog/17396-21ssh11:17:081
169940,0watchdog/17396-21ssh11:17:081
169940,0watchdog/14338-21sh08:31:441
169940,0watchdog/132704-21ssh11:15:001
169940,0watchdog/1173522sleep109:43:201
169940,0watchdog/116892-21munin-node11:46:441
169940,0watchdog/116017-21ssh12:26:271
169940,0watchdog/10-21swapper/112:01:431
169940,0watchdog/10-21swapper/109:06:361
169940,0watchdog/10-21swapper/108:51:441
169940,0watchdog/10-21swapper/107:16:491
149940,0migration/07853-21missed_timers09:56:470
149940,0migration/07047-21kthreadcore08:56:460
149940,0migration/032579-21runrttasks11:35:380
149940,0migration/030340-21kernelversion08:26:450
149940,0migration/021124-21kthreadcore11:46:460
149940,0migration/019454-21kthreadcore08:16:480
149940,0migration/014938-21irqcore07:26:460
149940,0migration/014261-21kthreadcore09:21:460
149940,0migration/012536-21kthreadcore10:01:450
126669943,0cyclictest4319-21awk08:31:442
126669943,0cyclictest3556-21lldpd08:36:302
126669943,0cyclictest3556-21lldpd07:41:302
126669943,0cyclictest27997-21awk09:31:442
126669943,0cyclictest27254-21awk10:11:432
126669943,0cyclictest26073-21awk11:31:442
126669943,0cyclictest25743-21awk11:51:432
126669943,0cyclictest20226-21sadc07:31:302
126669940,0cyclictest27185-21munin-node09:11:432
126659944,0cyclictest0-21swapper/111:40:401
126659943,0cyclictest3630-21awk09:36:471
126659943,0cyclictest3514-21snmpd11:51:591
126659943,0cyclictest3514-21snmpd10:37:441
126659943,0cyclictest3211-21awk09:56:431
126659943,0cyclictest29913-21awk08:26:431
126659943,0cyclictest2986-21awk10:16:431
126659943,0cyclictest28021-21awk09:31:441
126659943,0cyclictest27838-21sadc08:01:301
126659943,0cyclictest26688-21awk10:51:431
126659943,0cyclictest18152-21awk11:26:451
126659943,0cyclictest13741-21awk07:01:441
126659943,0cyclictest10847-21awk08:36:451
126649944,0cyclictest0-21swapper/009:55:280
126649943,0cyclictest9768-21awk11:41:430
126649943,0cyclictest3556-21lldpd10:17:330
126649943,0cyclictest3514-21snmpd11:10:140
126649943,0cyclictest3241-21irqbalance12:02:280
126649943,0cyclictest3241-21irqbalance10:31:380
126649943,0cyclictest3241-21irqbalance10:26:080
126649943,0cyclictest3241-21irqbalance09:17:480
126649943,0cyclictest3241-21irqbalance09:01:380
126649943,0cyclictest3241-21irqbalance08:54:180
126649943,0cyclictest3241-21irqbalance08:46:580
126649943,0cyclictest3241-21irqbalance08:37:180
126649943,0cyclictest3241-21irqbalance08:31:580
126649943,0cyclictest3241-21irqbalance08:12:290
126649943,0cyclictest3241-21irqbalance08:07:290
126649943,0cyclictest3241-21irqbalance08:01:490
126649943,0cyclictest3241-21irqbalance07:42:190
126649943,0cyclictest3241-21irqbalance07:35:290
126649943,0cyclictest3241-21irqbalance07:21:590
126649943,0cyclictest3241-21irqbalance07:12:290
126649943,0cyclictest2640-21awk10:36:450
126649943,0cyclictest23363-21awk08:21:430
126649943,0cyclictest22337-21awk07:56:440
126649943,0cyclictest20479-21awk07:06:450
126649943,0cyclictest19203-21awk10:06:430
126649943,0cyclictest17306-21awk12:26:440
126649943,0cyclictest11714-21awk09:41:440
29715030,0irq/26-eth0-rx-0-21swapper/308:56:483
29715030,0irq/26-eth0-rx-0-21swapper/308:48:503
29715030,0irq/26-eth0-rx-0-21swapper/308:26:393
29715030,0irq/26-eth0-rx-0-21swapper/308:05:093
29715030,0irq/26-eth0-rx-0-21swapper/307:27:513
29715030,0irq/26-eth0-rx-0-21swapper/307:07:043
259930,0migration/218249-21kthreadcore08:16:472
249930,0watchdog/20-21swapper/207:11:412
169930,0watchdog/1417-21ssh10:33:561
169930,0watchdog/110788-21diskmemload11:06:401
169930,0watchdog/110788-21diskmemload10:28:201
169930,0watchdog/10-21swapper/108:56:401
126669933,0cyclictest3556-21lldpd08:56:312
126669932,0cyclictest21363-21awk07:31:452
126669932,0cyclictest0-21swapper/210:51:302
126669932,0cyclictest0-21swapper/208:01:442
126669930,0cyclictest0-21swapper/207:46:312
126659932,0cyclictest8076-21awk07:21:441
126659932,0cyclictest23245-21awk08:21:421
126659932,0cyclictest19576-21awk09:46:441
126659932,0cyclictest16825-21sensors09:21:511
126659930,0cyclictest15063-21df07:51:411
126649933,0cyclictest2874-21kworker/0:109:36:310
126649933,0cyclictest19122-21kworker/0:010:52:130
126649932,0cyclictest6646-21sensors11:36:530
126649932,0cyclictest31587-21unixbench_singl11:11:520
126649932,0cyclictest26221-21grep11:51:450
126649932,0cyclictest19464-21grep09:46:430
126649932,0cyclictest18250-21sed11:26:450
126649930,0cyclictest16984-21munin-node12:06:420
329920,0watchdog/322847-21kthreadcore07:56:453
29715020,0irq/26-eth0-rx-0-21swapper/307:31:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional