You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 06:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed May 06, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450480,0irq/25-eth10-21swapper/318:51:503
597824536,0sleep20-21swapper/218:55:202
61924432,0sleep10-21swapper/118:51:461
592623722,0sleep00-21swapper/018:54:420
616099130,0cyclictest0-21swapper/020:56:460
61629960,0cyclictest0-21swapper/221:42:352
35160,0ktimersoftd/30-21swapper/321:42:333
339960,0migration/327292-21sh21:47:063
339960,0migration/312311-21sh21:01:143
29715060,0irq/26-eth0-rx-27504-21yum21:26:543
29715060,0irq/26-eth0-rx-0-21swapper/322:56:433
149960,0migration/02787-21sh23:35:210
149960,0migration/026389-21sh00:10:060
149960,0migration/012757-21sh21:41:180
149960,0migration/012025-21latency_hist22:41:280
8215050,0irq/24-0000:00:20305-21munin-run22:26:282
8215050,0irq/24-0000:00:18585-21awk00:26:262
61629955,0cyclictest0-21swapper/223:57:322
61629955,0cyclictest0-21swapper/219:31:532
61629954,0cyclictest4715-21crond21:36:282
61629950,0cyclictest0-21swapper/223:00:372
61629950,0cyclictest0-21swapper/222:08:172
61619955,0cyclictest0-21swapper/122:26:521
61619955,0cyclictest0-21swapper/100:23:131
61619950,0cyclictest0-21swapper/123:47:161
61619950,0cyclictest0-21swapper/100:07:271
61609955,0cyclictest0-21swapper/000:11:440
61609954,0cyclictest22210-21awk21:26:430
4150,0ktimersoftd/00-21swapper/021:58:200
35150,0ktimersoftd/30-21swapper/321:58:203
339950,0migration/39677-21sh00:18:483
339950,0migration/39628-21munin-node22:36:463
339950,0migration/37961-21missed_timers20:06:463
339950,0migration/3570-21kthreadcore20:51:463
339950,0migration/35145-21aten_r1power_po21:16:383
339950,0migration/34719-21kthreadcore19:41:453
339950,0migration/33557-21latency_hist20:31:283
339950,0migration/332655-21kthreadcore21:31:453
339950,0migration/330834-21kthreadcore21:11:443
339950,0migration/329528-21fschecks_count21:51:403
339950,0migration/327986-21taskset21:09:033
339950,0migration/327424-21kthreadcore20:46:443
339950,0migration/322328-21needreboot20:41:463
339950,0migration/318726-21taskset23:24:103
339950,0migration/316938-21if_eth1.320:16:433
339950,0migration/315314-21kthreadcore22:41:443
339950,0migration/314162-21timerandwakeup19:46:503
339950,0migration/313672-21munin-node21:21:413
339950,0migration/312583-21fschecks_time23:01:413
339950,0migration/31149-21latency20:01:443
29725050,0irq/27-eth0-tx-13980-21munin-node19:26:500
29725050,0irq/27-eth0-tx-0-21swapper/019:21:100
29715050,0irq/26-eth0-rx-3542-21lldpd00:13:543
29715050,0irq/26-eth0-rx-28507-21fschecks_time23:31:423
29715050,0irq/26-eth0-rx-23292-21kthreadcore22:06:443
29715050,0irq/26-eth0-rx-19093-21ssh22:23:023
29715050,0irq/26-eth0-rx-18257-21munin-node22:01:463
29715050,0irq/26-eth0-rx-12085-21if_eth100:01:423
29715050,0irq/26-eth0-rx-11014-21aten_r1power_vo00:21:393
29715050,0irq/26-eth0-rx-0-21swapper/323:51:463
29715050,0irq/26-eth0-rx-0-21swapper/323:50:193
29715050,0irq/26-eth0-rx-0-21swapper/323:37:553
29715050,0irq/26-eth0-rx-0-21swapper/323:28:143
29715050,0irq/26-eth0-rx-0-21swapper/323:18:403
29715050,0irq/26-eth0-rx-0-21swapper/322:54:283
29715050,0irq/26-eth0-rx-0-21swapper/322:48:463
29715050,0irq/26-eth0-rx-0-21swapper/322:48:463
29715050,0irq/26-eth0-rx-0-21swapper/322:32:383
29715050,0irq/26-eth0-rx-0-21swapper/322:20:073
29715050,0irq/26-eth0-rx-0-21swapper/321:39:423
29715050,0irq/26-eth0-rx-0-21swapper/321:05:133
27150,0ktimersoftd/20-21swapper/222:16:292
249950,0watchdog/229598-21gltestperf22:11:422
249950,0watchdog/220864-21kthreadcore00:06:452
249950,0watchdog/217903-21kthreadcore22:01:462
19150,0ktimersoftd/10-21swapper/120:41:441
179950,0migration/18366-21munin-node00:16:451
179950,0migration/15933-21irqcore21:56:431
179950,0migration/132282-21kthreadcore22:51:461
179950,0migration/128745-21kthreadcore19:36:451
179950,0migration/12028-21kthreadcore19:16:441
179950,0migration/113357-21cpuspeed_turbos21:41:391
169950,0watchdog/15290-21smartctl22:16:421
149950,0migration/09836-21kthreadcore19:21:450
149950,0migration/09591-21switchtime23:16:480
149950,0migration/06473-21kthreadcore23:56:440
149950,0migration/04822-21kthreadcore20:06:450
149950,0migration/04015-21taskset22:15:510
149950,0migration/03972-21ksmtuned20:52:220
149950,0migration/03780-21sh22:36:050
149950,0migration/03303-21taskset20:31:050
149950,0migration/032263-21kthreadcore21:11:440
149950,0migration/029284-21kthreadcore19:11:440
149950,0migration/026906-21kthreadcore20:46:440
149950,0migration/026541-21munin-node21:06:470
149950,0migration/026490-21sh23:28:220
149950,0migration/022757-21irqcore19:56:440
149950,0migration/021423-21fschecks_time22:06:400
149950,0migration/02000-21taskset22:51:560
149950,0migration/019736-21taskset22:45:520
149950,0migration/018628-21kthreadcore20:16:450
149950,0migration/015796-21kthreadcore21:21:460
149950,0migration/014550-21taskset19:48:420
149950,0migration/013379-21cpuspeed_turbos21:41:390
149950,0migration/012705-21if_eth123:21:420
149950,0migration/01240-21missed_timers20:01:450
149950,0migration/011192-21taskset23:41:140
149950,0migration/010997-21aten_r1power_po00:21:390
149950,0migration/010404-21kthreadcore21:16:440
149950,0migration/010224-21proc_pri22:16:480
61629943,0cyclictest5990-21awk21:16:412
61629943,0cyclictest3556-21lldpd20:35:532
61629943,0cyclictest3556-21lldpd20:13:232
61629943,0cyclictest3514-21snmpd20:02:142
61629943,0cyclictest3241-21irqbalance22:41:362
61629943,0cyclictest3241-21irqbalance22:37:362
61629943,0cyclictest3241-21irqbalance21:56:562
61629943,0cyclictest3241-21irqbalance20:56:462
61629943,0cyclictest31238-21awk20:51:442
61629943,0cyclictest30194-21awk21:11:422
61629943,0cyclictest29438-21awk22:31:422
61629943,0cyclictest28539-21awk23:51:442
61629943,0cyclictest27283-21awk19:11:432
61629943,0cyclictest25149-21grep19:06:482
61629943,0cyclictest2508-21awk19:41:432
61629943,0cyclictest21931-21awk21:46:432
61629943,0cyclictest21124-21awk22:46:422
61629943,0cyclictest21124-21awk22:46:422
61629943,0cyclictest14205-21awk21:21:442
61629943,0cyclictest13695-21if_eth1.321:01:432
61629940,0cyclictest0-21swapper/220:27:042
61619943,0cyclictest4763-21awk22:56:411
61619943,0cyclictest4438-21awk23:36:421
61619943,0cyclictest3556-21lldpd19:53:531
61619943,0cyclictest3514-21snmpd23:43:151
61619943,0cyclictest3514-21snmpd22:02:591
61619943,0cyclictest3514-21snmpd20:56:291
61619943,0cyclictest3514-21snmpd20:26:441
61619943,0cyclictest3514-21snmpd20:06:291
61619943,0cyclictest3514-21snmpd20:01:291
61619943,0cyclictest3514-21snmpd19:41:291
61619943,0cyclictest28971-21awk23:11:421
61619943,0cyclictest13980-21awk19:01:441
61619943,0cyclictest10157-21awk20:11:421
61619940,0cyclictest0-21swapper/123:19:411
61609944,0cyclictest26191-21kworker/0:023:05:190
61609943,0cyclictest3514-21snmpd21:46:290
61609943,0cyclictest28873-21awk23:11:410
61609943,0cyclictest26191-21kworker/0:021:51:350
61609943,0cyclictest26191-21kworker/0:020:11:430
61609943,0cyclictest11241-21awk20:36:430
339940,0migration/36877-21kthreadcore23:56:443
339940,0migration/324295-21kthreadcore19:56:453
339940,0migration/319620-21kthreadcore19:51:463
339940,0migration/317756-21kthreadcore19:01:463
339940,0migration/312764-21ntp_kernel_pll_19:21:473
29725040,0irq/27-eth0-tx-6738-21kthreadcore00:16:442
29725040,0irq/27-eth0-tx-5034-21ssh21:36:382
29725040,0irq/27-eth0-tx-28236-21ssh22:51:312
29725040,0irq/27-eth0-tx-28009-21ssh00:11:422
29725040,0irq/27-eth0-tx-19756-21ssh23:26:302
29725040,0irq/27-eth0-tx-0-21swapper/223:41:382
29725040,0irq/27-eth0-tx-0-21swapper/223:36:512
29725040,0irq/27-eth0-tx-0-21swapper/223:31:392
29725040,0irq/27-eth0-tx-0-21swapper/223:21:332
29725040,0irq/27-eth0-tx-0-21swapper/223:06:302
29725040,0irq/27-eth0-tx-0-21swapper/223:01:372
29725040,0irq/27-eth0-tx-0-21swapper/221:08:412
29725040,0irq/27-eth0-tx-0-21swapper/200:01:332
29725040,0irq/27-eth0-tx-0-21swapper/019:52:530
29725040,0irq/27-eth0-tx-0-21swapper/019:31:530
29715040,0irq/26-eth0-rx-0-21swapper/323:41:433
29715040,0irq/26-eth0-rx-0-21swapper/323:11:433
29715040,0irq/26-eth0-rx-0-21swapper/323:06:433
29715040,0irq/26-eth0-rx-0-21swapper/322:26:423
29715040,0irq/26-eth0-rx-0-21swapper/322:11:413
29715040,0irq/26-eth0-rx-0-21swapper/320:11:443
29715040,0irq/26-eth0-rx-0-21swapper/318:56:403
29715040,0irq/26-eth0-rx-0-21swapper/300:10:153
259940,0migration/2622-21timerandwakeup19:36:502
259940,0migration/223404-21idleruntime-cro20:46:282
259940,0migration/220428-21turbostat19:31:282
259940,0migration/210464-21kthreadcore19:21:452
249940,0watchdog/228018-21ssh23:11:372
249940,0watchdog/226387-21switchtime22:26:492
249940,0watchdog/223310-21kthreadcore23:46:452
249940,0watchdog/221325-21munin-node21:26:422
249940,0watchdog/218480-21kthreadcore19:51:462
249940,0watchdog/21377-21basename19:16:422
249940,0watchdog/210791-21grep18:56:462
249940,0watchdog/20-21swapper/223:18:132
249940,0watchdog/20-21swapper/221:51:502
249940,0watchdog/20-21swapper/220:21:462
249940,0watchdog/20-21swapper/220:06:462
249940,0watchdog/20-21swapper/219:01:502
179940,0migration/1798-21kthreadcore21:11:451
179940,0migration/17852-21kthreadcore21:36:441
179940,0migration/16901-21kthreadcore22:36:441
179940,0migration/13188-21munin-node23:56:381
179940,0migration/129042-21cpu22:11:401
179940,0migration/128778-21kthreadcore19:11:441
179940,0migration/128336-21taskset21:09:521
179940,0migration/125608-21unixbench_multi19:06:511
179940,0migration/125163-21kthreadcore20:21:451
179940,0migration/122582-21kthreadcore23:26:421
179940,0migration/122162-21kthreadcore19:31:451
179940,0migration/121485-21aten_r1power_vo21:26:401
179940,0migration/116055-21munin-node20:36:501
179940,0migration/114782-21kthreadcore21:01:451
179940,0migration/114652-21kthreadcore22:21:461
169940,0watchdog/129903-21kthreadcore23:51:451
169940,0watchdog/129827-21kthreadcore23:31:451
169940,0watchdog/128075-21ssh21:49:221
169940,0watchdog/125072-21kthreadcore22:46:451
169940,0watchdog/125072-21kthreadcore22:46:451
169940,0watchdog/117931-21ssh23:21:531
169940,0watchdog/117714-21rm00:03:091
169940,0watchdog/116046-21tr21:21:461
169940,0watchdog/11584-21ssh00:13:571
169940,0watchdog/111966-21munin-node23:01:491
169940,0watchdog/10-21swapper/122:31:451
169940,0watchdog/10-21swapper/122:06:381
169940,0watchdog/10-21swapper/120:51:461
169940,0watchdog/10-21swapper/119:21:461
149940,0migration/08042-21kthreadcore20:31:450
149940,0migration/0769-21kthreadcore21:31:450
149940,0migration/031487-21kthreadcore23:51:460
149940,0migration/029857-21kthreadcore19:36:450
149940,0migration/024807-21kthreadcore19:06:460
149940,0migration/022681-21kthreadcore23:46:450
149940,0migration/015947-21kthreadcore23:41:440
149940,0migration/014189-21kthreadcore21:01:440
149940,0migration/012485-21latency_hist22:21:280
149940,0migration/010555-21kthreadcore18:56:460
61629932,0cyclictest3556-21lldpd20:47:232
61629932,0cyclictest16868-21awk20:16:422
61629930,0cyclictest22285-21perl19:56:422
61619932,0cyclictest3514-21snmpd19:56:441
61619932,0cyclictest30250-21awk21:31:421
61619932,0cyclictest24469-21awk20:46:421
61619932,0cyclictest20850-21awk23:06:411
61609933,0cyclictest26191-21kworker/0:023:06:310
61609933,0cyclictest26191-21kworker/0:022:56:350
61609933,0cyclictest26191-21kworker/0:022:46:330
61609933,0cyclictest26191-21kworker/0:022:46:330
61609933,0cyclictest26191-21kworker/0:022:26:310
61609933,0cyclictest26191-21kworker/0:022:01:290
61609933,0cyclictest26191-21kworker/0:020:41:290
61609933,0cyclictest26191-21kworker/0:020:21:410
61609933,0cyclictest26191-21kworker/0:019:41:290
61609933,0cyclictest26191-21kworker/0:019:01:290
61609933,0cyclictest26191-21kworker/0:000:01:280
61609933,0cyclictest19917-21kworker/0:100:16:280
339930,0migration/329305-21kthreadcore19:11:443
29715030,0irq/26-eth0-rx-0-21swapper/320:26:413
29715030,0irq/26-eth0-rx-0-21swapper/320:21:393
29715030,0irq/26-eth0-rx-0-21swapper/319:36:483
29715030,0irq/26-eth0-rx-0-21swapper/319:33:163
29715030,0irq/26-eth0-rx-0-21swapper/319:20:453
29715030,0irq/26-eth0-rx-0-21swapper/319:06:393
259930,0migration/215546-21latency20:36:452
249930,0watchdog/20-21swapper/219:46:302
179930,0migration/116033-21aten_r1power_fr20:16:391
169930,0watchdog/14342-21diskmemload21:51:501
169930,0watchdog/118492-21ssh22:42:131
169930,0watchdog/10-21swapper/121:16:301
169930,0watchdog/10-21swapper/119:46:301
169930,0watchdog/10-21swapper/119:26:421
169930,0watchdog/10-21swapper/118:56:461
61619920,0cyclictest0-21swapper/120:31:281
35120,0ktimersoftd/315857-21kthreadcore19:26:423
29715020,0irq/26-eth0-rx-0-21swapper/320:36:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional