You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 10:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 28, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27881210197,0sleep20-21swapper/218:45:472
2176923728,0sleep10-21swapper/118:43:421
2791523622,0sleep00-21swapper/018:46:130
304450350,0irq/25-eth10-21swapper/318:45:273
281899970,0cyclictest29394-21cut19:58:512
339960,0migration/330842-21aten_r1power_po23:13:453
339960,0migration/323889-21sh21:44:303
339960,0migration/320752-21kthreadcore22:43:503
339960,0migration/316483-21fschecks_count19:03:463
29715060,0irq/26-eth0-rx-25766-21aten_r1power_fr20:23:463
29715060,0irq/26-eth0-rx-19336-21grep23:03:523
29715060,0irq/26-eth0-rx-10982-21users23:58:573
281899965,0cyclictest22355-21ssh22:45:492
19160,0ktimersoftd/10-21swapper/122:02:121
149960,0migration/021882-21kthreadcore20:18:500
149960,0migration/016420-21sh21:40:480
8215050,0irq/24-0000:00:2525-21cat18:53:342
339950,0migration/39077-21kthreadcore22:38:503
339950,0migration/38510-21ksmtuned21:57:443
339950,0migration/34464-21diskmemload22:13:513
339950,0migration/332448-21kthreadcore19:38:513
339950,0migration/329228-21diskmemload23:53:373
339950,0migration/32775-21aten_r1power_fr18:54:073
339950,0migration/326759-21kthreadcore22:08:503
339950,0migration/326571-21munin-node21:08:443
339950,0migration/325512-21kthreadcore23:08:513
339950,0migration/32546-21munin-node21:33:503
339950,0migration/325225-21munin-node19:58:473
339950,0migration/324227-21aten_r1power_cu22:28:433
339950,0migration/322634-21latency_hist19:08:343
339950,0migration/318163-21timerandwakeup20:13:573
339950,0migration/316339-21aten_r1power_cu22:23:443
339950,0migration/313054-21kthreadcore22:18:513
29725050,0irq/27-eth0-tx-9653-21munin-node21:38:502
29725050,0irq/27-eth0-tx-6993-21munin-node22:58:462
29725050,0irq/27-eth0-tx-6688-21munin-node20:33:500
29725050,0irq/27-eth0-tx-5681-21munin-node20:08:550
29725050,0irq/27-eth0-tx-25495-21munin-node21:48:462
29725050,0irq/27-eth0-tx-18185-21munin-node21:23:492
29725050,0irq/27-eth0-tx-14429-21sed21:58:502
29725050,0irq/27-eth0-tx-13376-21sed23:43:322
29725050,0irq/27-eth0-tx-0-21swapper/222:40:012
29725050,0irq/27-eth0-tx-0-21swapper/222:29:502
29725050,0irq/27-eth0-tx-0-21swapper/221:23:202
29725050,0irq/27-eth0-tx-0-21swapper/020:49:030
29725050,0irq/27-eth0-tx-0-21swapper/019:17:590
29715050,0irq/26-eth0-rx-9020-21ssh21:15:363
29715050,0irq/26-eth0-rx-6874-21kthreadcore23:38:493
29715050,0irq/26-eth0-rx-30411-21forks23:33:473
29715050,0irq/26-eth0-rx-13258-21ssh22:59:123
29715050,0irq/26-eth0-rx-11832-21ntp_kernel_err23:18:523
29715050,0irq/26-eth0-rx-0-21swapper/323:43:403
29715050,0irq/26-eth0-rx-0-21swapper/323:28:453
29715050,0irq/26-eth0-rx-0-21swapper/321:38:443
29715050,0irq/26-eth0-rx-0-21swapper/321:28:503
29715050,0irq/26-eth0-rx-0-21swapper/321:28:503
29715050,0irq/26-eth0-rx-0-21swapper/321:23:483
29715050,0irq/26-eth0-rx-0-21swapper/321:06:343
29715050,0irq/26-eth0-rx-0-21swapper/320:58:503
29715050,0irq/26-eth0-rx-0-21swapper/320:53:573
29715050,0irq/26-eth0-rx-0-21swapper/320:03:483
29715050,0irq/26-eth0-rx-0-21swapper/300:10:443
281899955,0cyclictest0-21swapper/223:53:462
281899955,0cyclictest0-21swapper/223:49:492
281899955,0cyclictest0-21swapper/223:30:542
281899955,0cyclictest0-21swapper/200:04:102
281889955,0cyclictest0-21swapper/122:29:451
281889954,0cyclictest3041-21awk20:53:491
281879955,0cyclictest0-21swapper/021:02:460
281879955,0cyclictest0-21swapper/019:23:550
281879954,0cyclictest7867-21ssh22:17:490
281879950,0cyclictest0-21swapper/023:21:210
281879950,0cyclictest0-21swapper/022:51:520
27150,0ktimersoftd/20-21swapper/221:04:412
259950,0migration/29097-21sh21:37:432
259950,0migration/28106-21munin-node21:13:562
259950,0migration/27238-21if_eth1.223:18:482
259950,0migration/25372-21sh22:54:312
259950,0migration/24848-21sh23:37:222
259950,0migration/229015-21taskset23:09:042
259950,0migration/224033-21sh21:44:562
259950,0migration/219760-21kthreadcore22:23:502
259950,0migration/218223-21idleruntime-cro21:03:332
259950,0migration/21468-21taskset20:52:412
259950,0migration/214200-21munin-node20:38:492
259950,0migration/211580-21ksmtuned00:00:452
249950,0watchdog/222235-21sh23:07:392
249950,0watchdog/220595-21cut22:03:512
19150,0ktimersoftd/10-21swapper/121:04:411
179950,0migration/14317-21timerwakeupswit23:13:561
179950,0migration/128638-21kthreadcore19:33:531
179950,0migration/123128-21munin-node19:08:471
179950,0migration/12233-21taskset00:14:051
179950,0migration/121706-21irqcore00:08:491
179950,0migration/12007-21kthreadcore20:28:501
179950,0migration/119327-21irqcore21:23:471
179950,0migration/111048-21fschecks_time19:23:471
169950,0watchdog/125872-21kthreadcore23:48:511
169950,0watchdog/12070-21kthreadcore19:13:521
169950,0watchdog/10-21swapper/121:33:471
149950,0migration/07703-21mdstat21:13:520
149950,0migration/06158-21kthreadcore19:43:500
149950,0migration/05418-21kthreadcore18:54:130
149950,0migration/0538-21kthreadcore23:33:510
149950,0migration/032131-21gltestperf20:03:480
149950,0migration/031219-21kthreadcore23:53:480
149950,0migration/030178-21munin-node19:58:530
149950,0migration/028414-21switchtime19:08:570
149950,0migration/028295-21latency_hist00:13:320
149950,0migration/025026-21aten_r1power_po22:08:450
149950,0migration/024130-21latency_hist22:28:320
149950,0migration/023387-21taskset19:32:330
149950,0migration/02138-21irqcore21:53:500
149950,0migration/018023-21kthreadcore19:03:500
149950,0migration/017011-21kthreadcore20:13:520
149950,0migration/017002-21kthreadcore23:23:500
149950,0migration/014491-21kthreadcore19:48:520
149950,0migration/01221-21kthreadcore22:33:510
149950,0migration/011365-21kthreadcore22:18:500
339940,0migration/332677-21kthreadcore18:48:523
339940,0migration/323309-21kthreadcore20:18:503
339940,0migration/312205-21idleruntime19:48:493
339940,0migration/310080-21taskset19:22:313
29725040,0irq/27-eth0-tx-8348-21ssh22:18:362
29725040,0irq/27-eth0-tx-3873-21kthreadcore20:53:512
29725040,0irq/27-eth0-tx-26462-21ssh21:08:392
29725040,0irq/27-eth0-tx-26109-21ssh21:28:402
29725040,0irq/27-eth0-tx-26109-21ssh21:28:402
29725040,0irq/27-eth0-tx-20751-21ssh23:25:222
29725040,0irq/27-eth0-tx-20613-21munin-node00:08:472
29725040,0irq/27-eth0-tx-0-21swapper/222:48:342
29725040,0irq/27-eth0-tx-0-21swapper/222:33:552
29725040,0irq/27-eth0-tx-0-21swapper/200:13:562
29715040,0irq/26-eth0-rx-11972-21cut19:23:503
29715040,0irq/26-eth0-rx-10779-21kthreadcore21:58:493
29715040,0irq/26-eth0-rx-0-21swapper/323:49:583
29715040,0irq/26-eth0-rx-0-21swapper/323:26:023
29715040,0irq/26-eth0-rx-0-21swapper/322:53:513
29715040,0irq/26-eth0-rx-0-21swapper/322:48:533
29715040,0irq/26-eth0-rx-0-21swapper/322:33:363
29715040,0irq/26-eth0-rx-0-21swapper/322:07:483
29715040,0irq/26-eth0-rx-0-21swapper/321:48:493
29715040,0irq/26-eth0-rx-0-21swapper/321:18:503
29715040,0irq/26-eth0-rx-0-21swapper/320:48:503
29715040,0irq/26-eth0-rx-0-21swapper/320:33:123
29715040,0irq/26-eth0-rx-0-21swapper/319:28:443
29715040,0irq/26-eth0-rx-0-21swapper/300:14:553
29715040,0irq/26-eth0-rx-0-21swapper/300:04:163
281899943,0cyclictest6584-21awk20:08:482
281899943,0cyclictest4574-21awk19:18:492
281899943,0cyclictest3658-21awk18:54:112
281899943,0cyclictest3514-21snmpd19:07:542
281899943,0cyclictest31315-21awk19:38:492
281899943,0cyclictest18023-21awk19:28:482
281899943,0cyclictest11297-21awk19:23:482
281889944,0cyclictest25786-21awk22:08:491
281889944,0cyclictest0-21swapper/122:46:081
281889943,0cyclictest7120-21awk23:18:471
281889943,0cyclictest6659-21awk20:08:491
281889943,0cyclictest3514-21snmpd23:53:401
281889943,0cyclictest3514-21snmpd21:51:551
281889943,0cyclictest3514-21snmpd20:13:391
281889943,0cyclictest3514-21snmpd19:46:391
281889943,0cyclictest3514-21snmpd19:20:241
281889943,0cyclictest3514-21snmpd18:53:541
281889943,0cyclictest29388-21awk18:48:501
281889943,0cyclictest22914-21awk23:28:471
281889943,0cyclictest2054-21awk21:53:501
281889943,0cyclictest14262-21awk20:38:491
281889943,0cyclictest10268-21awk18:58:471
281879944,0cyclictest18866-21kworker/0:221:28:540
281879944,0cyclictest18866-21kworker/0:221:28:540
281879944,0cyclictest0-21swapper/022:07:340
281879944,0cyclictest0-21swapper/021:58:440
281879944,0cyclictest0-21swapper/021:52:450
281879944,0cyclictest0-21swapper/021:37:560
281879944,0cyclictest0-21swapper/021:11:450
281879943,0cyclictest8008-21awk22:58:480
281879943,0cyclictest6427-21awk23:38:470
281879943,0cyclictest3514-21snmpd21:04:100
281879943,0cyclictest29357-21awk00:13:470
281879943,0cyclictest23768-21awk23:08:490
281879943,0cyclictest17300-21awk22:23:480
281879943,0cyclictest11145-21awk21:18:470
281879940,0cyclictest0-21swapper/019:38:480
259940,0migration/27998-21kthreadcore19:43:502
259940,0migration/27708-21kthreadcore23:38:492
259940,0migration/232031-21fschecks_time20:03:482
259940,0migration/224933-21kthreadcore19:08:512
259940,0migration/21670-21fschecks_time21:53:472
259940,0migration/212837-21kthreadcore19:48:512
259940,0migration/212036-21kthreadcore18:58:502
259940,0migration/210845-21kthreadcore20:33:522
249940,0watchdog/227004-21kthreadcore20:23:512
249940,0watchdog/225218-21kthreadcore19:33:522
249940,0watchdog/221679-21kthreadcore20:43:512
249940,0watchdog/219882-21if_err_eth1.220:18:472
249940,0watchdog/21810-21kthreadcore23:13:512
249940,0watchdog/213047-21grep20:13:472
249940,0watchdog/20-21swapper/222:13:472
249940,0watchdog/20-21swapper/222:08:512
249940,0watchdog/20-21swapper/220:28:472
249940,0watchdog/20-21swapper/219:13:522
20299240,0sleep320401-21fschecks_count20:43:483
179940,0migration/1786-21kthreadcore19:38:511
179940,0migration/132177-21munin-node20:03:491
179940,0migration/131731-21kthreadcore21:08:501
179940,0migration/126142-21fschecks_count20:23:481
179940,0migration/124814-21irqrtprio22:48:501
179940,0migration/118360-21gltestperf21:43:471
179940,0migration/117870-21kthreadcore23:03:511
179940,0migration/117426-21kthreadcore23:23:501
179940,0migration/113884-21kthreadcore21:38:501
179940,0migration/113279-21sh22:38:531
179940,0migration/113174-21kthreadcore19:48:511
169940,0watchdog/19129-21cut23:58:511
169940,0watchdog/131647-21kthreadcore23:33:511
169940,0watchdog/128995-21yum23:08:591
169940,0watchdog/123660-21ssh22:27:431
169940,0watchdog/117023-21ssh21:20:471
169940,0watchdog/115742-21kthreadcore23:43:511
169940,0watchdog/11476-21kthreadcore22:33:511
169940,0watchdog/111964-21ssh23:39:471
169940,0watchdog/10-21swapper/122:58:511
169940,0watchdog/10-21swapper/122:13:471
169940,0watchdog/10-21swapper/120:48:511
169940,0watchdog/10-21swapper/120:33:511
169940,0watchdog/10-21swapper/100:03:511
149940,0migration/05270-21latency20:28:510
149940,0migration/032450-21kthreadcore23:13:500
149940,0migration/029273-21kthreadcore20:23:520
149940,0migration/029058-21fschecks_time18:48:480
149940,0migration/023814-21kthreadcore23:28:490
149940,0migration/021534-21kthreadcore21:23:480
149940,0migration/019861-21sh00:07:050
149940,0migration/015624-21kthreadcore20:38:510
29725030,0irq/27-eth0-tx-0-21swapper/020:43:460
29725030,0irq/27-eth0-tx-0-21swapper/019:33:550
29715030,0irq/26-eth0-rx-0-21swapper/320:38:463
29715030,0irq/26-eth0-rx-0-21swapper/320:33:453
29715030,0irq/26-eth0-rx-0-21swapper/320:08:453
29715030,0irq/26-eth0-rx-0-21swapper/319:53:443
29715030,0irq/26-eth0-rx-0-21swapper/319:45:543
29715030,0irq/26-eth0-rx-0-21swapper/319:15:173
29715030,0irq/26-eth0-rx-0-21swapper/318:58:493
281899932,0cyclictest3514-21snmpd19:56:392
281889932,0cyclictest3514-21snmpd20:18:391
281889932,0cyclictest3142-21awk21:13:481
281889932,0cyclictest27136-21awk21:28:481
281889932,0cyclictest27136-21awk21:28:481
281889932,0cyclictest25699-21awk19:58:491
281889932,0cyclictest18998-21if_eth019:53:481
281889932,0cyclictest17125-21aten2.4-expect19:28:441
281879933,0cyclictest6232-21kworker/0:123:58:560
281879933,0cyclictest6232-21kworker/0:123:44:080
281879933,0cyclictest6232-21kworker/0:123:03:540
281879933,0cyclictest27953-21kworker/0:018:59:350
281879933,0cyclictest18866-21kworker/0:220:53:560
281879932,0cyclictest8630-21awk22:38:480
281879932,0cyclictest32392-21awk22:53:480
281879932,0cyclictest22365-21awk23:48:480
281879932,0cyclictest18551-21awk21:43:490
281879930,0cyclictest18768-21perl19:53:470
281879930,0cyclictest17806-21cut22:43:490
281879930,0cyclictest0-21swapper/019:18:510
179930,0migration/14120-21kthreadcore22:53:511
169930,0watchdog/10-21swapper/122:18:511
169930,0watchdog/10-21swapper/122:03:511
169930,0watchdog/10-21swapper/121:02:111
169930,0watchdog/10-21swapper/120:43:511
29715020,0irq/26-eth0-rx-0-21swapper/319:33:503
169920,0watchdog/10-21swapper/119:03:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional