You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 03:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 16, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1279523625,0sleep30-21swapper/318:48:513
1309623425,0sleep20-21swapper/218:52:222
1297423221,0sleep00-21swapper/018:50:560
1281122925,0sleep10-21swapper/118:49:011
339960,0migration/31496-21taskset22:23:273
339960,0migration/31424-21sh23:24:593
339960,0migration/312966-21munin-node21:32:503
339960,0migration/310016-21sh22:50:153
29715060,0irq/26-eth0-rx-4639-21gltestperf21:27:483
29715060,0irq/26-eth0-rx-4035-21df_abs21:47:463
29715060,0irq/26-eth0-rx-27665-21interrupts00:02:483
29715060,0irq/26-eth0-rx-27665-21interrupts00:02:483
29715060,0irq/26-eth0-rx-0-21swapper/321:02:473
179960,0migration/16338-21kthreadcore20:22:511
149960,0migration/03412-21latency_hist21:07:340
149960,0migration/018224-21sh22:14:280
149960,0migration/018213-21sh23:16:150
131909960,0cyclictest0-21swapper/223:52:462
131909960,0cyclictest0-21swapper/223:52:462
131909960,0cyclictest0-21swapper/223:27:322
131909960,0cyclictest0-21swapper/200:10:162
131899960,0cyclictest0-21swapper/123:41:121
4150,0ktimersoftd/00-21swapper/021:23:290
4150,0ktimersoftd/00-21swapper/021:09:560
35150,0ktimersoftd/30-21swapper/321:09:563
339950,0migration/35989-21kthreadcore23:27:503
339950,0migration/34898-21aten_r1power_cu20:47:453
339950,0migration/34501-21taskset20:45:483
339950,0migration/33958-21kthreadcore19:32:503
339950,0migration/328187-21taskset21:22:423
339950,0migration/327517-21latency_hist19:27:343
339950,0migration/32726-21latency_hist23:07:343
339950,0migration/321300-21kthreadcore20:07:523
339950,0migration/321094-21irqrtprio21:57:503
339950,0migration/320608-21latency19:42:523
339950,0migration/320109-21diskmemload21:17:373
339950,0migration/318571-21sh20:55:413
339950,0migration/317894-21munin-node21:52:573
339950,0migration/315116-21hddtemp_smartct19:17:483
339950,0migration/315113-21munin-node20:02:533
339950,0migration/314598-21kthreadcore22:12:503
339950,0migration/314346-21kthreadcore23:52:513
339950,0migration/314346-21kthreadcore23:52:513
339950,0migration/314174-21hddtemp_smartct18:52:473
339950,0migration/311745-21idleruntime23:12:503
339950,0migration/311340-21aten_r1power_cu22:32:443
339950,0migration/310741-21aten_r1power_po20:27:443
29725050,0irq/27-eth0-tx-3614-21munin-node21:07:472
29725050,0irq/27-eth0-tx-29633-21munin-node20:17:520
29725050,0irq/27-eth0-tx-27804-21chrt19:27:450
29725050,0irq/27-eth0-tx-27585-21ssh21:42:102
29725050,0irq/27-eth0-tx-18759-21ssh21:55:222
29725050,0irq/27-eth0-tx-11320-21munin-node22:32:522
29725050,0irq/27-eth0-tx-0-21swapper/223:27:492
29725050,0irq/27-eth0-tx-0-21swapper/019:02:540
29715050,0irq/26-eth0-rx-6559-21runrttasks00:16:223
29715050,0irq/26-eth0-rx-476-21kthreadcore22:02:513
29715050,0irq/26-eth0-rx-31790-21kthreadcore22:42:523
29715050,0irq/26-eth0-rx-31138-21kthreadcore21:42:493
29715050,0irq/26-eth0-rx-2863-21df_inode23:47:463
29715050,0irq/26-eth0-rx-27501-21grep23:42:473
29715050,0irq/26-eth0-rx-25940-21ssh20:58:373
29715050,0irq/26-eth0-rx-24176-21kthreadcore22:57:513
29715050,0irq/26-eth0-rx-20322-21cat00:17:503
29715050,0irq/26-eth0-rx-19669-21irqcore23:57:483
29715050,0irq/26-eth0-rx-19662-21if_err_eth023:37:473
29715050,0irq/26-eth0-rx-15534-21kthreadcore22:52:513
29715050,0irq/26-eth0-rx-0-21swapper/322:37:513
29715050,0irq/26-eth0-rx-0-21swapper/322:17:453
29715050,0irq/26-eth0-rx-0-21swapper/322:07:503
29715050,0irq/26-eth0-rx-0-21swapper/321:12:533
29715050,0irq/26-eth0-rx-0-21swapper/318:57:513
249950,0watchdog/24447-21gltestperf21:47:482
249950,0watchdog/24120-21iostat22:47:522
249950,0watchdog/212734-21hwlatdetect21:32:482
249950,0watchdog/20-21swapper/221:27:482
19150,0ktimersoftd/10-21swapper/121:09:561
179950,0migration/12966-21runrttasks21:25:551
179950,0migration/120097-21fschecks_count22:17:481
179950,0migration/119808-21munin-node22:37:471
179950,0migration/11794-21sh21:43:101
169950,0watchdog/19399-21gltestperf19:37:481
169950,0watchdog/130603-21grep23:42:521
169950,0watchdog/113149-21ntp_states19:12:531
149950,0migration/08990-21unixbench_singl23:07:580
149950,0migration/08401-21sh23:47:570
149950,0migration/08230-21switchtime00:07:540
149950,0migration/07179-21kthreadcore21:27:510
149950,0migration/05404-21kthreadcore22:07:500
149950,0migration/05252-21kthreadcore21:47:510
149950,0migration/03848-21kthreadcore19:32:500
149950,0migration/0342-21sh00:03:000
149950,0migration/0342-21sh00:03:000
149950,0migration/02981-21latency_hist22:47:340
149950,0migration/029375-21kthreadcore23:02:500
149950,0migration/023748-21kthreadcore19:47:530
149950,0migration/022002-21kthreadcore23:57:500
149950,0migration/021531-21kthreadcore23:17:500
149950,0migration/021495-21kthreadcore00:17:500
149950,0migration/021224-21kthreadcore20:07:520
149950,0migration/020609-21fschecks_count18:57:470
149950,0migration/019064-21latency_hist22:57:340
149950,0migration/016859-21sh00:13:450
149950,0migration/016347-21sh23:32:520
149950,0migration/014650-21runrttasks19:37:580
149950,0migration/014572-21kthreadcore22:52:510
149950,0migration/014049-21fschecks_time18:52:470
149950,0migration/012661-21kthreadcore23:52:500
149950,0migration/012661-21kthreadcore23:52:500
149950,0migration/012061-21kthreadcore20:27:490
131909955,0cyclictest17454-21ssh00:15:282
131909955,0cyclictest0-21swapper/223:38:152
131909955,0cyclictest0-21swapper/221:59:052
131909950,0cyclictest0-21swapper/222:45:552
131909950,0cyclictest0-21swapper/222:25:252
131909950,0cyclictest0-21swapper/221:20:562
131909950,0cyclictest0-21swapper/200:20:402
131899955,0cyclictest11361-21diskmemload23:24:111
131899955,0cyclictest0-21swapper/122:30:531
131899955,0cyclictest0-21swapper/122:08:581
131899955,0cyclictest0-21swapper/121:36:011
131899950,0cyclictest0-21swapper/122:23:571
131899950,0cyclictest0-21swapper/121:56:311
131899950,0cyclictest0-21swapper/100:10:131
131889955,0cyclictest0-21swapper/022:31:260
131889955,0cyclictest0-21swapper/022:21:110
131889954,0cyclictest6083-21sed19:57:510
131889950,0cyclictest0-21swapper/023:44:540
8215040,0irq/24-0000:00:28091-21cat21:22:342
8215040,0irq/24-0000:00:0-21swapper/223:12:492
339940,0migration/39513-21diskmemload22:28:103
339940,0migration/37780-21kthreadcore19:57:513
339940,0migration/34157-21cpuspeed_turbos20:22:463
339940,0migration/32873-21kthreadcore19:07:513
339940,0migration/324546-21kthreadcore20:12:503
339940,0migration/312058-21kthreadcore19:12:503
29725040,0irq/27-eth0-tx-3377-21telnet22:27:452
29725040,0irq/27-eth0-tx-27817-21munin-node22:02:462
29725040,0irq/27-eth0-tx-2405-21ssh23:47:372
29725040,0irq/27-eth0-tx-11361-21diskmemload23:07:362
29725040,0irq/27-eth0-tx-0-21swapper/223:17:452
29725040,0irq/27-eth0-tx-0-21swapper/223:02:402
29725040,0irq/27-eth0-tx-0-21swapper/223:00:052
29725040,0irq/27-eth0-tx-0-21swapper/222:37:392
29725040,0irq/27-eth0-tx-0-21swapper/222:12:392
29725040,0irq/27-eth0-tx-0-21swapper/221:42:562
29725040,0irq/27-eth0-tx-0-21swapper/220:57:452
29725040,0irq/27-eth0-tx-0-21swapper/200:02:582
29725040,0irq/27-eth0-tx-0-21swapper/200:02:582
29725040,0irq/27-eth0-tx-0-21swapper/020:52:410
29725040,0irq/27-eth0-tx-0-21swapper/020:42:460
29725040,0irq/27-eth0-tx-0-21swapper/020:37:450
29725040,0irq/27-eth0-tx-0-21swapper/020:32:470
29715040,0irq/26-eth0-rx-0-21swapper/323:32:483
29715040,0irq/26-eth0-rx-0-21swapper/323:17:473
29715040,0irq/26-eth0-rx-0-21swapper/323:02:363
29715040,0irq/26-eth0-rx-0-21swapper/321:37:553
29715040,0irq/26-eth0-rx-0-21swapper/320:32:443
29715040,0irq/26-eth0-rx-0-21swapper/319:47:533
29715040,0irq/26-eth0-rx-0-21swapper/319:37:523
29715040,0irq/26-eth0-rx-0-21swapper/300:07:433
259940,0migration/27875-21kthreadcore19:57:512
259940,0migration/26583-21proc_pri19:07:552
259940,0migration/2334-21kthreadcore20:42:502
259940,0migration/230796-21kthreadcore21:02:502
259940,0migration/230267-21kthreadcore19:27:512
259940,0migration/229671-21kthreadcore23:42:512
259940,0migration/22242-21cpuspeed_turbos19:32:462
259940,0migration/220727-21kthreadcore23:57:492
259940,0migration/21868-21kthreadcore20:17:532
259940,0migration/213834-21kthreadcore23:32:492
259940,0migration/212117-21fschecks_count20:52:472
249940,0watchdog/232250-21cut19:52:522
249940,0watchdog/222354-21df19:47:482
249940,0watchdog/20-21swapper/219:37:522
179940,0migration/17924-21kthreadcore22:47:541
179940,0migration/130814-21kthreadcore22:42:511
179940,0migration/12512-21fschecks_time19:32:471
179940,0migration/123679-21kthreadcore23:17:511
179940,0migration/113415-21aten_r1power_cu18:52:451
179940,0migration/112679-21hddtemp_smartct21:12:471
179940,0migration/112492-21kthreadcore20:02:511
169940,0watchdog/14446-21grep21:47:481
169940,0watchdog/132161-21netstat00:02:511
169940,0watchdog/132161-21netstat00:02:511
169940,0watchdog/128678-21if_eth121:02:481
169940,0watchdog/125638-21ssh00:00:271
169940,0watchdog/12515-21ssh22:05:441
169940,0watchdog/111361-21diskmemload23:07:401
169940,0watchdog/111361-21diskmemload21:27:361
169940,0watchdog/10-21swapper/123:02:481
169940,0watchdog/10-21swapper/119:22:451
169940,0watchdog/10-21swapper/100:17:471
149940,0migration/06696-21kthreadcore23:27:500
149940,0migration/028449-21turbostat19:57:290
149940,0migration/025006-21kthreadcore21:57:510
149940,0migration/019201-21kthreadcore19:42:520
149940,0migration/016046-21kthreadcore21:12:510
149940,0migration/01024-21missed_timers21:42:500
131909943,0cyclictest8546-21awk19:12:482
131909943,0cyclictest5779-21awk20:47:492
131909943,0cyclictest4453-21awk22:07:492
131909943,0cyclictest3556-21lldpd22:52:452
131909943,0cyclictest3556-21lldpd20:27:452
131909943,0cyclictest3556-21lldpd20:22:452
131909943,0cyclictest3556-21lldpd20:15:452
131909943,0cyclictest3556-21lldpd19:43:162
131909943,0cyclictest3556-21lldpd19:19:452
131909943,0cyclictest3556-21lldpd18:59:452
131909943,0cyclictest27555-21awk19:02:482
131909943,0cyclictest20463-21awk22:17:492
131909943,0cyclictest18142-21awk20:32:482
131909943,0cyclictest12755-21awk21:12:482
131899944,0cyclictest11361-21diskmemload00:15:251
131899944,0cyclictest0-21swapper/122:15:551
131899944,0cyclictest0-21swapper/120:49:311
131899944,0cyclictest0-21swapper/119:57:481
131899943,0cyclictest3514-21snmpd23:50:381
131899943,0cyclictest3514-21snmpd21:58:231
131899943,0cyclictest3514-21snmpd21:01:381
131899943,0cyclictest3514-21snmpd20:29:081
131899943,0cyclictest3514-21snmpd20:14:081
131899943,0cyclictest3514-21snmpd19:46:081
131899943,0cyclictest3514-21snmpd19:32:231
131899943,0cyclictest3514-21snmpd19:09:081
131899943,0cyclictest3241-21irqbalance23:32:521
131899943,0cyclictest3241-21irqbalance21:39:421
131899943,0cyclictest21128-21awk21:17:501
131899943,0cyclictest20955-21awk18:57:491
131899943,0cyclictest19990-21awk22:57:471
131899943,0cyclictest12281-21awk22:32:481
131899943,0cyclictest11799-21awk23:12:501
131899942,0cyclictest30501-21awk20:17:501
131889944,0cyclictest0-21swapper/022:43:530
131889944,0cyclictest0-21swapper/021:32:470
131889943,0cyclictest4870-21awk20:22:490
131889943,0cyclictest3241-21irqbalance22:38:420
131889943,0cyclictest3241-21irqbalance21:02:020
131889943,0cyclictest28767-21awk22:02:490
131889943,0cyclictest21818-21awk19:22:470
131889943,0cyclictest20633-21sort21:37:460
131889943,0cyclictest19737-21awk23:37:480
131889943,0cyclictest1923-21awk19:07:500
29725030,0irq/27-eth0-tx-0-21swapper/020:47:460
29725030,0irq/27-eth0-tx-0-21swapper/020:12:590
29725030,0irq/27-eth0-tx-0-21swapper/019:12:440
29715030,0irq/26-eth0-rx-0-21swapper/320:40:253
29715030,0irq/26-eth0-rx-0-21swapper/319:52:463
29715030,0irq/26-eth0-rx-0-21swapper/319:30:383
29715030,0irq/26-eth0-rx-0-21swapper/319:02:453
249930,0watchdog/20-21swapper/219:22:452
169930,0watchdog/10-21swapper/123:52:471
169930,0watchdog/10-21swapper/123:52:471
169930,0watchdog/10-21swapper/123:27:521
169930,0watchdog/10-21swapper/122:52:481
169930,0watchdog/10-21swapper/120:32:561
169930,0watchdog/10-21swapper/119:52:521
131909933,0cyclictest3556-21lldpd20:38:152
131909933,0cyclictest3556-21lldpd18:52:452
131909932,0cyclictest9608-21date20:02:342
131909932,0cyclictest17165-21awk20:07:482
131899932,0cyclictest3514-21snmpd19:49:231
131899932,0cyclictest24839-21awk20:37:491
131899932,0cyclictest12578-21awk20:52:491
131899930,0cyclictest0-21swapper/120:07:451
131889933,0cyclictest9304-21kworker/0:222:32:450
131889933,0cyclictest9304-21kworker/0:222:22:550
131889933,0cyclictest16896-21kworker/0:223:22:430
131889933,0cyclictest14877-21kworker/0:121:52:410
131889933,0cyclictest14877-21kworker/0:121:17:350
131889932,0cyclictest0-21swapper/019:17:450
131889931,0cyclictest0-21swapper/020:02:450
29715020,0irq/26-eth0-rx-0-21swapper/320:17:413
131899921,0cyclictest30531-21ls20:42:341
131899921,0cyclictest0-21swapper/119:17:341
131899920,0cyclictest26648-21latency_hist19:02:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional