You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 08:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jul 27, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450720,0irq/25-eth10-21swapper/318:46:003
630324334,0sleep20-21swapper/218:45:472
625223424,0sleep10-21swapper/118:45:141
636123026,0sleep00-21swapper/018:46:290
66279960,0cyclictest2958-21ssh21:25:050
66279960,0cyclictest19869-21needreboot19:18:580
35160,0ktimersoftd/30-21swapper/322:19:173
339960,0migration/37529-21fschecks_time18:48:523
339960,0migration/33465-21munin-node20:19:033
339960,0migration/327593-21fschecks_count22:23:523
339960,0migration/312866-21munin-node00:13:563
29715060,0irq/26-eth0-rx-31431-21open_files23:03:593
29715060,0irq/26-eth0-rx-19115-21kthreadcore23:18:563
149960,0migration/06936-21sh23:29:040
149960,0migration/032607-21sh23:05:570
149960,0migration/032439-21sh23:27:320
149960,0migration/031022-21taskset23:45:220
149960,0migration/027130-21aten_r1power_fr22:23:500
149960,0migration/026606-21sh21:39:200
8215050,0irq/24-0000:00:29640-21cat20:18:392
66299950,0cyclictest0-21swapper/222:19:122
66299950,0cyclictest0-21swapper/221:38:312
66299950,0cyclictest0-21swapper/220:55:292
66289950,0cyclictest0-21swapper/122:28:291
66289950,0cyclictest0-21swapper/122:20:081
66289950,0cyclictest0-21swapper/100:11:071
66279955,0cyclictest0-21swapper/022:05:080
66279955,0cyclictest0-21swapper/021:03:200
66279950,0cyclictest0-21swapper/023:15:360
66279950,0cyclictest0-21swapper/021:34:230
66279950,0cyclictest0-21swapper/021:14:030
339950,0migration/38291-21kthreadcore20:48:573
339950,0migration/37399-21sh23:52:403
339950,0migration/36913-21kthreadcore20:23:553
339950,0migration/35541-21kthreadcore19:33:553
339950,0migration/329656-21cpuspeed_turbos21:03:513
339950,0migration/329318-21taskset20:15:383
339950,0migration/326216-21taskset23:23:543
339950,0migration/325755-21munin-node18:58:583
339950,0migration/324260-21fschecks_count00:03:543
339950,0migration/32338-21switchtime21:24:033
339950,0migration/322166-21pmu-power23:39:003
339950,0migration/321725-21fschecks_time19:23:533
339950,0migration/321618-21taskset19:44:523
339950,0migration/320051-21latency_hist18:58:393
339950,0migration/319708-21sh21:58:423
339950,0migration/319131-21kthreadcore19:18:573
339950,0migration/316684-21hwlatdetect23:58:523
339950,0migration/31589-21sh22:48:263
339950,0migration/31589-21sh22:48:263
339950,0migration/315254-21taskset19:43:323
339950,0migration/314569-21kthreadcore22:53:563
339950,0migration/313289-21munin-node21:33:533
339950,0migration/312964-21kthreadcore20:03:553
339950,0migration/312395-21kthreadcore22:33:553
339950,0migration/311761-21munin-node22:13:543
29725050,0irq/27-eth0-tx-5119-21perl21:28:512
29725050,0irq/27-eth0-tx-26858-21munin-node19:04:032
29725050,0irq/27-eth0-tx-25829-21munin-node23:03:582
29725050,0irq/27-eth0-tx-21136-21munin-node19:23:532
29725050,0irq/27-eth0-tx-16752-21if_err_eth1.223:58:532
29725050,0irq/27-eth0-tx-16487-21munin-node20:09:012
29725050,0irq/27-eth0-tx-14485-21munin-node19:19:012
29725050,0irq/27-eth0-tx-1394-21ssh22:47:512
29725050,0irq/27-eth0-tx-1394-21ssh22:47:512
29725050,0irq/27-eth0-tx-13560-21munin-node23:53:592
29725050,0irq/27-eth0-tx-0-21swapper/222:39:352
29725050,0irq/27-eth0-tx-0-21swapper/221:24:022
29725050,0irq/27-eth0-tx-0-21swapper/200:13:382
29715050,0irq/26-eth0-rx-9443-21grep23:33:523
29715050,0irq/26-eth0-rx-5132-21fschecks_time21:28:513
29715050,0irq/26-eth0-rx-30923-21seq23:45:043
29715050,0irq/26-eth0-rx-2804-21kthreadcore00:08:573
29715050,0irq/26-eth0-rx-2003-21kthreadcore23:28:553
29715050,0irq/26-eth0-rx-11550-21ssh21:10:013
29715050,0irq/26-eth0-rx-0-21swapper/323:11:183
29715050,0irq/26-eth0-rx-0-21swapper/322:58:563
29715050,0irq/26-eth0-rx-0-21swapper/322:39:563
29715050,0irq/26-eth0-rx-0-21swapper/322:10:433
29715050,0irq/26-eth0-rx-0-21swapper/321:52:523
29715050,0irq/26-eth0-rx-0-21swapper/321:44:593
29715050,0irq/26-eth0-rx-0-21swapper/321:20:003
29715050,0irq/26-eth0-rx-0-21swapper/320:58:593
29715050,0irq/26-eth0-rx-0-21swapper/320:56:443
29715050,0irq/26-eth0-rx-0-21swapper/320:38:553
259950,0migration/27948-21aten_r1power_po19:13:522
259950,0migration/228680-21latency_hist21:23:392
259950,0migration/224927-21turbostat23:23:382
259950,0migration/220672-21munin-node21:58:542
259950,0migration/213747-21sh00:14:522
259950,0migration/213324-21kthreadcore22:33:562
249950,0watchdog/231797-21ssh23:47:442
179950,0migration/15372-21munin-node21:28:531
179950,0migration/15283-21kthreadcore19:33:551
179950,0migration/129903-21switchtime20:38:591
179950,0migration/124029-21munin-node22:38:581
179950,0migration/122426-21kthreadcore21:18:561
179950,0migration/118681-21gltestperf22:58:521
179950,0migration/11756-21munin-node23:08:521
179950,0migration/115564-21munin-node22:53:581
179950,0migration/114745-21irqrtprio18:53:571
179950,0migration/114448-21kthreadcore22:13:581
169950,0watchdog/113797-21kthreadcore23:33:561
169950,0watchdog/113261-21cpu21:13:531
149950,0migration/06664-21kthreadcore21:48:560
149950,0migration/06231-21irqcore20:48:560
149950,0migration/05822-21sh00:09:530
149950,0migration/04049-21kthreadcore19:33:550
149950,0migration/02713-21kthreadcore23:48:580
149950,0migration/025202-21needreboot21:58:580
149950,0migration/023414-21kthreadcore19:23:560
149950,0migration/022202-21kthreadcore20:33:560
149950,0migration/020493-21kthreadcore22:38:550
149950,0migration/018963-21kthreadcore20:08:550
149950,0migration/015284-21kthreadcore22:53:560
149950,0migration/012752-21kthreadcore20:03:550
149950,0migration/012539-21kthreadcore22:33:560
149950,0migration/01222-21kthreadcore21:03:570
149950,0migration/011347-21sh22:13:520
149950,0migration/011005-21timerandwakeup21:09:010
149950,0migration/010192-21kthreadcore19:38:560
8215040,0irq/24-0000:00:0-21swapper/221:43:392
66299943,0cyclictest9692-21awk19:38:542
66299943,0cyclictest4863-21awk21:48:542
66299943,0cyclictest3556-21lldpd23:39:232
66299943,0cyclictest30753-21awk20:18:552
66299943,0cyclictest29768-21awk19:53:542
66299943,0cyclictest24761-21awk00:03:562
66299943,0cyclictest14460-21awk18:53:562
66299943,0cyclictest11724-21awk20:28:542
66299943,0cyclictest10922-21awk22:53:532
66289944,0cyclictest0-21swapper/123:43:411
66289944,0cyclictest0-21swapper/121:10:261
66289943,0cyclictest4744-21awk21:48:531
66289943,0cyclictest4114-21awk22:08:551
66289943,0cyclictest3556-21lldpd23:29:531
66289943,0cyclictest3556-21lldpd23:26:531
66289943,0cyclictest3514-21snmpd23:50:071
66289943,0cyclictest3514-21snmpd23:23:371
66289943,0cyclictest3514-21snmpd21:59:371
66289943,0cyclictest3514-21snmpd21:40:371
66289943,0cyclictest3514-21snmpd21:28:371
66289943,0cyclictest3514-21snmpd20:52:371
66289943,0cyclictest3514-21snmpd19:40:071
66289943,0cyclictest3241-21irqbalance21:03:571
66289943,0cyclictest30729-21awk20:18:551
66289943,0cyclictest2917-21awk22:48:521
66289943,0cyclictest24664-21awk00:03:551
66289943,0cyclictest17419-21awk20:08:541
66289943,0cyclictest16363-21awk19:43:551
66289940,0cyclictest0-21swapper/123:16:251
66279943,0cyclictest3604-21sadc21:48:390
66279943,0cyclictest3567-21awk22:28:520
66279943,0cyclictest3514-21snmpd23:59:220
66279943,0cyclictest3241-21irqbalance22:59:570
66279943,0cyclictest3241-21irqbalance00:14:160
66279943,0cyclictest312-21grep19:04:030
66279943,0cyclictest26037-21kworker/0:220:41:520
66279943,0cyclictest23068-21awk19:48:550
66279943,0cyclictest21937-21awk21:18:540
66279943,0cyclictest20444-21sort22:18:560
66279943,0cyclictest1982-21awk19:08:540
66279943,0cyclictest14397-21awk18:53:550
339940,0migration/35543-21kthreadcore22:28:543
339940,0migration/32314-21irqrtprio19:08:553
339940,0migration/318666-21kthreadcore20:08:553
339940,0migration/314033-21kthreadcore21:53:563
339940,0migration/312606-21kthreadcore23:53:573
339940,0migration/311034-21kthreadcore19:13:583
29725040,0irq/27-eth0-tx-8925-21ssh22:51:122
29725040,0irq/27-eth0-tx-7690-21ssh23:09:162
29725040,0irq/27-eth0-tx-30712-21kthreadcore21:03:562
29725040,0irq/27-eth0-tx-24167-21munin-node20:38:492
29725040,0irq/27-eth0-tx-21142-21ssh20:58:472
29725040,0irq/27-eth0-tx-0-21swapper/223:34:162
29725040,0irq/27-eth0-tx-0-21swapper/223:28:522
29725040,0irq/27-eth0-tx-0-21swapper/222:58:432
29725040,0irq/27-eth0-tx-0-21swapper/222:23:542
29725040,0irq/27-eth0-tx-0-21swapper/222:13:582
29725040,0irq/27-eth0-tx-0-21swapper/221:38:502
29725040,0irq/27-eth0-tx-0-21swapper/221:14:042
29725040,0irq/27-eth0-tx-0-21swapper/218:58:542
29715040,0irq/26-eth0-rx-12532-21kthreadcore23:13:583
29715040,0irq/26-eth0-rx-0-21swapper/322:49:003
29715040,0irq/26-eth0-rx-0-21swapper/322:04:363
29715040,0irq/26-eth0-rx-0-21swapper/321:38:573
29715040,0irq/26-eth0-rx-0-21swapper/321:13:593
259940,0migration/26063-21sh21:08:542
259940,0migration/231927-21irqcore20:43:562
259940,0migration/228049-21kthreadcore23:23:552
259940,0migration/22613-21aten_r1power_en22:28:482
259940,0migration/215866-21df_abs19:43:532
259940,0migration/21105-21irqcore23:48:572
249940,0watchdog/29581-21kthreadcore20:48:572
249940,0watchdog/215970-21kthreadcore21:53:572
249940,0watchdog/210422-21iostat_ios23:13:562
249940,0watchdog/20-21swapper/222:08:572
249940,0watchdog/20-21swapper/222:03:532
249940,0watchdog/20-21swapper/220:04:012
249940,0watchdog/20-21swapper/219:48:572
179940,0migration/18711-21kthreadcore18:48:551
179940,0migration/13757-21fschecks_time19:58:521
179940,0migration/131932-21kthreadcore19:53:561
179940,0migration/131300-21fschecks_count20:43:531
179940,0migration/125857-21kthreadcore20:58:591
179940,0migration/122997-21idleruntime19:48:541
179940,0migration/121277-21aten_r1power_vo19:23:511
179940,0migration/120706-21taskset19:21:301
179940,0migration/117450-21kthreadcore23:58:551
179940,0migration/115883-21kthreadcore20:28:571
179940,0migration/113947-21kthreadcore22:33:561
179940,0migration/113268-21ntp_kernel_pll_19:14:001
179940,0migration/112846-21munin-node21:33:511
179940,0migration/110695-21kthreadcore23:53:561
179940,0migration/110593-21gltestperf20:03:521
169940,0watchdog/128163-21tune2fs22:03:531
169940,0watchdog/127843-21kthreadcore22:43:571
169940,0watchdog/127843-21kthreadcore22:43:571
169940,0watchdog/118320-21ssh21:55:091
169940,0watchdog/10-21swapper/123:40:321
169940,0watchdog/10-21swapper/123:03:561
169940,0watchdog/10-21swapper/120:13:531
149940,0migration/09691-21latency_hist20:03:390
149940,0migration/09515-21idleruntime23:33:530
149940,0migration/08037-21kthreadcore20:23:550
149940,0migration/05248-21kthreadcore23:08:560
149940,0migration/029814-21kthreadcore22:43:570
149940,0migration/029814-21kthreadcore22:43:570
149940,0migration/019662-21kthreadcore23:18:560
149940,0migration/013452-21kthreadcore21:53:560
149940,0migration/01137-21kthreadcore20:43:570
66299932,0cyclictest32128-21cut19:28:572
66299930,0cyclictest0-21swapper/219:08:592
66289933,0cyclictest13922-21awk20:53:561
66289932,0cyclictest4776-21cut20:23:511
66289932,0cyclictest3514-21snmpd20:38:071
66289932,0cyclictest31021-21kthreadcore19:28:561
66289932,0cyclictest27725-21awk19:03:541
66289932,0cyclictest23128-21kthreadcore18:58:551
66289930,0cyclictest6215-21kthreadcore22:28:541
66279933,0cyclictest26037-21kworker/0:220:53:420
66279933,0cyclictest26037-21kworker/0:220:28:440
66279933,0cyclictest26037-21kworker/0:220:18:420
66279933,0cyclictest26037-21kworker/0:220:13:500
66279933,0cyclictest26037-21kworker/0:219:53:400
66279933,0cyclictest26037-21kworker/0:219:43:400
66279933,0cyclictest26037-21kworker/0:219:28:410
66279933,0cyclictest26037-21kworker/0:219:13:430
66279933,0cyclictest26037-21kworker/0:218:58:410
66279933,0cyclictest26037-21kworker/0:218:48:410
66279933,0cyclictest13806-21kworker/0:123:53:410
66279933,0cyclictest13806-21kworker/0:123:38:400
66279933,0cyclictest13806-21kworker/0:122:48:520
66279933,0cyclictest13806-21kworker/0:122:08:440
66279933,0cyclictest13806-21kworker/0:121:28:420
66279933,0cyclictest13806-21kworker/0:100:03:450
29725030,0irq/27-eth0-tx-17493-21munin-node20:33:582
29725030,0irq/27-eth0-tx-0-21swapper/219:58:512
29715030,0irq/26-eth0-rx-0-21swapper/320:43:513
29715030,0irq/26-eth0-rx-0-21swapper/320:37:053
29715030,0irq/26-eth0-rx-0-21swapper/319:58:553
29715030,0irq/26-eth0-rx-0-21swapper/319:53:513
29715030,0irq/26-eth0-rx-0-21swapper/319:50:133
29715030,0irq/26-eth0-rx-0-21swapper/319:03:513
249930,0watchdog/27706-21munin-node18:48:532
249930,0watchdog/27610-21munin-node19:33:572
249930,0watchdog/20-21swapper/220:25:092
169930,0watchdog/12080-21ssh21:44:091
169930,0watchdog/11897-21munin-node19:08:531
169930,0watchdog/10-21swapper/100:14:161
29715020,0irq/26-eth0-rx-0-21swapper/320:30:223
29715020,0irq/26-eth0-rx-0-21swapper/319:28:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional