You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu May 14, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
357727873,0sleep00-21swapper/018:53:250
365025049,0sleep20-21swapper/218:54:152
304450360,0irq/25-eth10-21swapper/318:55:193
336223324,0sleep10-21swapper/118:51:101
38559960,0cyclictest1884-21diskmemload22:25:182
38559960,0cyclictest0-21swapper/223:50:452
38559960,0cyclictest0-21swapper/220:05:562
38539960,0cyclictest1884-21diskmemload23:49:071
38539960,0cyclictest0-21swapper/122:23:591
38529960,0cyclictest0-21swapper/000:08:480
339960,0migration/331675-21sh23:32:233
339960,0migration/326071-21fschecks_count22:50:533
339960,0migration/323259-21sh00:07:373
339960,0migration/315554-21sh00:24:193
29725060,0irq/27-eth0-tx-5048-21munin-node19:21:050
29715060,0irq/26-eth0-rx-8673-21ssh21:36:353
29715060,0irq/26-eth0-rx-31268-21sh00:12:373
29715060,0irq/26-eth0-rx-11389-21iostat_ios21:40:563
29715060,0irq/26-eth0-rx-0-21swapper/323:50:233
29715060,0irq/26-eth0-rx-0-21swapper/322:45:563
27160,0ktimersoftd/20-21swapper/223:02:592
19160,0ktimersoftd/11884-21diskmemload20:57:261
149960,0migration/08949-21sh21:37:220
149960,0migration/07902-21sh23:18:030
149960,0migration/07868-21sh22:36:360
149960,0migration/04953-21kthreadcore21:15:590
149960,0migration/032571-21sh22:11:550
149960,0migration/017763-21sh21:24:060
149960,0migration/016437-21sh23:03:420
38559955,0cyclictest0-21swapper/223:23:482
38559955,0cyclictest0-21swapper/223:09:182
38559955,0cyclictest0-21swapper/200:15:122
38559955,0cyclictest0-21swapper/200:10:182
38559954,0cyclictest11154-21cat21:00:582
38559950,0cyclictest0-21swapper/223:33:532
38559950,0cyclictest0-21swapper/223:14:302
38559950,0cyclictest0-21swapper/222:40:362
38559950,0cyclictest0-21swapper/222:03:052
38559950,0cyclictest0-21swapper/221:12:002
38559950,0cyclictest0-21swapper/200:18:592
38559950,0cyclictest0-21swapper/200:05:252
38539955,0cyclictest0-21swapper/122:05:421
38539955,0cyclictest0-21swapper/122:04:451
38539954,0cyclictest9851-21grep23:20:551
38539954,0cyclictest11287-21awk21:40:551
38539950,0cyclictest0-21swapper/123:13:581
38539950,0cyclictest0-21swapper/122:42:171
38539950,0cyclictest0-21swapper/121:28:581
38529955,0cyclictest0-21swapper/023:47:210
38529955,0cyclictest0-21swapper/021:02:170
38529954,0cyclictest27435-21wc21:30:560
38529950,0cyclictest0-21swapper/022:55:480
38529950,0cyclictest0-21swapper/022:34:120
339950,0migration/36267-21kthreadcore21:15:593
339950,0migration/36017-21rt-features00:16:023
339950,0migration/327116-21unixbench_multi20:46:053
339950,0migration/326786-21aten_r1power_po21:10:523
339950,0migration/32367-21fschecks_time22:15:543
339950,0migration/32245-21munin-node22:35:543
339950,0migration/321465-21irqrtprio20:20:593
339950,0migration/31785-21latency_hist21:55:413
339950,0migration/316994-21latency_hist23:25:413
339950,0migration/315333-21munin-node20:40:553
339950,0migration/315185-21kthreadcore22:00:593
339950,0migration/31513-21taskset20:51:363
339950,0migration/313798-21kthreadcore23:01:003
339950,0migration/311854-21unixbench-2d19:46:063
339950,0migration/310846-21munin-node19:00:533
339950,0migration/310703-21kthreadcore20:35:583
29725050,0irq/27-eth0-tx-0-21swapper/020:24:410
29725050,0irq/27-eth0-tx-0-21swapper/019:31:010
29715050,0irq/26-eth0-rx-7752-21ssh23:17:363
29715050,0irq/26-eth0-rx-7628-21memory20:56:023
29715050,0irq/26-eth0-rx-28453-21kthreadcore23:50:583
29715050,0irq/26-eth0-rx-27651-21kworker/3:021:00:573
29715050,0irq/26-eth0-rx-25616-21ssh22:09:523
29715050,0irq/26-eth0-rx-24886-21taskset23:09:583
29715050,0irq/26-eth0-rx-24749-21taskset19:56:013
29715050,0irq/26-eth0-rx-24117-21ssh21:26:003
29715050,0irq/26-eth0-rx-18605-21gltestperf22:25:553
29715050,0irq/26-eth0-rx-18396-21telnet21:45:523
29715050,0irq/26-eth0-rx-1786-21fschecks_count22:55:543
29715050,0irq/26-eth0-rx-17341-21latency_hist19:05:433
29715050,0irq/26-eth0-rx-16730-21ssh21:21:063
29715050,0irq/26-eth0-rx-14290-21munin-node00:01:013
29715050,0irq/26-eth0-rx-0-21swapper/323:40:593
29715050,0irq/26-eth0-rx-0-21swapper/323:36:083
29715050,0irq/26-eth0-rx-0-21swapper/323:20:593
29715050,0irq/26-eth0-rx-0-21swapper/322:32:273
29715050,0irq/26-eth0-rx-0-21swapper/322:20:593
29715050,0irq/26-eth0-rx-0-21swapper/322:11:293
29715050,0irq/26-eth0-rx-0-21swapper/321:55:543
29715050,0irq/26-eth0-rx-0-21swapper/321:32:523
29715050,0irq/26-eth0-rx-0-21swapper/321:05:573
249950,0watchdog/25066-21kthreadcore20:56:002
179950,0migration/16153-21irqcore19:20:581
179950,0migration/124736-21munin-node00:10:531
179950,0migration/12276-21munin-node22:55:571
179950,0migration/117729-21taskset21:04:291
169950,0watchdog/122034-21idleruntime20:45:561
149950,0migration/0885-21munin-node20:51:010
149950,0migration/06948-21taskset23:36:120
149950,0migration/06436-21sh23:56:030
149950,0migration/05284-21unixbench_singl19:41:050
149950,0migration/03774-21kthreadcore20:56:000
149950,0migration/032559-21kthreadcore19:15:590
149950,0migration/028244-21kthreadcore21:10:580
149950,0migration/026119-21fschecks_count22:50:530
149950,0migration/025551-21munin-node00:10:570
149950,0migration/025100-21cpuspeed_turbos23:50:530
149950,0migration/023635-21needreboot22:05:590
149950,0migration/018068-21kthreadcore20:40:580
149950,0migration/015665-21sh22:21:040
149950,0migration/015426-21sh00:23:560
149950,0migration/011646-21kthreadcore00:00:570
38559943,0cyclictest3556-21lldpd19:01:082
38559943,0cyclictest3514-21snmpd22:00:402
38559943,0cyclictest3514-21snmpd19:41:392
38559943,0cyclictest3241-21irqbalance21:50:502
38559943,0cyclictest3241-21irqbalance21:46:002
38559943,0cyclictest3241-21irqbalance21:17:102
38559943,0cyclictest3241-21irqbalance20:25:512
38559943,0cyclictest3241-21irqbalance20:21:312
38559943,0cyclictest3241-21irqbalance20:11:112
38559943,0cyclictest3241-21irqbalance19:56:012
38559943,0cyclictest3241-21irqbalance19:50:512
38559943,0cyclictest3241-21irqbalance19:46:212
38559943,0cyclictest3241-21irqbalance19:36:012
38559943,0cyclictest3241-21irqbalance19:31:212
38559943,0cyclictest3241-21irqbalance19:26:212
38559943,0cyclictest3241-21irqbalance19:22:212
38559943,0cyclictest3241-21irqbalance19:11:112
38559943,0cyclictest3241-21irqbalance19:05:512
38559943,0cyclictest31589-21awk19:15:572
38559943,0cyclictest2006-21awk20:30:582
38559943,0cyclictest19550-21awk21:25:562
38559943,0cyclictest17599-21munin-node22:45:582
38559943,0cyclictest1628-21awk23:35:572
38559943,0cyclictest14429-21awk20:15:552
38559943,0cyclictest11908-21kthreadcore23:40:592
38539944,0cyclictest0-21swapper/123:58:541
38539944,0cyclictest0-21swapper/122:54:341
38539944,0cyclictest0-21swapper/122:11:321
38539943,0cyclictest7754-21awk20:10:561
38539943,0cyclictest5722-21sadc19:45:431
38539943,0cyclictest3556-21lldpd23:40:411
38539943,0cyclictest3556-21lldpd23:07:411
38539943,0cyclictest3556-21lldpd22:35:421
38539943,0cyclictest3556-21lldpd22:30:421
38539943,0cyclictest3556-21lldpd22:30:111
38539943,0cyclictest3556-21lldpd21:55:411
38539943,0cyclictest3556-21lldpd20:54:411
38539943,0cyclictest3556-21lldpd19:13:091
38539943,0cyclictest3556-21lldpd19:00:091
38539943,0cyclictest2992-21awk21:55:561
38539943,0cyclictest17964-21awk23:25:551
38529944,0cyclictest0-21swapper/023:30:290
38529944,0cyclictest0-21swapper/023:15:120
38529944,0cyclictest0-21swapper/021:56:120
38529943,0cyclictest22081-21awk20:45:570
38529943,0cyclictest19412-21awk21:05:570
38529943,0cyclictest19233-21awk21:45:560
38529943,0cyclictest18556-21awk22:45:570
38529943,0cyclictest11313-21awk21:40:560
38529943,0cyclictest1115-21awk20:05:570
38529943,0cyclictest1079-21awk00:15:550
339940,0migration/316201-21kthreadcore19:50:593
29725040,0irq/27-eth0-tx-9052-21ssh21:37:402
29725040,0irq/27-eth0-tx-25526-21ssh22:30:272
29725040,0irq/27-eth0-tx-1884-21diskmemload22:31:502
29725040,0irq/27-eth0-tx-0-21swapper/223:56:392
29725040,0irq/27-eth0-tx-0-21swapper/223:45:512
29725040,0irq/27-eth0-tx-0-21swapper/223:28:302
29725040,0irq/27-eth0-tx-0-21swapper/223:15:532
29725040,0irq/27-eth0-tx-0-21swapper/222:57:322
29725040,0irq/27-eth0-tx-0-21swapper/222:50:432
29725040,0irq/27-eth0-tx-0-21swapper/222:43:232
29725040,0irq/27-eth0-tx-0-21swapper/222:05:582
29725040,0irq/27-eth0-tx-0-21swapper/221:32:082
29725040,0irq/27-eth0-tx-0-21swapper/221:06:002
29725040,0irq/27-eth0-tx-0-21swapper/200:23:282
29725040,0irq/27-eth0-tx-0-21swapper/020:30:550
29725040,0irq/27-eth0-tx-0-21swapper/019:56:020
29725040,0irq/27-eth0-tx-0-21swapper/019:51:040
29715040,0irq/26-eth0-rx-0-21swapper/323:56:153
29715040,0irq/26-eth0-rx-0-21swapper/323:10:583
29715040,0irq/26-eth0-rx-0-21swapper/322:45:033
29715040,0irq/26-eth0-rx-0-21swapper/319:40:593
259940,0migration/225836-21kthreadcore20:46:002
259940,0migration/212333-21kthreadcore21:40:572
249940,0watchdog/20-21swapper/222:14:242
249940,0watchdog/20-21swapper/221:20:522
249940,0watchdog/20-21swapper/220:41:002
249940,0watchdog/20-21swapper/220:01:012
249940,0watchdog/20-21swapper/218:55:572
179940,0migration/17656-21sensors_temp22:16:031
179940,0migration/16203-21cpuspeed_turbos19:45:551
179940,0migration/14301-21kthreadcore23:15:571
179940,0migration/127727-21kthreadcore19:35:581
179940,0migration/127495-21idleruntime21:10:551
179940,0migration/120248-21kthreadcore19:05:591
179940,0migration/119459-21cpu19:55:541
179940,0migration/116167-21sh00:05:171
179940,0migration/114129-21taskset20:38:221
179940,0migration/112522-21kthreadcore23:00:591
179940,0migration/112231-21kthreadcore19:00:581
179940,0migration/110997-21kthreadcore00:20:581
169940,0watchdog/18037-21missed_timers21:16:001
169940,0watchdog/125108-21ssh21:07:201
169940,0watchdog/124116-21ssh00:10:081
169940,0watchdog/120020-21grep20:41:001
169940,0watchdog/115604-21sh23:43:041
169940,0watchdog/10-21swapper/121:32:321
169940,0watchdog/10-21swapper/100:16:001
149940,0migration/022287-21kthreadcore23:06:000
149940,0migration/020571-21kthreadcore22:25:580
149940,0migration/016346-21kthreadcore19:26:000
149940,0migration/015329-21kthreadcore20:15:570
149940,0migration/013335-21kthreadcore23:40:590
149940,0migration/012559-21kthreadcore22:00:590
149940,0migration/010764-21irqcore22:40:580
149940,0migration/010646-21latency_hist19:00:430
8215030,0irq/24-0000:00:0-21swapper/220:50:432
38559932,0cyclictest7895-21munin-node20:36:002
38539933,0cyclictest3556-21lldpd20:18:401
38539933,0cyclictest13618-21awk19:50:571
38539932,0cyclictest32558-21sensors20:26:041
38539932,0cyclictest26900-21awk20:00:591
38539932,0cyclictest25944-21awk23:30:571
38539932,0cyclictest25874-21sensors20:21:041
38539932,0cyclictest25692-21awk23:50:551
38539932,0cyclictest1977-21grep19:15:591
38539932,0cyclictest18491-21awk22:45:561
38529933,0cyclictest4068-21kworker/0:223:30:430
38529933,0cyclictest4068-21kworker/0:223:20:430
38529933,0cyclictest4068-21kworker/0:222:15:430
38529933,0cyclictest4068-21kworker/0:221:50:430
38529933,0cyclictest4068-21kworker/0:221:25:470
38529933,0cyclictest4068-21kworker/0:220:35:460
38529933,0cyclictest4068-21kworker/0:220:25:440
38529933,0cyclictest4068-21kworker/0:220:10:460
38529933,0cyclictest4068-21kworker/0:220:00:440
38529933,0cyclictest4068-21kworker/0:219:45:440
38529933,0cyclictest4068-21kworker/0:219:35:440
38529933,0cyclictest4068-21kworker/0:219:10:440
38529933,0cyclictest4068-21kworker/0:219:05:440
38529933,0cyclictest4068-21kworker/0:219:00:460
29715030,0irq/26-eth0-rx-0-21swapper/320:30:593
29715030,0irq/26-eth0-rx-0-21swapper/320:25:533
29715030,0irq/26-eth0-rx-0-21swapper/320:18:193
29715030,0irq/26-eth0-rx-0-21swapper/320:10:533
29715030,0irq/26-eth0-rx-0-21swapper/320:05:463
29715030,0irq/26-eth0-rx-0-21swapper/320:01:083
29715030,0irq/26-eth0-rx-0-21swapper/319:35:523
29715030,0irq/26-eth0-rx-0-21swapper/319:26:013
29715030,0irq/26-eth0-rx-0-21swapper/319:21:393
29715030,0irq/26-eth0-rx-0-21swapper/319:16:173
29715030,0irq/26-eth0-rx-0-21swapper/318:55:543
249930,0watchdog/20-21swapper/222:15:522
19130,0ktimersoftd/10-21swapper/120:10:081
169930,0watchdog/18611-21ssh21:36:241
169930,0watchdog/123169-1kworker/1:1H21:45:521
169930,0watchdog/110783-21aten2.4-expect21:20:521
169930,0watchdog/10-21swapper/120:31:001
169930,0watchdog/10-21swapper/119:31:011
169930,0watchdog/10-21swapper/119:25:571
29715020,0irq/26-eth0-rx-19568-21irqrtprio19:30:593
29715020,0irq/26-eth0-rx-0-21swapper/319:12:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional