You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 17:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Jul 21, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209543599227214,11cyclictest2350130-21apt-get11:25:022
226961321740,3sleep3577-21kworker/3:2+mm_percpu_wq10:02:523
209542599150132,16cyclictest0-21swapper/011:25:020
24087092910,2chrt0-21swapper/212:22:502
22163362880,3chrt451irq_work/309:10:003
23058492680,4sleep10-21swapper/110:40:011
2095429996561,3cyclictest0-21swapper/111:25:021
23643182630,1sleep02364319-21needreboot11:37:500
23643182630,1sleep02364319-21needreboot11:37:500
22876952510,4sleep0201rcuc/010:22:470
2095425995141,7cyclictest278-21systemd-journal12:20:010
2095429994932,15cyclictest278-21systemd-journal09:23:441
2095425994942,5cyclictest2251073-21latency_hist09:45:010
2095429994829,3cyclictest2415845-21irqcore12:32:461
2095435994740,5cyclictest278-21systemd-journal08:40:002
2095425994330,3cyclictest2117654-21kworker/u8:2+flush-8:008:12:580
2095425994231,8cyclictest2375052-21true11:50:010
209078324228,9sleep10-21swapper/107:07:191
2095435994134,5cyclictest2100418-21gpgv07:15:012
209542599401,36cyclictest1-21systemd07:40:000
2095429993829,7cyclictest2191947-21/usr/sbin/munin08:47:571
2095425993826,9cyclictest278-21systemd-journal07:45:000
20917252382,7sleep30-21swapper/307:07:493
2095435993730,5cyclictest278-21systemd-journal08:10:012
2095435993730,5cyclictest278-21systemd-journal08:10:002
2095429993728,7cyclictest2132241-21latency_hist07:45:011
2095425993728,7cyclictest2107820-21/usr/sbin/munin07:22:570
2095425993727,8cyclictest2399772-21apt-get12:15:000
2095429993627,7cyclictest2414862-21latency_hist12:30:011
2095425993630,4cyclictest2117654-21kworker/u8:2+flush-8:009:47:430
2095425993630,4cyclictest2095299-21kworker/u8:3+flush-8:008:42:570
2095435993522,10cyclictest278-21systemd-journal10:47:452
2095429993522,10cyclictest278-21systemd-journal11:10:011
2095425993530,4cyclictest2095299-21kworker/u8:3+flush-8:009:57:570
2095425993530,4cyclictest2095299-21kworker/u8:3+flush-8:009:32:440
2095425993527,6cyclictest2266531-21/usr/sbin/munin10:02:580
2095425993428,4cyclictest2226243-21apt-key09:20:000
2095425993428,4cyclictest2226243-21apt-key09:20:000
2095429993324,7cyclictest2191564-21cat08:45:011
2095425993326,5cyclictest2117654-21kworker/u8:2+events_unbound09:12:550
2095429993223,7cyclictest2286312-21/usr/sbin/munin10:22:571
2095429993222,8cyclictest2345483-21apt-get11:21:381
2095429993222,7cyclictest278-21systemd-journal07:40:011
2095435993127,2cyclictest2424718-21cron12:40:002
2095429993126,3cyclictest2186583-21cron08:40:001
2095429993123,6cyclictest2325835-21apt-get11:02:371
2095425993123,6cyclictest2196476-21latency_hist08:50:010
2095425993121,7cyclictest2280927-21latency_hist10:15:010
2095425993120,8cyclictest2142804-21diskstats07:57:400
2095429993025,3cyclictest2283544-21kthreadcore10:17:481
2095429993024,4cyclictest2315969-21apt-get10:52:361
2095429993023,5cyclictest2320903-21apt-get10:57:371
2095429993022,6cyclictest2241156-21latency_hist09:35:011
2095429993019,8cyclictest278-21systemd-journal08:32:451
2095425993024,4cyclictest2117654-21kworker/u8:2+events_unbound09:52:410
2095425993024,4cyclictest2095299-21kworker/u8:3+events_unbound11:45:000
209542599301,24cyclictest2127293-21kworker/0:1+events09:26:270
209543599296,8cyclictest2246606-21cut09:42:382
209543599291,16cyclictest0-21swapper/208:48:292
2095429992926,2cyclictest2266096-21sendmail10:00:001
2095429992924,3cyclictest2384918-21turbostat.cron12:00:001
2095429992924,3cyclictest2280203-21ntpq10:12:521
2095429992924,3cyclictest2166835-21systemctl08:20:001
2095429992921,6cyclictest278-21systemd-journal10:50:011
2095425992925,3cyclictest2058669-21kworker/u8:1+events_unbound07:32:450
2095425992920,6cyclictest2216240-21latency_hist09:10:000
2095425992919,8cyclictest2210551-21ntpq09:02:520
2095425992918,9cyclictest2294994-21ntpq10:27:490
209542599291,24cyclictest2127293-21kworker/0:1+events07:50:350
2095435992824,2cyclictest2305417-21unixbench_singl10:37:582
2095435992821,5cyclictest278-21systemd-journal12:17:432
2095429992824,2cyclictest0-21swapper/110:30:001
2095429992823,3cyclictest2386119-21irqrtprio12:02:481
2095429992822,4cyclictest2250879-21unixbench_singl09:42:571
2095429992818,8cyclictest2099567-21ntpq07:12:521
2095429992816,10cyclictest2157634-21diskstats08:12:451
2095425992824,2cyclictest0-21swapper/007:15:000
209542599282,25cyclictest2127293-21kworker/0:1+events08:59:350
2095425992820,6cyclictest2325810-21/usr/sbin/munin11:02:540
2095425992820,5cyclictest2409951-21latency_hist12:25:010
209542599281,26cyclictest2127293-21kworker/0:1+events10:31:150
20946172282,9sleep02094664-21ps07:07:580
2095435992723,2cyclictest2191268-21unixbench_multi08:43:002
2095435992722,3cyclictest0-21swapper/209:05:002
2095435992721,4cyclictest2113029-21cpuspeed_turbos07:27:422
2095429992722,4cyclictest2058669-21kworker/u8:1+flush-8:007:22:511
209542599276,20cyclictest2127293-21kworker/0:1+events12:06:350
209542599276,20cyclictest2127293-21kworker/0:1+events08:18:400
2095425992723,3cyclictest2117654-21kworker/u8:2+flush-8:008:52:440
209542599272,24cyclictest2127293-21kworker/0:1+events12:33:240
209542599272,24cyclictest2127293-21kworker/0:1+events11:53:230
2095425992721,4cyclictest2305381-21unixbench_multi10:37:580
2095425992721,1cyclictest0-21swapper/011:22:580
2095425992719,6cyclictest2315297-21grep10:47:580
209542599271,25cyclictest2127293-21kworker/0:1+events10:17:150
209542599271,25cyclictest2127293-21kworker/0:1+events09:37:030
209543599268,6cyclictest0-21swapper/210:30:002
209543599264,12cyclictest2177583-21awk08:32:452
2095429992622,3cyclictest2133280-21irqcore07:47:461
2095429992621,3cyclictest0-21swapper/111:35:001
2095429992620,4cyclictest2095299-21kworker/u8:3+events_unbound11:17:411
2095429992618,6cyclictest2152423-21/usr/sbin/munin08:07:581
2095429992618,6cyclictest2152423-21/usr/sbin/munin08:07:581
2095429992615,3cyclictest0-21swapper/109:52:571
209542599266,19cyclictest2127293-21kworker/0:1+events10:05:510
209542599266,18cyclictest2127293-21kworker/0:1+events08:05:480
209542599266,18cyclictest2127293-21kworker/0:1+events08:05:470
2095425992621,4cyclictest2095299-21kworker/u8:3+flush-8:012:28:490
2095425992621,3cyclictest2185797-21needreboot08:37:520
2095425992619,5cyclictest2107360-21cron07:20:000
2095425992618,6cyclictest2360235-21latency_hist11:35:000
2095425992617,7cyclictest2310585-21latency_hist10:45:010
209542599260,25cyclictest2127293-21kworker/0:1+events10:59:190
2095435992521,2cyclictest2320935-21aten2_r5power_c10:57:392
2095435992521,2cyclictest2217047-21fschecks_time09:12:432
2095435992521,2cyclictest2151784-21unixbench_singl08:03:002
2095435992520,3cyclictest2316320-21fschecks_time10:52:412
2095435992513,8cyclictest2299917-21ntpq10:32:522
2095435992510,11cyclictest2306101-21apt-get10:42:382
209543599250,9cyclictest2350184-21munin-run11:25:002
2095429992522,2cyclictest2197195-21cut08:52:431
2095429992521,2cyclictest2407615-21kthreadcore12:22:481
2095429992521,2cyclictest0-21swapper/108:02:591
2095429992520,3cyclictest2207412-21irqcore09:02:461
2095429992520,3cyclictest0-21swapper/112:10:001
2095429992519,5cyclictest2058669-21kworker/u8:1+flush-8:007:32:141
2095429992516,7cyclictest2111686-21kworker/u8:0+flush-8:007:27:541
209542599256,18cyclictest2127293-21kworker/0:1+events08:30:230
209542599251,19cyclictest2127293-21kworker/0:1+events11:05:110
2095435992421,2cyclictest371rcuc/210:13:232
2095435992421,2cyclictest371rcuc/207:43:182
2095435992418,4cyclictest2330111-21unixbench_singl11:02:562
2095429992421,2cyclictest2170964-21needreboot08:22:501
2095429992419,3cyclictest0-21swapper/109:10:011
2095429992418,4cyclictest2275669-21wc10:07:591
2095429992418,4cyclictest2225914-21unixbench_singl09:18:001
2095429992418,4cyclictest2225914-21unixbench_singl09:17:591
2095429992415,7cyclictest2255163-21grep09:47:491
2095425992419,3cyclictest2117038-21unixbench_multi07:27:580
2095425992418,4cyclictest2095299-21kworker/u8:3+events_unbound07:47:550
209543599235,5cyclictest0-21swapper/209:45:332
2095435992320,2cyclictest2162432-21aten2_r5power_v08:17:402
2095435992319,2cyclictest2241142-21cron09:35:002
209543599231,6cyclictest2157930-21sed08:12:482
209543599231,11cyclictest2202754-21irqstats08:57:472
2095435992310,9cyclictest2101506-21kthreadcore07:15:032
2095429992319,2cyclictest0-21swapper/112:12:561
2095429992319,2cyclictest0-21swapper/111:52:571
2095429992319,2cyclictest0-21swapper/110:42:401
2095429992319,2cyclictest0-21swapper/109:27:451
2095429992319,2cyclictest0-21swapper/107:52:571
2095429992318,4cyclictest395-21dbus-daemon12:40:001
2095429992318,4cyclictest2374835-21unixbench_singl11:48:001
2095429992317,4cyclictest2296211-21apt-get10:32:391
2095429992312,3cyclictest0-21swapper/108:57:531
209542599232,20cyclictest2127293-21kworker/0:1+events12:02:230
2095425992318,3cyclictest0-21swapper/008:02:430
2095425992316,5cyclictest2117654-21kworker/u8:2+events_unbound09:25:000
2095425992315,6cyclictest2335684-21apt-get11:12:390
209542599231,21cyclictest2127293-21kworker/0:1+events12:36:150
209542599231,21cyclictest2127293-21kworker/0:1+events08:24:150
209543599225,6cyclictest0-21swapper/211:17:582
209543599224,5cyclictest0-21swapper/207:20:092
209543599223,5cyclictest39-21ksoftirqd/207:32:432
2095435992218,2cyclictest2271777-21fschecks_count10:07:432
2095435992218,2cyclictest2256648-21cpuspeed_turbos09:52:422
2095435992210,9cyclictest2397126-21tr12:12:472
209543599220,7cyclictest2126619-21ntpq07:37:562
2095429992218,2cyclictest0-21swapper/107:15:021
2095429992217,4cyclictest2402935-21kthreadcore12:17:501
2095429992217,3cyclictest0-21swapper/111:45:001
2095429992217,3cyclictest0-21swapper/108:30:011
2095429992213,7cyclictest2364450-21ntpq11:37:541
2095429992213,7cyclictest2364450-21ntpq11:37:531
209542599222,19cyclictest2127293-21kworker/0:1+events11:56:470
209542599222,19cyclictest2127293-21kworker/0:1+events11:16:510
209542599222,19cyclictest2127293-21kworker/0:1+events10:50:190
2095425992214,6cyclictest2172211-21apt-get08:27:400
209543599216,4cyclictest0-21swapper/211:15:002
209543599215,5cyclictest0-21swapper/211:52:192
209543599215,5cyclictest0-21swapper/211:45:172
209543599215,5cyclictest0-21swapper/209:16:162
209543599215,5cyclictest0-21swapper/209:16:162
209543599214,9cyclictest0-21swapper/208:29:352
209543599214,5cyclictest0-21swapper/212:26:092
209543599214,5cyclictest0-21swapper/209:26:432
2095435992117,2cyclictest2137842-21cpuspeed_turbos07:52:422
2095435992113,4cyclictest2419066-21ntpq12:32:522
2095435992113,3cyclictest2394087-21ntpq12:07:532
2095435992112,4cyclictest2355729-21apt-get11:32:412
2095435992112,4cyclictest2171089-21ntpq08:22:542
2095429992117,2cyclictest0-21swapper/110:02:491
2095429992117,2cyclictest0-21swapper/109:37:391
2095429992117,2cyclictest0-21swapper/107:57:511
2095429992115,4cyclictest0-21swapper/111:12:431
209543599204,5cyclictest0-21swapper/211:41:522
209543599204,4cyclictest0-21swapper/210:23:042
209543599204,4cyclictest0-21swapper/208:50:162
209543599204,3cyclictest23868382tr12:02:492
209543599203,5cyclictest0-21swapper/209:35:102
209543599202,5cyclictest0-21swapper/211:57:322
209543599202,4cyclictest0-21swapper/209:07:432
2095435992011,7cyclictest278-21systemd-journal10:05:002
2095435992011,4cyclictest2226823-21apt-get09:22:412
20908042204,12sleep20-21swapper/207:07:352
209543599194,5cyclictest0-21swapper/207:49:382
209543599194,4cyclictest0-21swapper/211:36:422
209543599194,4cyclictest0-21swapper/211:36:422
209543599194,4cyclictest0-21swapper/211:06:412
209543599193,4cyclictest0-21swapper/210:18:282
209543599192,4cyclictest0-21swapper/209:56:572
2095429991915,3cyclictest2217227-21sort09:12:451
209543599183,4cyclictest0-21swapper/207:57:552
23991622140,10sleep30-21swapper/312:12:563
23607562146,5sleep30-21swapper/311:37:433
23607562146,5sleep30-21swapper/311:37:423
24108632132,7sleep30-21swapper/312:27:453
23750222132,6sleep30-21swapper/311:50:013
22809362132,6sleep30-21swapper/310:15:013
22268252132,7sleep30-21swapper/309:22:413
22261022130,7sleep30-21swapper/309:20:003
22261022130,7sleep30-21swapper/309:20:003
22018712132,6sleep30-21swapper/308:57:423
21908792134,6sleep30-21swapper/308:42:573
21767082132,6sleep30-21swapper/308:30:013
21073582132,7sleep30-21swapper/307:20:003
24148832122,5sleep30-21swapper/312:30:013
24002832122,6sleep30-21swapper/312:15:453
23813502123,5sleep30-21swapper/311:57:483
23696762122,6sleep30-21swapper/311:42:593
23493602122,6sleep30-21swapper/311:22:533
23382772122,6sleep30-21swapper/311:12:513
23258392122,6sleep30-21swapper/311:02:393
23147332123,6sleep30-21swapper/310:47:513
22953512122,6sleep30-21swapper/310:27:573
22714842122,6sleep30-21swapper/310:07:393
22559922122,6sleep30-21swapper/309:50:013
22465642122,6sleep30-21swapper/309:42:393
22416232122,6sleep30-21swapper/309:37:423
22163362122,5sleep30-21swapper/309:10:023
22074452122,6sleep30-21swapper/309:02:473
21925082122,6sleep30-21swapper/308:47:473
21819222122,6sleep30-21swapper/308:35:553
21759202122,6sleep30-21swapper/308:27:533
21618892122,6sleep30-21swapper/308:15:013
21371942122,6sleep30-21swapper/307:50:013
21279662122,6sleep30-21swapper/307:42:443
21225642122,6sleep30-21swapper/307:35:453
21127772122,6sleep30-21swapper/307:27:403
24200472113,5sleep30-21swapper/312:35:073
24053142112,6sleep30-21swapper/312:21:233
23902782112,5sleep30-21swapper/312:07:393
23853632112,6sleep30-21swapper/312:02:373
23790132113,5sleep30-21swapper/311:52:503
23559772112,5sleep30-21swapper/311:32:443
23507382112,6sleep30-21swapper/311:27:033
23311462112,5sleep30-21swapper/311:07:453
23214332112,5sleep30-21swapper/310:57:463
23157532112,6sleep30-21swapper/310:50:113
23060032112,6sleep30-21swapper/310:41:453
23009582112,6sleep30-21swapper/310:35:513
22958842112,5sleep30-21swapper/310:30:013
22862022112,6sleep30-21swapper/310:21:153
22807452112,5sleep30-21swapper/310:13:003
22623922112,5sleep30-21swapper/309:57:483
22514512112,5sleep30-21swapper/309:47:083
22378492112,6sleep30-21swapper/309:32:483
22317292112,5sleep30-21swapper/309:27:393
22006482112,5sleep30-21swapper/308:52:523
21672312112,6sleep30-21swapper/308:22:073
21578862112,6sleep30-21swapper/308:12:483
21523702112,6sleep30-21swapper/308:06:583
21523702112,6sleep30-21swapper/308:06:583
21478232112,6sleep30-21swapper/308:02:453
21423642112,6sleep30-21swapper/307:55:313
21329742112,6sleep30-21swapper/307:47:453
21218672112,5sleep30-21swapper/307:33:003
21076692112,6sleep30-21swapper/307:20:453
20952762112,5sleep30-21swapper/307:10:023
23404132102,5sleep30-21swapper/311:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional