You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 07:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 14, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19621252680,3sleep10-21swapper/122:17:441
1776182996455,6cyclictest2090626-21latency_hist00:25:011
1776180996251,8cyclictest1907145-21latency_hist21:20:010
1776180995646,7cyclictest1946690-21latency_hist22:00:000
1776180995444,6cyclictest2095583-21latency_hist00:30:010
1776186995146,4cyclictest2078976-21kworker/u8:2+flush-8:000:12:592
19315412500,6sleep20-21swapper/221:43:022
1776186994641,3cyclictest2000555-21kworker/u8:3+flush-8:022:55:002
1776182994638,6cyclictest275-21systemd-journal22:39:551
1776182994637,6cyclictest275-21systemd-journal20:38:501
1776180994641,3cyclictest425360-21kworker/u8:3+flush-8:020:07:590
1776180994641,3cyclictest425360-21kworker/u8:3+flush-8:020:07:590
1776180994535,8cyclictest2036854-21diskstats23:32:440
1776180994535,8cyclictest2036854-21diskstats23:32:440
1776180994435,6cyclictest1822085-21ntpq19:52:540
1776186994339,3cyclictest1891663-21kworker/u8:0+flush-8:021:25:012
1776180994338,3cyclictest1891663-21kworker/u8:0+flush-8:022:33:010
1776180994335,6cyclictest2089922-21ntpq00:22:580
1776186994238,3cyclictest1761514-21kworker/u8:2+flush-8:019:20:002
1776186994236,4cyclictest1981096-21kworker/u8:2+flush-8:022:48:012
1776182994134,5cyclictest1882887-21apt-get20:57:401
1776180994133,6cyclictest2016834-21diskstats23:12:450
1776180994133,5cyclictest275-21systemd-journal23:48:550
1776186994035,4cyclictest1951634-21kworker/u8:3+flush-8:022:23:012
1776186994035,3cyclictest1891663-21kworker/u8:0+events_unbound22:12:452
1776182994033,5cyclictest275-21systemd-journal22:44:561
1776180994029,9cyclictest1893026-21diskstats21:07:440
1776182993935,3cyclictest2000555-21kworker/u8:3+flush-8:023:42:481
1776182993930,6cyclictest2026025-21latency_hist23:20:001
1776180993930,6cyclictest1832740-21latency_hist20:05:000
1776180993929,7cyclictest1981672-21/usr/sbin/munin22:37:530
1776182993831,5cyclictest1852374-21kworker/u8:1+flush-8:020:32:581
1776182993830,6cyclictest1787185-21ntpq19:17:541
1776180993832,4cyclictest1761514-21kworker/u8:2+flush-8:021:12:480
1776180993828,8cyclictest2070131-21ntpq00:02:520
1776186993732,4cyclictest1981096-21kworker/u8:2+flush-8:023:22:572
1776182993732,4cyclictest1891663-21kworker/u8:0+flush-8:021:58:001
1776182993729,6cyclictest1937244-21apt-get21:52:431
1776182993729,6cyclictest1937244-21apt-get21:52:431
1776180993733,3cyclictest1981096-21kworker/u8:2+flush-8:023:42:550
1776180993730,5cyclictest1956566-21latency_hist22:10:010
1776182993529,5cyclictest1776052-21kworker/u8:0+flush-8:019:28:021
1776182993529,4cyclictest1761514-21kworker/u8:2+flush-8:019:47:451
1776182993528,5cyclictest2076237-21apt-get00:12:441
1776180993528,5cyclictest1857480-21latency_hist20:30:010
1776180993526,7cyclictest1802379-21ntpq19:32:560
1776186993429,3cyclictest425360-21kworker/u8:3+flush-8:021:02:482
1776186993425,6cyclictest275-21systemd-journal21:15:012
1776182993424,7cyclictest275-21systemd-journal20:20:001
1776182993327,5cyclictest1990734-21kworker/u8:1+events_unbound22:47:561
1776182993326,6cyclictest1878174-21cpuspeed_turbos20:52:461
1776182993325,5cyclictest1951614-21latency_hist22:05:011
1776180993327,4cyclictest1951634-21kworker/u8:3+flush-8:022:20:010
1776180993323,7cyclictest1847569-21latency_hist20:20:010
1776182993227,4cyclictest425360-21kworker/u8:3+flush-8:019:57:481
1776182993226,4cyclictest2016130-21turbostat.cron23:10:001
1776182993225,5cyclictest275-21systemd-journal20:04:431
1776182993225,5cyclictest275-21systemd-journal00:38:001
1776182993225,5cyclictest1922417-21/usr/sbin/munin21:37:581
1776182993223,7cyclictest1788640-21apt-get19:22:431
1776182993223,6cyclictest1981240-21latency_hist22:35:011
1776180993229,2cyclictest1926898-21sh21:40:000
1776180993227,4cyclictest2026114-21base6423:20:000
1776180993227,4cyclictest2000555-21kworker/u8:3+events_unbound23:07:580
1776180993226,4cyclictest1863597-21irqrtprio20:37:490
1776180993222,7cyclictest2036151-21latency_hist23:30:000
1776186993126,4cyclictest1776052-21kworker/u8:0+flush-8:019:12:532
1776186993125,4cyclictest1867379-21apt-get20:40:002
1776182993125,4cyclictest1901223-21kthreadcore21:12:531
1776182993125,4cyclictest1808493-21apt-get19:42:411
1776182993123,6cyclictest1874954-21sshd20:47:491
1776180993126,4cyclictest1852374-21kworker/u8:1+flush-8:022:27:570
1776180993126,3cyclictest2056188-21kworker/u8:3+flush-8:023:55:320
1776180993122,4cyclictest275-21systemd-journal20:40:010
1776180993121,8cyclictest1827069-21ntpq19:57:540
17759462314,9sleep20-21swapper/219:09:352
1776186993026,3cyclictest1981096-21kworker/u8:2+flush-8:023:07:542
1776186993025,4cyclictest1761514-21kworker/u8:2+flush-8:020:57:532
1776182993024,4cyclictest1976333-21latency_hist22:30:011
1776180993027,2cyclictest1887415-21systemd-run21:00:010
1776180993026,2cyclictest0-21swapper/019:50:000
1776180993021,6cyclictest275-21systemd-journal19:17:430
1776182992925,3cyclictest844-21mta-sts-daemon21:07:461
1776182992925,3cyclictest401-21dbus-daemon00:20:001
1776182992924,4cyclictest1981096-21kworker/u8:2+flush-8:023:12:491
1776182992923,5cyclictest1981096-21kworker/u8:2+events_unbound23:37:561
1776182992922,5cyclictest2096042-21apt-get00:32:421
1776182992922,5cyclictest2056201-21kworker/u8:4+flush-8:023:57:561
1776180992925,3cyclictest1891663-21kworker/u8:0+events_unbound21:42:510
1776180992922,5cyclictest1848290-21diskstats20:22:460
1776180992921,6cyclictest1917484-21/usr/sbin/munin21:33:000
1776180992921,5cyclictest275-21systemd-journal23:05:000
1776180992919,8cyclictest275-21systemd-journal20:50:000
17756232293,18sleep00-21swapper/019:08:000
1776186992824,3cyclictest1981096-21kworker/u8:2+events_unbound23:12:572
1776186992822,5cyclictest1891663-21kworker/u8:0+flush-8:021:29:572
1776182992824,3cyclictest1852374-21kworker/u8:1-ext4-rsv-conversion21:50:001
1776182992824,3cyclictest1776175-21cyclictest19:33:001
1776182992823,3cyclictest1907152-21/usr/sbin/munin21:20:001
1776182992820,3cyclictest1891663-21kworker/u8:0+events_unbound22:23:281
1776180992824,3cyclictest401-21dbus-daemon21:30:000
1776180992822,3cyclictest0-21swapper/019:22:440
1776180992820,6cyclictest1776052-21kworker/u8:0+events_unbound19:27:440
1776180992820,5cyclictest1882441-21latency_hist20:55:010
1776180992818,8cyclictest2000508-21ntpq22:52:560
1776186992723,3cyclictest1981096-21kworker/u8:2+events_unbound22:43:032
1776186992723,3cyclictest1897263-21idleruntime-cro21:10:002
1776186992723,2cyclictest1873132-21aten2_r5power_v20:47:432
1776186992722,4cyclictest1846824-21kworker/u8:0+flush-8:020:18:022
1776182992723,3cyclictest1981096-21kworker/u8:2+flush-8:023:33:111
1776182992723,3cyclictest1981096-21kworker/u8:2+flush-8:023:33:111
1776182992723,2cyclictest0-21swapper/121:34:501
1776182992722,3cyclictest2056188-21kworker/u8:3+flush-8:023:55:011
1776182992722,3cyclictest1838838-21irqrtprio20:12:461
1776182992721,5cyclictest1990734-21kworker/u8:1+flush-8:022:57:561
1776182992720,3cyclictest275-21systemd-journal23:30:001
1776180992724,2cyclictest1971399-21systemd-run22:25:010
1776180992722,4cyclictest425360-21kworker/u8:3+flush-8:019:11:140
1776180992722,4cyclictest2078976-21kworker/u8:2+flush-8:000:32:310
1776180992718,7cyclictest1861654-21ntpq20:32:530
177618099271,15cyclictest2081626-21/usr/sbin/munin00:17:470
17752242275,15sleep10-21swapper/119:07:531
1776186992623,2cyclictest2007005-21fschecks_time23:02:452
1776186992623,2cyclictest1985947-21unixbench_multi22:38:012
1776186992622,3cyclictest2078976-21kworker/u8:2+flush-8:000:40:002
1776186992622,3cyclictest1832739-21apt20:05:002
1776186992622,2cyclictest1922502-21aten2_r5power_e21:37:452
1776186992621,3cyclictest1802822-21unixbench_multi19:33:022
1776182992623,2cyclictest1961529-21systemd-run22:15:011
1776182992622,3cyclictest425360-21kworker/u8:3+flush-8:019:37:461
1776182992622,2cyclictest0-21swapper/123:48:011
1776182992622,2cyclictest0-21swapper/119:52:531
1776182992621,3cyclictest1761514-21kworker/u8:2+flush-8:020:27:451
1776182992617,7cyclictest2056201-21kworker/u8:4+flush-8:000:07:551
1776182992616,8cyclictest1867416-21http20:40:011
1776182992610,10cyclictest2029325-21kthreadcore23:22:511
1776180992622,3cyclictest1776175-21cyclictest00:07:560
1776180992622,2cyclictest0-21swapper/019:42:430
1776186992522,2cyclictest2086465-21fschecks_time00:22:472
1776186992522,2cyclictest1946441-21unixbench_multi21:58:052
1776186992521,3cyclictest1981096-21kworker/u8:2+flush-8:022:58:172
1776186992520,4cyclictest1761514-21kworker/u8:2+flush-8:020:05:302
1776186992520,4cyclictest1761514-21kworker/u8:2+flush-8:020:05:302
1776186992519,4cyclictest2026153-21gpgv23:20:002
1776186992519,4cyclictest1976113-21unixbench_singl22:28:022
1776182992522,2cyclictest1888192-21cut21:02:451
1776182992521,2cyclictest0-21swapper/100:02:421
1776182992520,3cyclictest1780772-21unixbench_multi19:13:001
1776182992520,3cyclictest0-21swapper/122:08:001
1776182992519,4cyclictest1846824-21kworker/u8:0+flush-8:020:22:491
1776182992511,3cyclictest421rcuog/221:42:551
1776180992520,3cyclictest2029693-21kthreadcore23:22:520
1776180992519,4cyclictest2057119-21tr23:52:480
1776180992519,3cyclictest1852374-21kworker/u8:1+events_unbound21:03:540
19181032240,5sleep3451irq_work/321:32:523
1776186992421,2cyclictest1862222-21unixbench_singl20:33:012
1776186992420,2cyclictest2095333-21unixbench_multi00:28:022
1776186992419,4cyclictest1761514-21kworker/u8:2+events_unbound21:52:492
1776186992419,4cyclictest1761514-21kworker/u8:2+events_unbound21:52:492
1776186992419,3cyclictest1853087-21aten2_r5power_v20:27:432
1776186992418,4cyclictest2078976-21kworker/u8:2+flush-8:000:15:062
1776186992416,6cyclictest275-21systemd-journal22:10:002
1776182992420,3cyclictest1917129-21latency_hist21:30:011
1776182992420,2cyclictest0-21swapper/123:02:551
1776182992419,4cyclictest1761514-21kworker/u8:2+flush-8:020:08:001
1776182992419,4cyclictest1761514-21kworker/u8:2+flush-8:020:08:001
1776180992420,2cyclictest0-21swapper/021:52:480
1776180992420,2cyclictest0-21swapper/021:52:480
1776180992419,4cyclictest1951634-21kworker/u8:3+flush-8:022:42:540
1776180992419,3cyclictest1808116-21latency_hist19:40:010
1776186992320,2cyclictest1848330-21fschecks_count20:22:462
1776186992318,4cyclictest1919908-21kthreadcore21:32:542
1776182992318,3cyclictest0-21swapper/122:55:011
1776180992319,3cyclictest1961279-21unixbench_multi22:13:040
1776180992319,2cyclictest0-21swapper/023:00:000
1776180992318,3cyclictest1936269-21mailstats21:48:000
1776180992318,3cyclictest0-21swapper/023:37:490
1776180992317,5cyclictest2078976-21kworker/u8:2+flush-8:000:15:000
1776186992218,3cyclictest1981096-21kworker/u8:2+flush-8:023:32:562
1776186992218,3cyclictest1981096-21kworker/u8:2+flush-8:023:32:562
1776186992218,2cyclictest1807814-21unixbench_singl19:38:012
1776186992218,2cyclictest0-21swapper/220:45:012
1776186992213,7cyclictest275-21systemd-journal00:05:012
1776182992217,4cyclictest2078976-21kworker/u8:2+flush-8:000:27:461
1776180992215,5cyclictest2078976-21kworker/u8:2+flush-8:000:37:510
1776186992117,3cyclictest1761514-21kworker/u8:2+events_unbound21:17:502
1776186992115,4cyclictest2075517-21unixbench_multi00:08:022
1776186992113,6cyclictest1951359-21unixbench_multi22:03:032
1776186992112,2cyclictest0-21swapper/219:42:412
1776182992117,2cyclictest0-21swapper/121:23:021
1776180992117,2cyclictest0-21swapper/022:47:460
1776180992117,2cyclictest0-21swapper/021:22:420
1776180992116,4cyclictest1761514-21kworker/u8:2+flush-8:020:12:550
1776180992116,3cyclictest0-21swapper/022:02:510
1776186992017,2cyclictest2051720-21fschecks_count23:47:442
1776186992016,3cyclictest1981096-21kworker/u8:2+flush-8:023:42:562
1776186992016,2cyclictest0-21swapper/222:33:022
1776186992015,4cyclictest425360-21kworker/u8:3+flush-8:020:50:062
1776186992015,4cyclictest2078976-21kworker/u8:2+flush-8:000:33:332
17711262202,9sleep30-21swapper/319:05:023
19997602190,2sleep3451irq_work/322:52:533
177618699192,12cyclictest2041553-21apt-get23:37:412
1776186991916,2cyclictest850-21mta-sts-daemon23:57:482
1776186991915,2cyclictest0-21swapper/223:28:002
1776186991814,3cyclictest1842367-21unixbench_singl20:12:592
1776186991812,4cyclictest0-21swapper/222:17:512
1776186991810,6cyclictest1933912-21cut21:47:502
1776186991714,2cyclictest0-21swapper/219:27:532
1776186991713,2cyclictest0-21swapper/219:52:432
1776186991713,2cyclictest0-21swapper/219:23:022
1776186991712,4cyclictest1981096-21kworker/u8:2+flush-8:023:50:212
1776186991612,2cyclictest1813697-21fschecks_count19:47:452
1776186991611,3cyclictest1825901-21kthreadcore19:57:522
19311132156,6sleep30-21swapper/321:42:563
19509092142,8sleep30-21swapper/322:02:583
19026842142,8sleep30-21swapper/321:17:443
18521212145,5sleep30-21swapper/320:23:033
20062032132,7sleep30-21swapper/323:00:003
18972922132,6sleep30-21swapper/321:10:023
18725862132,6sleep30-21swapper/320:45:023
20927512122,6sleep30-21swapper/300:27:523
20857172122,5sleep30-21swapper/300:20:013
20817312122,6sleep30-21swapper/300:17:493
20760012122,5sleep30-21swapper/300:10:023
20662562122,6sleep30-21swapper/300:01:563
20609572122,6sleep30-21swapper/323:55:023
20561722122,6sleep30-21swapper/323:50:123
20542592122,6sleep30-21swapper/323:47:513
20383112122,6sleep30-21swapper/323:32:513
20383112122,6sleep30-21swapper/323:32:513
20356792122,6sleep30-21swapper/323:28:013
20282882122,6sleep30-21swapper/323:22:513
20114102122,5sleep30-21swapper/323:05:023
19863852122,5sleep30-21swapper/322:40:023
19857312122,6sleep30-21swapper/322:38:013
19787572122,6sleep30-21swapper/322:32:523
19759292122,6sleep30-21swapper/322:28:023
19667322122,6sleep30-21swapper/322:20:563
19615832122,6sleep30-21swapper/322:15:023
19571892120,3chrt575-21kworker/3:2+mm_percpu_wq22:12:453
19558482122,7sleep30-21swapper/322:07:563
19424302122,6sleep30-21swapper/321:57:503
19370792122,6sleep30-21swapper/321:50:543
19370792122,6sleep30-21swapper/321:50:543
19220152122,5sleep30-21swapper/321:35:013
19129452122,6sleep30-21swapper/321:27:473
18972242122,6sleep30-21swapper/321:09:453
18840252122,6sleep30-21swapper/320:57:503
18582702122,6sleep30-21swapper/320:32:463
18529472122,6sleep30-21swapper/320:27:413
18430112123,5sleep30-21swapper/320:17:413
18392232122,6sleep30-21swapper/320:12:473
18287482122,6sleep30-21swapper/320:02:483
18271862122,6sleep30-21swapper/319:57:593
18138842122,6sleep30-21swapper/319:47:483
18080602122,5sleep30-21swapper/319:40:013
17886452124,5sleep30-21swapper/319:22:443
17810412122,5sleep30-21swapper/319:15:013
21007442112,5sleep30-21swapper/300:35:023
21004662113,5sleep30-21swapper/300:34:303
20712802112,6sleep30-21swapper/300:07:293
20460982112,5sleep30-21swapper/323:40:023
20414902112,6sleep30-21swapper/323:37:123
20210802112,5sleep30-21swapper/323:15:013
20203532112,6sleep30-21swapper/323:12:563
20069412112,5sleep30-21swapper/323:02:453
19915922112,5sleep30-21swapper/322:45:033
19361102112,5sleep30-21swapper/321:47:573
19111642112,6sleep30-21swapper/321:22:543
18882992113,5sleep30-21swapper/321:02:473
18793922112,5sleep30-21swapper/320:52:523
18686072112,5sleep30-21swapper/320:42:493
18628752112,5sleep30-21swapper/320:37:433
18327612112,5sleep30-21swapper/320:05:013
18327612112,5sleep30-21swapper/320:05:013
18183362112,5sleep30-21swapper/319:52:413
18033422112,5sleep30-21swapper/319:35:283
17983282112,5sleep30-21swapper/319:30:023
17941402112,5sleep30-21swapper/319:27:493
17762842102,5sleep30-21swapper/319:10:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional