You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 17:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Aug 05, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203201523750,1sleep3575-21kworker/3:2-events11:52:563
203637521810,6sleep30-21swapper/311:57:493
19682602560,5chrt0-21swapper/010:47:570
1894068994737,7cyclictest1931894-21latency_hist10:10:010
1894072994638,6cyclictest1893909-21latency_hist07:10:001
189407499392,17cyclictest1986893-21apt-get11:07:492
1894072993933,4cyclictest1981500-21apt-key11:00:001
189407499382,18cyclictest2036257-21apt-get11:57:482
1894072993832,4cyclictest2060675-21munin-run12:20:001
1894068993833,4cyclictest1927225-21kworker/u8:1+events_unbound11:27:560
1894068993829,6cyclictest275-21systemd-journal11:57:530
1894074993724,11cyclictest2061375-21cpuspeed_turbos12:22:522
1894074993724,11cyclictest2061375-21cpuspeed_turbos12:22:522
1894074993722,13cyclictest2066431-21aten2_r5power_e12:27:492
1894074993722,13cyclictest1927608-21cpuspeed_turbos10:07:522
1894074993721,14cyclictest2015827-21unixbench_singl11:33:102
1894072993733,2cyclictest1972580-21irqrtprio10:52:561
1894072993631,3cyclictest1992537-21irqrtprio11:12:561
1894068993629,5cyclictest1997105-21fschecks_time11:17:520
1894068993627,7cyclictest1932709-21fschecks_time10:12:540
1894074993521,12cyclictest1942469-21cpuspeed_turbos10:22:512
1894074993518,14cyclictest1911207-21idleruntime-cro09:10:002
1894072993529,4cyclictest1899209-21cron07:35:001
1894072993528,5cyclictest1902302-21cron08:00:001
1894068993526,7cyclictest2061126-21/usr/sbin/munin12:23:060
1894068993526,7cyclictest2061126-21/usr/sbin/munin12:23:060
1894068993526,7cyclictest1966447-21cron10:45:000
189407499340,18cyclictest2011133-21true11:30:012
1894072993425,6cyclictest275-21systemd-journal12:09:111
1894068993429,3cyclictest0-21swapper/010:18:080
1894068993427,5cyclictest1904161-21cron08:15:000
1894068993425,7cyclictest2016017-21cron11:35:000
1894074993329,2cyclictest275-21systemd-journal11:00:002
1894074993324,7cyclictest275-21systemd-journal11:50:002
1894074993318,13cyclictest2075854-21latency_hist12:35:002
1894074993318,13cyclictest1996272-21cron11:15:002
189407499330,18cyclictest2046722-21taskset12:07:562
1894072993329,2cyclictest1909951-21cron09:00:001
1894072993328,3cyclictest1901725-21systemd-run07:55:001
1894072993326,5cyclictest1911194-21cron09:10:001
1894072993324,7cyclictest1957033-21/usr/sbin/munin10:38:081
1894072993324,7cyclictest1956582-21cron10:35:001
1894068993327,4cyclictest0-21swapper/012:20:000
1894068993326,5cyclictest2080754-21cron12:40:000
1894068993326,5cyclictest2046512-21fschecks_count12:07:540
1894068993326,5cyclictest1991105-21unixbench_multi11:08:070
1894068993326,5cyclictest1900466-21cron07:45:000
189406899331,30cyclictest1894761-21kworker/0:0+events07:25:200
189407499321,28cyclictest1941222-21/usr/sbin/munin10:18:052
189407499320,13cyclictest2016492-21apt-get11:37:492
189407499320,13cyclictest1971858-21apt-get10:52:472
1894072993227,3cyclictest1897745-21cron07:25:001
1894072993227,3cyclictest1897745-21cron07:25:001
1894072993226,4cyclictest1971193-21unixbench_singl10:48:081
1894072993225,5cyclictest1941755-21cron10:20:001
1894068993226,4cyclictest1977020-21cpuspeed_turbos10:57:520
1894068993226,4cyclictest1922731-21fschecks_count10:02:540
1894068993225,5cyclictest2025130-21needreboot11:43:000
1894074993123,6cyclictest1908246-21base6408:45:012
189407299318,13cyclictest1926178-21ld10:03:041
1894072993126,3cyclictest2011138-21systemd-run11:30:011
1894072993125,4cyclictest2066601-21cpuspeed_turbos12:27:501
1894072993125,4cyclictest1917678-21cpuspeed_turbos09:57:471
1894072993125,4cyclictest1917678-21cpuspeed_turbos09:57:471
1894072993124,5cyclictest1932624-21fschecks_count10:12:531
1894072993123,6cyclictest1907265-21latency_hist08:40:011
189407299311,26cyclictest2036200-21sd-pam11:57:531
1894068993125,4cyclictest1976100-21unixbench_multi10:53:080
1894068993125,4cyclictest1946686-21cron10:25:000
1894068993123,7cyclictest2055492-21unixbench_singl12:13:080
189406899312,28cyclictest1976349-21kworker/0:2+events11:53:060
18936582313,3sleep00-21swapper/007:06:540
1894074993024,4cyclictest2025663-21unixbench_multi11:43:082
1894072993024,4cyclictest2001212-21cron11:19:591
1894072993024,4cyclictest1914518-21cron09:35:001
1894072993024,4cyclictest1897114-21cron07:20:001
1894072993023,5cyclictest2001825-21aten2_r5power_v11:22:531
1894072993023,5cyclictest1905406-21cron08:25:001
1894072993022,6cyclictest275-21systemd-journal12:35:011
1894072993022,6cyclictest1982210-21cpuspeed_turbos11:02:511
1894072993015,4cyclictest2033446-21kthreadcore11:52:581
189406899307,13cyclictest2075464-21/usr/sbin/munin12:33:070
1894068993025,3cyclictest2005400-21needreboot11:23:030
1894068993025,3cyclictest1907897-21apt08:45:010
1894068993024,4cyclictest1982205-21cpuspeed_turbos11:02:510
1894068993024,4cyclictest1957349-21fschecks_count10:37:540
18936052304,10sleep20-21swapper/207:06:122
189407499291,24cyclictest1898373-21apt-get07:30:022
1894072992921,6cyclictest275-21systemd-journal11:38:121
1894072992918,3cyclictest161rcu_preempt11:47:531
1894068992923,5cyclictest1881799-21kworker/u8:0+flush-8:007:15:000
1894068992920,7cyclictest1995596-21ntpq11:13:040
189407499281,23cyclictest2051171-21apt-get12:12:482
1894074992812,13cyclictest1913062-21turbostat.cron09:25:002
1894074992810,16cyclictest0-21swapper/209:57:542
1894074992810,16cyclictest0-21swapper/209:57:542
1894072992822,4cyclictest2025906-21cron11:45:001
1894072992822,4cyclictest1908725-21cron08:50:001
189407299280,16cyclictest1991297-21taskset11:09:271
189406899286,14cyclictest0-21swapper/008:15:190
1894068992824,2cyclictest0-21swapper/007:20:000
1894068992823,3cyclictest2045777-21systemd-run12:05:000
189407499277,17cyclictest2001699-21sort11:22:502
189407499277,16cyclictest0-21swapper/207:59:322
1894074992719,6cyclictest275-21systemd-journal08:50:022
1894074992718,7cyclictest275-21systemd-journal07:39:062
1894074992711,14cyclictest275-21systemd-journal12:40:002
189407499270,23cyclictest1904169-21apt08:15:002
1894072992722,3cyclictest2055505-21unixbench_singl12:13:081
1894072992721,4cyclictest1942565-21fschecks_time10:22:531
1894072992720,5cyclictest1904241-21latency_hist08:15:001
1894072992718,6cyclictest275-21systemd-journal10:08:121
1894072992715,4cyclictest161rcu_preempt11:32:561
189406899274,5cyclictest2026380-21apt-get11:47:490
189406899273,13cyclictest0-21swapper/009:26:230
1894068992722,3cyclictest1899838-21cron07:40:000
1894068992721,4cyclictest1915761-21cron09:45:000
1894068992721,4cyclictest1907897-21apt-get08:45:030
189407499262,21cyclictest1986434-21munin-run11:05:002
1894074992618,5cyclictest275-21systemd-journal07:29:592
189407499261,21cyclictest275-21systemd-journal08:30:002
189407499261,21cyclictest1962243-21/usr/sbin/munin10:42:542
189407499261,21cyclictest1904791-21latency_hist08:20:002
1894074992612,12cyclictest1957145-21aten2_r5power_p10:37:522
1894074992612,12cyclictest0-21swapper/212:02:482
1894074992611,13cyclictest0-21swapper/210:47:562
1894074992611,13cyclictest0-21swapper/208:50:422
1894074992610,14cyclictest1897755-21turbostat.cron07:25:002
1894074992610,14cyclictest1897755-21turbostat.cron07:25:002
189407499260,23cyclictest2056105-21seq12:17:282
189407499260,22cyclictest2032190-21/usr/sbin/munin11:52:562
189407499260,22cyclictest1996716-21seq11:17:392
189407499260,22cyclictest1952306-21/usr/sbin/munin10:32:502
189407299266,10cyclictest0-21swapper/112:22:501
189407299266,10cyclictest0-21swapper/112:22:501
189407299264,13cyclictest0-21swapper/109:53:451
1894072992622,2cyclictest1913909-21cron09:30:001
1894072992622,2cyclictest0-21swapper/112:37:561
1894072992622,2cyclictest0-21swapper/108:35:001
189406899269,9cyclictest0-21swapper/009:04:360
189406899266,10cyclictest1917433-21munin-node09:57:430
189406899266,10cyclictest1917433-21munin-node09:57:430
189406899264,8cyclictest1901570-21taskset07:53:270
189406899263,13cyclictest0-21swapper/009:33:490
189406899263,12cyclictest2066381-21aten2_r5power_c12:27:490
1894068992622,3cyclictest1912489-21latency_hist09:20:000
1894068992622,2cyclictest0-21swapper/008:05:000
1894068992621,3cyclictest0-21swapper/008:55:010
189407499258,14cyclictest0-21swapper/210:27:582
189407499252,18cyclictest1922465-21apt-get10:02:492
189407499251,21cyclictest1909980-21tr09:00:002
189407499251,20cyclictest275-21systemd-journal07:40:362
189407499250,22cyclictest1932193-21chrt10:11:002
189407499250,21cyclictest1916417-21grep09:50:002
189407499250,21cyclictest1912634-21cut09:20:012
189407299256,4cyclictest0-21swapper/110:43:051
1894072992521,3cyclictest1904797-21idleruntime-cro08:20:001
1894072992521,2cyclictest1947879-21irqrtprio10:27:561
1894072992520,3cyclictest1916374-21cron09:50:001
1894072992520,3cyclictest1907885-21cron08:45:001
1894072992519,4cyclictest2045523-21unixbench_multi12:03:061
1894072992519,4cyclictest1898642-21apt-key07:30:011
1894072992515,8cyclictest275-21systemd-journal08:05:001
189406899256,5cyclictest1955842-21ntpq10:33:000
189406899254,9cyclictest1947595-21if_enp4s010:27:540
189406899254,8cyclictest0-21swapper/007:49:540
1894068992521,3cyclictest1911242-21latency_hist09:10:010
1894068992517,2cyclictest161rcu_preempt09:54:240
1894068992516,2cyclictest161rcu_preempt11:37:530
189406899251,16cyclictest0-21swapper/007:33:000
189407499246,15cyclictest0-21swapper/209:01:222
189407499241,20cyclictest1915790-21true09:45:002
189407499241,20cyclictest1906767-21date08:35:012
189407499240,22cyclictest1915154-21awk09:40:002
189407499240,21cyclictest1914684-21chrt09:35:022
189407299247,4cyclictest0-21swapper/109:15:001
189407299243,12cyclictest0-21swapper/109:18:591
189407299243,12cyclictest0-21swapper/108:51:421
1894072992420,2cyclictest0-21swapper/109:05:001
189407299240,14cyclictest1915479-21taskset09:41:161
189406899244,10cyclictest1897782-21/usr/sbin/munin07:25:000
189406899244,10cyclictest1897782-21/usr/sbin/munin07:25:000
1894068992419,3cyclictest851-21mta-sts-daemon08:21:080
189406899241,13cyclictest0-21swapper/008:08:230
19715492230,2sleep3471rcuc/310:50:013
189407499235,15cyclictest0-21swapper/208:08:022
189407499234,16cyclictest0-21swapper/209:50:052
189407499234,16cyclictest0-21swapper/209:10:292
189407499234,16cyclictest0-21swapper/207:51:092
189407499230,21cyclictest1897118-21cron07:20:002
189407499230,20cyclictest1894386-21taskset07:12:342
189407299239,4cyclictest0-21swapper/109:24:221
189407299231,8cyclictest1915067-21runrttasks09:39:111
189407299231,8cyclictest1900112-21taskset07:40:211
189407299231,8cyclictest1894193-21runrttasks07:10:011
189407299230,10cyclictest1900773-21runrttasks07:45:561
189406899233,8cyclictest573-21runrttasks09:22:020
189406899233,6cyclictest0-21swapper/008:35:110
189406899232,7cyclictest0-21swapper/008:58:030
1894068992319,3cyclictest1915183-21systemd-run09:40:000
1894068992316,1cyclictest161rcu_preempt09:12:070
1894068992312,5cyclictest161rcu_preempt08:28:350
1894068992311,2cyclictest161rcu_preempt09:49:320
189406899231,12cyclictest0-21swapper/007:57:280
189407499225,14cyclictest0-21swapper/207:45:152
189407499221,18cyclictest1913917-21apt09:30:002
189407499220,20cyclictest1902618-21chrt08:00:482
189407499220,18cyclictest1907442-21latency_hist08:40:012
189407299221,8cyclictest1903170-21taskset08:05:021
1894072992210,2cyclictest161rcu_preempt08:27:471
189406899222,7cyclictest0-21swapper/008:30:060
189407499213,16cyclictest0-21swapper/208:21:182
189407299217,5cyclictest0-21swapper/107:38:381
20416112180,2sleep3471rcuc/312:02:513
18938322183,9sleep30-21swapper/307:09:143
20700122133,6sleep30-21swapper/312:28:003
20461942132,7sleep30-21swapper/312:07:493
19992912133,7sleep30-21swapper/311:17:583
19326152133,6sleep30-21swapper/310:12:543
19073032132,6sleep30-21swapper/308:40:023
20758742122,6sleep30-21swapper/312:35:023
20570422122,6sleep30-21swapper/312:17:573
20271092122,6sleep30-21swapper/311:47:553
20226272122,6sleep30-21swapper/311:42:583
20208092122,6sleep30-21swapper/311:38:123
19805632123,5sleep30-21swapper/310:58:043
19715492122,6sleep30-21swapper/310:50:023
19635142122,6sleep30-21swapper/310:42:593
19565792122,5sleep30-21swapper/310:35:013
19468382122,5sleep30-21swapper/310:25:023
19460802122,6sleep30-21swapper/310:23:053
19275642123,5sleep30-21swapper/310:07:533
19189892122,6sleep30-21swapper/309:57:543
19189892122,6sleep30-21swapper/309:57:543
19139332122,5sleep30-21swapper/309:30:013
19066312122,5sleep30-21swapper/308:35:003
19032172122,6sleep30-21swapper/308:05:393
18993352122,5sleep30-21swapper/307:35:023
18945662122,6sleep30-21swapper/307:15:003
20614372112,5sleep30-21swapper/312:22:543
20614372112,5sleep30-21swapper/312:22:543
20512042112,5sleep30-21swapper/312:12:513
20113422112,5sleep30-21swapper/311:30:063
20103652112,5sleep30-21swapper/311:28:013
20016672112,6sleep30-21swapper/311:22:363
19916432113,5sleep30-21swapper/311:10:563
19901992112,5sleep30-21swapper/311:07:593
19823222112,5sleep30-21swapper/311:02:543
19521022113,5sleep30-21swapper/310:32:493
19372462112,5sleep30-21swapper/310:17:483
19260382112,5sleep30-21swapper/310:03:033
19167422112,5sleep30-21swapper/309:51:483
19156842112,5sleep30-21swapper/309:44:013
19151272112,5sleep30-21swapper/309:40:003
19135272112,6sleep30-21swapper/309:25:043
19126772112,5sleep30-21swapper/309:20:023
19106152112,5sleep30-21swapper/309:05:023
19098692113,5sleep30-21swapper/308:59:003
19092642112,5sleep30-21swapper/308:54:063
19087222110,7sleep30-21swapper/308:50:013
19055062112,5sleep30-21swapper/308:25:013
19043942112,5sleep30-21swapper/308:15:023
19024462112,5sleep30-21swapper/308:00:023
19001432112,5sleep30-21swapper/307:40:443
18990942112,5sleep30-21swapper/307:33:353
18982772112,5sleep30-21swapper/307:28:563
18973642112,5sleep30-21swapper/307:20:023
18973642112,5sleep30-21swapper/307:20:023
18967652113,5sleep30-21swapper/307:15:283
20711162102,5sleep30-21swapper/312:30:043
19159972102,4sleep30-21swapper/309:45:023
19121082102,5sleep30-21swapper/309:15:533
19114942102,5sleep30-21swapper/309:10:513
19102042102,5sleep30-21swapper/309:00:043
19070502103,4sleep30-21swapper/308:37:253
19050312102,5sleep30-21swapper/308:20:043
19037992102,5sleep30-21swapper/308:10:173
19019272102,5sleep30-21swapper/307:55:043
19014202102,5sleep30-21swapper/307:51:273
19007682102,5sleep30-21swapper/307:45:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional