You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 02:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 17, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
192300021440,3sleep375-21kworker/3:1+events22:05:013
1746770996945,22cyclictest1981761-21ntpq23:00:360
1746770996943,23cyclictest1779227-21diskstats19:40:280
1746781996863,4cyclictest1746524-21kworker/u8:3+flush-8:020:30:422
1746770996744,20cyclictest2041120-21ntpq00:00:390
1746770996743,21cyclictest1847225-21ntpq20:45:390
1746781996458,4cyclictest1746524-21kworker/u8:3+events_unbound19:40:432
1746777996454,8cyclictest2006501-21ntpq23:25:371
1746770996453,8cyclictest1971899-21ntpq22:50:380
19480822630,3chrt75-21kworker/3:1+events22:30:023
1746781996255,5cyclictest2037276-21kworker/u8:0+events_unbound00:25:392
1746777996251,9cyclictest1931921-21ntpq22:10:411
1746770996238,8cyclictest1704890-21systemd-journal21:40:010
1746781996156,4cyclictest1798556-21kworker/u8:2+flush-8:021:50:292
1746777996151,8cyclictest1777768-21ntpq19:35:371
1746781996055,3cyclictest1932393-21kworker/u8:2+events_unbound22:15:382
1746777996051,7cyclictest2007668-21/usr/sbin/munin23:30:361
1746770995951,6cyclictest1812402-21ntpq20:10:380
1746770995951,6cyclictest1812402-21ntpq20:10:380
1746770995847,8cyclictest1901825-21ntpq21:40:370
1746777995748,7cyclictest1886736-21ntpq21:25:381
1746770995739,5cyclictest2001517-21ntpq23:20:360
1746777995647,7cyclictest1962688-21latency_hist22:45:011
1746770995647,6cyclictest2076408-21ntpq00:35:410
1746781995551,3cyclictest1798556-21kworker/u8:2+flush-8:021:10:432
1746781995450,3cyclictest1932393-21kworker/u8:2+events_unbound00:00:442
1746770995447,5cyclictest1997515-21latency_hist23:20:000
1746777995344,7cyclictest2042490-21/usr/sbin/munin00:05:381
1746777995344,7cyclictest1951971-21ntpq22:30:401
1746777995343,8cyclictest1967001-21ntpq22:45:381
1746770995343,7cyclictest1967879-21latency_hist22:50:000
1746781995247,3cyclictest1798556-21kworker/u8:2+flush-8:020:00:442
1746777995242,8cyclictest2017555-21/usr/sbin/munin23:40:381
1746777995241,9cyclictest2066298-21ntpq00:25:381
1746781995146,3cyclictest1892213-21kworker/u8:3+flush-8:022:00:272
1746770995143,5cyclictest1767845-21ntpq19:25:340
1746770995141,7cyclictest2051244-21ntpq00:10:410
1746781995044,4cyclictest1746524-21kworker/u8:3+events_unbound19:50:392
1746777995038,10cyclictest1704890-21systemd-journal20:40:001
1746781994944,3cyclictest1798556-21kworker/u8:2+events_unbound21:05:312
1746777994940,7cyclictest1797578-21ntpq19:55:341
1746781994844,3cyclictest923664-21kworker/u8:0+events_unbound19:20:392
1746777994839,7cyclictest1877989-21/usr/sbin/munin21:20:401
1746777994838,7cyclictest2071298-21ntpq00:30:421
1746770994839,6cyclictest1833314-21latency_hist20:35:010
18235712470,4sleep00-21swapper/020:25:260
1746770994737,8cyclictest1817324-21ntpq20:15:360
1746781994642,3cyclictest1902224-21kworker/u8:1+events_unbound21:40:452
1746777994636,7cyclictest1891731-21ntpq21:30:421
1746770994636,7cyclictest1857984-21latency_hist21:00:020
1746770994438,4cyclictest2022514-21apt-get23:45:230
1746781994339,3cyclictest1932393-21kworker/u8:2+flush-8:022:25:402
1746777994334,7cyclictest1848384-21/usr/sbin/munin20:50:411
1746777994232,8cyclictest2061442-21ntpq00:20:411
1746777994232,7cyclictest1902964-21/usr/sbin/munin21:45:351
1746770994232,7cyclictest1704890-21systemd-journal19:21:080
1746781994134,5cyclictest1932977-21base6422:15:012
1746777994134,5cyclictest2027447-21apt-get23:50:231
1746770994127,9cyclictest1892213-21kworker/u8:3+flush-8:023:55:360
1746770994126,11cyclictest1932798-21apt-get22:15:000
18352622400,4sleep0882-21mta-sts-daemon20:35:330
1746777994032,6cyclictest2037034-40logrotate00:00:001
1746770994029,9cyclictest1838793-21diskstats20:40:280
1746770993933,4cyclictest1798556-21kworker/u8:2+events_unbound21:55:010
1746770993926,10cyclictest1704890-21systemd-journal21:50:010
1746770993924,11cyclictest1947020-21kworker/u8:1+events_unbound22:55:390
174677099391,34cyclictest1982722-21kworker/0:1+events23:40:370
19571072370,2sleep3471rcuc/322:35:423
1746777993729,6cyclictest1758663-21apt-get19:20:011
174677099379,22cyclictest1803496-21kworker/0:0+events20:20:230
1746770993729,5cyclictest1947868-21latency_hist22:30:000
1746770993711,23cyclictest1882695-21kworker/0:0+events23:05:410
1746781993629,5cyclictest1704890-21systemd-journal23:35:002
174677099369,21cyclictest1982722-21kworker/0:1+events23:30:240
1746770993628,5cyclictest2037276-21kworker/u8:0+flush-8:000:15:260
1746770993627,6cyclictest1932393-21kworker/u8:2+flush-8:023:35:310
1746770993625,9cyclictest1807484-21ntpq20:05:360
1746770993625,9cyclictest1807484-21ntpq20:05:360
174677099356,24cyclictest1872804-21kworker/0:1+events21:20:220
1746770993524,8cyclictest1772868-21ntpq19:30:400
1746770993523,8cyclictest1704890-21systemd-journal23:15:000
1746781993430,3cyclictest1947020-21kworker/u8:1+events_unbound22:35:352
1746781993428,4cyclictest1892213-21kworker/u8:3+flush-8:021:45:052
1746777993429,4cyclictest1746524-21kworker/u8:3+flush-8:020:30:371
1746777993428,4cyclictest1803750-21apt-get20:05:241
1746777993428,4cyclictest1803750-21apt-get20:05:231
1746777993425,7cyclictest1783957-21/usr/sbin/munin19:45:421
1746777993425,6cyclictest1803474-21latency_hist20:05:011
174677099342,26cyclictest1803496-21kworker/0:0+events20:05:010
1746781993327,4cyclictest1704890-21systemd-journal21:40:012
1746777993327,4cyclictest1908178-21apt-get21:50:241
1746777993323,8cyclictest1818801-21diskstats20:20:261
1746770993329,3cyclictest2037276-21kworker/u8:0+flush-8:000:05:090
1746770993327,4cyclictest1962276-21grep22:40:450
1746770993310,21cyclictest2022262-21kworker/0:2+events00:21:200
1746781993226,4cyclictest1798556-21kworker/u8:2+events_unbound20:15:072
1746781993224,6cyclictest1704890-21systemd-journal19:20:002
1746777993226,4cyclictest923664-21kworker/u8:0+flush-8:019:21:481
1746777993225,5cyclictest1987910-21apt-get23:10:251
1746777993221,8cyclictest1704890-21systemd-journal23:46:471
174677099322,28cyclictest1882695-21kworker/0:0+events22:05:470
1746770993221,9cyclictest2027790-21cut23:50:270
174677099321,29cyclictest2022262-21kworker/0:2+events00:30:410
1746770993211,15cyclictest1882695-21kworker/0:0+events21:25:250
20627182310,2sleep3471rcuc/300:25:273
174677799314,12cyclictest1896391-21cut21:35:351
1746777993127,3cyclictest1798556-21kworker/u8:2+flush-8:021:17:011
1746777993110,10cyclictest0-21swapper/120:55:261
174677099319,19cyclictest1803496-21kworker/0:0+events20:50:240
174677099312,27cyclictest1736734-21kworker/0:2+events19:15:020
1746770993120,8cyclictest1773584-21kworker/u8:1+flush-8:019:55:370
19929902300,3sleep10-21swapper/123:15:261
1746781993025,4cyclictest1882313-21kworker/u8:0+flush-8:021:31:172
1746781993024,4cyclictest1857552-21unixbench_multi20:55:442
1746781993024,4cyclictest1746494-21apt-get19:10:032
174677799309,8cyclictest1790884-21tr19:50:341
1746777993024,4cyclictest1798556-21kworker/u8:2+flush-8:021:08:491
1746777993010,9cyclictest1773842-21cut19:35:011
1746777993010,19cyclictest1-21systemd22:07:441
174677099302,26cyclictest1882695-21kworker/0:0+events22:30:300
174677099302,26cyclictest1882695-21kworker/0:0+events21:30:370
174677099301,27cyclictest1736734-21kworker/0:2+events19:10:330
20223772290,2sleep2371rcuc/223:45:012
1746781992924,4cyclictest923664-21kworker/u8:0+events_unbound19:34:502
174677799295,15cyclictest1809776-21cut20:10:341
174677799295,15cyclictest1809776-21cut20:10:341
174677799295,13cyclictest1781870-21cut19:40:331
1746777992925,2cyclictest1970311-21kthreadcore22:50:341
1746777992925,2cyclictest1859197-21kthreadcore21:00:331
1746777992924,3cyclictest1937971-21cron22:20:001
174677799292,13cyclictest1986826-21ntpq23:05:421
174677799291,16cyclictest2016398-21ntpq23:35:371
1746777992911,10cyclictest1813591-21/usr/sbin/munin20:15:431
174677099292,25cyclictest1982722-21kworker/0:1+events23:25:310
174677099290,27cyclictest1882695-21kworker/0:0+events22:40:010
1746781992824,2cyclictest1803981-21tr20:05:272
1746781992824,2cyclictest1803981-21tr20:05:272
1746781992823,4cyclictest1773584-21kworker/u8:1+events_unbound21:24:572
1746781992818,8cyclictest2072491-21cat00:35:012
1746777992824,3cyclictest1902224-21kworker/u8:1+flush-8:021:56:411
174677099289,18cyclictest1882695-21kworker/0:0+events22:00:330
174677099289,17cyclictest1882695-21kworker/0:0+events22:00:000
174677099286,20cyclictest1736734-21kworker/0:2+events19:50:280
174677099283,17cyclictest1783987-21chrt19:45:250
1746770992823,3cyclictest1863439-21cpuspeed_turbos21:05:240
1746770992817,9cyclictest1868395-21diskstats21:10:280
174677099281,25cyclictest1882695-21kworker/0:0+events22:15:370
174677099280,26cyclictest1848168-21kworker/0:2+events21:15:330
1746781992724,2cyclictest2042574-21aten2_r5power_e00:05:252
1746781992723,2cyclictest1952358-21unixbench_multi22:30:452
1746781992722,3cyclictest1923553-21uniq22:05:312
174677799274,5cyclictest1824095-21irqcore20:25:311
174677799274,12cyclictest2039405-21cat00:00:351
174677799270,16cyclictest2001558-21ntpq23:20:361
174677799270,16cyclictest1922087-21ntpq22:00:391
174677799270,14cyclictest2056449-21ntpq00:15:381
1746770992710,16cyclictest1882695-21kworker/0:0+events22:20:350
1746770992710,15cyclictest1736734-21kworker/0:2+events19:35:380
1746781992621,4cyclictest1964674-21kthreadcore22:45:342
1746781992621,4cyclictest1892213-21kworker/u8:3+events_unbound22:23:562
174677799266,10cyclictest0-21swapper/122:35:391
174677799265,11cyclictest1943187-21apt-get22:25:251
174677799265,11cyclictest0-21swapper/100:35:431
174677799264,11cyclictest1976735-21sed22:55:371
174677799263,12cyclictest1870287-21kthreadcore21:10:341
1746777992621,3cyclictest0-21swapper/120:50:011
174677799262,12cyclictest1842357-21ntpq20:40:401
174677799260,14cyclictest1941981-21ntpq22:20:391
174678199256,2cyclictest20349091kthreadcore23:55:322
1746781992520,4cyclictest1932393-21kworker/u8:2+events_unbound00:16:292
1746781992520,4cyclictest1768777-21cron19:29:592
174677799253,9cyclictest1765949-21kthreadcore19:25:301
174677799252,11cyclictest1981787-21ntpq23:00:381
1746777992511,2cyclictest0-21swapper/121:40:321
174677799250,14cyclictest2051328-21ntpq00:10:431
174677799250,10cyclictest1751762-21runrttasks19:14:231
1746781992419,4cyclictest1947020-21kworker/u8:1+events_unbound23:01:562
174678199240,8cyclictest2051583-21grep00:10:462
174677099247,16cyclictest1803496-21kworker/0:0+events21:00:250
174678199231,9cyclictest18235742cut20:25:262
1746781992319,2cyclictest2072651-21aten2_r5power_c00:35:262
174677099234,18cyclictest2022262-21kworker/0:2+events00:28:510
1746770992317,4cyclictest1746928-21latency_hist19:10:010
17418982224,11sleep10-21swapper/119:05:281
1746781992117,2cyclictest1797392-21grep19:55:322
1746781992117,2cyclictest0-21swapper/223:25:422
1746781992117,2cyclictest0-21swapper/220:45:442
174678199211,5cyclictest1961774-21ntpq22:40:382
1746781992115,4cyclictest1887211-21unixbench_singl21:25:442
174678199202,12cyclictest1858275-21apt-get21:00:262
1746781992016,2cyclictest0-21swapper/223:10:462
1746781992016,2cyclictest0-21swapper/220:10:282
1746781992016,2cyclictest0-21swapper/220:10:272
1746781992015,3cyclictest2061815-21unixbench_multi00:20:452
1746781992012,6cyclictest1704890-21systemd-journal23:55:002
174678199200,5cyclictest1971887-21ntpq22:50:362
19820522190,2sleep3451irq_work/323:00:443
174678199192,5cyclictest0-21swapper/223:45:312
1746781991915,2cyclictest0-21swapper/223:24:592
17462452193,9sleep30-21swapper/319:07:003
17419032194,9sleep20-21swapper/219:05:292
18322082180,2sleep3481ktimers/320:30:353
174678199189,7cyclictest1984504-21tr23:05:342
174678199182,12cyclictest1996682-21ntpq23:15:402
174678199182,11cyclictest1787801-21ntpq19:45:382
1746781991815,2cyclictest0-21swapper/220:40:002
1746781991814,2cyclictest1913643-21grep21:55:292
1746781991814,2cyclictest0-21swapper/221:15:252
1746781991713,3cyclictest1839465-21tail20:40:322
1746781991713,2cyclictest0-21swapper/220:20:272
174678199171,11cyclictest2012627-21apt-get23:35:242
174678199170,3cyclictest1976842-21ntpq22:55:392
19580562162,9sleep30-21swapper/322:40:263
1746781991612,2cyclictest0-21swapper/219:35:452
19076572152,7sleep30-21swapper/321:50:003
174678199157,6cyclictest1848448-21cut20:50:252
20672082132,6sleep30-21swapper/300:30:013
20352832132,7sleep30-21swapper/323:55:333
20179572133,7sleep30-21swapper/323:40:283
20023332134,5sleep30-21swapper/323:23:363
19827252132,6sleep30-21swapper/323:05:023
19747522135,5sleep30-21swapper/322:55:353
18930302131,8sleep30-21swapper/321:35:253
18784382132,7sleep30-21swapper/321:20:323
18570942132,7sleep30-21swapper/320:55:393
18384292132,6sleep30-21swapper/320:40:023
18338472132,7sleep30-21swapper/320:35:293
18083922132,7sleep30-21swapper/320:10:013
17825192132,7sleep30-21swapper/319:40:353
20126022122,6sleep30-21swapper/323:35:243
20114392122,6sleep30-21swapper/323:30:383
20069672122,6sleep30-21swapper/323:25:443
19723632122,6sleep30-21swapper/322:50:443
19480822122,5sleep30-21swapper/322:30:033
19284802122,6sleep30-21swapper/322:10:323
19230002122,6sleep30-21swapper/322:05:013
19124482122,6sleep30-21swapper/321:50:463
18978042122,5sleep30-21swapper/321:40:023
18875322122,6sleep30-21swapper/321:29:153
18728072122,5sleep30-21swapper/321:15:013
18590172122,6sleep30-21swapper/321:00:333
18481492122,6sleep30-21swapper/320:50:023
18461162122,6sleep30-21swapper/320:45:363
18235142122,6sleep30-21swapper/320:25:253
18227862122,6sleep30-21swapper/320:20:443
18136202122,6sleep30-21swapper/320:15:273
17985632122,5sleep30-21swapper/320:00:013
17975852122,6sleep30-21swapper/319:55:363
17907132122,6sleep30-21swapper/319:50:343
17640882122,5sleep30-21swapper/319:25:013
20725662112,5sleep30-21swapper/300:35:033
20575642112,5sleep30-21swapper/300:20:023
20570312112,5sleep30-21swapper/300:16:293
20480232112,5sleep30-21swapper/300:10:343
20425202112,5sleep30-21swapper/300:05:263
20372722113,5sleep30-21swapper/300:00:043
20274162112,6sleep30-21swapper/323:50:213
20232182112,5sleep30-21swapper/323:45:313
19965712112,5sleep30-21swapper/323:15:373
19882872112,5sleep30-21swapper/323:10:313
19632042112,6sleep30-21swapper/322:45:283
19425392112,5sleep30-21swapper/322:20:473
19332662112,5sleep30-21swapper/322:15:183
19173092112,5sleep30-21swapper/321:55:433
18882562112,5sleep30-21swapper/321:30:303
18722002112,6sleep30-21swapper/321:10:453
18631562112,5sleep30-21swapper/321:05:033
18091782111,6sleep30-21swapper/320:10:333
18091782111,6sleep30-21swapper/320:10:323
18042222112,5sleep30-21swapper/320:05:313
17883542112,5sleep30-21swapper/319:46:123
17737682112,4sleep30-21swapper/319:35:013
17690712112,6sleep30-21swapper/319:30:283
17591452112,5sleep30-21swapper/319:20:053
17522422112,5sleep30-21swapper/319:15:033
17470812102,5sleep30-21swapper/319:10:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional