You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 22:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Mar 17, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209131721970,3sleep375-21kworker/3:1+events11:56:353
213567821910,6sleep30-21swapper/312:40:003
185689021110,5sleep3451irq_work/307:56:433
18179922920,5chrt0-21swapper/007:20:010
20405532560,2sleep375-21kworker/3:1-events11:01:453
20996632530,3sleep375-21kworker/3:1-events12:01:443
20421162500,2chrt481ktimers/311:06:353
1806123994940,6cyclictest1976947-21latency_hist10:00:010
1806128994738,6cyclictest280-21systemd-journal12:25:012
18220852460,2sleep130-21ksoftirqd/107:21:471
1806123994636,7cyclictest1917348-21latency_hist09:00:010
1806125994538,5cyclictest1852719-21gpgv07:55:001
1806125994536,7cyclictest1986837-21sh10:10:001
1806123994438,4cyclictest2036549-21latency_hist11:00:010
1806125994337,4cyclictest1837950-21kworker/u8:1+flush-8:007:46:371
1806128994134,5cyclictest280-21systemd-journal09:00:372
1806125994136,4cyclictest2016525-21kworker/u8:1+flush-8:010:41:401
1806125994136,4cyclictest1769595-21kworker/u8:3+flush-8:007:16:401
1806125994131,8cyclictest1862174-21ntpq08:01:451
1806125994131,8cyclictest1862174-21ntpq08:01:451
1806125994033,5cyclictest280-21systemd-journal11:41:551
1806125994033,5cyclictest2001706-21latency_hist10:25:011
1806123994031,7cyclictest1872085-21ntpq08:11:460
1806125993931,6cyclictest1971755-21apt-get09:55:001
1806123993930,7cyclictest1951998-21latency_hist09:35:010
18014072394,31sleep20-21swapper/207:06:312
1806125993833,4cyclictest1837950-21kworker/u8:1+flush-8:008:26:361
1806125993828,8cyclictest1897950-21/usr/sbin/munin08:41:501
1806125993827,8cyclictest1942124-21latency_hist09:25:001
1806125993731,4cyclictest1995976-21kworker/u8:2+events_unbound10:26:501
1806125993730,5cyclictest280-21systemd-journal08:37:531
1806123993730,5cyclictest1769595-21kworker/u8:3+flush-8:008:26:450
1806123993728,7cyclictest2124986-21ntpq12:26:460
1806125993631,3cyclictest2061842-21cpuspeed_turbos11:26:351
1806125993627,6cyclictest1951148-21ntpq09:31:451
1806125993525,8cyclictest1921528-21ntpq09:01:501
1806123993526,6cyclictest280-21systemd-journal12:36:370
1806123993526,6cyclictest1847653-21latency_hist07:50:000
1806125993430,3cyclictest2036593-21kworker/u8:1+events_unbound12:31:421
1806125993430,3cyclictest2007078-21kworker/u8:0+events_unbound11:06:391
1806125993428,4cyclictest2036593-21kworker/u8:1+flush-8:011:55:311
1806123993428,4cyclictest2115597-21apt-get12:20:000
18057382343,10sleep10-21swapper/107:07:141
1806125993329,3cyclictest1837950-21kworker/u8:1+flush-8:008:16:511
1806125993329,2cyclictest1992898-21irqrtprio10:16:391
1806125993328,4cyclictest1769595-21kworker/u8:3+events_unbound09:36:521
1806125993327,4cyclictest1907865-21apt-get08:51:331
1806125993324,7cyclictest1827044-21ntpq07:26:481
1806125993322,8cyclictest2105032-21ntpq12:06:491
1806123993326,5cyclictest1853107-21kworker/u8:2+flush-8:007:56:360
180129923320,7sleep30-21swapper/307:05:083
1806128993225,5cyclictest280-21systemd-journal11:25:002
1806125993226,4cyclictest1922666-21apt-get09:06:331
1806125993226,4cyclictest1837950-21kworker/u8:1+flush-8:008:31:491
1806125993222,7cyclictest2015918-21ntpq10:36:451
1806123993228,2cyclictest2040644-21needreboot11:01:460
1806123993225,5cyclictest2116331-21aten2_r5power_v12:21:340
1806128993125,4cyclictest1907194-21unixbench_singl08:46:532
1806128993121,8cyclictest280-21systemd-journal07:59:532
1806125993126,3cyclictest2007078-21kworker/u8:0+events_unbound12:21:501
1806125993125,4cyclictest1853212-21apt-get07:56:321
1806125993125,4cyclictest1769595-21kworker/u8:3+flush-8:008:56:431
1806123993125,4cyclictest2080153-21needreboot11:41:430
1806128993027,2cyclictest2135320-21unixbench_multi12:36:542
1806128993022,6cyclictest2027393-21fschecks_time10:51:372
1806125993024,4cyclictest2115725-21gpgv12:20:011
1806123993026,3cyclictest1991806-21cron10:15:000
1806123993026,3cyclictest1922320-21systemd-run09:05:000
1806123993024,4cyclictest1853107-21kworker/u8:2+flush-8:008:01:500
1806123993024,4cyclictest1853107-21kworker/u8:2+flush-8:008:01:500
1806123993023,5cyclictest280-21systemd-journal09:25:450
1806123993022,6cyclictest2065865-21unixbench_multi11:26:520
1806128992925,2cyclictest1907896-21aten2_r5power_c08:51:352
1806125992924,3cyclictest1981632-21unixbench_singl10:01:531
1806123992925,2cyclictest2021743-21systemd-run10:45:000
1806123992922,5cyclictest2055999-21unixbench_singl11:16:510
1806123992922,5cyclictest1956552-21grep09:36:520
1806123992921,6cyclictest1986492-21unixbench_multi10:06:510
1806128992824,2cyclictest2126144-21aten2_r5power_c12:31:372
1806128992823,3cyclictest1986836-21idleruntime-cro10:10:002
1806128992819,7cyclictest1806712-21fschecks_time07:11:372
1806125992824,2cyclictest1806116-21cyclictest09:41:381
1806125992823,4cyclictest2031608-21kworker/u8:3+events_unbound11:11:481
1806125992823,3cyclictest2007078-21kworker/u8:0+flush-8:011:36:501
1806125992822,4cyclictest1837699-21sendmail07:40:001
1806123992824,2cyclictest1928375-21irqrtprio09:11:410
1806123992823,3cyclictest2012513-21fschecks_time10:36:370
1806123992822,4cyclictest1967248-21aten2_r5power_e09:51:360
1806123992822,4cyclictest1961533-21unixbench_multi09:41:520
1806123992822,4cyclictest1823341-21aten2_r5power_p07:26:350
1806123992818,2cyclictest161rcu_preempt08:41:460
1806128992723,2cyclictest2091478-21cpuspeed_turbos11:56:352
1806128992721,4cyclictest1898289-21fschecks_time08:41:372
1806128992719,6cyclictest1972705-21fschecks_time09:56:372
1806128992718,7cyclictest1863646-21fschecks_count08:06:372
1806125992723,3cyclictest1917615-21kworker/u8:2+flush-8:009:55:551
1806125992721,4cyclictest280-21systemd-journal12:36:381
1806123992723,3cyclictest2126331-21cpuspeed_turbos12:31:380
1806123992723,3cyclictest2071175-21systemd-run11:35:000
1806123992722,4cyclictest1754166-21kworker/u8:2+flush-8:007:31:510
1806123992722,3cyclictest2046853-21aten2_r5power_c11:11:340
1806123992721,4cyclictest1927283-21idleruntime-cro09:10:000
1806123992721,4cyclictest1867937-21cron08:10:000
1806123992721,4cyclictest1838144-21aten2_r5power_e07:41:350
1806123992720,6cyclictest2096451-21cpuspeed_turbos12:01:370
1806128992623,2cyclictest1952713-21fschecks_time09:36:372
1806128992622,2cyclictest1818388-21aten2_r5power_v07:21:352
1806128992621,4cyclictest1852601-21cron07:55:002
1806128992620,4cyclictest2012549-21fschecks_time10:36:372
1806128992620,4cyclictest1937850-21fschecks_time09:21:372
1806128992617,7cyclictest280-21systemd-journal10:45:542
1806128992617,7cyclictest1843354-21fschecks_count07:46:372
1806125992622,2cyclictest2037198-21cut11:01:381
1806125992621,4cyclictest1447053-21kworker/u8:0+flush-8:007:11:501
1806125992620,4cyclictest2106120-21apt-get12:11:341
1806125992620,4cyclictest2007078-21kworker/u8:0+events_unbound11:31:391
1806125992620,4cyclictest1754166-21kworker/u8:2+events_unbound07:31:381
1806123992622,3cyclictest1877851-21systemd-run08:20:010
1806123992621,3cyclictest1837689-21cron07:40:000
1806123992620,4cyclictest876-21mta-sts-daemon10:30:000
1806123992620,4cyclictest2011820-21cron10:35:000
1806123992620,4cyclictest1897304-21unixbench_singl08:36:540
1806128992522,2cyclictest1873514-21fschecks_count08:16:382
1806128992520,3cyclictest2052046-21fschecks_time11:16:362
1806128992520,3cyclictest1966523-21unixbench_singl09:46:532
1806128992520,3cyclictest0-21swapper/210:25:002
1806128992518,5cyclictest2114690-21needreboot12:16:442
1806128992517,6cyclictest2121441-21fschecks_count12:26:352
1806128992517,6cyclictest2061974-21fschecks_time11:26:372
1806128992517,6cyclictest2002358-21fschecks_count10:26:352
1806128992516,7cyclictest2106409-21fschecks_count12:11:382
1806128992516,7cyclictest1995816-21needreboot10:16:432
1806128992516,7cyclictest1926934-21unixbench_multi09:06:532
1806128992516,7cyclictest1813612-21fschecks_time07:16:392
1806125992522,2cyclictest2011549-21unixbench_singl10:31:531
1806125992520,4cyclictest2031608-21kworker/u8:3+events_unbound11:46:481
1806125992519,3cyclictest0-21swapper/107:45:001
1806123992521,3cyclictest1981043-21needreboot10:01:450
1806123992521,2cyclictest1996719-21sh10:20:000
1806123992518,5cyclictest1852330-21grep07:51:540
1806128992420,3cyclictest2011480-21unixbench_multi10:31:532
1806128992420,2cyclictest2085679-21unixbench_singl11:46:542
1806128992419,3cyclictest2096543-21fschecks_time12:01:382
1806128992419,3cyclictest2086603-21fschecks_count11:51:372
1806128992416,6cyclictest2101430-21fschecks_count12:06:372
1806128992416,6cyclictest2046526-21grep11:10:012
1806125992420,3cyclictest2007078-21kworker/u8:0+events_unbound10:50:011
1806125992420,2cyclictest0-21swapper/108:46:371
1806125992418,4cyclictest2090548-21unixbench_multi11:51:521
1806125992418,4cyclictest1872900-21kworker/u8:0+flush-8:010:11:451
1806125992418,4cyclictest1769595-21kworker/u8:3+events_unbound08:11:541
1806123992420,3cyclictest1941782-21unixbench_multi09:21:520
1806123992420,3cyclictest1917615-21kworker/u8:2+events_unbound09:17:540
1806123992420,3cyclictest1917615-21kworker/u8:2+events_unbound09:17:540
1806123992419,4cyclictest1882800-21cron08:25:000
1806123992419,3cyclictest2045570-21needreboot11:06:440
19379612230,3sleep375-21kworker/3:1+events09:21:383
1806128992320,2cyclictest1858739-21fschecks_time08:01:372
1806128992320,2cyclictest1858739-21fschecks_time08:01:372
1806128992320,2cyclictest1833321-21cpuspeed_turbos07:36:362
1806128992318,3cyclictest2066853-21fschecks_count11:31:382
1806128992317,4cyclictest2021366-21unixbench_multi10:41:532
1806128992317,4cyclictest1957646-21fschecks_time09:41:372
1806128992315,6cyclictest280-21systemd-journal09:55:002
1806128992315,6cyclictest0-21swapper/211:00:002
180612899230,2cyclictest161rcu_preempt08:31:472
180612599232,15cyclictest583-21snmpd11:16:331
1806125992320,2cyclictest0-21swapper/111:00:001
1806125992319,3cyclictest2007078-21kworker/u8:0+flush-8:011:21:381
1806125992317,2cyclictest0-21swapper/109:26:401
1806125992316,3cyclictest0-21swapper/108:21:511
1806123992319,3cyclictest2105413-21unixbench_multi12:06:520
1806123992319,3cyclictest2092167-21cut11:56:410
1806123992319,3cyclictest1888678-21sort08:31:420
1806123992319,2cyclictest0-21swapper/012:15:010
1806123992317,4cyclictest0-21swapper/010:55:010
1806123992312,9cyclictest280-21systemd-journal10:25:000
18013132233,3sleep00-21swapper/007:05:170
1806128992219,2cyclictest2047136-21fschecks_time11:11:372
1806128992219,2cyclictest1883402-21cpuspeed_turbos08:26:352
1806128992217,3cyclictest2071806-21fschecks_count11:36:352
1806128992217,3cyclictest1932847-21fschecks_count09:16:362
1806128992217,3cyclictest1932847-21fschecks_count09:16:362
1806128992216,4cyclictest1981911-21cron10:05:002
1806128992216,4cyclictest1881910-21needreboot08:21:452
1806128992215,6cyclictest2076786-21fschecks_time11:41:362
1806125992217,4cyclictest1961619-21kworker/u8:1+flush-8:009:46:371
1806125992217,4cyclictest1769595-21kworker/u8:3+flush-8:008:06:371
1806125992217,3cyclictest1928375-21irqrtprio09:11:411
1806125992217,2cyclictest0-21swapper/110:51:331
1806125992215,5cyclictest0-21swapper/112:01:471
1806123992217,3cyclictest876-21mta-sts-daemon08:51:420
1806123992217,3cyclictest1907181-21unixbench_multi08:46:520
1806123992217,3cyclictest0-21swapper/011:21:510
1806123992217,3cyclictest0-21swapper/007:25:010
1806128992116,3cyclictest1987551-21fschecks_time10:11:372
1806128992116,3cyclictest1842347-21unixbench_multi07:41:532
1806128992113,6cyclictest2041522-21latency_hist11:05:002
1806125992117,3cyclictest1872900-21kworker/u8:0+events_unbound09:16:451
1806125992117,3cyclictest1872900-21kworker/u8:0+events_unbound09:16:451
1806123992118,2cyclictest2026700-21systemd-run10:50:010
1806123992117,3cyclictest1806634-21sh07:11:360
1806123992116,4cyclictest2073792-21kthreadcore11:36:400
1806128992017,2cyclictest1927963-21fschecks_time09:11:382
1806128992015,3cyclictest1942716-21cpuspeed_turbos09:26:362
1806123992015,3cyclictest2031608-21kworker/u8:3+flush-8:011:51:410
1806123992015,3cyclictest0-21swapper/011:46:390
1806123992015,3cyclictest0-21swapper/009:46:370
1806128991911,6cyclictest1868542-21cpuspeed_turbos08:11:352
1806125991914,3cyclictest0-21swapper/112:26:331
1806128991815,2cyclictest1913122-21fschecks_time08:56:352
1806128991813,3cyclictest1893336-21fschecks_time08:36:382
1806128991813,3cyclictest0-21swapper/207:30:002
1806128991812,4cyclictest0-21swapper/207:35:002
21110322162,9sleep30-21swapper/312:16:343
1806128991612,2cyclictest0-21swapper/209:31:372
19777082142,8sleep30-21swapper/310:01:393
18621632143,7sleep30-21swapper/308:01:463
18621632143,7sleep30-21swapper/308:01:463
18271332144,6sleep30-21swapper/307:26:513
21258872132,6sleep30-21swapper/312:30:023
20555512132,7sleep30-21swapper/311:16:473
20235212133,7sleep30-21swapper/310:46:423
18525962132,7sleep30-21swapper/307:55:003
18191582133,6sleep30-21swapper/307:21:413
21196652123,5sleep30-21swapper/312:21:433
21015182122,6sleep30-21swapper/312:06:393
20814132122,6sleep30-21swapper/311:46:363
20703152122,6sleep30-21swapper/311:31:483
20615452122,6sleep30-21swapper/311:25:543
20505062122,6sleep30-21swapper/311:11:453
20125892122,6sleep30-21swapper/310:36:383
19967722122,5sleep30-21swapper/310:20:013
19958502122,6sleep30-21swapper/310:16:443
19718002122,5sleep30-21swapper/309:55:013
19680772122,6sleep30-21swapper/309:51:443
19470522121,6sleep30-21swapper/309:30:023
19429772122,6sleep30-21swapper/309:26:403
19276652122,6sleep30-21swapper/309:11:363
19170282122,6sleep30-21swapper/308:56:513
19078392122,6sleep30-21swapper/308:51:333
18977442122,5sleep30-21swapper/308:40:023
18889712122,7sleep30-21swapper/308:31:433
18835462122,6sleep30-21swapper/308:26:383
18786362122,6sleep30-21swapper/308:21:403
18633932122,6sleep30-21swapper/308:06:353
18438122122,6sleep30-21swapper/307:46:413
18380912122,6sleep30-21swapper/307:41:363
18327622122,5sleep30-21swapper/307:35:013
18299642122,6sleep30-21swapper/307:31:443
18175272122,6sleep30-21swapper/307:16:563
18062632122,6sleep30-21swapper/307:10:113
21215292112,5sleep30-21swapper/312:26:373
21065402112,6sleep30-21swapper/312:11:403
20861122112,5sleep30-21swapper/311:50:013
20763282112,5sleep30-21swapper/311:40:023
20715212112,5sleep30-21swapper/311:36:333
20607052112,5sleep30-21swapper/311:21:533
20360232111,6sleep30-21swapper/310:56:533
20310192112,6sleep30-21swapper/310:51:513
20170202112,6sleep30-21swapper/310:40:123
20073282112,5sleep30-21swapper/310:31:373
20020432112,5sleep30-21swapper/310:26:313
19870562112,5sleep30-21swapper/310:10:023
19822912112,6sleep30-21swapper/310:06:333
19621102112,5sleep30-21swapper/309:45:023
19572112112,5sleep30-21swapper/309:40:493
19524222112,6sleep30-21swapper/309:36:363
19361722112,5sleep30-21swapper/309:16:453
19361722112,5sleep30-21swapper/309:16:453
19225202112,5sleep30-21swapper/309:05:023
19180782112,5sleep30-21swapper/309:01:413
19060502112,6sleep30-21swapper/308:46:443
18968032112,5sleep30-21swapper/308:36:493
18731342112,6sleep30-21swapper/308:15:263
18679332112,5sleep30-21swapper/308:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional