You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 21, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18601122600,5chrt0-21swapper/308:55:023
1753480995648,6cyclictest1799851-21latency_hist07:55:011
1753483995549,4cyclictest1854887-21gpgv08:50:012
1753480995546,6cyclictest1780001-21latency_hist07:35:011
1753480995243,6cyclictest1909903-21latency_hist09:45:011
1753476995142,6cyclictest1859970-21latency_hist08:55:010
1753480995043,5cyclictest1753785-21/usr/sbin/munin07:12:531
1753476995040,7cyclictest2053753-21latency_hist12:10:000
1753480994836,9cyclictest1914135-21ntpq09:47:521
20323322460,2sleep3575-21kworker/3:2+mm_percpu_wq11:47:453
1753476994639,5cyclictest1849825-21latency_hist08:45:010
18962892450,1sleep2371rcuc/209:32:442
1753476994541,3cyclictest2029269-21kworker/u8:2+events_unbound12:37:520
1753483994427,15cyclictest1880218-21aten2_r5power_c09:17:362
1753476994434,8cyclictest1963781-21ntpq10:37:490
1753480994338,4cyclictest1875041-21kworker/u8:0+events_unbound09:32:551
1753480994337,4cyclictest275-21systemd-journal08:58:191
1753476994336,5cyclictest1765221-21kworker/u8:1+flush-8:007:37:390
1753480994237,4cyclictest101218-21kworker/u8:3+flush-8:008:47:501
1753480994237,3cyclictest1779871-21kworker/u8:0+flush-8:008:07:401
1753480994237,3cyclictest1738001-21kworker/u8:2+events_unbound07:17:361
1753480994232,8cyclictest1950356-21diskstats10:27:391
1753480994232,8cyclictest1950356-21diskstats10:27:391
1753476994233,7cyclictest1994766-21/usr/sbin/munin11:12:460
1753476994230,9cyclictest275-21systemd-journal12:25:000
1753483994126,13cyclictest1905470-21aten2_r5power_c09:42:362
1753480994134,5cyclictest275-21systemd-journal11:59:191
1753480994134,5cyclictest2034698-21diskstats11:52:401
1753480994134,4cyclictest275-21systemd-journal09:35:191
1753480994033,5cyclictest1779871-21kworker/u8:0+flush-8:008:30:311
1753480994033,5cyclictest1779871-21kworker/u8:0+flush-8:008:30:311
1753480994030,7cyclictest275-21systemd-journal10:36:191
1753476994032,6cyclictest101218-21kworker/u8:3+flush-8:008:02:410
1753476994027,10cyclictest275-21systemd-journal12:05:000
1753483993924,13cyclictest1920041-21kworker/u8:2-ext4-rsv-conversion11:00:002
18967762380,5sleep3451irq_work/309:32:453
175348399382,28cyclictest2034448-21apt-get11:52:362
1753480993834,3cyclictest1779871-21kworker/u8:0+flush-8:008:22:531
1753480993831,5cyclictest1945167-21/usr/sbin/munin10:22:521
1753480993831,5cyclictest1945167-21/usr/sbin/munin10:22:521
1753476993832,4cyclictest1875041-21kworker/u8:0+events_unbound11:02:550
1753483993719,16cyclictest1779991-21cron07:35:002
1753480993732,4cyclictest1920041-21kworker/u8:2+flush-8:009:57:491
1753480993729,6cyclictest2063609-21latency_hist12:20:011
1753476993728,6cyclictest2014227-21latency_hist11:30:010
1753476993727,7cyclictest1900035-21latency_hist09:35:010
18906082360,3sleep3575-21kworker/3:2+events09:27:403
1753480993631,4cyclictest2029269-21kworker/u8:2+flush-8:012:02:431
1753480993630,4cyclictest1875041-21kworker/u8:0+flush-8:011:07:521
1753480993626,8cyclictest1928977-21ntpq10:02:481
1753476993627,7cyclictest1839772-21cp08:35:000
1753476993627,7cyclictest1839772-21cp08:35:000
1753480993531,3cyclictest1800075-21kworker/u8:2+events_unbound09:02:381
1753480993530,4cyclictest2029269-21kworker/u8:2+flush-8:012:32:381
1753476993529,4cyclictest1855333-21kworker/u8:1+events_unbound09:42:530
175348399342,25cyclictest1860424-21taskset08:57:372
175348399341,26cyclictest1999755-21apt-get11:17:372
1753480993430,3cyclictest2009285-21kworker/u8:3+events_unbound11:37:531
1753480993430,3cyclictest1875041-21kworker/u8:0+flush-8:010:42:411
1753480993425,7cyclictest1885375-21/usr/sbin/munin09:22:541
1753476993429,4cyclictest1999564-21kworker/u8:1+flush-8:011:52:540
1753483993320,11cyclictest1844877-21sendmail08:40:002
1753483993318,13cyclictest2055133-21kthreadcore12:12:442
1753480993328,4cyclictest1800075-21kworker/u8:2+flush-8:008:42:411
1753480993327,4cyclictest1800075-21kworker/u8:2+flush-8:008:37:501
1753480993327,4cyclictest1770148-21ls07:25:001
1753480993325,6cyclictest1920041-21kworker/u8:2+events_unbound10:57:481
1753476993328,4cyclictest1804776-21cron08:00:000
19093732320,4sleep3575-21kworker/3:2+events09:42:533
1753483993223,7cyclictest275-21systemd-journal07:40:002
175348399322,23cyclictest1945194-21apt-get10:22:362
175348399322,23cyclictest1945194-21apt-get10:22:362
175348399322,23cyclictest1885400-21apt-get09:22:372
175348399321,25cyclictest1-21systemd11:47:532
1753480993228,3cyclictest2069728-21irqrtprio12:27:421
1753480993227,4cyclictest1870066-21kworker/u8:3+flush-8:009:27:541
1753480993227,3cyclictest1870817-21irqcore09:07:421
1753476993228,3cyclictest1864871-21cron09:00:000
1753476993227,3cyclictest1924740-21idleruntime-cro10:00:000
1753476993226,4cyclictest1765221-21kworker/u8:1+flush-8:007:30:010
1753476993225,5cyclictest101218-21kworker/u8:3+events_unbound08:30:000
1753476993224,6cyclictest275-21systemd-journal07:50:000
1753476993223,7cyclictest1894843-21apt-get09:30:010
1753483993124,5cyclictest275-21systemd-journal10:40:012
175348399312,22cyclictest2078855-21apt-get12:37:352
175348399312,22cyclictest1900486-21apt-get09:37:372
1753480993127,3cyclictest1875041-21kworker/u8:0+events_unbound11:02:471
1753480993126,4cyclictest1870066-21kworker/u8:3+flush-8:009:17:521
1753480993122,7cyclictest1935046-21/usr/sbin/munin10:12:481
1753476993127,3cyclictest1875041-21kworker/u8:0+flush-8:010:07:550
1753476993125,4cyclictest1870066-21kworker/u8:3+flush-8:010:17:390
1753476993125,4cyclictest1814466-21unixbench_singl08:07:550
1753476993125,4cyclictest1738001-21kworker/u8:2+events_unbound07:22:400
175348399303,21cyclictest1920222-21apt-get09:57:362
1753483993013,15cyclictest1834705-21cron08:30:002
175348399301,24cyclictest2064661-21ps12:22:422
175348399301,23cyclictest1865351-21apt-get09:02:362
1753480993026,3cyclictest1870066-21kworker/u8:3+events_unbound09:12:481
1753480993026,3cyclictest1800075-21kworker/u8:2+flush-8:008:02:551
1753480993025,3cyclictest2016831-21kthreadcore11:32:451
1753480993025,3cyclictest1970206-21fschecks_count10:47:401
1753480993024,4cyclictest1819849-21cron08:15:001
1753480993024,4cyclictest101218-21kworker/u8:3+flush-8:008:17:541
1753476993026,2cyclictest0-21swapper/009:55:000
1753476993025,4cyclictest2057893-21needreboot12:12:470
1753476993025,4cyclictest1999564-21kworker/u8:1+flush-8:011:37:390
1753476993024,4cyclictest1765221-21kworker/u8:1+flush-8:007:32:510
1753476993024,4cyclictest1760740-21aten2_r5power_c07:17:360
1753476993021,6cyclictest1789983-21latency_hist07:45:010
175348399293,20cyclictest2077640-21ntpq12:32:452
1753483992913,14cyclictest1989648-21sed11:05:012
1753480992925,3cyclictest401-21dbus-daemon08:00:001
1753480992925,3cyclictest1875041-21kworker/u8:0+events_unbound10:17:511
1753480992923,5cyclictest1875041-21kworker/u8:0+events_unbound09:52:411
1753476992923,5cyclictest1969195-21unixbench_multi10:42:550
1753476992919,8cyclictest2033258-21ntpq11:47:480
1753476992916,4cyclictest0-21swapper/009:12:550
1753483992824,2cyclictest2044693-21fschecks_time12:02:432
1753483992824,2cyclictest1910582-21tr09:47:402
175348399282,20cyclictest1984713-21apt-get11:02:362
1753483992818,8cyclictest1944815-21cat10:20:002
1753483992814,12cyclictest2039415-21aten2_r5power_c11:57:392
1753483992814,12cyclictest1789971-21sh07:45:002
1753483992812,14cyclictest1760927-21cpuspeed_turbos07:17:372
1753480992824,3cyclictest1875041-21kworker/u8:0+events_unbound11:27:511
1753480992824,3cyclictest101218-21kworker/u8:3+flush-8:008:25:311
1753480992822,4cyclictest2009285-21kworker/u8:3+events_unbound12:12:521
1753476992822,5cyclictest1754341-21irqcore07:12:420
1753476992822,4cyclictest1795893-21irqcore07:52:430
1753476992820,6cyclictest1950193-21aten2_r5power_p10:27:370
1753476992820,6cyclictest1950193-21aten2_r5power_p10:27:370
17486532283,9sleep20-21swapper/207:05:262
175348399277,18cyclictest1951104-21tr10:27:432
175348399277,18cyclictest1951104-21tr10:27:432
175348399276,18cyclictest1964980-21cut10:42:372
1753483992723,2cyclictest1855547-21aten2_r5power_p08:52:372
175348399272,20cyclictest2049295-21apt-get12:07:372
1753483992713,12cyclictest0-21swapper/208:07:552
175348399271,24cyclictest2018868-21/usr/sbin/munin11:32:552
175348399271,22cyclictest2005039-21/usr/sbin/munin11:22:382
175348399271,22cyclictest1820314-21apt-get08:17:362
175348399271,22cyclictest1803822-21/usr/sbin/munin07:57:452
175348399271,22cyclictest1767808-21ps07:22:442
175348399271,21cyclictest1790542-21/usr/sbin/munin07:47:372
175348399270,24cyclictest2009676-21taskset11:27:242
175348399270,24cyclictest1805712-21/usr/sbin/munin08:02:432
175348399270,23cyclictest2024598-21/usr/sbin/munin11:42:372
175348399270,23cyclictest1955351-21/usr/sbin/munin10:32:392
175348399270,23cyclictest1935046-21/usr/sbin/munin10:12:352
1753480992721,4cyclictest2029269-21kworker/u8:2+flush-8:012:37:391
1753480992721,4cyclictest1974849-21apt-get10:52:351
1753480992721,4cyclictest1875041-21kworker/u8:0+flush-8:011:22:481
1753480992720,5cyclictest2029269-21kworker/u8:2+flush-8:011:47:551
1753480992720,5cyclictest2029037-21latency_hist11:45:011
1753476992722,4cyclictest2025084-21sort11:42:420
1753476992722,3cyclictest1844609-21unixbench_multi08:37:550
1753476992721,4cyclictest2043659-21unixbench_singl11:57:570
175348399268,16cyclictest0-21swapper/211:36:362
175348399267,16cyclictest1770950-21sort07:27:392
175348399262,19cyclictest1825268-21apt-get08:22:372
175348399262,19cyclictest1819121-21ntpq08:12:482
175348399261,23cyclictest1894104-21ntpq09:27:492
175348399261,22cyclictest1870813-21ps09:07:422
175348399261,20cyclictest2069210-21cpuspeed_turbos12:27:372
175348399260,23cyclictest1978771-21/usr/sbin/munin10:52:532
175348399260,23cyclictest1845261-21seq08:41:582
175348399260,23cyclictest1839049-21/usr/sbin/munin08:32:502
175348399260,23cyclictest1839049-21/usr/sbin/munin08:32:502
175348399260,22cyclictest1971885-21cut10:47:442
175348399260,22cyclictest1795607-21/usr/sbin/munin07:52:392
1753480992623,2cyclictest2000475-21irqrtprio11:17:431
1753480992621,3cyclictest2029269-21kworker/u8:2+flush-8:012:07:241
1753480992621,3cyclictest1920041-21kworker/u8:2+events_unbound10:35:001
1753476992621,4cyclictest1868103-21kthreadcore09:02:460
1753476992621,3cyclictest2009257-21cron11:25:000
1753476992620,4cyclictest1824789-21cron08:20:000
1753476992618,6cyclictest1910329-21/usr/sbin/munin09:47:550
1753476992617,7cyclictest1939575-21latency_hist10:15:000
1753476992616,8cyclictest2072772-21ntpq12:27:490
1753476992616,8cyclictest1874006-21ntpq09:07:480
17531442262,6sleep00-21swapper/007:08:130
175348399251,21cyclictest2058975-21taskset12:15:492
175348399251,21cyclictest1758353-21latency_hist07:15:012
175348399250,23cyclictest1933660-21/usr/sbin/munin10:07:452
175348399250,23cyclictest1928109-21cut10:02:442
175348399250,23cyclictest1917956-21cut09:52:452
175348399250,21cyclictest1994825-21/usr/sbin/munin11:12:362
1753480992520,3cyclictest1775110-21systemd-run07:30:011
1753480992519,4cyclictest1849849-21kworker/u8:0+flush-8:008:52:471
1753480992516,7cyclictest2067898-21ntpq12:22:501
1753476992521,3cyclictest2061159-21kthreadcore12:17:430
1753476992521,2cyclictest0-21swapper/012:32:530
1753476992521,2cyclictest0-21swapper/010:22:460
1753476992521,2cyclictest0-21swapper/010:22:460
1753476992520,4cyclictest1829737-21/usr/sbin/munin08:25:000
1753476992518,5cyclictest1875041-21kworker/u8:0+flush-8:011:35:000
175348399241,20cyclictest1878963-21/usr/sbin/munin09:12:472
1753480992421,2cyclictest1785011-21munin-run07:40:001
1753480992418,5cyclictest101218-21kworker/u8:3+flush-8:007:42:551
1753476992420,3cyclictest1980500-21irqrtprio10:57:420
1753476992420,3cyclictest1925729-21sort10:02:410
1753476992420,2cyclictest1955355-21fschecks_count10:32:390
1753476992419,3cyclictest1920041-21kworker/u8:2+events_unbound11:17:380
1753476992415,7cyclictest1875041-21kworker/u8:0+flush-8:009:22:500
1753480992319,2cyclictest0-21swapper/111:12:361
1753480992318,3cyclictest1933852-21ntp_kernel_err10:07:471
1753480992317,4cyclictest1792579-21kthreadcore07:47:451
1753476992316,5cyclictest1920041-21kworker/u8:2+events_unbound10:52:380
1753476992315,6cyclictest1855214-21cp08:50:010
1753476992218,2cyclictest0-21swapper/009:40:000
1753476992117,2cyclictest0-21swapper/011:07:350
1753476992116,4cyclictest1870066-21kworker/u8:3+flush-8:009:17:470
17486772214,11sleep10-21swapper/107:05:451
205015521910,6sleep30-21swapper/312:07:443
1753476991914,3cyclictest0-21swapper/010:47:370
1753476991912,5cyclictest1815666-21grep08:12:390
17491322193,9sleep30-21swapper/307:07:403
18052522172,9sleep30-21swapper/308:02:373
18653542162,8sleep30-21swapper/309:02:373
20349212143,8sleep30-21swapper/311:52:433
20290252130,7sleep30-21swapper/311:45:013
20204812132,7sleep30-21swapper/311:37:423
19879992134,5sleep30-21swapper/311:02:473
19694822132,6sleep30-21swapper/310:45:013
19013702134,6sleep30-21swapper/309:37:443
18259262132,6sleep30-21swapper/308:22:443
18141962134,5sleep30-21swapper/308:07:553
17758802132,7sleep30-21swapper/307:32:403
17701522132,6sleep30-21swapper/307:25:013
20685782122,5sleep30-21swapper/312:25:023
20633942122,6sleep30-21swapper/312:17:553
20580742122,6sleep30-21swapper/312:12:543
20440972122,6sleep30-21swapper/312:00:023
20399592122,6sleep30-21swapper/311:57:463
20094892122,5sleep30-21swapper/311:25:023
20052852122,6sleep30-21swapper/311:22:423
19943632122,6sleep30-21swapper/311:10:023
19829522122,6sleep30-21swapper/310:57:463
19647542122,6sleep30-21swapper/310:40:203
19602212122,6sleep30-21swapper/310:37:393
19503582122,6sleep30-21swapper/310:27:403
19503582122,6sleep30-21swapper/310:27:403
19448272122,5sleep30-21swapper/310:20:013
19448272122,5sleep30-21swapper/310:20:013
19400332122,6sleep30-21swapper/310:17:373
19355282122,6sleep30-21swapper/310:12:433
19301392122,6sleep30-21swapper/310:07:373
19296712122,5sleep30-21swapper/310:05:013
19198132122,5sleep30-21swapper/309:55:013
19103032122,6sleep30-21swapper/309:47:193
18854602122,6sleep30-21swapper/309:22:393
18800552122,6sleep30-21swapper/309:16:173
18751792122,6sleep30-21swapper/309:12:203
18698522122,5sleep30-21swapper/309:05:013
18505262122,6sleep30-21swapper/308:47:403
18475422122,6sleep30-21swapper/308:42:463
18207522122,6sleep30-21swapper/308:17:423
17949352122,5sleep30-21swapper/307:50:013
17854862122,6sleep30-21swapper/307:42:393
17837412122,6sleep30-21swapper/307:37:453
17604102122,6sleep30-21swapper/307:15:063
20824452112,6sleep30-21swapper/312:37:463
20737892112,6sleep30-21swapper/312:31:163
20679462112,5sleep30-21swapper/312:22:533
20144822112,6sleep30-21swapper/311:30:283
19996242112,6sleep30-21swapper/311:16:203
19896622112,6sleep30-21swapper/311:05:083
19747392113,5sleep30-21swapper/310:51:323
19546312112,5sleep30-21swapper/310:30:013
19151892113,5sleep30-21swapper/309:51:403
18601122112,5sleep30-21swapper/308:55:023
18401752112,6sleep30-21swapper/308:35:363
18354192112,5sleep30-21swapper/308:32:393
18354192112,5sleep30-21swapper/308:32:393
18302522112,6sleep30-21swapper/308:27:373
18152822113,5sleep30-21swapper/308:12:003
18002602112,6sleep30-21swapper/307:57:283
17904302112,5sleep30-21swapper/307:47:373
17655652112,6sleep30-21swapper/307:21:563
17538162112,5sleep30-21swapper/307:12:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional