You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 16:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Apr 05, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
181714622030,2sleep3481ktimers/307:41:293
17870332760,3chrt75-21kworker/3:1+events07:11:393
1782727995936,20cyclictest2072749-21latency_hist12:00:010
19787062580,3sleep20-21swapper/210:26:222
19708292550,4sleep2371rcuc/210:16:302
1782727995027,20cyclictest1944093-21diskstats09:51:230
1782727994536,7cyclictest2083280-21diskstats12:11:250
1782727994522,20cyclictest1897724-21ntpq09:01:320
1782727994422,19cyclictest2032683-21apt-get11:20:010
1782727994419,9cyclictest1909343-21diskstats09:16:240
1782730994336,5cyclictest689053-21kworker/u8:2+events_unbound09:36:361
1782730994333,7cyclictest1918614-21latency_hist09:25:011
1782730994330,10cyclictest1803637-21ntpq07:26:361
1782727994319,7cyclictest280-21systemd-journal09:00:010
1782730994236,3cyclictest1888691-21kworker/u8:3+events_unbound10:16:391
1782730994136,4cyclictest689053-21kworker/u8:2+flush-8:008:26:371
1782730994131,8cyclictest1957532-21ntpq10:01:331
1782727994124,15cyclictest1987994-21idleruntime-cro10:35:000
1782727994124,15cyclictest1808964-21unixbench_multi07:31:390
1782727994122,17cyclictest0-21swapper/008:20:000
1782727994120,19cyclictest1879153-21/usr/sbin/munin08:46:310
1782727994020,17cyclictest2002819-21latency_hist10:50:000
1782727994020,17cyclictest2002819-21latency_hist10:50:000
1782727993917,7cyclictest2063198-21/usr/sbin/munin11:51:310
1782730993833,3cyclictest1903761-21kworker/u8:0+events_unbound09:41:351
1782727993827,8cyclictest1839055-21latency_hist08:05:010
178272799382,13cyclictest589-21runrttasks09:56:210
1782727993820,2cyclictest0-21swapper/011:15:010
1782727993819,15cyclictest0-21swapper/008:41:210
1782727993819,15cyclictest0-21swapper/008:41:210
1782727993816,3cyclictest0-21swapper/008:26:240
1782730993730,5cyclictest689053-21kworker/u8:2+flush-8:010:21:361
1782727993715,2cyclictest0-21swapper/009:21:180
1782730993631,3cyclictest1730334-21kworker/u8:0+events_unbound07:15:031
1782730993629,5cyclictest1888691-21kworker/u8:3+events_unbound12:11:371
1782727993627,6cyclictest2007753-21latency_hist10:54:590
1782727993616,18cyclictest2057700-21cron11:45:000
1782730993530,4cyclictest689053-21kworker/u8:2+flush-8:008:06:241
1782730993524,8cyclictest280-21systemd-journal10:31:161
178272799359,22cyclictest1782599-21kworker/0:0+events07:36:210
1782727993526,7cyclictest1907646-21ntpq09:11:330
1782727993526,7cyclictest1790124-21diskstats07:16:230
18185652340,2sleep2381ktimers/207:41:362
1782730993429,3cyclictest689053-21kworker/u8:2+flush-8:008:16:261
1782730993429,3cyclictest1888691-21kworker/u8:3+events_unbound11:46:381
1782730993428,4cyclictest689053-21kworker/u8:2+flush-8:008:51:301
1782730993422,9cyclictest1808468-21ntpq07:31:321
1782730993421,10cyclictest1839063-21apt-get08:05:001
1782727993425,7cyclictest2096640-21ntpq12:21:300
1782727993425,7cyclictest2091700-21ntpq12:16:320
1782727993414,5cyclictest2017994-21apt-get11:06:180
1782730993328,3cyclictest689053-21kworker/u8:2+events_unbound10:30:011
1782730993326,6cyclictest689053-21kworker/u8:2+flush-8:009:56:351
1782730993324,6cyclictest280-21systemd-journal11:22:161
1782727993323,8cyclictest2043156-21/usr/sbin/munin11:31:290
1782727993323,8cyclictest1884362-21diskstats08:51:240
1782730993227,4cyclictest1903761-21kworker/u8:0+flush-8:009:26:241
1782730993227,3cyclictest1888691-21kworker/u8:3+flush-8:010:46:281
1782730993227,3cyclictest1888691-21kworker/u8:3+flush-8:010:46:281
1782730993222,8cyclictest2076858-21ntpq12:01:321
1782730993221,9cyclictest280-21systemd-journal11:02:161
1782727993212,4cyclictest2033320-21aten2_r5power_c11:21:210
1782730993126,4cyclictest1730334-21kworker/u8:0+events_unbound08:11:381
1782730993126,3cyclictest2022569-21cron11:10:001
1782730993126,3cyclictest1888691-21kworker/u8:3+events_unbound09:20:011
1782730993125,5cyclictest2092215-21kworker/u8:0+events_unbound12:31:231
1782730993125,4cyclictest1888691-21kworker/u8:3+events_unbound09:51:271
1782730993123,6cyclictest689053-21kworker/u8:2+flush-8:007:51:271
1782730993121,7cyclictest2111513-21ntpq12:36:321
1782730993026,3cyclictest2003228-21aten2_r5power_e10:51:211
1782730993026,2cyclictest1938784-21aten2_r5power_p09:46:231
1782730993025,3cyclictest1888691-21kworker/u8:3+events_unbound10:06:271
1782730993024,5cyclictest1888691-21kworker/u8:3+events_unbound12:06:361
1782730993023,5cyclictest280-21systemd-journal07:41:091
178272799305,23cyclictest1809354-21kworker/0:1+events09:36:420
178272799303,25cyclictest1809354-21kworker/0:1+events10:21:270
1782727993026,3cyclictest1873882-21systemd-run08:40:000
1782727993025,3cyclictest1824230-21systemd-run07:50:000
1782730992925,2cyclictest1813987-21unixbench_singl07:36:401
1782727992921,5cyclictest1943258-21latency_hist09:50:010
19183162280,2sleep3471rcuc/309:21:383
1782730992823,3cyclictest2048652-21irqcore11:36:251
1782730992823,3cyclictest1829371-21kworker/u8:1+events_unbound08:36:281
1782730992818,7cyclictest280-21systemd-journal07:58:091
1782727992823,3cyclictest1957439-21needreboot10:01:310
1782727992817,8cyclictest2062641-21apt-get11:50:010
17823962283,8sleep20-21swapper/207:07:582
1782733992723,2cyclictest1973567-21aten2_r5power_c10:21:202
1782733992721,4cyclictest1903519-21latency_hist09:10:002
1782730992723,3cyclictest2045339-21kthreadcore11:31:271
1782730992722,4cyclictest689053-21kworker/u8:2+events_unbound07:46:371
1782730992722,4cyclictest2042849-21kworker/u8:2+flush-8:011:56:391
1782730992722,3cyclictest1787749-21kworker/u8:3+events_unbound07:21:401
1782730992720,5cyclictest1894026-21apt-get09:01:201
1782730992718,7cyclictest1907661-21ntpq09:11:331
1782727992722,4cyclictest2092215-21kworker/u8:0+flush-8:012:26:270
1782727992722,4cyclictest2013984-21kthreadcore11:01:270
1782727992721,4cyclictest1730334-21kworker/u8:0+flush-8:008:10:380
17780442275,14sleep10-21swapper/107:06:201
1782733992622,2cyclictest2058115-21aten2_r5power_e11:46:202
1782733992622,2cyclictest1938733-21aten2_r5power_c09:46:232
1782733992622,2cyclictest1909125-21aten2_r5power_c09:16:222
1782733992622,2cyclictest1819764-21aten2_r5power_v07:46:232
1782730992622,3cyclictest689053-21kworker/u8:2+flush-8:008:41:381
1782730992622,3cyclictest689053-21kworker/u8:2+flush-8:008:41:381
1782730992621,4cyclictest2042849-21kworker/u8:2+flush-8:012:16:341
1782730992620,4cyclictest2052765-21kworker/u8:0+flush-8:011:41:301
1782730992620,4cyclictest1968362-21latency_hist10:15:011
1782727992622,2cyclictest1938335-21cron09:45:000
1782727992618,6cyclictest1958937-21diskstats10:06:220
1782727992617,6cyclictest2112368-21latency_hist12:40:010
1782733992522,2cyclictest2078425-21fschecks_time12:06:242
1782733992522,2cyclictest1859755-21fschecks_time08:26:242
1782733992521,2cyclictest2018218-21cpuspeed_turbos11:06:222
1782733992521,2cyclictest1783300-21fschecks_time07:11:242
1782733992519,4cyclictest280-21systemd-journal09:25:002
1782730992519,4cyclictest1829371-21kworker/u8:1+events_unbound09:06:261
1782730992519,4cyclictest1730334-21kworker/u8:0+flush-8:007:11:301
1782730992518,5cyclictest1903761-21kworker/u8:0+events_unbound09:31:291
178272799259,15cyclictest1809354-21kworker/0:1+events09:26:290
1782727992521,2cyclictest1815395-21irqrtprio07:41:260
1782727992519,4cyclictest0-21swapper/011:36:190
1782733992420,2cyclictest1949093-21fschecks_count09:56:242
1782733992420,2cyclictest1919251-21fschecks_count09:26:232
1782733992420,2cyclictest1889317-21fschecks_count08:56:242
1782733992420,2cyclictest0-21swapper/209:45:002
1782733992418,4cyclictest2077367-21unixbench_multi12:01:402
1782730992421,2cyclictest2098447-21irqcore12:26:261
1782730992420,3cyclictest1859041-21cron08:25:001
1782730992418,4cyclictest1903761-21kworker/u8:0+events_unbound10:36:301
1782730992417,5cyclictest689053-21kworker/u8:2+flush-8:008:31:321
1782727992418,5cyclictest1928148-21unixbench_singl09:31:400
1782727992418,4cyclictest1868935-21turbostat.cron08:35:000
1782733992320,2cyclictest1998374-21aten2_r5power_v10:46:232
1782733992320,2cyclictest1998374-21aten2_r5power_v10:46:232
1782733992319,2cyclictest2102483-21cron12:30:002
1782733992319,2cyclictest2097189-21unixbench_singl12:21:372
1782733992319,2cyclictest2048410-21fschecks_count11:36:232
1782733992317,4cyclictest2042473-21unixbench_multi11:26:382
1782730992320,2cyclictest0-21swapper/108:50:001
1782730992319,2cyclictest0-21swapper/110:45:001
1782730992318,4cyclictest2092215-21kworker/u8:0+flush-8:012:21:021
1782730992318,3cyclictest2042365-21wc11:26:361
1782730992318,3cyclictest0-21swapper/108:56:271
178272799239,13cyclictest1809354-21kworker/0:1+events08:07:140
1782727992319,2cyclictest2012707-21sendmail11:00:010
1782727992319,2cyclictest1903528-21awk09:10:000
1782727992318,3cyclictest1858742-21unixbench_singl08:21:380
1782727992316,5cyclictest1794727-21sshd07:20:020
1782733992219,2cyclictest2013173-21aten2_r5power_v11:01:222
1782733992219,2cyclictest1963938-21fschecks_time10:11:242
1782733992217,3cyclictest2007392-21unixbench_multi10:51:392
1782733992214,6cyclictest2104132-21sshd12:31:282
178273399220,8cyclictest21114012missed_timers12:36:312
1782730992218,3cyclictest2028072-21/usr/sbin/munin11:16:291
1782730992218,2cyclictest0-21swapper/111:51:211
178272799223,17cyclictest388745-21kworker/0:2+events07:11:350
1782727992217,3cyclictest1804079-21unixbench_singl07:26:400
1782727992216,3cyclictest0-21swapper/012:31:320
1782733992118,2cyclictest1894378-21fschecks_time09:01:252
1782733992117,3cyclictest1884379-21fschecks_count08:51:242
1782733992117,2cyclictest1835399-21kthreadcore08:01:292
1782733992117,2cyclictest0-21swapper/211:15:012
1782733992117,2cyclictest0-21swapper/209:15:012
1782733992116,3cyclictest2033620-21tune2fs11:21:242
1782733992116,3cyclictest1987646-21unixbench_multi10:31:412
178273399210,19cyclictest1954653-21uname10:01:272
1782730992117,3cyclictest0-21swapper/111:15:011
1782730992115,4cyclictest0-21swapper/110:56:281
178272799216,14cyclictest1809354-21kworker/0:1+events12:05:330
178272799214,15cyclictest1809354-21kworker/0:1+events11:25:250
1782727992117,2cyclictest0-21swapper/007:51:290
1782727992116,3cyclictest1982708-21unixbench_singl10:26:390
1782727992113,6cyclictest1967481-21ntpq10:11:350
17820312212,12sleep01782269-21unixbench_singl07:06:400
178273399202,13cyclictest1846733-21ps08:11:312
1782733992016,2cyclictest1849627-21aten2_r5power_v08:16:242
1782733992016,2cyclictest0-21swapper/208:46:312
1782733992015,3cyclictest1809320-21cron07:35:002
1782733992013,5cyclictest0-21swapper/208:06:292
178272799203,16cyclictest1809354-21kworker/0:1+events10:16:210
1782727992015,3cyclictest1833743-21unixbench_multi07:56:400
178272799201,17cyclictest1809354-21kworker/0:1+events10:44:340
17777212203,9sleep30-21swapper/307:05:023
178273399198,8cyclictest1824560-21apt-get07:51:192
1782733991916,2cyclictest0-21swapper/211:51:272
1782733991915,2cyclictest2008217-21aten2_r5power_v10:56:202
1782733991910,7cyclictest1947193-21tr09:51:302
178273399182,12cyclictest2031894-21ntpq11:16:342
1782733991815,2cyclictest1794157-21unixbench_singl07:16:402
1782733991814,2cyclictest0-21swapper/212:16:232
1782733991814,2cyclictest0-21swapper/211:31:352
1782733991814,2cyclictest0-21swapper/210:41:252
178272799183,14cyclictest1809354-21kworker/0:1+events12:04:550
178273399177,2cyclictest0-21swapper/209:31:252
1782733991714,2cyclictest1958978-21fschecks_count10:06:242
1782733991713,2cyclictest1814284-21cron07:40:002
1782733991713,2cyclictest0-21swapper/210:36:392
1782733991713,2cyclictest0-21swapper/209:36:392
1782733991713,2cyclictest0-21swapper/208:36:222
1782733991712,3cyclictest1868200-21ntpq08:31:352
1782733991712,3cyclictest0-21swapper/211:56:252
178273399171,12cyclictest1855361-21kernelversion08:21:262
178272799172,5cyclictest0-21swapper/010:36:230
20031722162,9sleep30-21swapper/310:51:203
18692902162,9sleep30-21swapper/308:36:203
178273399162,13cyclictest0-21swapper/207:58:192
1782733991612,2cyclictest2083344-21fschecks_time12:11:252
1782733991612,2cyclictest0-21swapper/207:25:002
1782733991611,3cyclictest0-21swapper/208:41:302
1782733991611,3cyclictest0-21swapper/208:41:302
1782733991611,3cyclictest0-21swapper/207:26:292
178273399156,2cyclictest0-21swapper/211:43:442
19603822140,3sleep375-21kworker/3:1+events10:06:283
20419612132,7sleep30-21swapper/311:26:313
20225962132,6sleep30-21swapper/311:10:023
20198372130,2sleep3481ktimers/311:06:283
19476962132,7sleep30-21swapper/309:51:363
19323792133,6sleep30-21swapper/309:36:313
18928452132,7sleep30-21swapper/308:56:343
17982382133,6sleep30-21swapper/307:21:323
21074262122,5sleep30-21swapper/312:35:013
21028132122,6sleep30-21swapper/312:31:203
20925362122,6sleep30-21swapper/312:20:003
20826912122,5sleep30-21swapper/312:10:013
20728842122,5sleep30-21swapper/312:00:023
20638162123,5sleep30-21swapper/311:51:273
20620212122,6sleep30-21swapper/311:46:383
20535002122,6sleep30-21swapper/311:41:283
20477922122,6sleep30-21swapper/311:35:023
19986332122,6sleep30-21swapper/310:46:263
19986332122,6sleep30-21swapper/310:46:263
19932682122,6sleep30-21swapper/310:41:163
19830162122,5sleep30-21swapper/310:30:003
19827472122,6sleep30-21swapper/310:26:403
19732422122,5sleep30-21swapper/310:20:023
19725892122,6sleep30-21swapper/310:16:403
19539942122,6sleep30-21swapper/310:01:233
19484732122,5sleep30-21swapper/309:55:013
19235272122,5sleep30-21swapper/309:30:013
19192462122,6sleep30-21swapper/309:26:243
19089832122,6sleep30-21swapper/309:15:173
19043502122,6sleep30-21swapper/309:11:273
19028292122,6sleep30-21swapper/309:06:383
18939932122,6sleep30-21swapper/309:01:163
18780982122,6sleep30-21swapper/308:41:383
18780982122,6sleep30-21swapper/308:41:383
18681462123,5sleep30-21swapper/308:31:343
18491732122,5sleep30-21swapper/308:15:013
18467392122,6sleep30-21swapper/308:11:323
18393992122,5sleep30-21swapper/308:05:023
18201212122,6sleep30-21swapper/307:46:283
18141612123,6sleep30-21swapper/307:38:373
17936592122,6sleep30-21swapper/307:16:343
20977302112,5sleep30-21swapper/312:25:023
20929902112,5sleep30-21swapper/312:21:213
20780472112,5sleep30-21swapper/312:06:203
20684032112,6sleep30-21swapper/311:56:253
20464092112,5sleep30-21swapper/311:31:293
20332932112,5sleep30-21swapper/311:21:213
20280712112,5sleep30-21swapper/311:16:203
20130332112,5sleep30-21swapper/311:01:193
20085292112,5sleep30-21swapper/310:56:253
19907632112,5sleep30-21swapper/310:36:313
19634922112,5sleep30-21swapper/310:10:023
19385692112,5sleep30-21swapper/309:45:023
19341162112,5sleep30-21swapper/309:41:243
18879292112,5sleep30-21swapper/308:51:363
18791522112,5sleep30-21swapper/308:46:193
18636242112,5sleep30-21swapper/308:26:413
18588972112,5sleep30-21swapper/308:23:123
18350682112,5sleep30-21swapper/308:01:293
18295842112,5sleep30-21swapper/307:56:233
18249832112,5sleep30-21swapper/307:51:253
18046192112,5sleep30-21swapper/307:30:023
18000702112,5sleep30-21swapper/307:26:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional