You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 22:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 26, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176182123830,2sleep3451irq_work/307:25:173
20637372950,3chrt75-21kworker/3:1-events12:25:313
18509712950,5chrt0-21swapper/108:55:011
18519742930,2chrt471rcuc/308:55:233
1744767997467,5cyclictest1846010-21kworker/u8:3+flush-8:010:35:271
1744767997467,5cyclictest1846010-21kworker/u8:3+flush-8:010:35:271
20493082640,1sleep02049310-21grep12:10:360
1744767995746,8cyclictest1748716-21ntpq07:10:301
1744767995549,5cyclictest1751768-21kworker/u8:2+flush-8:007:25:351
1744767995548,5cyclictest1846010-21kworker/u8:3+events_unbound09:20:281
1744767995448,5cyclictest1743746-21kworker/u8:1+events_unbound08:25:291
1744767995448,4cyclictest1836319-21kworker/u8:2+flush-8:009:00:331
1744765995443,8cyclictest1911323-21diskstats09:55:190
18169352530,2sleep30-21swapper/308:20:193
1744767995348,4cyclictest1751768-21kworker/u8:2+events_unbound07:45:311
1744767995248,3cyclictest1846010-21kworker/u8:3+flush-8:011:55:451
1744767995247,4cyclictest1743746-21kworker/u8:1+events_unbound07:30:271
1744767995245,3cyclictest1866080-21kworker/u8:0+flush-8:009:30:301
1744765995245,5cyclictest1743746-21kworker/u8:1+flush-8:007:30:270
19239072510,4chrt0-21swapper/310:05:253
1744767995044,4cyclictest1796754-21kworker/u8:0+flush-8:008:20:281
1744767995043,5cyclictest1846010-21kworker/u8:3+flush-8:011:40:311
1744767994945,3cyclictest1959775-21kworker/u8:2+events_unbound10:50:351
1744767994943,4cyclictest1751768-21kworker/u8:2+events_unbound07:35:381
1744767994942,5cyclictest1940749-21kworker/u8:0+flush-8:010:30:281
1744767994937,9cyclictest1959673-21ntpq10:40:271
1744767994844,3cyclictest1796754-21kworker/u8:0+flush-8:008:05:311
1744767994842,4cyclictest1751768-21kworker/u8:2+flush-8:007:15:341
1744767994841,5cyclictest1796754-21kworker/u8:0+flush-8:008:10:311
1744767994840,5cyclictest1866080-21kworker/u8:0+flush-8:009:10:251
1744767994840,5cyclictest1846010-21kworker/u8:3+events_unbound10:55:271
1744765994839,6cyclictest2039769-21latency_hist12:05:000
1744767994742,3cyclictest1846010-21kworker/u8:3+events_unbound11:10:331
1744767994741,4cyclictest1796754-21kworker/u8:0+flush-8:008:45:321
1744767994638,5cyclictest2009717-21kworker/u8:0+flush-8:012:30:291
1744767994538,4cyclictest1846010-21kworker/u8:3+events_unbound08:55:241
1744765994533,9cyclictest1874790-21ntpq09:15:270
1744767994439,4cyclictest2009717-21kworker/u8:0+flush-8:012:20:371
1744767994439,4cyclictest1866080-21kworker/u8:0+events_unbound10:00:271
1744767994438,4cyclictest2053605-21kworker/u8:2+flush-8:012:15:311
1744767994437,5cyclictest1980648-21kworker/u8:1+events_unbound12:00:321
1744767994436,6cyclictest1836319-21kworker/u8:2+flush-8:010:05:311
1744765994435,6cyclictest1766408-21latency_hist07:30:010
1744765994433,9cyclictest1704890-21systemd-journal08:00:010
1744767994337,4cyclictest2009717-21kworker/u8:0+flush-8:012:05:191
1744767994336,5cyclictest1846010-21kworker/u8:3+flush-8:012:10:301
1744767994237,4cyclictest1751768-21kworker/u8:2+events_unbound07:40:351
1744767994234,6cyclictest1866080-21kworker/u8:0+events_unbound09:15:321
1744767994134,5cyclictest1980648-21kworker/u8:1+flush-8:011:30:281
1744767994133,6cyclictest1865839-21latency_hist09:10:011
1744767994133,5cyclictest1990567-21kworker/u8:2+flush-8:011:25:311
1744770994030,8cyclictest2064566-21awk12:29:592
1744770994029,9cyclictest1905667-21apt-get09:50:002
1744767994033,5cyclictest1796754-21kworker/u8:0+flush-8:008:35:301
1744767994032,6cyclictest1756810-21apt-get07:20:191
1744767994032,6cyclictest1756810-21apt-get07:20:181
1744765994031,7cyclictest1846010-21kworker/u8:3+flush-8:010:45:250
1744767993934,4cyclictest1836319-21kworker/u8:2+flush-8:009:35:351
1744767993926,9cyclictest1704890-21systemd-journal10:15:251
1744767993926,9cyclictest1704890-21systemd-journal10:15:241
19076282380,3sleep239-21ksoftirqd/209:50:232
1744770993823,13cyclictest1816625-21aten2_r5power_e08:20:172
1744767993832,4cyclictest1900506-21apt-get09:45:001
1744767993832,4cyclictest1836319-21kworker/u8:2+events_unbound08:40:231
1744767993831,5cyclictest1846010-21kworker/u8:3+flush-8:009:55:351
1744767993829,6cyclictest1704890-21systemd-journal12:35:261
1744770993722,12cyclictest2055017-21aten2_r5power_v12:20:172
1744767993731,5cyclictest2009717-21kworker/u8:0+flush-8:012:25:291
1744765993727,7cyclictest1905891-21cp09:50:000
1744770993624,10cyclictest1806739-21aten2_r5power_e08:10:172
1744770993623,11cyclictest1890907-21aten2_r5power_c09:35:152
1744770993622,12cyclictest2050006-21aten2_r5power_e12:15:172
1744767993629,5cyclictest1846010-21kworker/u8:3+flush-8:009:40:281
1744767993628,5cyclictest1704890-21systemd-journal09:51:251
174477099353,9cyclictest1880960-21apt-get09:25:152
1744770993523,10cyclictest1851434-21cpuspeed_turbos08:55:182
1744770993522,11cyclictest2015416-21aten2_r5power_e11:40:172
174477099352,12cyclictest1811610-21apt-get08:15:162
1744770993516,16cyclictest1806417-21turbostat.cron08:10:012
1744767993531,3cyclictest1846010-21kworker/u8:3+events_unbound11:45:201
1744767993528,5cyclictest1866080-21kworker/u8:0+flush-8:010:10:281
1744765993528,5cyclictest1796754-21kworker/u8:0+flush-8:008:35:360
1744765993528,5cyclictest1704890-21systemd-journal12:19:350
174477099341,12cyclictest1980684-21apt-get11:05:162
1744767993426,6cyclictest1866080-21kworker/u8:0+flush-8:009:25:261
1744765993429,4cyclictest1796754-21kworker/u8:0+flush-8:008:15:320
1744765993426,6cyclictest1704890-21systemd-journal08:35:010
1744765993425,7cyclictest1980648-21kworker/u8:1+flush-8:011:05:220
1744765993425,7cyclictest1930217-21kworker/u8:1+events_unbound10:25:280
1744770993327,4cyclictest2074589-21cp12:40:012
1744765993328,4cyclictest1846010-21kworker/u8:3+flush-8:011:40:330
1744765993328,3cyclictest2032328-21kthreadcore11:55:230
1744765993327,4cyclictest1796754-21kworker/u8:0+events_unbound08:20:230
1744765993323,8cyclictest1791317-21apt-get07:55:010
1744765993322,9cyclictest1704890-21systemd-journal10:15:000
1744770993217,13cyclictest1866166-21aten2_r5power_e09:10:162
1744770993216,13cyclictest0-21swapper/211:15:242
1744770993212,6cyclictest1849096-21seq08:50:262
174477099321,11cyclictest1995553-21apt-get11:20:162
1744767993227,3cyclictest1704890-21systemd-journal08:20:011
1744767993225,5cyclictest1751768-21kworker/u8:2+events_unbound07:55:271
1744767993224,6cyclictest1846010-21kworker/u8:3+flush-8:011:35:311
1744765993221,8cyclictest1704890-21systemd-journal09:10:000
174477099319,8cyclictest1776388-21awk07:40:002
174477099311,8cyclictest1761740-21apt-get07:25:152
1744770993110,9cyclictest1977963-21cut11:00:232
1744765993127,3cyclictest1735072-21kworker/u8:3+flush-8:007:45:310
1744765993125,5cyclictest1866080-21kworker/u8:0+events_unbound10:00:290
1744765993124,5cyclictest2074460-21cron12:39:590
1744765993123,6cyclictest1704890-21systemd-journal12:35:000
174476599312,24cyclictest1826216-21kworker/0:2+events08:40:030
174476599311,28cyclictest1860901-21true09:05:010
174477099302,8cyclictest1785388-21ntpq07:45:282
174477099302,7cyclictest1895828-21apt-get09:40:142
174477099301,11cyclictest1930828-21apt-get10:15:162
174477099301,11cyclictest1930828-21apt-get10:15:152
1744767993026,2cyclictest1791319-21idleruntime-cro07:55:001
1744767993024,4cyclictest1796754-21kworker/u8:0+events_unbound08:00:231
1744765993025,4cyclictest1940749-21kworker/u8:0+flush-8:010:30:310
1744765993024,4cyclictest1845585-21grep08:45:360
1744765993021,7cyclictest1836319-21kworker/u8:2+flush-8:009:35:310
1744765993020,8cyclictest1900506-21apt-get09:45:010
17437902303,6sleep10-21swapper/107:05:321
174477099299,6cyclictest1791615-21cat07:55:012
174477099299,5cyclictest1962610-21tr10:45:242
174477099292,7cyclictest2035122-21apt-get12:00:142
1744770992925,2cyclictest2030282-21aten2_r5power_v11:55:162
1744770992913,15cyclictest0-21swapper/210:05:002
174477099291,11cyclictest1950947-21taskset10:35:142
174477099291,11cyclictest1950947-21taskset10:35:132
1744765992925,2cyclictest1876615-21irqcore09:20:220
1744765992924,4cyclictest1751768-21kworker/u8:2+flush-8:007:20:240
1744765992924,4cyclictest1751768-21kworker/u8:2+flush-8:007:20:240
1744765992923,5cyclictest1751768-21kworker/u8:2+flush-8:007:35:310
17445022290,7sleep00-21swapper/007:08:500
19458902280,2sleep21945895-21sort10:30:162
174477099288,7cyclictest1890221-21unixbench_singl09:30:352
174477099287,7cyclictest2065793-21tr12:30:232
174477099282,7cyclictest1914794-21ntpq09:55:272
174477099281,9cyclictest1745662-21/usr/sbin/munin07:10:252
1744770992815,11cyclictest0-21swapper/210:30:002
1744770992813,13cyclictest1776747-21aten2_r5power_p07:40:162
1744770992812,2cyclictest0-21swapper/211:54:592
174477099281,13cyclictest1821528-21taskset08:25:152
1744770992810,2cyclictest0-21swapper/210:20:342
1744767992824,3cyclictest1846010-21kworker/u8:3+flush-8:011:50:341
1744767992823,4cyclictest1743746-21kworker/u8:1+flush-8:008:30:341
1744765992825,2cyclictest1960638-21systemd-run10:44:590
1744765992824,2cyclictest2010561-21cpuspeed_turbos11:35:190
1744765992823,4cyclictest2009717-21kworker/u8:0+events_unbound12:20:270
1744765992823,4cyclictest1930217-21kworker/u8:1+events_unbound10:15:330
1744765992823,4cyclictest1930217-21kworker/u8:1+events_unbound10:15:320
1744765992822,4cyclictest1972922-21kthreadcore10:55:240
1744765992822,4cyclictest1905667-21apt-get09:50:030
1744765992821,5cyclictest1743746-21kworker/u8:1+flush-8:008:25:290
174477099279,3cyclictest1970509-21idleruntime-cro10:55:012
174477099279,2cyclictest0-21swapper/211:30:012
174477099277,7cyclictest1793637-21tr07:55:232
174477099276,7cyclictest1864222-21tr09:05:252
174477099276,6cyclictest1958840-21tr10:40:252
174477099276,6cyclictest1750880-21cut07:15:032
174477099272,6cyclictest2010338-21apt-get11:35:172
174477099272,6cyclictest1970769-21apt-get10:55:172
1744770992715,10cyclictest0-21swapper/212:05:272
174477099271,10cyclictest1758196-21kthreadcore07:20:272
174477099271,10cyclictest1758196-21kthreadcore07:20:272
1744767992721,4cyclictest1980648-21kworker/u8:1+events_unbound11:05:301
1744765992722,3cyclictest2004721-21unixbench_multi11:25:360
1744765992721,4cyclictest1846010-21kworker/u8:3+flush-8:011:50:320
1744765992720,6cyclictest1980648-21kworker/u8:1+flush-8:011:10:300
1744765992720,5cyclictest1704890-21systemd-journal11:16:240
1744765992716,9cyclictest1704890-21systemd-journal07:45:010
174477099262,4cyclictest0-21swapper/211:30:312
1744770992610,3cyclictest0-21swapper/208:40:232
1744767992622,3cyclictest1846010-21kworker/u8:3+events_unbound11:15:191
1744767992620,3cyclictest1930217-21kworker/u8:1+events_unbound10:25:271
1744765992622,3cyclictest2009717-21kworker/u8:0+events_unbound12:25:330
1744765992622,3cyclictest1855949-21systemd-run09:00:000
1744765992622,3cyclictest1743746-21kworker/u8:1+events_unbound08:50:350
174476599261,24cyclictest1739772-21kworker/0:0+events07:15:400
174477099252,12cyclictest0-21swapper/208:04:532
1744770992511,2cyclictest0-21swapper/207:30:242
174477099251,10cyclictest1857461-21kthreadcore09:00:232
1744767992520,3cyclictest1976442-21irqrtprio11:00:211
1744767992520,2cyclictest0-21swapper/111:25:011
1744767992519,4cyclictest1846010-21kworker/u8:3+events_unbound10:20:171
1744765992522,2cyclictest1890603-21cron09:35:000
1744765992521,3cyclictest1796754-21kworker/u8:0+flush-8:008:00:260
1744765992513,9cyclictest1921211-21diskstats10:05:200
174477099245,7cyclictest1925675-21sed10:10:002
1744767992419,2cyclictest0-21swapper/110:45:231
174476599242,21cyclictest1846015-21kworker/0:1+events10:35:210
174476599242,21cyclictest1846015-21kworker/0:1+events10:35:210
1744765992418,4cyclictest1811363-21systemd-run08:15:010
174477099239,2cyclictest0-21swapper/211:45:332
1744770992318,4cyclictest1830731-21unixbench_singl08:30:372
174477099231,3cyclictest1874218-21cut09:15:242
174476599232,20cyclictest1846015-21kworker/0:1+events11:46:420
174476599232,20cyclictest1846015-21kworker/0:1+events10:20:190
1744765992318,3cyclictest0-21swapper/012:05:170
174476599222,19cyclictest0-21swapper/010:50:340
174476599222,19cyclictest0-21swapper/008:05:330
1744765992218,2cyclictest0-21swapper/011:00:170
174477099218,3cyclictest0-21swapper/211:10:252
1744770992117,3cyclictest1876111-21aten2_r5power_p09:20:172
1744770992117,2cyclictest1831453-21aten2_r5power_e08:35:172
174476599211,19cyclictest2009779-21sshd11:31:240
174477099209,4cyclictest0-21swapper/208:45:322
1744765992017,2cyclictest0-21swapper/011:20:260
1744765992015,3cyclictest0-21swapper/009:25:260
174476599201,18cyclictest1870641-21sshd09:13:240
17445152204,9sleep20-21swapper/207:08:592
1744770991912,6cyclictest0-21swapper/210:10:302
174476599199,8cyclictest0-21swapper/007:10:220
1744770991810,6cyclictest2046569-21tr12:10:232
17444632183,9sleep30-21swapper/307:08:213
19655572156,5sleep30-21swapper/310:50:003
19804432144,6sleep30-21swapper/311:05:013
19157282142,7sleep30-21swapper/310:00:013
18958312140,9sleep30-21swapper/309:40:143
18017462142,8sleep30-21swapper/308:05:153
20735452132,7sleep30-21swapper/312:35:283
20056692133,6sleep30-21swapper/311:30:193
19510302133,6sleep30-21swapper/310:35:163
19510302133,6sleep30-21swapper/310:35:153
18561952132,7sleep30-21swapper/309:00:163
18351092132,7sleep30-21swapper/308:35:293
17863762132,7sleep30-21swapper/307:50:023
20647282122,5sleep30-21swapper/312:30:013
20589512122,6sleep30-21swapper/312:20:353
20397962122,6sleep30-21swapper/312:05:023
20301302122,5sleep30-21swapper/311:55:023
20151092122,5sleep30-21swapper/311:40:013
20014992122,6sleep30-21swapper/311:25:253
19949732122,6sleep30-21swapper/311:16:263
19899202122,6sleep30-21swapper/311:10:363
19757272122,6sleep30-21swapper/311:00:173
19459752122,6sleep30-21swapper/310:30:193
19361982122,6sleep30-21swapper/310:20:193
19348792122,6sleep30-21swapper/310:15:343
19348792122,6sleep30-21swapper/310:15:343
19302042122,6sleep30-21swapper/310:10:353
19061782122,6sleep30-21swapper/309:50:173
19013432122,6sleep30-21swapper/309:45:203
18807162122,5sleep30-21swapper/309:25:013
18769122122,6sleep30-21swapper/309:20:233
18715242122,6sleep30-21swapper/309:15:223
18700482122,6sleep30-21swapper/309:10:333
18658262122,6sleep30-21swapper/309:10:013
18460272122,6sleep30-21swapper/308:50:023
18456232122,6sleep30-21swapper/308:45:363
18397162122,6sleep30-21swapper/308:40:273
18264322122,6sleep30-21swapper/308:30:153
18240152122,6sleep30-21swapper/308:25:253
18115302122,6sleep30-21swapper/308:15:033
18011442122,6sleep30-21swapper/308:00:503
17917832122,6sleep30-21swapper/307:55:113
17760722122,6sleep30-21swapper/307:36:253
17683812122,6sleep30-21swapper/307:30:243
20499532112,6sleep30-21swapper/312:15:173
20452392110,7sleep30-21swapper/312:10:193
20351812112,6sleep30-21swapper/312:00:163
20275532112,5sleep30-21swapper/311:50:253
20203082112,5sleep30-21swapper/311:45:153
20103122112,6sleep30-21swapper/311:35:153
19961552112,5sleep30-21swapper/311:20:223
19747822112,5sleep30-21swapper/310:55:353
19661812112,5sleep30-21swapper/310:50:213
19599112112,5sleep30-21swapper/310:40:343
19407922112,5sleep30-21swapper/310:25:173
19169452112,5sleep30-21swapper/310:00:253
18908812112,6sleep30-21swapper/309:35:163
18863372112,5sleep30-21swapper/309:30:233
18108892112,5sleep30-21swapper/308:10:363
17816102112,6sleep30-21swapper/307:45:093
17807052112,5sleep30-21swapper/307:40:353
17568132112,6sleep30-21swapper/307:20:213
17568132112,6sleep30-21swapper/307:20:203
17499752112,5sleep30-21swapper/307:15:033
17446452112,5sleep30-21swapper/307:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional