You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 12:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Jul 14, 2026 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207918123690,4sleep30-21swapper/300:22:333
19853782880,1chrt1985380-21kthreadcore22:47:350
19182092760,5sleep30-21swapper/321:37:363
1767926996049,8cyclictest1894313-21latency_hist21:15:011
1767922995717,26cyclictest0-21swapper/021:42:390
1767922995634,18cyclictest281-21systemd-journal23:05:010
176316125627,10sleep10-21swapper/119:05:531
1767922995546,6cyclictest2033241-21latency_hist23:35:020
1767922995546,6cyclictest2018377-21latency_hist23:20:010
1767926995145,4cyclictest1753120-21kworker/u8:2+events_unbound21:47:291
1767926994943,4cyclictest1904413-21kworker/u8:1+events_unbound23:10:011
1767922994930,17cyclictest1959970-21irqrtprio22:22:350
1767922994840,6cyclictest1948926-21latency_hist22:10:010
18836282450,3chrt584-21kworker/3:2+events21:02:383
1767926994540,4cyclictest2008493-21kworker/u8:3+flush-8:023:32:461
1767926994539,5cyclictest1904413-21kworker/u8:1+flush-8:023:02:451
1767926994437,5cyclictest943196-21kworker/u8:1+events_unbound20:32:461
1767926994335,6cyclictest2008493-21kworker/u8:3+events_unbound23:37:281
19618892420,2chrt0-21swapper/222:22:372
1767926994237,4cyclictest2008493-21kworker/u8:3+events_unbound23:22:271
1767926994236,5cyclictest2048110-21kworker/u8:1+events_unbound00:32:301
1767926994236,5cyclictest1753120-21kworker/u8:2+events_unbound20:50:031
1767922994226,14cyclictest2082751-21cron00:24:590
1767926994136,3cyclictest2048110-21kworker/u8:1+events_unbound00:17:341
1767926994134,5cyclictest1939048-21kworker/u8:0+events_unbound22:22:301
1767926994134,5cyclictest1753120-21kworker/u8:2+events_unbound21:07:401
1767926994132,7cyclictest1943992-21latency_hist22:05:011
1767922994130,8cyclictest1982987-21ntpq22:42:380
1767926994036,3cyclictest1753120-21kworker/u8:2+events_unbound20:27:481
1767926994033,5cyclictest1762890-21kworker/u8:3+flush-8:019:27:401
176792299409,22cyclictest0-21swapper/020:23:460
1767922994031,7cyclictest281-21systemd-journal20:37:330
1767922994031,6cyclictest281-21systemd-journal00:27:330
1767922994010,17cyclictest1974499-21cpuspeed22:37:280
1767926993935,3cyclictest1939048-21kworker/u8:0+events_unbound23:00:001
1767926993934,4cyclictest943196-21kworker/u8:1+events_unbound20:37:301
1767926993934,4cyclictest1884645-21kworker/u8:3+events_unbound21:22:331
1767926993933,4cyclictest943196-21kworker/u8:1+events_unbound19:47:301
1767926993932,5cyclictest1939048-21kworker/u8:0+events_unbound23:27:341
1767926993932,5cyclictest1939048-21kworker/u8:0+events_unbound23:12:281
1767922993921,16cyclictest1939012-21latency_hist22:00:010
1767922993920,17cyclictest2090312-21tr00:32:360
1767922993916,18cyclictest0-21swapper/020:12:280
1767926993833,4cyclictest1753120-21kworker/u8:2+events_unbound19:22:391
1767926993833,3cyclictest1904413-21kworker/u8:1+events_unbound22:47:351
1767926993832,5cyclictest943196-21kworker/u8:1+events_unbound20:07:301
1767926993831,5cyclictest1762890-21kworker/u8:3+events_unbound19:52:341
176792299388,19cyclictest585-21runrttasks20:18:490
19827742370,2sleep3481ktimers/322:42:363
19322132370,3sleep2371rcuc/221:52:362
1767930993732,3cyclictest452-21mta-sts-daemon22:40:002
1767930993732,3cyclictest1904413-21kworker/u8:1+flush-8:022:17:462
1767926993733,3cyclictest1762890-21kworker/u8:3+flush-8:020:12:471
1767926993732,4cyclictest1939048-21kworker/u8:0+flush-8:023:57:401
1767926993732,4cyclictest1939048-21kworker/u8:0+events_unbound23:55:001
1767926993732,3cyclictest1753120-21kworker/u8:2+flush-8:020:42:441
1767922993721,13cyclictest0-21swapper/021:55:010
1767922993720,15cyclictest1993698-21cron22:55:000
1767922993720,14cyclictest0-21swapper/019:25:010
1767922993719,16cyclictest2077823-21idleruntime-cro00:20:000
176792299371,5cyclictest19056651kthreadcore21:27:360
1767930993629,5cyclictest1795046-21cat19:35:002
1767926993631,4cyclictest1939048-21kworker/u8:0+events_unbound22:42:301
1767926993630,5cyclictest1762890-21kworker/u8:3+events_unbound20:22:301
1767926993630,5cyclictest1753120-21kworker/u8:2+events_unbound22:37:381
1767926993629,5cyclictest1939048-21kworker/u8:0+events_unbound22:52:391
1767922993618,16cyclictest1968464-21unixbench_singl22:27:450
1767926993530,4cyclictest1762890-21kworker/u8:3+events_unbound19:42:331
1767926993529,5cyclictest943196-21kworker/u8:1+events_unbound19:12:421
1767926993529,4cyclictest2048110-21kworker/u8:1+events_unbound00:07:311
176792299353,3cyclictest0-21swapper/022:12:270
176792299353,3cyclictest0-21swapper/019:17:260
176792299351,7cyclictest1903415-21ntpq21:22:420
176792299351,6cyclictest585-21runrttasks21:30:580
1767922993516,16cyclictest281-21systemd-journal00:05:010
1767922993511,19cyclictest1849775-21apt-get20:32:270
1767926993431,2cyclictest1753120-21kworker/u8:2+events_unbound21:52:311
1767926993429,3cyclictest1884645-21kworker/u8:3+flush-8:021:42:341
1767926993428,4cyclictest1904413-21kworker/u8:1+events_unbound21:32:411
1767926993425,7cyclictest1775148-21/usr/sbin/munin19:17:361
176792299343,3cyclictest0-21swapper/023:57:260
176792299343,3cyclictest0-21swapper/019:27:270
176792299343,2cyclictest0-21swapper/021:37:250
176792299343,2cyclictest0-21swapper/020:47:270
176792299342,11cyclictest2008906-21apt-get23:12:270
1767922993416,16cyclictest1826444-21kthreadcore20:07:350
1767922993412,19cyclictest1767925-21latency_hist19:10:010
1767926993329,3cyclictest1753120-21kworker/u8:2+flush-8:021:02:441
1767926993329,2cyclictest1797587-21kthreadcore19:37:371
176792299334,27cyclictest0-21swapper/019:12:340
176792299333,2cyclictest0-21swapper/023:27:260
176792299333,2cyclictest0-21swapper/022:32:270
176792299333,2cyclictest0-21swapper/022:32:260
176792299333,2cyclictest0-21swapper/019:47:260
176792299332,2cyclictest0-21swapper/000:37:250
1767922993318,12cyclictest0-21swapper/023:10:000
1767922993317,14cyclictest2067068-21needreboot00:07:380
1767922993317,14cyclictest0-21swapper/019:37:430
1767922993315,15cyclictest0-21swapper/019:42:290
176792299331,29cyclictest2033509-21sshd23:35:320
1767926993227,4cyclictest1904413-21kworker/u8:1+events_unbound21:57:471
1767926993226,4cyclictest1790779-21sed19:32:331
1767926993223,7cyclictest1918263-21ntpq21:37:371
176792299323,3cyclictest0-21swapper/023:47:270
176792299323,3cyclictest0-21swapper/023:42:270
176792299323,2cyclictest0-21swapper/023:22:270
176792299323,2cyclictest0-21swapper/021:02:270
176792299323,2cyclictest0-21swapper/019:52:260
176792299323,2cyclictest0-21swapper/019:32:260
176792299322,4cyclictest1994141-21apt-get22:57:260
176792299322,2cyclictest0-21swapper/020:57:270
1767922993221,9cyclictest0-21swapper/022:02:400
1767922993215,15cyclictest1889379-21systemd-run21:10:010
1767926993126,4cyclictest2008493-21kworker/u8:3+events_unbound23:47:411
1767926993126,4cyclictest2008493-21kworker/u8:3+events_unbound23:42:321
1767926993126,4cyclictest1939048-21kworker/u8:0+events_unbound22:27:421
1767926993125,4cyclictest1859669-21kworker/u8:0+events_unbound21:17:431
176792299313,3cyclictest0-21swapper/021:47:260
176792299313,2cyclictest0-21swapper/020:42:250
176792299313,2cyclictest0-21swapper/020:27:260
176792299313,14cyclictest0-21swapper/019:55:010
176792299312,3cyclictest1873790-21ntpq20:52:410
176792299311,9cyclictest1894749-21apt-get21:17:260
17631922314,9sleep20-21swapper/219:06:192
1767930993027,2cyclictest1800914-21grep19:42:332
1767926993026,3cyclictest1904413-21kworker/u8:1+flush-8:022:07:431
1767926993024,5cyclictest2072864-21kworker/u8:2+events_unbound00:27:281
176792299303,3cyclictest0-21swapper/020:02:280
176792299302,4cyclictest2052312-21ntpq23:52:400
176792299302,21cyclictest18897912sleep021:12:270
1767922993019,8cyclictest2072846-21latency_hist00:15:000
1767922993015,13cyclictest0-21swapper/022:17:340
1767926992925,3cyclictest1762890-21kworker/u8:3+flush-8:019:57:451
1767926992924,4cyclictest1939048-21kworker/u8:0+events_unbound00:12:321
1767926992924,3cyclictest1939048-21kworker/u8:0+flush-8:023:17:341
1767930992824,3cyclictest1899771-21aten2_r5power_p21:22:302
1767930992824,2cyclictest1974025-21base6422:35:002
1767930992824,2cyclictest1974025-21base6422:35:002
1767926992824,3cyclictest1939048-21kworker/u8:0+flush-8:000:00:101
1767926992822,5cyclictest1859669-21kworker/u8:0+events_unbound20:57:401
1767926992821,5cyclictest1973379-21unixbench_multi22:32:461
1767926992821,5cyclictest1973379-21unixbench_multi22:32:461
1767926992820,6cyclictest281-21systemd-journal22:20:001
1767930992722,4cyclictest1779672-21idleruntime-cro19:20:002
1767930992722,3cyclictest1988543-21unixbench_singl22:47:462
1767926992723,3cyclictest2058235-21kworker/u8:3+events_unbound00:37:401
1767930992623,2cyclictest1943757-21unixbench_singl22:02:472
1767930992622,2cyclictest1879922-21aten2_r5power_c21:02:272
1767926992622,3cyclictest943196-21kworker/u8:1+events_unbound20:02:441
1767926992622,3cyclictest1939048-21kworker/u8:0+flush-8:022:12:461
1767926992622,3cyclictest1859669-21kworker/u8:0+flush-8:020:47:461
1767930992522,2cyclictest1840016-21aten2_r5power_v20:22:292
176793099250,8cyclictest20757211kthreadcore00:17:362
1767926992521,3cyclictest2072864-21kworker/u8:2+flush-8:000:22:431
1767926992521,3cyclictest1753120-21kworker/u8:2+flush-8:021:27:411
1767930992421,2cyclictest1795540-21aten2_r5power_v19:37:282
1767930992420,3cyclictest1834476-21cron20:15:002
1767930992420,2cyclictest1859958-21aten2_r5power_p20:42:262
1767930992414,8cyclictest281-21systemd-journal19:47:332
1767930992320,2cyclictest2009125-21cpuspeed_turbos23:12:282
1767930992320,2cyclictest0-21swapper/220:07:332
1767930992318,3cyclictest2083455-21fschecks_count00:27:282
1767926992317,4cyclictest1839459-21idleruntime-cro20:20:001
1767930992218,3cyclictest2023791-21aten2_r5power_c23:27:282
1767930992218,2cyclictest1919604-21aten2_r5power_v21:42:282
176793099212,13cyclictest2048523-21apt-get23:52:282
1767930992117,3cyclictest2014460-21sort23:17:332
1767930992117,2cyclictest1889848-21aten2_r5power_e21:12:292
1767930992117,2cyclictest0-21swapper/223:22:402
1767930992117,2cyclictest0-21swapper/219:25:012
1767930992116,3cyclictest2057676-21unixbench_multi23:57:452
1767930992113,6cyclictest1865178-21grep20:47:312
1767930992017,2cyclictest2067638-21unixbench_multi00:07:482
1767930992017,2cyclictest1979351-21aten2_r5power_p22:42:272
1767930992016,3cyclictest1944478-21aten2_r5power_e22:07:272
1767930992016,2cyclictest2008468-21idleruntime-cro23:10:012
1767930992010,2cyclictest0-21swapper/221:57:312
176793099200,8cyclictest20594041kthreadcore00:02:352
176793099200,8cyclictest18784212grep20:57:372
176793099195,3cyclictest19142722sort21:35:002
1767930991916,2cyclictest0-21swapper/221:50:002
1767930991915,3cyclictest1855208-21fschecks_count20:37:312
1767930991915,2cyclictest0-21swapper/221:37:272
1767930991915,2cyclictest0-21swapper/220:00:002
176793099189,2cyclictest0-21swapper/223:42:412
176793099188,2cyclictest0-21swapper/220:02:442
176793099182,2cyclictest19646842if_err_enp4s0.222:27:332
176793099182,2cyclictest17706241kthreadcore19:12:362
1767930991815,2cyclictest1834955-21aten2_r5power_c20:17:262
1767930991814,3cyclictest1850126-21fschecks_time20:32:312
1767930991813,4cyclictest0-21swapper/222:52:452
17671952183,8sleep30-21swapper/319:07:443
19089492172,2sleep20-21swapper/221:27:502
19042642170,2sleep3471rcuc/321:25:003
1767930991712,3cyclictest0-21swapper/223:02:342
1767930991712,3cyclictest0-21swapper/222:57:332
1767930991711,4cyclictest0-21swapper/220:27:362
1767930991711,4cyclictest0-21swapper/200:22:262
176793099171,12cyclictest2091888-21ntpq00:32:402
20035482162,5sleep30-21swapper/323:04:513
19488412162,5sleep30-21swapper/322:09:113
18548522162,5sleep30-21swapper/320:36:353
18397792162,4sleep30-21swapper/320:21:103
18151352162,5sleep30-21swapper/319:56:483
17953992162,5sleep30-21swapper/319:37:253
176793099162,13cyclictest0-21swapper/222:10:472
1767930991613,2cyclictest0-21swapper/223:32:472
1767930991613,2cyclictest0-21swapper/219:51:422
1767930991613,2cyclictest0-21swapper/219:29:302
1767930991612,2cyclictest0-21swapper/223:47:272
1767930991612,2cyclictest0-21swapper/220:52:382
1767930991612,2cyclictest0-21swapper/200:40:002
1767930991612,2cyclictest0-21swapper/200:12:252
1767930991610,2cyclictest0-21swapper/221:09:282
176793099160,14cyclictest1899242-21awk21:20:002
20186412152,4sleep30-21swapper/323:20:243
19045672151,4sleep30-21swapper/321:27:063
176793099152,10cyclictest2033926-21diskstats23:37:302
20429892142,4sleep30-21swapper/323:43:033
20868812134,5sleep30-21swapper/300:27:363
20594822133,7sleep30-21swapper/300:02:363
20464022133,7sleep30-21swapper/323:47:363
20234042132,6sleep30-21swapper/323:25:013
20125242132,7sleep30-21swapper/323:12:383
19936942132,7sleep30-21swapper/322:55:003
19849782133,7sleep30-21swapper/322:47:343
19510152132,6sleep30-21swapper/322:12:363
19104662132,6sleep30-21swapper/321:32:363
18502532132,7sleep30-21swapper/320:32:343
20933682122,6sleep30-21swapper/300:37:313
20732892122,6sleep30-21swapper/300:17:293
20630022122,6sleep30-21swapper/300:05:013
20538302122,6sleep30-21swapper/323:57:313
20335832122,6sleep30-21swapper/323:36:333
20141562123,6sleep30-21swapper/323:17:313
20084612122,5sleep30-21swapper/323:10:013
19687002122,6sleep30-21swapper/322:30:013
19687002122,6sleep30-21swapper/322:30:013
19628362122,6sleep30-21swapper/322:22:393
19353952122,6sleep30-21swapper/321:57:353
19298622122,6sleep30-21swapper/321:52:343
19264822123,5sleep30-21swapper/321:47:363
18992142121,7sleep30-21swapper/321:20:003
18753582122,6sleep30-21swapper/320:57:333
18708992122,6sleep30-21swapper/320:52:363
18302532122,6sleep30-21swapper/320:12:323
18204192123,6sleep30-21swapper/320:02:333
18098662122,6sleep30-21swapper/319:50:013
18067552122,6sleep30-21swapper/319:47:363
18006302122,6sleep30-21swapper/319:42:323
17858012122,6sleep30-21swapper/319:27:353
17845642122,6sleep30-21swapper/319:24:373
17730712122,6sleep30-21swapper/319:15:023
20881252112,6sleep30-21swapper/300:32:173
20688322112,5sleep30-21swapper/300:12:353
20483702112,6sleep30-21swapper/323:50:453
20285992112,6sleep30-21swapper/323:31:313
19940582112,5sleep30-21swapper/322:56:413
19746292112,6sleep30-21swapper/322:37:313
19639952112,6sleep30-21swapper/322:25:193
19543802112,6sleep30-21swapper/322:17:293
19406652112,6sleep30-21swapper/322:02:373
19231462112,5sleep30-21swapper/321:42:393
18902912112,5sleep30-21swapper/321:12:343
18851962112,5sleep30-21swapper/321:07:323
18646232112,5sleep30-21swapper/320:45:013
18598462112,6sleep30-21swapper/320:42:253
18448422112,5sleep30-21swapper/320:27:283
18358422112,6sleep30-21swapper/320:17:333
18250502112,5sleep30-21swapper/320:07:263
17900922113,5sleep30-21swapper/319:30:553
17680902112,6sleep30-21swapper/319:10:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional