You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 11:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 16, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1960788997568,5cyclictest2206424-21kworker/u8:2+events_unbound23:30:371
1960788997365,6cyclictest2101263-21kworker/u8:0+flush-8:022:05:411
1960788997062,4cyclictest2251243-21kworker/u8:4+flush-8:000:25:261
1960788996962,5cyclictest2251243-21kworker/u8:4+events_unbound00:35:381
1960788996960,7cyclictest2052513-21kworker/u8:3+flush-8:021:05:401
1960788996862,4cyclictest2037253-21kworker/u8:0+events_unbound20:30:441
1960788996860,6cyclictest2076871-21kworker/u8:2+events_unbound21:40:381
1960788996762,4cyclictest2206424-21kworker/u8:2+flush-8:023:35:461
1960788996761,4cyclictest2002451-21kworker/u8:2+flush-8:020:00:411
1960788996758,7cyclictest2037253-21kworker/u8:0+flush-8:020:25:391
1960788996660,5cyclictest2086994-21kworker/u8:1+events_unbound21:35:411
1960788996660,5cyclictest2086994-21kworker/u8:1+events_unbound21:35:411
1960788996660,4cyclictest2251243-21kworker/u8:4+flush-8:000:05:421
1960788996660,4cyclictest2251243-21kworker/u8:4+events_unbound00:20:391
1960788996660,4cyclictest2052513-21kworker/u8:3+flush-8:020:40:451
1960788996659,5cyclictest2076871-21kworker/u8:2+flush-8:021:25:401
1960788996655,8cyclictest1965651-21latency_hist19:15:011
1960788996560,4cyclictest1928932-21kworker/u8:2+events_unbound19:30:431
1960788996560,3cyclictest1987252-21kworker/u8:0+events_unbound19:40:411
1960788996558,5cyclictest2101263-21kworker/u8:0+events_unbound23:10:401
1960786996557,6cyclictest2245108-21ntpq23:50:360
1960786996542,9cyclictest2100656-21ntpq21:25:350
1960788996458,5cyclictest1928932-21kworker/u8:2+flush-8:019:20:401
1960788996458,4cyclictest2235581-21kworker/u8:3+events_unbound23:50:411
1960788996356,6cyclictest1987252-21kworker/u8:0+flush-8:019:35:381
1960788996356,5cyclictest2101263-21kworker/u8:0+events_unbound23:25:411
1960786996346,6cyclictest1704890-21systemd-journal00:30:380
1960788996255,6cyclictest1928932-21kworker/u8:2+flush-8:019:15:411
1960788996255,5cyclictest2101263-21kworker/u8:0+flush-8:023:00:441
1960788996157,3cyclictest2052513-21kworker/u8:3+flush-8:020:55:251
1960788996156,3cyclictest2125561-21kworker/u8:1+events_unbound22:00:361
1960788996156,3cyclictest2002451-21kworker/u8:2+events_unbound19:50:431
1960788996154,4cyclictest1967812-21kworker/u8:1+flush-8:019:45:371
1960788996153,6cyclictest2002451-21kworker/u8:2+flush-8:019:55:401
1960788996055,3cyclictest2145989-21kworker/u8:2+events_unbound22:30:431
1960788996053,5cyclictest2206424-21kworker/u8:2+events_unbound23:20:261
1960788996053,5cyclictest2206424-21kworker/u8:2+events_unbound23:20:251
1960786996050,7cyclictest2065821-21ntpq20:50:370
1960786996049,8cyclictest2236216-21apt-get23:45:220
1960792995953,4cyclictest2111778-21kworker/u8:3+flush-8:022:10:422
1960788995953,5cyclictest2251236-21kworker/u8:0+flush-8:000:10:301
1960788995953,4cyclictest2052513-21kworker/u8:3+events_unbound21:15:271
1960788995951,5cyclictest1967812-21kworker/u8:1+events_unbound20:05:391
1960788995851,6cyclictest2111778-21kworker/u8:3+events_unbound21:55:381
1960788995851,5cyclictest1960628-21kworker/u8:3+flush-8:020:20:391
1960788995850,5cyclictest2111778-21kworker/u8:3+events_unbound21:50:391
1960786995850,5cyclictest2037253-21kworker/u8:0+flush-8:020:30:420
19715962570,6chrt0-21swapper/019:15:360
1960788995751,4cyclictest2125561-21kworker/u8:1+flush-8:022:20:271
1960786995747,8cyclictest2171726-21/usr/sbin/munin22:40:370
1960788995650,4cyclictest2251243-21kworker/u8:4+events_unbound00:30:401
1960788995649,5cyclictest2206424-21kworker/u8:2+flush-8:023:55:381
1960788995646,7cyclictest2031814-21latency_hist20:20:011
1960786995650,4cyclictest2002451-21kworker/u8:2+flush-8:020:35:430
1960788995550,4cyclictest2190456-21kworker/u8:3+events_unbound23:00:011
1960788995550,3cyclictest1704890-21systemd-journal22:50:371
1960788995548,5cyclictest2145989-21kworker/u8:2+flush-8:022:15:421
21522022540,5sleep20-21swapper/222:20:312
1960788995448,4cyclictest2206424-21kworker/u8:2+events_unbound23:45:361
1960788995347,4cyclictest2206424-21kworker/u8:2+events_unbound23:15:421
1960788995346,5cyclictest1967812-21kworker/u8:1+flush-8:021:00:411
1960788995343,8cyclictest2235045-21ntpq23:40:381
1960786995348,4cyclictest2251243-21kworker/u8:4+flush-8:000:25:430
1960786995346,5cyclictest1977484-21latency_hist19:25:010
1960788995146,4cyclictest2052513-21kworker/u8:3+flush-8:020:50:391
1960788995145,4cyclictest1967812-21kworker/u8:1+events_unbound20:10:431
1960788995144,5cyclictest2145989-21kworker/u8:2+flush-8:022:25:401
1960786995143,6cyclictest2081581-21latency_hist21:10:010
1960786995142,7cyclictest2032593-21diskstats20:20:270
1960786995142,6cyclictest2021964-21latency_hist20:10:000
1960786995141,7cyclictest2156881-21apt-get22:25:230
1960788995041,7cyclictest2269929-21ntpq00:15:371
1960786995041,6cyclictest1704890-21systemd-journal23:10:370
1960792994930,7cyclictest2240872-21apt-get23:50:012
1960788994942,5cyclictest2101263-21kworker/u8:0+flush-8:022:45:401
1960788994941,6cyclictest1967812-21kworker/u8:1+events_unbound19:25:381
1960792994842,4cyclictest1928932-21kworker/u8:2+flush-8:019:10:312
1960788994842,3cyclictest2101263-21kworker/u8:0+flush-8:022:10:341
1960788994837,8cyclictest2060906-21ntpq20:45:391
1960786994840,6cyclictest2206424-21kworker/u8:2+events_unbound00:00:010
1960786994835,10cyclictest2135620-21ntpq22:00:370
1960792994637,6cyclictest1704890-21systemd-journal19:35:012
1960788994641,4cyclictest2166043-21kworker/u8:3+flush-8:022:40:401
1960786994639,5cyclictest2125561-21kworker/u8:1+flush-8:022:20:010
22677772450,3sleep375-21kworker/3:1-events00:15:343
1960788994541,3cyclictest2076871-21kworker/u8:2+flush-8:021:45:291
1960788994539,4cyclictest2086994-21kworker/u8:1+events_unbound21:30:361
1960788994539,4cyclictest2052513-21kworker/u8:3+flush-8:021:10:401
1960786994535,7cyclictest2256014-21latency_hist00:05:010
1960792994433,8cyclictest1704890-21systemd-journal22:55:002
1960788994440,3cyclictest2101263-21kworker/u8:0+flush-8:022:35:271
1960788994439,3cyclictest2052513-21kworker/u8:3+flush-8:021:20:401
1960786994441,2cyclictest8550irq/124-ahci[0000:00:12.0]21:35:400
1960786994441,2cyclictest8550irq/124-ahci[0000:00:12.0]21:35:390
1960786994439,4cyclictest2251243-21kworker/u8:4+flush-8:000:20:320
1960786994434,8cyclictest2092260-21diskstats21:20:290
1960786994434,7cyclictest1704890-21systemd-journal22:45:360
1960786994334,7cyclictest2206424-21kworker/u8:2+flush-8:023:40:350
1960792994231,8cyclictest2126857-21cp21:55:022
1960788994235,5cyclictest2002451-21kworker/u8:2+flush-8:020:35:401
1960788994234,6cyclictest2190456-21kworker/u8:3+flush-8:023:05:261
1960786994133,6cyclictest2037253-21kworker/u8:0+events_unbound20:25:400
1960788994036,3cyclictest2225893-21kworker/u8:1+flush-8:000:00:271
1960786994035,4cyclictest2076871-21kworker/u8:2+flush-8:021:47:380
1960786994030,8cyclictest2265014-21ntpq00:10:380
1960786993932,4cyclictest2002451-21kworker/u8:2+events_unbound20:15:010
1960786993932,4cyclictest1967812-21kworker/u8:1+flush-8:020:00:300
1960786993829,7cyclictest1704890-21systemd-journal19:15:000
196078699382,30cyclictest2141510-21kworker/0:1+events22:55:250
196078699375,31cyclictest2141510-21kworker/0:1+events00:37:560
1960786993731,4cyclictest1967812-21kworker/u8:1+flush-8:019:45:380
1960786993727,8cyclictest2087281-21diskstats21:15:290
1960786993629,5cyclictest2086524-21apt-get21:14:590
196078699361,28cyclictest2141510-21kworker/0:1+events23:35:270
1960786993527,6cyclictest1987881-21diskstats19:35:270
196078699352,31cyclictest1955750-21kworker/0:1+events19:50:360
1960786993425,7cyclictest2161812-21/usr/sbin/munin22:30:360
196078699339,21cyclictest1955750-21kworker/0:1+events20:45:250
1960786993324,7cyclictest2126427-21apt-get21:55:000
1960786993310,21cyclictest1955750-21kworker/0:1+events21:00:250
1960792993221,8cyclictest2111546-21awk21:40:002
1960792993221,8cyclictest2111546-21awk21:40:002
196078699327,24cyclictest2141510-21kworker/0:1+events23:25:280
1960786993224,6cyclictest1967812-21kworker/u8:1+flush-8:019:25:380
19604182323,8sleep10-21swapper/119:07:481
1960792993122,7cyclictest1704890-21systemd-journal21:44:592
1960786993127,3cyclictest2002451-21kworker/u8:2+events_unbound19:55:430
1960786993123,6cyclictest2052513-21kworker/u8:3+flush-8:020:55:280
196078699312,27cyclictest1955750-21kworker/0:1+events19:40:430
1960786993121,8cyclictest1704890-21systemd-journal21:58:340
196078699311,28cyclictest2141510-21kworker/0:1+events00:20:000
196078699311,28cyclictest2141510-21kworker/0:1+events00:05:270
196078699311,28cyclictest1955750-21kworker/0:1+events20:40:270
196078699311,28cyclictest1-21systemd23:07:370
1960792993024,4cyclictest2195873-21unixbench_multi23:00:452
1960792993022,6cyclictest2056379-21unixbench_multi20:40:462
1960786993024,5cyclictest2101263-21kworker/u8:0+flush-8:022:05:270
196078699302,26cyclictest2141510-21kworker/0:1+events23:30:270
196078699300,28cyclictest2141510-21kworker/0:1+events22:20:370
1960792992920,7cyclictest1704890-21systemd-journal22:31:362
1960792992920,7cyclictest1704890-21systemd-journal20:45:332
1960792992920,6cyclictest2032275-21cp20:20:012
196078699292,25cyclictest2141510-21kworker/0:1+events23:15:400
196078699292,25cyclictest1955750-21kworker/0:1+events19:33:320
196078699291,26cyclictest2086555-21kworker/0:0+events21:40:350
196078699290,27cyclictest2141510-21kworker/0:1+events23:00:420
1960792992823,4cyclictest2037253-21kworker/u8:0+flush-8:020:39:402
1960792992723,2cyclictest2097028-21aten2_r5power_p21:25:262
1960792992722,3cyclictest2018050-21irqrtprio20:05:322
196078699272,24cyclictest1955750-21kworker/0:1+events20:16:310
196078699272,24cyclictest0-21swapper/022:50:430
1960786992722,3cyclictest2212145-21irqrtprio23:20:320
1960786992722,3cyclictest2212145-21irqrtprio23:20:320
1960792992622,3cyclictest2042464-21cpuspeed_turbos20:30:272
1960792992619,5cyclictest2251236-21kworker/u8:0+flush-8:000:15:362
1960792992617,7cyclictest2086125-21unixbench_singl21:10:452
196078699266,19cyclictest2086555-21kworker/0:0+events21:33:110
1960786992622,3cyclictest1704890-21systemd-journal22:15:000
1960792992521,2cyclictest2077143-21cpuspeed_turbos21:05:272
1960792992521,2cyclictest2041572-21unixbench_singl20:25:442
1960792992520,3cyclictest2206692-21cpuspeed_turbos23:15:282
1960792992520,3cyclictest2026509-21unixbench_singl20:10:462
196079299250,20cyclictest2011454-21runrttasks19:55:412
196078699252,22cyclictest2141510-21kworker/0:1+events22:37:390
1960792992420,2cyclictest2087089-21aten2_r5power_e21:15:262
1960792992420,2cyclictest2032429-21aten2_r5power_p20:20:272
1960792992419,4cyclictest2002763-21fschecks_count19:50:282
1960792992415,7cyclictest2226576-21fschecks_count23:35:302
1960792992415,7cyclictest2117098-21fschecks_count21:45:292
1960792992314,7cyclictest2167697-21kthreadcore22:35:332
1960792992312,8cyclictest2281398-21fschecks_time00:30:282
21806552220,2chrt75-21kworker/3:1-events22:45:443
196079299222,14cyclictest2246316-21apt-get23:55:252
1960792992219,2cyclictest2012523-21aten2_r5power_v20:00:272
1960792992217,4cyclictest2190863-21unixbench_multi22:55:442
1960792992117,3cyclictest2172016-21fschecks_count22:40:292
1960792992117,2cyclictest0-21swapper/219:40:002
1960792992115,4cyclictest2176999-21fschecks_time22:45:312
1960792992114,5cyclictest1971555-21needreboot19:15:362
1960792992112,7cyclictest2241606-21cpuspeed_turbos23:50:262
1960792992112,7cyclictest1997855-21fschecks_count19:45:272
196079299210,10cyclictest2225999-21cron23:35:012
196079299202,12cyclictest2101856-21apt-get21:30:262
1960792992017,2cyclictest2261275-21aten2_r5power_c00:10:272
1960792992017,2cyclictest1973178-21fschecks_time19:20:282
1960792992015,3cyclictest0-21swapper/221:00:342
1960792992012,7cyclictest2205766-21unixbench_multi23:10:472
19595382204,9sleep20-21swapper/219:05:352
19557422203,8sleep30-21swapper/319:05:003
196079299192,13cyclictest1992655-21apt-get19:40:262
1960792991916,2cyclictest2196934-21fschecks_time23:05:292
1960792991914,4cyclictest2151420-21sendmail22:20:002
1960792991914,4cyclictest20977-21cron23:25:002
1960792991914,4cyclictest20977-21cron23:24:592
1960792991914,3cyclictest2286551-21fschecks_time00:35:282
1960792991914,3cyclictest0-21swapper/222:30:012
196079299182,12cyclictest2126932-21apt-get21:55:262
1960792991815,2cyclictest2256513-21cpuspeed_turbos00:05:272
1960792991814,2cyclictest0-21swapper/219:25:432
1960792991814,2cyclictest0-21swapper/200:25:252
1960786991811,3cyclictest1960597-21latency_hist19:10:010
196079299177,8cyclictest2131933-21cut22:00:242
196079299175,10cyclictest2274420-21tr00:20:342
1960792991714,2cyclictest2137107-21fschecks_count22:05:272
196079299167,7cyclictest2064687-21cut20:50:332
196079299166,8cyclictest2217766-21tr23:25:332
196079299162,13cyclictest0-21swapper/220:58:382
1960792991613,2cyclictest0-21swapper/221:20:482
1960792991612,2cyclictest0-21swapper/223:40:292
1960792991610,4cyclictest0-21swapper/200:00:312
21988822143,7sleep30-21swapper/323:05:363
22714012131,8sleep30-21swapper/300:20:283
22409922132,6sleep30-21swapper/323:50:013
22288002132,6sleep30-21swapper/323:35:373
21902612132,7sleep30-21swapper/322:55:373
21665162132,6sleep30-21swapper/322:35:013
21568022132,6sleep30-21swapper/322:25:033
20569412132,6sleep30-21swapper/320:45:013
20460742132,7sleep30-21swapper/320:30:403
20319482132,6sleep30-21swapper/320:20:023
19967452132,7sleep30-21swapper/319:40:443
19765712132,7sleep30-21swapper/319:20:393
22758782122,5sleep30-21swapper/300:25:013
22365872122,6sleep30-21swapper/323:45:293
22237692122,6sleep30-21swapper/323:30:363
22201342122,6sleep30-21swapper/323:25:383
22154772122,6sleep30-21swapper/323:20:453
22154772122,6sleep30-21swapper/323:20:443
22064782122,6sleep30-21swapper/323:15:273
22015612122,6sleep30-21swapper/323:10:283
21915132122,6sleep30-21swapper/323:00:023
21717562122,6sleep30-21swapper/322:40:283
21490702122,6sleep30-21swapper/322:15:353
21414632122,5sleep30-21swapper/322:10:023
21406722122,6sleep30-21swapper/322:05:403
21316782122,6sleep30-21swapper/322:00:013
21237682122,6sleep30-21swapper/321:50:353
21210602122,6sleep30-21swapper/321:45:453
21118332122,6sleep30-21swapper/321:40:283
21115142120,8sleep30-21swapper/321:40:003
21115142120,8sleep30-21swapper/321:39:593
21015642122,6sleep30-21swapper/321:30:013
20917582122,5sleep30-21swapper/321:20:003
20875012122,6sleep30-21swapper/321:15:323
20822302122,6sleep30-21swapper/321:10:303
20667222122,5sleep30-21swapper/320:55:013
20662212122,6sleep30-21swapper/320:50:443
20476392120,8sleep30-21swapper/320:35:313
20377712122,6sleep30-21swapper/320:25:323
20286222122,6sleep30-21swapper/320:15:363
20113462122,6sleep30-21swapper/319:55:413
20061172122,6sleep30-21swapper/319:50:363
19974522122,6sleep30-21swapper/319:45:033
19882012122,6sleep30-21swapper/319:35:313
19835812122,6sleep30-21swapper/319:30:343
19779672123,6sleep30-21swapper/319:25:273
22899482112,5sleep30-21swapper/300:35:373
22812902112,5sleep30-21swapper/300:30:273
22658502113,5sleep30-21swapper/300:14:133
22603122112,5sleep30-21swapper/300:05:473
22515942112,5sleep30-21swapper/300:00:303
22472022112,5sleep30-21swapper/323:55:313
22316652112,5sleep30-21swapper/323:40:313
21815842112,5sleep30-21swapper/322:50:023
21654232112,5sleep30-21swapper/322:30:363
21519382110,7sleep30-21swapper/322:20:283
21314472112,6sleep30-21swapper/321:58:223
21018152112,5sleep30-21swapper/321:30:133
20768842112,6sleep30-21swapper/321:05:173
20723702112,5sleep30-21swapper/321:00:303
20521652112,5sleep30-21swapper/320:40:293
20221892112,5sleep30-21swapper/320:10:023
20209062112,5sleep30-21swapper/320:05:373
20124152112,5sleep30-21swapper/320:00:283
19680972112,5sleep30-21swapper/319:15:293
19609152112,5sleep30-21swapper/319:10:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional