You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 12:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 28, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19432832630,2sleep1291ktimers/119:57:421
1892742995750,6cyclictest2113888-21kworker/u8:0+flush-8:023:07:461
20270202560,6chrt0-21swapper/221:22:422
1892739995347,4cyclictest1909478-21latency_hist19:25:010
1892739995144,5cyclictest2128548-21latency_hist23:05:010
1892742994943,4cyclictest1855456-21kworker/u8:1+flush-8:019:13:141
1892742994941,6cyclictest1969675-21/usr/sbin/munin20:27:491
1892739994943,5cyclictest2034263-21kworker/u8:3+flush-8:022:57:490
1892742994843,3cyclictest572672-21kworker/u8:4+events_unbound20:47:491
1892742994842,5cyclictest1929104-21kworker/u8:1+flush-8:021:27:471
1892742994838,8cyclictest275-21systemd-journal21:40:001
1892742994741,4cyclictest2183018-21kworker/u8:3+events_unbound00:12:381
1892739994740,5cyclictest2168206-21latency_hist23:45:010
1892742994642,3cyclictest2143946-21kworker/u8:1+events_unbound23:42:461
1892742994642,3cyclictest1929104-21kworker/u8:1+flush-8:019:47:461
1892742994639,5cyclictest2208035-21latency_hist00:25:001
1892742994541,3cyclictest1913634-21kworker/u8:0+flush-8:020:02:421
1892742994540,3cyclictest1745305-21kworker/u8:2+events_unbound19:42:411
1892742994438,4cyclictest2028900-21kworker/u8:2+events_unbound21:57:501
1892742994436,5cyclictest1964061-21latency_hist20:20:011
1892739994437,5cyclictest2113888-21kworker/u8:0+flush-8:000:22:350
1892739994434,8cyclictest2157542-21ntpq23:32:430
1892744994326,15cyclictest2084024-21run-parts22:20:002
1892742994337,5cyclictest2034263-21kworker/u8:3+flush-8:022:47:451
1892742994337,4cyclictest2218574-21apt-get00:37:301
1892742994337,4cyclictest2034263-21kworker/u8:3+events_unbound22:57:481
1892742994337,4cyclictest1745305-21kworker/u8:2+flush-8:019:37:521
1892742994336,5cyclictest2034263-21kworker/u8:3+flush-8:022:12:471
1892742994336,5cyclictest1929104-21kworker/u8:1+flush-8:020:32:451
1892742994335,6cyclictest2034443-21apt-get21:32:301
1892742994329,11cyclictest275-21systemd-journal19:25:001
1892742994237,3cyclictest2113888-21kworker/u8:0+events_unbound23:12:421
1892742994236,4cyclictest572672-21kworker/u8:4+flush-8:021:12:401
1892742994236,4cyclictest572672-21kworker/u8:4+flush-8:021:12:401
1892742994235,5cyclictest2028900-21kworker/u8:2+events_unbound00:32:451
1892742994235,5cyclictest2028900-21kworker/u8:2+events_unbound00:32:451
1892739994234,6cyclictest2143946-21kworker/u8:1+flush-8:023:47:330
1892744994132,7cyclictest275-21systemd-journal22:07:292
1892742994136,4cyclictest2113888-21kworker/u8:0+flush-8:023:57:341
1892742994136,3cyclictest2068533-21kworker/u8:1+flush-8:022:42:371
1892742994135,4cyclictest2013985-21latency_hist21:10:001
1892742994135,4cyclictest2013985-21latency_hist21:10:001
1892742994133,6cyclictest2028900-21kworker/u8:2+events_unbound23:32:311
1892744994020,7cyclictest275-21systemd-journal20:25:002
1892739994035,4cyclictest1855456-21kworker/u8:1+events_unbound19:12:320
1892739994034,5cyclictest572672-21kworker/u8:4+events_unbound21:12:430
1892739994034,5cyclictest572672-21kworker/u8:4+events_unbound21:12:420
1892742993934,4cyclictest572672-21kworker/u8:4+events_unbound19:17:451
1892742993934,4cyclictest2183018-21kworker/u8:3+events_unbound00:02:481
1892742993933,4cyclictest572672-21kworker/u8:4+flush-8:020:07:381
1892742993933,4cyclictest2068533-21kworker/u8:1+events_unbound22:07:321
1892742993933,4cyclictest1929104-21kworker/u8:1+flush-8:020:37:451
1892742993833,4cyclictest2013816-21kworker/u8:0+events_unbound21:22:361
1892742993832,5cyclictest2028900-21kworker/u8:2+events_unbound23:47:431
1892742993832,5cyclictest1745305-21kworker/u8:2+flush-8:019:27:381
1892742993832,4cyclictest572672-21kworker/u8:4+flush-8:020:52:371
1892742993832,4cyclictest2089409-21apt-get22:27:321
1892742993831,5cyclictest1913634-21kworker/u8:0+flush-8:020:12:491
1892742993830,6cyclictest2113888-21kworker/u8:0+flush-8:000:07:341
1892744993731,4cyclictest1944067-21apt-get20:00:002
1892742993733,3cyclictest2183018-21kworker/u8:3+events_unbound00:15:301
1892742993730,5cyclictest2138796-21kworker/u8:3+flush-8:023:17:451
1892739993731,4cyclictest275-21systemd-journal20:53:280
1892739993729,6cyclictest275-21systemd-journal22:45:000
1892739993729,6cyclictest2073116-21ntpq22:07:450
1892739993729,6cyclictest1969026-21apt-get20:25:010
1892739993729,6cyclictest1909890-21/usr/sbin/munin19:27:450
1892742993631,4cyclictest2143946-21kworker/u8:1+events_unbound23:37:471
1892742993631,4cyclictest2028900-21kworker/u8:2+events_unbound21:52:461
1892742993630,4cyclictest2113888-21kworker/u8:0+flush-8:023:27:381
1892742993629,5cyclictest572672-21kworker/u8:4+flush-8:020:42:431
1892742993629,5cyclictest2013816-21kworker/u8:0+flush-8:022:02:361
1892739993627,7cyclictest275-21systemd-journal21:00:000
18924562364,9sleep10-21swapper/119:08:351
1892744993525,8cyclictest275-21systemd-journal20:45:002
1892742993528,5cyclictest2028900-21kworker/u8:2+flush-8:023:22:481
1892742993524,8cyclictest2177282-21ntpq23:52:431
1892742993430,3cyclictest2028900-21kworker/u8:2+flush-8:021:40:361
1892742993428,5cyclictest572672-21kworker/u8:4+events_unbound21:02:341
1892742993428,4cyclictest1914830-21apt-get19:32:301
1892739993429,3cyclictest1913634-21kworker/u8:0+events_unbound20:12:350
1892739993427,5cyclictest275-21systemd-journal20:04:310
1892739993426,6cyclictest1949685-21apt-get20:07:310
1892739993426,6cyclictest1919369-21latency_hist19:35:010
189273999341,31cyclictest2113677-21true22:50:000
1892742993328,3cyclictest2068533-21kworker/u8:1+flush-8:022:22:401
1892742993326,5cyclictest1913634-21kworker/u8:0+flush-8:020:22:451
1892742993325,6cyclictest1929104-21kworker/u8:1+flush-8:019:52:461
189273999330,30cyclictest1-21systemd23:12:290
21282022320,2sleep3471rcuc/323:02:513
1892742993226,4cyclictest2208531-21kworker/u8:3+flush-8:000:27:471
1892742993226,4cyclictest2068533-21kworker/u8:1+events_unbound22:17:341
1892742993225,5cyclictest2099592-21cut22:37:361
1892739993228,3cyclictest2058985-21cron21:55:000
1892744993121,8cyclictest275-21systemd-journal21:55:012
1892742993126,4cyclictest1929104-21kworker/u8:1+flush-8:020:57:341
1892742993125,4cyclictest2068533-21kworker/u8:1+flush-8:022:32:451
1892739993125,4cyclictest2078918-21cp22:15:010
1892739993124,5cyclictest275-21systemd-journal21:39:430
1892739993026,3cyclictest1929304-21systemd-run19:45:000
1892739993026,3cyclictest1929104-21kworker/u8:1+flush-8:020:32:480
1892739993026,2cyclictest1930439-21irqrtprio19:47:380
1892739993024,4cyclictest572672-21kworker/u8:4+flush-8:020:47:400
1892739993024,4cyclictest2143946-21kworker/u8:1+flush-8:023:36:000
1892739993023,5cyclictest2063649-21grep21:57:520
21303052290,6sleep20-21swapper/223:07:402
19031532290,7sleep20-21swapper/219:17:422
1892744992923,4cyclictest2167986-21unixbench_singl23:42:512
1892744992920,7cyclictest275-21systemd-journal20:47:272
1892744992920,7cyclictest275-21systemd-journal00:15:002
1892744992919,8cyclictest2173110-21turbostat.cron23:50:002
1892742992924,4cyclictest2028900-21kworker/u8:2+events_unbound23:02:431
1892739992925,3cyclictest2183018-21kworker/u8:3+flush-8:000:02:400
1892739992924,3cyclictest2113888-21kworker/u8:0+flush-8:022:52:360
1892744992820,6cyclictest275-21systemd-journal20:29:282
189274299280,26cyclictest2117954-21ntpq22:52:481
1892739992824,3cyclictest2028900-21kworker/u8:2+flush-8:021:47:490
1892739992822,4cyclictest2208531-21kworker/u8:3+flush-8:000:28:010
1892739992822,4cyclictest1929104-21kworker/u8:1+flush-8:021:07:380
1892739992822,4cyclictest1929104-21kworker/u8:1+flush-8:021:07:380
1892739992821,5cyclictest572672-21kworker/u8:4+flush-8:020:42:330
1892744992724,2cyclictest1905202-21cpuspeed_turbos19:22:342
1892739992724,2cyclictest2197310-21needreboot00:12:420
1892739992723,2cyclictest1892742-21cyclictest19:10:010
1892739992722,4cyclictest1855456-21kworker/u8:1+flush-8:019:15:060
1892739992722,3cyclictest2223124-21systemd-run00:40:000
1892739992718,7cyclictest2085198-21irqrtprio22:22:380
1892739992715,9cyclictest2044862-21diskstats21:42:350
1892744992622,3cyclictest2208768-21aten2_r5power_e00:27:342
1892744992621,4cyclictest2068533-21kworker/u8:1+flush-8:022:22:342
1892744992620,4cyclictest2035161-21tr21:32:392
1892739992621,4cyclictest1929104-21kworker/u8:1+flush-8:020:37:480
1892739992620,5cyclictest2028900-21kworker/u8:2+flush-8:022:37:460
1892739992620,4cyclictest2068533-21kworker/u8:1+events_unbound22:35:010
1892739992618,6cyclictest1969026-21apt-get20:25:010
18879932263,8sleep20-21swapper/219:05:512
189274299251,5cyclictest2049543-21/usr/sbin/munin21:47:351
1892739992521,2cyclictest0-21swapper/023:22:300
1892739992520,4cyclictest1929104-21kworker/u8:1+flush-8:019:52:490
1892739992520,3cyclictest2139094-21cpuspeed_turbos23:17:330
1892739992519,4cyclictest2113888-21kworker/u8:0+flush-8:023:57:500
1892739992518,5cyclictest2028900-21kworker/u8:2+flush-8:000:10:000
1892744992421,2cyclictest1999738-21aten2_r5power_v20:57:322
1892744992421,2cyclictest1958887-21unixbench_multi20:12:542
1892744992421,2cyclictest1950034-21fschecks_time20:07:352
1892744992418,4cyclictest2019367-21cp21:15:012
1892744992418,4cyclictest2019367-21cp21:15:012
1892744992415,7cyclictest275-21systemd-journal00:10:002
189273999242,21cyclictest0-21swapper/022:27:510
1892739992420,2cyclictest0-21swapper/022:17:380
1892739992419,4cyclictest2208531-21kworker/u8:3+flush-8:000:34:590
1892739992419,4cyclictest2208531-21kworker/u8:3+flush-8:000:34:590
1892739992418,4cyclictest2153080-21unixbench_multi23:27:510
20342102230,6chrt0-21swapper/221:30:002
1892744992313,7cyclictest1939314-21cat19:55:012
1892739992318,4cyclictest2030427-21kthreadcore21:27:410
1892739992318,3cyclictest1943858-21unixbench_singl19:57:500
1892739992317,4cyclictest572672-21kworker/u8:4+flush-8:021:17:450
1892739992317,4cyclictest572672-21kworker/u8:4+flush-8:021:17:450
1892739992316,3cyclictest0-21swapper/023:07:320
1892739992315,6cyclictest1959552-21/usr/sbin/munin20:17:420
1892739992315,4cyclictest0-21swapper/019:37:310
1892739992314,7cyclictest2198536-21/usr/sbin/munin00:17:490
1892744992218,3cyclictest2218319-21latency_hist00:35:002
1892744992218,3cyclictest2218319-21latency_hist00:35:002
1892744992218,3cyclictest2068613-21tail22:02:512
1892744992215,5cyclictest2019319-21latency_hist21:15:002
1892744992215,5cyclictest2019319-21latency_hist21:15:002
1892744992214,6cyclictest2004888-21grep21:02:352
1892739992216,4cyclictest2038682-21unixbench_multi21:32:520
189274499213,3cyclictest20108292cut21:07:392
189274499213,3cyclictest20108292cut21:07:392
1892744992118,2cyclictest2178779-21fschecks_count23:57:362
1892744992117,2cyclictest0-21swapper/223:32:372
1892744992117,2cyclictest0-21swapper/222:47:382
189274299211,13cyclictest571-21snmpd21:17:441
189274299211,13cyclictest571-21snmpd21:17:441
1892739992117,2cyclictest0-21swapper/023:55:000
1892739992114,3cyclictest1929104-21kworker/u8:1+flush-8:021:00:300
189274499209,9cyclictest0-21swapper/219:30:002
189274499202,17cyclictest0-21swapper/223:02:502
1892744992017,2cyclictest1979600-21aten2_r5power_c20:37:332
1892744992016,3cyclictest2143163-21unixbench_singl23:17:512
1892744992016,2cyclictest0-21swapper/222:15:002
1892744992016,2cyclictest0-21swapper/220:55:002
1892744992011,7cyclictest2041859-21tr21:37:412
1892739992016,3cyclictest8450irq/124-ahci[0000:00:12.0]22:00:160
1892739992011,7cyclictest2028387-21ntpq21:22:480
1892744991915,2cyclictest0-21swapper/200:25:012
1892744991915,2cyclictest0-21swapper/200:05:002
1892744991913,4cyclictest2202226-21cut00:17:432
1892744991910,7cyclictest2136898-21tr23:12:422
1892744991910,7cyclictest2114633-21tr22:52:392
18881512193,9sleep30-21swapper/319:07:323
189274499183,9cyclictest1919809-21apt-get19:37:322
189274499182,15cyclictest0-21swapper/219:47:502
1892744991814,2cyclictest0-21swapper/219:13:202
1892744991813,3cyclictest2050576-21cut21:47:402
1892744991813,3cyclictest0-21swapper/222:57:432
1892744991813,3cyclictest0-21swapper/222:27:412
1892744991812,4cyclictest0-21swapper/221:57:412
189274499181,15cyclictest1925690-21sort19:42:392
20485052170,2sleep22048586-21tr21:42:502
189274499179,6cyclictest2176518-21tr23:52:412
189274499179,6cyclictest1974812-21sort20:32:332
189274499178,7cyclictest2149737-21cut23:27:382
1892744991713,2cyclictest0-21swapper/223:37:402
1892744991713,2cyclictest0-21swapper/222:37:332
1892744991713,2cyclictest0-21swapper/220:02:392
1892744991713,2cyclictest0-21swapper/200:40:002
189274499167,7cyclictest1961911-21tr20:17:402
189274499162,13cyclictest0-21swapper/223:24:312
189274499162,13cyclictest0-21swapper/222:42:022
1892744991611,3cyclictest0-21swapper/222:32:422
1892744991611,3cyclictest0-21swapper/219:32:392
21037822143,5sleep30-21swapper/322:40:013
19845442145,5sleep30-21swapper/320:42:313
22127272132,7sleep30-21swapper/300:27:523
21187492132,6sleep30-21swapper/322:55:023
21101162133,6sleep30-21swapper/322:47:393
20939272132,6sleep30-21swapper/322:30:023
20689092132,6sleep30-21swapper/322:05:023
20586162132,7sleep30-21swapper/321:52:543
20439652132,6sleep30-21swapper/321:40:023
19791152132,6sleep30-21swapper/320:35:013
19682792134,5sleep30-21swapper/320:22:453
19386992132,7sleep30-21swapper/319:52:513
19318732132,7sleep30-21swapper/319:47:413
19006992132,7sleep30-21swapper/319:17:403
22230392122,6sleep30-21swapper/300:39:323
22033882122,6sleep30-21swapper/300:21:303
21984922122,6sleep30-21swapper/300:17:003
21981002122,6sleep30-21swapper/300:15:003
21930012122,6sleep30-21swapper/300:07:573
21834092122,6sleep30-21swapper/300:02:323
21789132122,6sleep30-21swapper/323:57:383
21686582122,6sleep30-21swapper/323:47:313
21617352122,6sleep30-21swapper/323:37:433
21533842122,5sleep30-21swapper/323:30:013
21492152123,6sleep30-21swapper/323:27:363
21461692122,5sleep30-21swapper/323:22:433
21384022122,6sleep30-21swapper/323:15:003
21285612122,5sleep30-21swapper/323:05:013
21144712122,6sleep30-21swapper/322:52:373
21079462122,6sleep30-21swapper/322:42:463
20742792123,5sleep30-21swapper/322:12:323
20531632122,6sleep30-21swapper/321:47:443
20290892122,6sleep30-21swapper/321:25:013
20041312122,5sleep30-21swapper/321:00:013
19996292122,6sleep30-21swapper/320:57:323
19944112122,5sleep30-21swapper/320:50:023
19835512122,6sleep30-21swapper/320:37:503
19698132122,6sleep30-21swapper/320:27:343
19598262122,6sleep30-21swapper/320:17:353
19499382122,6sleep30-21swapper/320:07:363
19441902122,5sleep30-21swapper/320:00:013
19256682122,6sleep30-21swapper/319:42:403
19193942122,5sleep30-21swapper/319:35:013
19148342122,6sleep30-21swapper/319:32:333
19093072122,6sleep30-21swapper/319:23:023
22136682112,5sleep30-21swapper/300:32:333
22136682112,5sleep30-21swapper/300:32:333
21733602112,6sleep30-21swapper/323:50:203
21635032112,6sleep30-21swapper/323:40:083
21386582112,6sleep30-21swapper/323:15:163
20892452112,6sleep30-21swapper/322:25:443
20886842112,5sleep30-21swapper/322:22:513
20799362112,5sleep30-21swapper/322:17:383
20643932112,5sleep30-21swapper/322:02:333
20630262112,5sleep30-21swapper/321:57:433
20392582112,6sleep30-21swapper/321:36:003
20382602112,5sleep30-21swapper/321:32:473
20244492112,6sleep30-21swapper/321:21:163
20194212112,5sleep30-21swapper/321:15:343
20194212112,5sleep30-21swapper/321:15:343
20142522112,6sleep30-21swapper/321:10:323
20142522112,6sleep30-21swapper/321:10:323
20139262112,6sleep30-21swapper/321:09:283
20139262112,6sleep30-21swapper/321:09:283
19895592112,6sleep30-21swapper/320:45:323
19550572112,6sleep30-21swapper/320:12:383
19393872112,6sleep30-21swapper/319:55:163
19096992112,5sleep30-21swapper/319:25:023
18926002112,5sleep30-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional