You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 15:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun Apr 26, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205206722310,3sleep375-21kworker/3:1+events11:56:063
205719121740,6sleep375-21kworker/3:1+mm_percpu_wq12:01:083
18779602620,2sleep30-21swapper/309:00:013
1766843995650,4cyclictest2066258-21kworker/u8:3+flush-8:012:36:222
1766839995246,5cyclictest1967061-21kworker/u8:3+flush-8:011:31:171
1766838995044,4cyclictest1991453-21kworker/u8:2+flush-8:011:21:100
1766838995041,7cyclictest280-21systemd-journal10:30:000
1766843994844,3cyclictest1991453-21kworker/u8:2+flush-8:011:41:202
1766839994838,8cyclictest2040721-21ntpq11:41:171
1766839994838,7cyclictest1783569-21latency_hist07:25:011
1766839994743,3cyclictest2021774-21kworker/u8:0+flush-8:012:31:071
1766843994638,6cyclictest280-21systemd-journal12:10:012
1766839994641,4cyclictest1803374-21kworker/u8:0+flush-8:007:56:231
1766838994639,5cyclictest2050836-21ntpq11:51:170
1766838994639,5cyclictest1828374-21/usr/sbin/munin08:11:240
1766838994439,4cyclictest1773872-21kworker/u8:3+flush-8:007:36:130
1766839994338,4cyclictest2066258-21kworker/u8:3+events_unbound12:11:241
1766839994337,4cyclictest1813449-21kworker/u8:3+flush-8:008:06:091
1766839994336,5cyclictest1880593-21kworker/u8:0+events_unbound09:06:171
1766839994335,6cyclictest1880593-21kworker/u8:0+flush-8:009:26:191
1766838994337,4cyclictest1880593-21kworker/u8:0+events_unbound11:01:060
1766843994235,5cyclictest2066258-21kworker/u8:3+events_unbound12:26:082
1766838994233,6cyclictest1991734-21latency_hist10:55:010
176683899411,38cyclictest1-21systemd10:50:000
176683899411,38cyclictest1-21systemd10:49:590
1766843994035,3cyclictest1880593-21kworker/u8:0+events_unbound10:41:122
1766843994028,9cyclictest280-21systemd-journal10:35:352
1766839994033,5cyclictest2016575-21turbostat.cron11:20:001
1766838994029,8cyclictest1734141-21kworker/u8:1+flush-8:007:21:070
1766843993934,4cyclictest1803374-21kworker/u8:0+flush-8:008:06:172
1766839993933,5cyclictest1813449-21kworker/u8:3+flush-8:008:16:201
1766839993932,5cyclictest2005791-21ntpq11:06:171
1766839993930,6cyclictest1897540-21latency_hist09:20:011
1766839993834,3cyclictest1880593-21kworker/u8:0+events_unbound09:40:001
1766839993833,3cyclictest1813449-21kworker/u8:3+events_unbound08:11:101
1766839993831,5cyclictest1956768-21grep10:16:231
1766838993828,8cyclictest2016573-21apt-get11:20:010
1766838993828,7cyclictest1771717-21latency_hist07:15:010
1766843993732,3cyclictest1852679-21kworker/u8:2+flush-8:008:36:232
1766843993732,3cyclictest1852679-21kworker/u8:2+flush-8:008:36:232
1766839993727,8cyclictest280-21systemd-journal11:45:031
1766839993630,4cyclictest1813449-21kworker/u8:3+flush-8:008:01:221
1766839993627,7cyclictest1891725-21ntpq09:11:161
1766838993630,4cyclictest1734141-21kworker/u8:1+flush-8:007:26:100
1766838993628,6cyclictest280-21systemd-journal08:05:090
1766839993529,4cyclictest2076765-21apt-get12:21:031
1766839993526,7cyclictest1946997-21apt-get10:10:011
1766839993525,8cyclictest1846976-21ntpq08:26:181
1766839993525,8cyclictest1846976-21ntpq08:26:171
1766838993529,4cyclictest2066851-21apt-get12:11:040
1766838993529,4cyclictest1967061-21kworker/u8:3+events_unbound11:40:010
1766843993429,3cyclictest2066258-21kworker/u8:3+events_unbound12:21:102
1766843993427,5cyclictest280-21systemd-journal08:44:592
1766843993426,6cyclictest280-21systemd-journal09:50:312
1766839993429,3cyclictest1991453-21kworker/u8:2+events_unbound10:56:131
1766839993428,5cyclictest1872028-21kworker/u8:3+events_unbound09:46:091
1766839993423,8cyclictest280-21systemd-journal10:46:361
1766839993423,8cyclictest280-21systemd-journal10:46:361
1766838993429,4cyclictest2066258-21kworker/u8:3+events_unbound12:25:000
1766838993425,6cyclictest2026713-21latency_hist11:30:010
1766838993424,8cyclictest280-21systemd-journal09:00:010
1766843993328,4cyclictest1991453-21kworker/u8:2+flush-8:011:36:192
1766843993327,4cyclictest1880593-21kworker/u8:0+flush-8:009:11:092
1766839993330,2cyclictest1794494-21irqrtprio07:36:111
1766839993328,4cyclictest2066258-21kworker/u8:3+flush-8:012:36:071
1766839993328,3cyclictest2066258-21kworker/u8:3+events_unbound12:20:001
1766839993328,3cyclictest1734141-21kworker/u8:1+events_unbound07:15:051
1766839993326,5cyclictest1803800-21grep07:46:091
176662123321,6sleep00-21swapper/007:09:400
18126592320,8sleep3451irq_work/307:51:233
1766843993228,3cyclictest1880593-21kworker/u8:0+flush-8:010:11:152
1766839993228,2cyclictest1868434-21cut08:51:091
1766839993226,4cyclictest280-21systemd-journal10:31:351
1766839993222,8cyclictest2020888-21ntpq11:21:181
1766839993222,8cyclictest1921361-21ntpq09:41:171
1766839993222,4cyclictest1880593-21kworker/u8:0+flush-8:009:21:241
1766838993223,2cyclictest421rcuog/207:16:240
17666382324,9sleep20-21swapper/207:09:542
1766843993124,5cyclictest1880593-21kworker/u8:0+events_unbound10:46:222
1766843993124,5cyclictest1880593-21kworker/u8:0+events_unbound10:46:222
1766843993122,7cyclictest280-21systemd-journal11:20:002
1766839993127,2cyclictest1857811-21apt-config08:40:001
1766839993127,2cyclictest1857811-21apt-config08:40:001
1766839993126,4cyclictest1747099-21kworker/u8:2+flush-8:007:51:091
1766839993125,5cyclictest1813449-21kworker/u8:3+events_unbound08:21:211
1766839993122,7cyclictest1937348-21/usr/sbin/munin10:01:161
1766838993127,3cyclictest1939713-21kworker/u8:2+flush-8:010:06:140
1766839993025,4cyclictest0-21swapper/107:15:001
1766839993025,3cyclictest2006324-21kworker/u8:1+flush-8:011:10:311
1766839993024,4cyclictest1991453-21kworker/u8:2+events_unbound12:01:241
1766838993026,3cyclictest1813449-21kworker/u8:3+events_unbound08:21:100
1766843992925,3cyclictest1991453-21kworker/u8:2+events_unbound11:26:222
1766843992924,3cyclictest1788871-21aten2_r5power_e07:31:082
1766839992925,3cyclictest1734141-21kworker/u8:1+flush-8:007:26:231
1766839992924,4cyclictest1880593-21kworker/u8:0+flush-8:009:51:211
1766839992924,2cyclictest1873680-21irqcore08:56:131
1766839992922,5cyclictest2046779-21kworker/u8:1+flush-8:012:06:181
1766839992922,5cyclictest1880593-21kworker/u8:0+events_unbound11:01:181
1766839992922,5cyclictest1747099-21kworker/u8:2+flush-8:007:31:211
1766839992921,6cyclictest280-21systemd-journal11:57:351
1766838992924,3cyclictest1958184-21irqrtprio10:21:120
1766838992920,7cyclictest280-21systemd-journal09:15:010
1766838992919,8cyclictest1792547-21ntpq07:31:190
1766843992823,4cyclictest1880593-21kworker/u8:0+flush-8:009:01:252
1766843992818,8cyclictest1808299-21cron07:49:592
1766843992817,8cyclictest1927151-21cat09:49:592
1766839992826,1cyclictest1991453-21kworker/u8:2+events_unbound11:36:231
1766839992823,3cyclictest2026339-21unixbench_multi11:26:251
1766839992822,5cyclictest1872028-21kworker/u8:3+flush-8:009:31:171
1766839992821,5cyclictest1980991-21ntpq10:41:181
176683999281,24cyclictest1962125-21true10:25:001
1766838992822,3cyclictest0-21swapper/011:31:030
1766843992722,4cyclictest1880593-21kworker/u8:0+flush-8:010:01:342
1766839992723,3cyclictest1803374-21kworker/u8:0+flush-8:008:31:221
1766839992723,2cyclictest1976955-21sendmail10:40:001
1766839992720,5cyclictest1880593-21kworker/u8:0+flush-8:009:01:181
1766839992719,6cyclictest1872028-21kworker/u8:3+flush-8:009:56:201
1766838992724,2cyclictest2042218-21aten2_r5power_e11:46:050
1766838992724,2cyclictest1901596-21needreboot09:21:180
1766838992724,2cyclictest1766829-21cyclictest09:05:010
1766838992723,2cyclictest1858086-21latency_hist08:40:010
1766838992723,2cyclictest1858086-21latency_hist08:40:010
1766838992722,4cyclictest1872028-21kworker/u8:3+flush-8:009:45:490
1766838992722,3cyclictest1937405-21aten2_r5power_c10:01:060
1766838992722,3cyclictest1912348-21cron09:35:000
1766838992721,4cyclictest1803374-21kworker/u8:0+events_unbound08:46:200
1766843992623,2cyclictest2027105-21aten2_r5power_e11:31:062
1766843992622,3cyclictest1912744-21aten2_r5power_e09:36:062
1766843992618,6cyclictest280-21systemd-journal08:25:002
1766839992621,4cyclictest1852679-21kworker/u8:2+flush-8:008:47:071
1766839992616,8cyclictest1802477-21ntpq07:41:161
1766838992622,3cyclictest2056623-21cron12:00:000
176683899262,23cyclictest0-21swapper/010:36:230
1766838992621,4cyclictest1996371-21unixbench_singl10:56:260
1766838992620,4cyclictest1819062-21irqcore08:01:120
1766838992617,7cyclictest1991453-21kworker/u8:2+flush-8:011:41:180
1766843992522,2cyclictest1902927-21aten2_r5power_p09:26:082
1766843992521,2cyclictest0-21swapper/210:25:002
1766843992520,3cyclictest1957105-21apt10:20:002
1766843992520,3cyclictest1812907-21unixbench_singl07:51:242
1766839992520,4cyclictest1734141-21kworker/u8:1+events_unbound08:40:011
1766839992520,3cyclictest0-21swapper/110:10:011
1766839992520,2cyclictest0-21swapper/112:26:121
1766838992521,2cyclictest0-21swapper/009:30:000
1766838992518,6cyclictest1880593-21kworker/u8:0+flush-8:009:06:160
1766838992517,6cyclictest2066516-21latency_hist12:10:010
1766838992517,6cyclictest1837621-21unixbench_singl08:16:240
1766838992516,7cyclictest1848151-21/usr/sbin/munin08:31:170
1766838992516,6cyclictest1862972-21latency_hist08:45:000
1766843992420,3cyclictest2017211-21aten2_r5power_e11:21:072
1766843992420,2cyclictest2046381-21unixbench_multi11:46:242
1766843992420,2cyclictest1962788-21fschecks_time10:26:072
1766843992418,4cyclictest280-21systemd-journal08:49:362
1766843992416,6cyclictest280-21systemd-journal11:05:012
1766839992416,5cyclictest0-21swapper/110:51:171
1766838992420,2cyclictest1803374-21kworker/u8:0+events_unbound08:51:140
1766838992420,2cyclictest0-21swapper/012:01:070
1766838992420,2cyclictest0-21swapper/010:45:000
1766838992419,4cyclictest1813449-21kworker/u8:3+flush-8:007:55:360
1766838992419,4cyclictest1734141-21kworker/u8:1+flush-8:009:16:180
1766838992419,3cyclictest0-21swapper/010:15:010
1766838992416,6cyclictest1927545-21aten2_r5power_e09:51:080
1766838992415,7cyclictest2081697-21/usr/sbin/munin12:26:170
17664612244,9sleep10-21swapper/107:07:361
18010272230,4sleep0583-21snmpd07:41:130
1766843992320,2cyclictest2061301-21unixbench_singl12:01:252
1766843992320,2cyclictest1996306-21unixbench_multi10:56:262
1766843992318,4cyclictest2006324-21kworker/u8:1+events_unbound11:08:452
1766843992318,3cyclictest1818755-21cpuspeed_turbos08:01:072
1766843992316,5cyclictest1947259-21cat10:10:012
1766839992317,4cyclictest2046779-21kworker/u8:1+flush-8:011:51:201
1766839992314,6cyclictest1880593-21kworker/u8:0+events_unbound10:26:041
176683899232,1cyclictest0-21swapper/007:51:230
1766838992319,3cyclictest2095852-21unixbench_singl12:36:240
1766838992318,3cyclictest1880593-21kworker/u8:0+flush-8:010:16:090
1766838992316,6cyclictest1880593-21kworker/u8:0+flush-8:009:36:180
1766838992316,5cyclictest1843475-21cpuspeed_turbos08:26:080
1766838992316,5cyclictest1843475-21cpuspeed_turbos08:26:080
1766838992315,6cyclictest280-21systemd-journal12:15:350
1766838992314,7cyclictest1807541-21ntpq07:46:220
176684399228,3cyclictest17757132grep07:16:132
1766843992219,2cyclictest1837632-21unixbench_singl08:16:242
1766843992216,4cyclictest1897200-21unixbench_singl09:16:252
1766843992215,5cyclictest280-21systemd-journal12:15:002
1766843992213,7cyclictest2076425-21awk12:20:002
1766838992217,3cyclictest0-21swapper/012:35:010
1766838992217,3cyclictest0-21swapper/009:41:080
1766838992216,4cyclictest2006299-21unixbench_multi11:06:250
1766838992215,5cyclictest1967408-21aten2_r5power_c10:31:070
176684399215,3cyclictest18010302cut07:41:132
1766843992118,2cyclictest1898002-21aten2_r5power_v09:21:082
1766843992117,3cyclictest1852774-21idleruntime-cro08:35:002
1766843992116,3cyclictest1957083-21kworker/u8:1+events_unbound10:50:072
1766838992116,4cyclictest2010713-21head11:11:160
1766843992016,3cyclictest1747099-21kworker/u8:2+events_unbound07:55:022
1766843992010,8cyclictest2053015-21tr11:56:122
1766838992016,2cyclictest0-21swapper/009:56:130
20818392190,5sleep375-21kworker/3:1+mm_percpu_wq12:26:073
176684399195,2cyclictest18779501latency_hist09:00:012
176684399192,12cyclictest1907752-21apt-get09:31:062
1766843991915,3cyclictest1813449-21kworker/u8:3+flush-8:008:13:412
1766843991914,4cyclictest1967061-21kworker/u8:3+flush-8:010:30:252
176684399191,16cyclictest1887689-21awk09:10:002
176684399189,7cyclictest1918723-21tr09:41:132
176684399183,2cyclictest20493682kthreadcore11:51:142
1766843991814,2cyclictest1783234-21unixbench_singl07:21:262
176684399180,2cyclictest20901792cat12:31:152
17663982183,8sleep30-21swapper/307:06:463
20294022178,5sleep30-21swapper/311:31:153
176684399172,11cyclictest1793776-21apt-get07:36:052
1766843991714,2cyclictest1734141-21kworker/u8:1+events_unbound07:10:092
176684399171,12cyclictest2007005-21apt-get11:11:062
176684399162,13cyclictest0-21swapper/208:25:152
176684399162,13cyclictest0-21swapper/208:25:152
1766843991613,2cyclictest0-21swapper/207:25:132
1766843991511,2cyclictest1932642-21cpuspeed_turbos09:56:082
1766843991510,3cyclictest0-21swapper/208:51:142
20951162132,7sleep30-21swapper/312:36:163
20771892134,5sleep30-21swapper/312:21:113
20714842132,6sleep30-21swapper/312:15:003
19579532133,7sleep30-21swapper/310:21:123
19428782132,7sleep30-21swapper/310:06:113
19370892132,6sleep30-21swapper/310:00:023
19123812132,5sleep30-21swapper/309:35:023
19085142132,7sleep30-21swapper/309:31:123
18577212132,7sleep30-21swapper/308:40:003
18577212132,7sleep30-21swapper/308:40:003
20864552122,6sleep30-21swapper/312:30:023
20621852123,6sleep30-21swapper/312:06:103
20511962122,6sleep30-21swapper/311:51:253
20457512122,6sleep30-21swapper/311:46:163
20408412122,6sleep30-21swapper/311:41:223
20171592122,6sleep30-21swapper/311:21:083
20135542122,6sleep30-21swapper/311:16:143
19920732122,6sleep30-21swapper/310:56:083
19834472122,6sleep30-21swapper/310:46:123
19834472122,6sleep30-21swapper/310:46:123
19725732122,6sleep30-21swapper/310:36:093
19673822122,6sleep30-21swapper/310:31:083
19629262122,6sleep30-21swapper/310:26:103
19523692122,5sleep30-21swapper/310:15:023
19520462122,6sleep30-21swapper/310:13:543
19320392122,6sleep30-21swapper/309:54:363
19176472122,6sleep30-21swapper/309:41:083
18922972122,6sleep30-21swapper/309:11:263
18682182122,6sleep30-21swapper/308:51:083
18582592122,6sleep30-21swapper/308:40:363
18478332122,6sleep30-21swapper/308:30:003
18380752122,5sleep30-21swapper/308:20:013
18377112122,6sleep30-21swapper/308:17:013
18329752122,6sleep30-21swapper/308:14:363
18132452122,5sleep30-21swapper/307:55:023
18000592122,6sleep30-21swapper/307:41:133
17978302122,6sleep30-21swapper/307:36:243
17884952122,5sleep30-21swapper/307:30:003
17878762122,6sleep30-21swapper/307:26:243
17788592122,5sleep30-21swapper/307:20:023
17748522122,6sleep30-21swapper/307:16:123
17713702122,6sleep30-21swapper/307:11:273
20718042112,5sleep30-21swapper/312:16:053
20220622112,5sleep30-21swapper/311:26:053
20069562112,6sleep30-21swapper/311:10:483
20019152112,5sleep30-21swapper/311:05:023
20010602112,5sleep30-21swapper/311:01:253
19871082112,5sleep30-21swapper/310:51:053
19772912114,4sleep30-21swapper/310:41:073
19323482112,5sleep30-21swapper/309:55:323
19228112112,5sleep30-21swapper/309:46:093
19073942113,5sleep30-21swapper/309:29:523
19019052112,5sleep30-21swapper/309:21:253
18929642112,5sleep30-21swapper/309:16:073
18829532113,5sleep30-21swapper/309:05:043
18779602112,5sleep30-21swapper/309:00:023
18632082113,5sleep30-21swapper/308:45:143
18432462112,5sleep30-21swapper/308:26:073
18432462112,5sleep30-21swapper/308:26:073
18185362112,6sleep30-21swapper/308:01:073
18035782112,5sleep30-21swapper/307:45:023
20319212102,5sleep30-21swapper/311:35:043
18234022102,5sleep30-21swapper/308:05:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional