You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 07:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jul 06, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191275423720,2sleep3451irq_work/320:30:163
191275423720,2sleep3451irq_work/320:30:153
212336321990,3sleep375-21kworker/3:1+events00:00:163
199484921910,4sleep3481ktimers/321:50:183
1829507996857,8cyclictest1838632-21kworker/u8:0+flush-8:019:25:271
1829502996759,6cyclictest1961787-21kworker/u8:1+events_unbound22:25:230
1829512996455,6cyclictest1704890-21systemd-journal23:40:012
1829502996457,5cyclictest2056942-21kworker/u8:2+flush-8:023:30:230
1829507996353,7cyclictest1876307-21latency_hist19:55:001
1829502996156,4cyclictest1936653-21kworker/u8:3+flush-8:021:05:270
1829502996155,4cyclictest1961787-21kworker/u8:1+flush-8:023:35:260
1829502996049,9cyclictest2045814-21ntpq22:40:180
1829507995948,8cyclictest2090633-21ntpq23:25:231
1829502995954,4cyclictest1819629-21kworker/u8:1+flush-8:020:20:210
1829502995954,4cyclictest1819629-21kworker/u8:1+flush-8:020:20:210
1829502995952,5cyclictest2035932-21kworker/u8:3+events_unbound00:35:190
1829502995753,3cyclictest1896020-21kworker/u8:0+events_unbound20:15:150
1829502995753,3cyclictest1896020-21kworker/u8:0+events_unbound20:15:140
1829502995752,4cyclictest2035932-21kworker/u8:3+events_unbound23:55:230
1829502995747,8cyclictest2110505-21ntpq23:45:230
1829512995649,5cyclictest1819629-21kworker/u8:1+flush-8:019:30:242
1829507995651,4cyclictest2130368-21kworker/u8:4+flush-8:000:30:111
1829502995649,5cyclictest1838632-21kworker/u8:0+flush-8:019:20:000
1829502995551,3cyclictest1906573-21kworker/u8:3+flush-8:020:35:250
1829502995549,4cyclictest2035932-21kworker/u8:3+flush-8:023:50:220
1829502995548,5cyclictest1936653-21kworker/u8:3+flush-8:020:55:240
1829502995449,3cyclictest1961787-21kworker/u8:1+events_unbound22:20:150
1829502995447,5cyclictest1952520-21kworker/u8:2+flush-8:021:35:220
1829507995344,7cyclictest1901372-21apt-get20:20:011
1829507995344,7cyclictest1901372-21apt-get20:20:001
1829502995348,4cyclictest1982074-21kworker/u8:3+events_unbound22:00:090
1829502995347,5cyclictest2035932-21kworker/u8:3+flush-8:023:05:240
1829512995242,7cyclictest1704890-21systemd-journal19:55:132
1829507995238,10cyclictest1704890-21systemd-journal21:21:131
1829502995248,3cyclictest1952520-21kworker/u8:2+flush-8:021:45:200
1829502995246,5cyclictest2003326-21kworker/u8:2+flush-8:022:35:200
1829502995245,5cyclictest1952520-21kworker/u8:2+flush-8:021:40:220
1829502995243,6cyclictest1866448-21latency_hist19:45:010
1829502995242,7cyclictest1961787-21kworker/u8:1+flush-8:023:20:190
1829502995242,7cyclictest1961787-21kworker/u8:1+flush-8:023:20:190
1829502995242,7cyclictest1704890-21systemd-journal19:32:140
1829507995141,7cyclictest1704890-21systemd-journal00:05:131
1829502995146,3cyclictest1952520-21kworker/u8:2+flush-8:021:10:250
1829502995146,3cyclictest1896020-21kworker/u8:0+events_unbound21:15:080
1829502995045,3cyclictest2035932-21kworker/u8:3+events_unbound23:45:020
1829502995044,4cyclictest1982074-21kworker/u8:3+flush-8:021:55:260
1829502995043,4cyclictest993089-21kworker/u8:4+events_unbound19:55:260
19132202490,4sleep00-21swapper/020:30:170
19132202490,4sleep00-21swapper/020:30:160
1829507994943,4cyclictest1991993-21apt-get21:50:011
1829507994941,6cyclictest1972100-21latency_hist21:30:021
1829507994941,5cyclictest1704890-21systemd-journal23:20:011
1829507994941,5cyclictest1704890-21systemd-journal23:20:001
1829507994939,7cyclictest2121315-21/usr/sbin/munin00:00:001
1829502994943,4cyclictest993089-21kworker/u8:4+events_unbound19:45:260
1829502994943,4cyclictest2003326-21kworker/u8:2+flush-8:022:05:220
1829502994943,4cyclictest1961787-21kworker/u8:1+flush-8:022:10:190
1829502994940,6cyclictest1834414-21apt-get19:15:010
1829502994843,3cyclictest1896020-21kworker/u8:0+flush-8:020:25:190
1829502994843,3cyclictest1896020-21kworker/u8:0+flush-8:020:25:180
1829502994842,3cyclictest2035932-21kworker/u8:3+events_unbound00:10:170
1829502994841,5cyclictest1936042-21ntpq20:50:200
1829502994841,5cyclictest1936042-21ntpq20:50:200
1829502994841,5cyclictest1819629-21kworker/u8:1+flush-8:019:50:180
1829512994741,4cyclictest1896020-21kworker/u8:0+flush-8:020:15:132
1829512994741,4cyclictest1896020-21kworker/u8:0+flush-8:020:15:132
1829507994738,7cyclictest2056942-21kworker/u8:2+flush-8:023:40:281
1829507994737,8cyclictest1704890-21systemd-journal21:35:141
1829502994744,2cyclictest1961787-21kworker/u8:1+events_unbound23:15:270
1829502994741,4cyclictest2035932-21kworker/u8:3+flush-8:000:30:280
1829502994739,7cyclictest2035932-21kworker/u8:3+flush-8:023:00:270
1829502994738,6cyclictest1961787-21kworker/u8:1+flush-8:021:25:290
1829512994640,4cyclictest2035932-21kworker/u8:3+flush-8:000:35:242
1829512994639,5cyclictest1704890-21systemd-journal20:10:002
1829512994638,6cyclictest1704890-21systemd-journal19:30:002
1829507994638,6cyclictest2041799-21latency_hist22:40:011
1829502994640,4cyclictest1936653-21kworker/u8:3+events_unbound21:20:160
1829512994535,7cyclictest1704890-21systemd-journal20:43:142
1829512994535,7cyclictest1704890-21systemd-journal20:43:132
1829507994539,4cyclictest1922197-21apt-get20:40:081
1829507994539,4cyclictest1922197-21apt-get20:40:081
1829512994437,5cyclictest2035932-21kworker/u8:3+events_unbound23:55:132
1829507994436,6cyclictest1861496-21latency_hist19:40:001
1829507994436,6cyclictest1834414-21apt-get19:15:031
1829502994438,5cyclictest1896020-21kworker/u8:0+flush-8:021:00:260
1829502994437,5cyclictest2017283-21apt-get22:15:080
1829507994335,6cyclictest1916728-21gpgv20:35:001
1829507994335,6cyclictest1916728-21gpgv20:35:001
1829507994334,6cyclictest1819629-21kworker/u8:1+flush-8:019:40:141
1829507994333,7cyclictest2096492-21latency_hist23:35:021
1829502994336,6cyclictest1961787-21kworker/u8:1+flush-8:000:00:310
1829502994336,5cyclictest2035932-21kworker/u8:3+events_unbound00:20:230
1829502994335,6cyclictest1952520-21kworker/u8:2+events_unbound21:30:200
1829502994335,5cyclictest1838632-21kworker/u8:0+flush-8:019:25:200
1829507994235,5cyclictest1704890-21systemd-journal00:29:121
1829502994237,3cyclictest1856312-21kworker/u8:2+flush-8:019:35:100
19633502410,3sleep375-21kworker/3:1+events21:20:153
1829507994135,4cyclictest1841847-21apt-get19:20:061
1829502994135,4cyclictest993089-21kworker/u8:4+flush-8:019:20:210
1829502994135,4cyclictest2003326-21kworker/u8:2+events_unbound22:30:240
1829502994135,4cyclictest1961787-21kworker/u8:1+events_unbound22:45:240
1829512994033,5cyclictest1856312-21kworker/u8:2+flush-8:019:35:212
1829502994035,3cyclictest1921561-21kworker/u8:2+flush-8:020:45:140
1829512993933,4cyclictest2130368-21kworker/u8:4+events_unbound00:05:242
1829512993933,4cyclictest1992456-21kworker/u8:0+flush-8:022:10:282
1829507993932,5cyclictest1704890-21systemd-journal21:40:141
1829507993929,8cyclictest1870449-21ntpq19:45:231
1829502993932,5cyclictest1961787-21kworker/u8:1+flush-8:023:25:100
1829512993832,3cyclictest1952520-21kworker/u8:2+events_unbound21:20:192
1829502993834,3cyclictest2056942-21kworker/u8:2+flush-8:022:55:250
1829502993834,3cyclictest1982074-21kworker/u8:3+flush-8:021:50:280
1829502993833,4cyclictest1961787-21kworker/u8:1+flush-8:023:10:270
1829502993833,4cyclictest1961787-21kworker/u8:1+flush-8:023:10:260
1829512993731,4cyclictest1916706-21apt-get20:35:002
1829512993731,4cyclictest1916706-21apt-get20:34:592
1829507993731,4cyclictest1982074-21kworker/u8:3+flush-8:021:55:281
1829507993730,6cyclictest993089-21kworker/u8:4+events_unbound19:10:261
1829507993729,6cyclictest2056942-21kworker/u8:2+flush-8:023:45:241
1829502993731,4cyclictest1961787-21kworker/u8:1+flush-8:000:15:110
1829502993726,8cyclictest2150146-21ntpq00:25:200
1829512993631,3cyclictest2044399-21kworker/u8:0+flush-8:022:50:272
1829512993627,6cyclictest1952193-21turbostat.cron21:09:592
1829507993631,3cyclictest1957440-21apt-get21:15:061
1829507993630,4cyclictest1886734-21apt-get20:05:081
1829502993632,3cyclictest1856312-21kworker/u8:2+flush-8:020:10:260
1829502993632,3cyclictest1856312-21kworker/u8:2+flush-8:020:10:250
1829512993529,4cyclictest2035932-21kworker/u8:3+flush-8:023:00:092
1829507993529,4cyclictest993089-21kworker/u8:4+flush-8:019:55:251
1829507993422,9cyclictest1704890-21systemd-journal23:35:111
1829502993428,4cyclictest2035932-21kworker/u8:3+events_unbound00:05:270
1829502993428,3cyclictest993089-21kworker/u8:4+flush-8:020:05:270
1829507993329,3cyclictest1992456-21kworker/u8:0+events_unbound22:00:141
1829507993328,4cyclictest1961787-21kworker/u8:1+events_unbound22:10:201
1829507993326,5cyclictest1704890-21systemd-journal21:07:141
1829502993329,3cyclictest1856312-21kworker/u8:2+flush-8:020:00:510
1829512993227,4cyclictest1968283-21kworker/u8:0+flush-8:021:25:222
1829512993224,6cyclictest1704890-21systemd-journal23:15:002
1829512993224,6cyclictest1704890-21systemd-journal23:14:592
1829507993228,3cyclictest1936653-21kworker/u8:3+events_unbound20:51:461
1829507993228,3cyclictest1936653-21kworker/u8:3+events_unbound20:51:451
1829507993227,3cyclictest2081463-21munin-run23:20:001
1829507993226,4cyclictest2035932-21kworker/u8:3+flush-8:023:00:221
20314272310,6sleep20-21swapper/222:25:272
1829507993125,4cyclictest1937259-21apt-get20:55:091
1829507993124,5cyclictest2035932-21kworker/u8:3+flush-8:000:15:261
1829512993022,6cyclictest1704890-21systemd-journal23:19:132
1829507993025,4cyclictest1856312-21kworker/u8:2+events_unbound20:10:241
1829507993025,4cyclictest1856312-21kworker/u8:2+events_unbound20:10:231
1829507993024,4cyclictest2130368-21kworker/u8:4+events_unbound00:20:151
1829507993024,4cyclictest2035932-21kworker/u8:3+flush-8:023:05:221
1829507993024,4cyclictest1856508-21cron19:35:001
1829507993017,9cyclictest1704890-21systemd-journal22:41:131
1829512992925,3cyclictest993089-21kworker/u8:4+events_unbound20:00:242
1829512992925,3cyclictest2003326-21kworker/u8:2+flush-8:022:00:222
1829512992925,2cyclictest2106441-21cron23:45:002
1829507992923,4cyclictest2131528-21apt-get00:10:071
1829507992921,6cyclictest1961787-21kworker/u8:1+flush-8:023:10:211
1829507992921,6cyclictest1961787-21kworker/u8:1+flush-8:023:10:211
1829507992825,2cyclictest2047255-21cpuspeed_turbos22:45:111
1829507992824,3cyclictest2150222-21kworker/u8:0+flush-8:000:38:441
1829507992823,4cyclictest1896020-21kworker/u8:0+events_unbound21:00:191
1829507992819,7cyclictest1704890-21systemd-journal22:35:011
1829502992824,3cyclictest1896020-21kworker/u8:0+events_unbound20:40:030
1829502992824,3cyclictest1896020-21kworker/u8:0+events_unbound20:40:030
18283052285,15sleep10-21swapper/119:05:251
1829512992722,4cyclictest2035932-21kworker/u8:3+events_unbound22:55:112
1829512992718,7cyclictest1704890-21systemd-journal19:15:002
1829507992722,4cyclictest1896020-21kworker/u8:0+flush-8:020:25:241
1829507992722,4cyclictest1896020-21kworker/u8:0+flush-8:020:25:231
1829507992721,4cyclictest1982074-21kworker/u8:3+events_unbound21:50:201
1829507992720,5cyclictest2003326-21kworker/u8:2+events_unbound22:05:121
1829502992721,4cyclictest2052010-21apt-get22:50:060
18284402274,15sleep01828510-21python319:05:290
1829512992623,2cyclictest2021985-21sendmail22:20:002
1829512992622,3cyclictest2082076-21aten2_r5power_v23:20:092
1829512992622,3cyclictest2082076-21aten2_r5power_v23:20:082
1829512992622,2cyclictest0-21swapper/220:30:002
1829512992622,2cyclictest0-21swapper/220:29:592
1829507992622,2cyclictest0-21swapper/120:20:001
1829507992622,2cyclictest0-21swapper/120:19:591
1829507992616,8cyclictest1704890-21systemd-journal22:19:141
1829512992521,2cyclictest2007588-21fschecks_count22:05:132
1829512992520,3cyclictest2120736-21kworker/u8:0+events_unbound00:00:142
1829507992520,4cyclictest2035932-21kworker/u8:3+flush-8:023:50:261
1829507992520,4cyclictest1961787-21kworker/u8:1+events_unbound22:20:211
1829507992518,5cyclictest1704890-21systemd-journal22:29:591
1829507992517,6cyclictest2056710-21latency_hist22:55:011
1829512992420,3cyclictest1936653-21kworker/u8:3+flush-8:021:15:172
1829512992419,3cyclictest2035932-21kworker/u8:3+events_unbound22:30:302
1829512992417,5cyclictest1704890-21systemd-journal19:55:002
1829507992420,2cyclictest0-21swapper/123:00:001
1829507992419,3cyclictest0-21swapper/120:40:001
1829512992320,2cyclictest2141524-21aten2_r5power_e00:20:092
1829512992320,2cyclictest1942342-21aten2_r5power_p21:00:082
1829512992319,2cyclictest0-21swapper/220:40:002
20856802220,5sleep30-21swapper/323:20:203
20856802220,5sleep30-21swapper/323:20:203
20735002220,2sleep3451irq_work/323:10:163
20735002220,2sleep3451irq_work/323:10:163
20520852220,2sleep3481ktimers/322:50:103
1829512992215,5cyclictest1-21systemd22:00:002
1829507992216,4cyclictest1976664-21sed21:30:271
1829507992216,4cyclictest1932051-21latency_hist20:50:001
1829512992118,2cyclictest2022589-21fschecks_time22:20:122
1829512992117,2cyclictest1991593-21unixbench_singl21:45:282
1829512992116,4cyclictest2140726-21unixbench_multi00:15:272
1829507992117,2cyclictest0-21swapper/120:00:151
18291512213,11sleep30-21swapper/319:09:543
182951299207,9cyclictest1985836-21kthreadcore21:40:192
1829512992017,2cyclictest1841934-21aten2_r5power_p19:20:082
1829512992016,2cyclictest2066996-21aten2_r5power_v23:05:102
1829512992016,2cyclictest0-21swapper/223:29:592
1829512992015,3cyclictest0-21swapper/220:20:092
1829512992015,3cyclictest0-21swapper/220:20:082
1829512992011,2cyclictest0-21swapper/221:30:232
1829512991914,4cyclictest1941570-21unixbench_singl20:55:292
1829512991914,3cyclictest1932658-21fschecks_time20:50:122
1829512991914,3cyclictest1932658-21fschecks_time20:50:112
1829512991914,3cyclictest0-21swapper/221:15:012
1829512991910,7cyclictest1838603-21cut19:15:162
1829507991915,2cyclictest0-21swapper/121:10:161
1829507991910,7cyclictest2121564-21/usr/sbin/munin00:00:201
18283382194,9sleep20-21swapper/219:05:262
182951299182,12cyclictest1931020-21ntpq20:45:232
1829512991815,2cyclictest1866975-21fschecks_count19:45:142
1829512991814,2cyclictest0-21swapper/221:50:262
1829512991814,2cyclictest0-21swapper/221:35:192
1829512991814,2cyclictest0-21swapper/200:35:002
1829512991813,3cyclictest0-21swapper/223:30:282
1829512991811,5cyclictest2146663-21sshd00:25:122
1829512991713,2cyclictest0-21swapper/219:40:122
21539782160,4sleep3481ktimers/300:30:183
182951299162,13cyclictest0-21swapper/222:35:262
1829512991613,2cyclictest0-21swapper/223:50:142
1829512991613,2cyclictest0-21swapper/220:10:202
1829512991613,2cyclictest0-21swapper/220:10:192
1829512991612,3cyclictest2110362-21missed_timers23:45:202
1829512991612,2cyclictest0-21swapper/222:45:062
182951299157,6cyclictest2131747-21tr00:10:102
182951299152,8cyclictest2045840-21ntpq22:40:182
21312582142,8sleep30-21swapper/300:10:013
19621212143,7sleep30-21swapper/321:20:013
18774852144,6sleep30-21swapper/319:55:173
18340812142,8sleep30-21swapper/319:10:533
21461702132,6sleep30-21swapper/300:25:023
21114332132,6sleep30-21swapper/323:50:023
20814402132,7sleep30-21swapper/323:19:593
20656902132,7sleep30-21swapper/323:00:213
20120322132,6sleep30-21swapper/322:10:013
20021652132,6sleep30-21swapper/322:00:023
19770712132,6sleep30-21swapper/321:35:013
19672662132,6sleep30-21swapper/321:25:033
18702812132,7sleep30-21swapper/319:45:213
21451612122,6sleep30-21swapper/300:20:203
21324132122,6sleep30-21swapper/300:10:173
21203122122,6sleep30-21swapper/323:55:203
20967522122,6sleep30-21swapper/323:35:093
20958582120,8sleep30-21swapper/323:30:283
20871542122,6sleep30-21swapper/323:25:133
20605052122,6sleep30-21swapper/322:55:203
20516812122,6sleep30-21swapper/322:49:133
20368402122,5sleep30-21swapper/322:35:023
20233952122,6sleep30-21swapper/322:20:173
20167182122,6sleep30-21swapper/322:11:133
19976862123,6sleep30-21swapper/321:55:113
19825512123,5sleep30-21swapper/321:40:113
19732712122,6sleep30-21swapper/321:30:163
19479842122,6sleep30-21swapper/321:05:153
19461032122,6sleep30-21swapper/321:00:223
19374982122,6sleep30-21swapper/320:55:133
19363302122,6sleep30-21swapper/320:50:263
19363302122,6sleep30-21swapper/320:50:263
19037432122,6sleep30-21swapper/320:20:163
19037432122,6sleep30-21swapper/320:20:163
19011182122,6sleep30-21swapper/320:17:003
19011182122,6sleep30-21swapper/320:17:003
18917162122,6sleep30-21swapper/320:10:103
18917162122,6sleep30-21swapper/320:10:093
18874572122,6sleep30-21swapper/320:05:163
18857962123,6sleep30-21swapper/320:00:263
18622482122,6sleep30-21swapper/319:40:153
18571932122,6sleep30-21swapper/319:35:143
21566992112,5sleep30-21swapper/300:35:133
21364752112,5sleep30-21swapper/300:15:023
21066822112,6sleep30-21swapper/323:45:083
21016992113,5sleep30-21swapper/323:40:063
20674632112,5sleep30-21swapper/323:05:153
20424152112,5sleep30-21swapper/322:40:113
20325842112,5sleep30-21swapper/322:30:153
20271642112,5sleep30-21swapper/322:25:013
20172962112,5sleep30-21swapper/322:15:103
19875502112,5sleep30-21swapper/321:45:133
19562292112,5sleep30-21swapper/321:10:223
19269232112,5sleep30-21swapper/320:45:013
19223542112,5sleep30-21swapper/320:40:123
19223542112,5sleep30-21swapper/320:40:113
19176362112,6sleep30-21swapper/320:35:143
19068162112,5sleep30-21swapper/320:25:113
19068162112,5sleep30-21swapper/320:25:113
18719012112,5sleep30-21swapper/319:50:113
18518132112,6sleep30-21swapper/319:30:093
18473032112,5sleep30-21swapper/319:25:143
18415702112,5sleep30-21swapper/319:20:013
18370912112,5sleep30-21swapper/319:15:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional