You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 17:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 25, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19535022790,4sleep00-21swapper/007:16:300
1943484997262,7cyclictest280-21systemd-journal08:00:002
1943480997062,6cyclictest1980173-21kworker/u8:3+flush-8:008:41:181
1943480996660,5cyclictest2198679-21kworker/u8:0+flush-8:012:11:231
1943480996557,6cyclictest2198679-21kworker/u8:0+flush-8:012:31:191
1943480996358,4cyclictest2153586-21kworker/u8:3+flush-8:010:46:241
1943480996358,4cyclictest1900093-21kworker/u8:2+events_unbound07:21:241
1943480996256,5cyclictest1801761-21kworker/u8:1+flush-8:008:36:191
1943480996155,4cyclictest1801761-21kworker/u8:1+events_unbound10:06:111
1943480996154,6cyclictest2084390-21kworker/u8:3+events_unbound10:01:231
1943480995952,6cyclictest2183181-21kworker/u8:2+flush-8:011:11:201
1943480995854,3cyclictest1801761-21kworker/u8:1+events_unbound08:01:211
1943480995751,5cyclictest2198679-21kworker/u8:0+flush-8:011:36:191
1943475995748,6cyclictest2193500-21latency_hist11:20:010
1943480995650,5cyclictest2044634-21kworker/u8:2+flush-8:008:51:261
1943480995649,5cyclictest1801761-21kworker/u8:1+events_unbound07:36:191
1943480995648,6cyclictest2153586-21kworker/u8:3+flush-8:011:21:211
1943475995645,8cyclictest2149533-21diskstats10:36:100
1943480995550,4cyclictest1801761-21kworker/u8:1+flush-8:008:26:121
1943480995549,5cyclictest2044634-21kworker/u8:2+flush-8:009:41:241
1943480995549,4cyclictest2044634-21kworker/u8:2+flush-8:009:01:221
1943480995448,4cyclictest1980173-21kworker/u8:3+events_unbound08:31:201
1943484995347,4cyclictest2044634-21kworker/u8:2+flush-8:009:56:262
1943480995346,5cyclictest2183181-21kworker/u8:2+flush-8:011:26:261
194347599535,46cyclictest1-21systemd11:10:000
1943475995344,7cyclictest2108053-21ntpq09:51:180
1943475995343,7cyclictest2019709-21latency_hist08:25:000
1943484995247,3cyclictest1980173-21kworker/u8:3+flush-8:008:06:232
1943480995248,3cyclictest2183181-21kworker/u8:2+events_unbound11:31:091
1943480995248,3cyclictest1980173-21kworker/u8:3+flush-8:008:06:251
1943480995247,4cyclictest2044634-21kworker/u8:2+events_unbound09:46:201
1943480995247,4cyclictest1980173-21kworker/u8:3+flush-8:008:46:201
1943480995247,4cyclictest1801761-21kworker/u8:1+flush-8:007:46:201
1943480995246,4cyclictest2198679-21kworker/u8:0+events_unbound12:26:081
1943480995245,6cyclictest2138798-21kworker/u8:1+flush-8:010:36:211
1943480995245,5cyclictest2153586-21kworker/u8:3+flush-8:010:56:201
1943480995245,5cyclictest1801761-21kworker/u8:1+events_unbound08:11:191
1943480995245,5cyclictest1801761-21kworker/u8:1+events_unbound08:11:191
1943480995244,6cyclictest1801761-21kworker/u8:1+flush-8:007:51:221
1943480995147,3cyclictest2044634-21kworker/u8:2+events_unbound09:36:241
1943480995146,4cyclictest1801761-21kworker/u8:1+events_unbound07:16:231
1943480995145,5cyclictest1900093-21kworker/u8:2+flush-8:008:21:091
1943475995142,7cyclictest280-21systemd-journal08:45:010
22393912500,2sleep3481ktimers/312:06:093
1943480995044,5cyclictest2173406-21kworker/u8:1+flush-8:011:01:191
1943480994942,5cyclictest2044634-21kworker/u8:2+flush-8:009:16:191
1943480994941,6cyclictest2084390-21kworker/u8:3+flush-8:010:11:171
1943480994941,6cyclictest2084390-21kworker/u8:3+flush-8:010:11:171
1943480994842,4cyclictest2153586-21kworker/u8:3+flush-8:011:16:191
1943480994840,6cyclictest2123372-21kworker/u8:0+flush-8:010:31:211
1943475994838,8cyclictest2144341-21diskstats10:31:090
1943480994742,3cyclictest2198679-21kworker/u8:0+events_unbound11:41:221
1943480994740,5cyclictest2138798-21kworker/u8:1+flush-8:010:41:131
1943480994737,7cyclictest280-21systemd-journal08:20:001
1943480994737,7cyclictest280-21systemd-journal08:20:001
1943480994733,10cyclictest280-21systemd-journal11:55:001
1943484994640,4cyclictest1900093-21kworker/u8:2+flush-8:007:36:102
1943480994541,3cyclictest1980173-21kworker/u8:3+events_unbound07:56:201
1943480994540,3cyclictest2223604-21kworker/u8:3+events_unbound12:21:231
1943480994538,5cyclictest2044634-21kworker/u8:2+flush-8:010:21:111
1943480994437,5cyclictest2223604-21kworker/u8:3+flush-8:011:56:111
1943480994437,5cyclictest2198679-21kworker/u8:0+events_unbound11:46:191
1943475994439,4cyclictest2044634-21kworker/u8:2+events_unbound09:26:250
1943475994438,4cyclictest2223604-21kworker/u8:3+events_unbound12:05:000
1943475994436,6cyclictest1970545-21/usr/sbin/munin07:36:170
1943480994338,3cyclictest2198679-21kworker/u8:0+flush-8:012:06:191
1943480994337,5cyclictest2044634-21kworker/u8:2+events_unbound09:06:091
1943480994337,4cyclictest1900093-21kworker/u8:2+events_unbound07:26:151
1943480994336,5cyclictest2223604-21kworker/u8:3+events_unbound12:01:181
1943475994337,4cyclictest2018932-21kworker/u8:0+flush-8:008:51:100
1943475994332,8cyclictest2228340-21apt-get11:55:000
1943480994236,4cyclictest2173406-21kworker/u8:1+events_unbound12:16:081
1943480994236,4cyclictest1102287-21kworker/u8:4+events_unbound07:11:191
1943480994234,6cyclictest2123372-21kworker/u8:0+flush-8:010:16:181
20787082410,6sleep30-21swapper/309:21:253
1943480994136,3cyclictest2173406-21kworker/u8:1+events_unbound12:36:121
1943480994135,4cyclictest2044634-21kworker/u8:2+events_unbound09:31:141
1943480994135,4cyclictest2018932-21kworker/u8:0+flush-8:009:26:131
1943480994131,8cyclictest2108020-21ntpq09:51:171
1943475994032,7cyclictest2044634-21kworker/u8:2+flush-8:010:51:230
1943475994031,6cyclictest2173406-21kworker/u8:1+flush-8:012:16:050
1943480993934,3cyclictest2173406-21kworker/u8:1+events_unbound11:06:151
1943480993933,5cyclictest2153586-21kworker/u8:3+events_unbound10:51:201
1943475993933,4cyclictest2138798-21kworker/u8:1+flush-8:010:41:220
1943475993929,8cyclictest2254066-21diskstats12:21:090
1943484993830,6cyclictest280-21systemd-journal11:00:342
1943484993828,8cyclictest2228340-21apt-get11:54:592
1943480993832,4cyclictest2018932-21kworker/u8:0+flush-8:008:56:151
194319923823,10sleep10-21swapper/107:08:491
1943480993733,3cyclictest1801761-21kworker/u8:1+flush-8:007:31:241
1943480993732,4cyclictest2018932-21kworker/u8:0+events_unbound09:21:141
1943480993732,4cyclictest1801761-21kworker/u8:1+flush-8:007:41:211
1943475993731,4cyclictest2198679-21kworker/u8:0+flush-8:012:31:240
1943475993731,4cyclictest2173406-21kworker/u8:1+events_unbound11:31:230
1943475993730,5cyclictest2018932-21kworker/u8:0+events_unbound08:56:200
1943475993729,6cyclictest2268572-21/usr/sbin/munin12:36:210
19432902372,10sleep01943340-21munin-run07:10:010
1943484993631,3cyclictest1102287-21kworker/u8:4+events_unbound07:11:252
1943475993630,4cyclictest1801761-21kworker/u8:1+events_unbound07:51:260
1943475993530,4cyclictest1980173-21kworker/u8:3+flush-8:008:46:230
1943475993527,5cyclictest1999931-21latency_hist08:05:010
1943475993429,4cyclictest1801761-21kworker/u8:1+events_unbound10:06:210
1943475993428,5cyclictest2044634-21kworker/u8:2+flush-8:009:06:220
1943475993428,4cyclictest1980173-21kworker/u8:3+events_unbound08:06:260
1943475993427,5cyclictest2018932-21kworker/u8:0+flush-8:009:16:100
1943475993427,4cyclictest2029582-21latency_hist08:35:010
1943475993425,7cyclictest2068540-21ntpq09:11:220
1943475993423,8cyclictest2143528-21latency_hist10:30:010
1943484993325,6cyclictest2218562-21apt-get11:46:052
1943475993328,4cyclictest2044634-21kworker/u8:2+flush-8:009:01:110
1943475993326,5cyclictest2018932-21kworker/u8:0+flush-8:009:21:200
1943475993325,6cyclictest1980173-21kworker/u8:3+flush-8:007:56:190
1943475993324,7cyclictest2117903-21ntpq10:01:190
1943475993323,8cyclictest280-21systemd-journal10:15:000
1943475993323,8cyclictest280-21systemd-journal10:14:590
1943484993228,3cyclictest2044634-21kworker/u8:2+flush-8:010:26:202
1943484993227,4cyclictest2223604-21kworker/u8:3+events_unbound12:01:222
1943484993226,4cyclictest2044634-21kworker/u8:2+flush-8:009:31:242
1943475993230,1cyclictest2173406-21kworker/u8:1+events_unbound12:06:180
1943475993227,3cyclictest401-21dbus-daemon07:45:000
1943475993225,5cyclictest1801761-21kworker/u8:1+flush-8:007:46:100
1943475993222,8cyclictest2129256-21diskstats10:16:090
1943480993125,4cyclictest2138798-21kworker/u8:1+flush-8:010:26:121
1943475993126,4cyclictest2173406-21kworker/u8:1+flush-8:011:01:350
1943475993125,4cyclictest1801761-21kworker/u8:1+events_unbound08:26:250
1943475993026,3cyclictest1801761-21kworker/u8:1+flush-8:007:31:230
1943475993026,2cyclictest2014735-21latency_hist08:20:000
1943475993026,2cyclictest2014735-21latency_hist08:20:000
1943475993025,3cyclictest2163795-21cron10:50:000
1943475993024,5cyclictest2044634-21kworker/u8:2+flush-8:010:21:190
1943475993024,4cyclictest2044634-21kworker/u8:2+events_unbound09:36:120
1943475993023,5cyclictest2198679-21kworker/u8:0+events_unbound11:55:010
1943475993023,5cyclictest1900093-21kworker/u8:2+flush-8:007:26:210
1943475993021,6cyclictest2034523-21latency_hist08:40:010
1943484992924,3cyclictest2009437-21unixbench_multi08:11:262
1943484992924,3cyclictest2009437-21unixbench_multi08:11:252
1943484992922,5cyclictest2059454-21cron09:05:002
1943480992923,4cyclictest2018932-21kworker/u8:0+events_unbound09:11:111
1943475992925,2cyclictest1955754-21cpuspeed_turbos07:21:080
1943475992923,5cyclictest2198679-21kworker/u8:0+flush-8:011:46:170
19646522280,7sleep375-21kworker/3:1+mm_percpu_wq07:26:243
1943484992822,4cyclictest280-21systemd-journal07:35:002
1943475992821,5cyclictest2198679-21kworker/u8:0+flush-8:011:36:050
1943475992821,5cyclictest2173703-21sendmail11:00:000
1943484992723,3cyclictest2123372-21kworker/u8:0+flush-8:010:31:202
1943484992722,4cyclictest2018932-21kworker/u8:0+flush-8:008:21:232
1943484992721,4cyclictest2213257-21idleruntime-cro11:39:592
1943484992717,8cyclictest280-21systemd-journal12:26:332
1943475992722,4cyclictest2183181-21kworker/u8:2+events_unbound11:11:240
1943475992717,8cyclictest280-21systemd-journal09:50:000
1943475992713,12cyclictest2213956-21fschecks_time11:41:100
1943484992622,2cyclictest2268863-21fschecks_count12:36:082
1943484992621,4cyclictest2094088-21munin-run09:40:002
1943484992620,4cyclictest2264055-21cut12:31:102
1943480992622,3cyclictest2044634-21kworker/u8:2+events_unbound09:56:291
1943475992621,4cyclictest2044634-21kworker/u8:2+flush-8:009:56:570
194348499252,9cyclictest19535042kthreadcore07:16:302
1943484992521,2cyclictest2254107-21fschecks_count12:21:112
1943484992521,2cyclictest2244060-21aten2_r5power_v12:11:072
1943484992521,2cyclictest2068992-21unixbench_multi09:11:272
1943484992520,3cyclictest2099689-21fschecks_time09:46:102
1943484992520,3cyclictest2094541-21aten2_r5power_v09:41:082
194348499250,8cyclictest19986691kthreadcore08:01:172
1943475992522,2cyclictest2198475-21systemd-run11:25:000
1943475992521,2cyclictest2248516-21cron12:15:000
1943484992420,2cyclictest1985475-21aten2_r5power_c07:51:092
1943484992415,7cyclictest280-21systemd-journal09:10:002
1943475992420,3cyclictest2198679-21kworker/u8:0+events_unbound12:26:220
1943475992420,2cyclictest876-21mta-sts-daemon09:41:160
194348499236,3cyclictest21594492entropy10:46:092
1943484992319,2cyclictest2039887-21aten2_r5power_p08:46:072
1943484992319,2cyclictest1980573-21aten2_r5power_p07:46:072
1943475992319,3cyclictest1948359-21turbostat.cron07:15:000
1943475992318,4cyclictest1980173-21kworker/u8:3+events_unbound08:11:110
1943475992318,4cyclictest1980173-21kworker/u8:3+events_unbound08:11:100
194348499222,14cyclictest2049692-21apt-get08:56:062
1943484992218,3cyclictest2154455-21cpuspeed_turbos10:41:082
1943484992217,3cyclictest2208000-21unixbench_singl11:31:252
1943484992214,6cyclictest2199073-21cut11:26:122
1943475992215,5cyclictest2183181-21kworker/u8:2+events_unbound11:26:110
1943484992117,2cyclictest0-21swapper/207:41:202
1943484992114,5cyclictest2118070-21grep10:01:232
1943484992017,2cyclictest2233523-21sh12:00:002
1943484992016,2cyclictest1960782-21aten2_r5power_e07:26:072
1943475992015,3cyclictest2088813-21unixbench_singl09:31:260
19386772204,10sleep20-21swapper/207:05:212
21893942190,2sleep20-21swapper/211:16:122
194348499198,9cyclictest2023730-21needreboot08:26:182
194348499192,12cyclictest2074632-21apt-get09:21:072
194348499192,12cyclictest2034869-21apt-get08:41:072
1943484991915,2cyclictest0-21swapper/210:56:232
1943484991912,5cyclictest2184121-21sort11:11:082
194348499191,13cyclictest1955535-21apt-get07:21:082
19386732194,8sleep30-21swapper/307:05:183
194348499189,7cyclictest2119322-21seq10:06:082
194348499188,2cyclictest0-21swapper/209:16:072
194348499186,4cyclictest0-21swapper/210:52:342
194348499182,11cyclictest2024981-21apt-get08:31:082
1943484991814,2cyclictest2213840-21cpuspeed_turbos11:41:082
1943484991814,2cyclictest0-21swapper/212:20:002
1943484991814,2cyclictest0-21swapper/211:06:252
1943484991814,2cyclictest0-21swapper/210:21:102
22011982170,2sleep3471rcuc/311:26:173
1943484991713,2cyclictest0-21swapper/212:07:062
1943484991713,2cyclictest0-21swapper/209:51:132
1943484991713,2cyclictest0-21swapper/208:36:232
1943484991712,3cyclictest0-21swapper/210:36:162
1943484991712,3cyclictest0-21swapper/209:26:162
194348499167,7cyclictest2124314-21sort10:11:092
194348499167,7cyclictest2124314-21sort10:11:092
1943484991613,2cyclictest0-21swapper/210:15:412
1943484991613,2cyclictest0-21swapper/208:52:582
1943484991612,2cyclictest0-21swapper/211:21:112
194348499161,10cyclictest2010153-21apt-get08:16:072
194348499161,10cyclictest2010153-21apt-get08:16:072
19555382152,8sleep30-21swapper/307:21:073
20734382142,8sleep30-21swapper/309:16:193
20435272142,8sleep30-21swapper/308:46:183
19795572144,6sleep30-21swapper/307:41:263
22636612133,6sleep30-21swapper/312:31:063
21385952132,6sleep30-21swapper/310:25:023
20189562132,7sleep30-21swapper/308:21:233
20106252132,7sleep30-21swapper/308:16:133
20106252132,7sleep30-21swapper/308:16:133
19655172132,6sleep30-21swapper/307:30:023
22685712123,6sleep30-21swapper/312:36:043
22525532120,8sleep30-21swapper/312:16:183
22335092122,6sleep30-21swapper/312:00:003
22190342122,6sleep30-21swapper/311:46:123
22089182122,6sleep30-21swapper/311:36:093
21941202122,6sleep30-21swapper/311:21:113
21925782122,6sleep30-21swapper/311:16:183
21844062122,6sleep30-21swapper/311:11:133
21777992122,6sleep30-21swapper/311:01:183
21654872122,7sleep30-21swapper/310:51:143
21580142122,6sleep30-21swapper/310:41:193
21439842122,6sleep30-21swapper/310:30:043
21290112123,6sleep30-21swapper/310:16:063
21237442122,6sleep30-21swapper/310:10:013
21237442122,6sleep30-21swapper/310:10:013
21140982122,6sleep30-21swapper/310:00:383
20944322122,6sleep30-21swapper/309:41:083
20935582122,6sleep30-21swapper/309:36:273
20648262122,6sleep30-21swapper/309:11:103
20532582122,6sleep30-21swapper/308:56:183
20299182123,6sleep30-21swapper/308:36:073
19999562122,5sleep30-21swapper/308:05:013
19906252122,6sleep30-21swapper/307:56:103
19858192122,6sleep30-21swapper/307:51:133
19745732122,6sleep30-21swapper/307:36:243
19509902122,6sleep30-21swapper/307:16:263
19436662122,6sleep30-21swapper/307:11:003
22623422112,5sleep30-21swapper/312:26:173
22540672111,6sleep30-21swapper/312:21:113
22482952112,5sleep30-21swapper/312:12:083
22339062112,5sleep30-21swapper/312:01:093
22274352112,5sleep30-21swapper/311:51:183
22134982112,5sleep30-21swapper/311:40:023
22036732112,5sleep30-21swapper/311:30:353
21802852113,5sleep30-21swapper/311:06:143
21690022112,5sleep30-21swapper/310:55:203
21591002112,5sleep30-21swapper/310:45:133
21492562112,5sleep30-21swapper/310:36:063
21384492112,6sleep30-21swapper/310:23:383
21219032111,6sleep30-21swapper/310:06:163
21094732112,5sleep30-21swapper/309:56:133
21043412112,5sleep30-21swapper/309:51:073
20990322111,5sleep30-21swapper/309:45:013
20844022112,6sleep30-21swapper/309:30:163
20795592112,5sleep30-21swapper/309:26:073
20597642112,5sleep30-21swapper/309:06:053
20551052112,5sleep30-21swapper/309:01:113
20446702112,6sleep30-21swapper/308:50:363
20348412112,5sleep30-21swapper/308:41:053
20285682112,6sleep30-21swapper/308:31:183
20199792112,5sleep30-21swapper/308:25:353
20051862112,6sleep30-21swapper/308:11:073
20051862112,6sleep30-21swapper/308:11:073
19952852112,6sleep30-21swapper/308:00:363
19808792112,5sleep30-21swapper/307:46:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional