You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon Sep 07, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195658421530,3sleep375-21kworker/3:1+events20:14:263
206881721040,2sleep1281rcuc/122:09:151
20198212760,4chrt0-21swapper/321:19:183
1890805995145,4cyclictest1957295-21kworker/u8:2+events_unbound21:19:131
1890805995044,4cyclictest2205559-21kworker/u8:2+flush-8:000:25:011
1890805995041,7cyclictest2011494-21latency_hist21:10:011
1890805994943,4cyclictest2091095-21kworker/u8:1+flush-8:023:14:261
1890805994438,4cyclictest2101057-21kworker/u8:3+flush-8:023:44:111
1890805994437,5cyclictest1957295-21kworker/u8:2+flush-8:020:54:251
1890805994338,4cyclictest1972206-21kworker/u8:1+flush-8:020:34:231
1890805994338,4cyclictest1890674-21kworker/u8:0+events_unbound19:34:221
22043102420,2chrt75-21kworker/3:1-events00:24:173
1890805994233,6cyclictest2086138-21latency_hist22:25:001
1890802994236,4cyclictest1035700-21kworker/u8:1+events_unbound19:19:260
1890802994233,7cyclictest2161327-21/usr/sbin/munin23:44:240
20348842410,3sleep20-21swapper/221:34:172
1890805994034,5cyclictest1890674-21kworker/u8:0+flush-8:020:19:251
1890805994033,5cyclictest1972206-21kworker/u8:1+events_unbound22:15:021
1890805994033,5cyclictest1972206-21kworker/u8:1+events_unbound22:15:021
1890805994032,6cyclictest1957295-21kworker/u8:2+flush-8:021:49:281
1890805993934,4cyclictest2205559-21kworker/u8:2+flush-8:000:34:241
1890805993934,3cyclictest2197010-21irqrtprio00:19:171
1890805993833,4cyclictest1957295-21kworker/u8:2+events_unbound22:44:261
1890805993832,4cyclictest1880893-21kworker/u8:3+flush-8:019:14:261
1890805993732,3cyclictest2216358-21fschecks_count00:39:111
1890805993729,6cyclictest1981873-21latency_hist20:40:011
1890802993728,7cyclictest2170755-21cp23:50:010
1890808993628,6cyclictest1962231-21cat20:20:012
1890805993630,4cyclictest1922886-21apt-get19:44:071
1890805993530,3cyclictest2027838-21irqrtprio21:29:131
1890802993530,4cyclictest1890674-21kworker/u8:0+flush-8:020:29:140
1890805993429,3cyclictest1957295-21kworker/u8:2+events_unbound20:44:091
1890805993428,5cyclictest2101057-21kworker/u8:3+events_unbound23:50:021
1890805993424,7cyclictest278-21systemd-journal19:46:491
1890805993328,3cyclictest2076521-21kworker/u8:3+events_unbound22:29:111
1890805993327,4cyclictest2180800-21kworker/u8:1+events_unbound00:29:201
1890805993327,4cyclictest1035700-21kworker/u8:1+flush-8:019:59:231
1890802993323,8cyclictest2160651-21cp23:40:000
1890805993227,3cyclictest1890674-21kworker/u8:0+events_unbound20:25:001
1890805993226,5cyclictest2135598-21kworker/u8:0+flush-8:023:29:101
1890805993226,4cyclictest2135598-21kworker/u8:0+flush-8:023:59:251
1890805993226,4cyclictest1947004-21cron20:05:011
22100582310,4sleep00-21swapper/000:29:240
1890808993127,3cyclictest1035700-21kworker/u8:1-ext4-rsv-conversion20:10:002
1890805993127,3cyclictest2135598-21kworker/u8:0+events_unbound23:19:261
1890805993127,3cyclictest1957295-21kworker/u8:2+flush-8:021:34:251
1890805993126,4cyclictest1035700-21kworker/u8:1+flush-8:020:09:251
1890805993126,3cyclictest2135598-21kworker/u8:0+flush-8:023:39:241
1890805993124,5cyclictest1880893-21kworker/u8:3+flush-8:019:19:221
1890805993123,6cyclictest2065509-21ntpq22:04:191
1890802993127,2cyclictest1962256-21cat20:20:010
1890802993123,6cyclictest1987384-21/usr/sbin/munin20:49:310
1890808993025,4cyclictest1976817-21unixbench_multi20:34:262
1890808993012,7cyclictest1918373-21awk19:39:132
1890805993026,3cyclictest2101057-21kworker/u8:3+events_unbound22:59:271
1890805993025,3cyclictest1954686-21kthreadcore20:14:171
1890802993026,2cyclictest2139857-21strings23:19:200
1890802993024,4cyclictest2077520-21irqrtprio22:19:160
1890802993024,4cyclictest2077520-21irqrtprio22:19:160
1890802993021,7cyclictest2056276-21latency_hist21:55:010
189080299300,21cyclictest2205597-21sshd00:24:590
1890808992924,3cyclictest2002561-21fschecks_time21:04:132
1890805992924,3cyclictest2191350-21aten2_r5power_c00:14:111
1890805992923,5cyclictest1957295-21kworker/u8:2+flush-8:021:44:261
1890805992923,4cyclictest2101057-21kworker/u8:3+events_unbound00:09:221
1890805992923,4cyclictest1957295-21kworker/u8:2+events_unbound21:39:171
1890802992925,3cyclictest2076037-21systemd-run22:15:000
1890802992925,2cyclictest1927282-21munin-run19:45:010
1890802992924,4cyclictest2076521-21kworker/u8:3+flush-8:022:29:290
1890802992924,4cyclictest1890674-21kworker/u8:0+flush-8:021:49:200
1890802992924,3cyclictest2131548-21fschecks_time23:14:120
1890802992923,4cyclictest278-21systemd-journal22:33:490
1890802992923,4cyclictest2200646-21cron00:20:000
1890802992919,8cyclictest2030838-21ntpq21:29:180
1890808992822,4cyclictest2021455-21unixbench_multi21:19:352
189080599283,17cyclictest571-21snmpd23:49:101
1890805992824,2cyclictest1918675-21irqrtprio19:39:151
1890805992823,4cyclictest1880893-21kworker/u8:3+flush-8:019:54:141
1890805992822,3cyclictest1972206-21kworker/u8:1+events_unbound21:59:171
1890805992821,5cyclictest1972206-21kworker/u8:1+flush-8:021:14:101
1890805992818,8cyclictest1911817-21ntpq19:29:181
1890802992824,2cyclictest2106830-21fschecks_count22:49:130
1890802992824,2cyclictest1895866-21latency_hist19:15:010
1890802992823,4cyclictest1880893-21kworker/u8:3+flush-8:019:49:310
189080299282,25cyclictest0-21swapper/021:44:260
189080899276,6cyclictest2073663-21cut22:14:162
1890805992722,3cyclictest2101057-21kworker/u8:3+flush-8:000:04:151
1890805992719,6cyclictest2091095-21kworker/u8:1+events_unbound23:04:091
189080299276,20cyclictest2041394-21kworker/0:2+events21:58:390
1890802992723,3cyclictest1890674-21kworker/u8:0+flush-8:019:34:200
189080299272,24cyclictest1922341-21kworker/0:0+events20:09:150
189080299272,24cyclictest0-21swapper/021:19:330
189080299272,23cyclictest2110931-21kworker/0:0+events23:54:070
1890802992722,3cyclictest1937113-21cron19:55:000
1890808992622,3cyclictest1956766-21unixbench_multi20:14:272
1890805992620,4cyclictest1957295-21kworker/u8:2+flush-8:021:04:211
1890805992619,5cyclictest2022185-21apt-get21:24:081
1890805992617,7cyclictest278-21systemd-journal23:33:501
189080299266,19cyclictest2110931-21kworker/0:0+events23:28:590
1890802992622,3cyclictest1996684-21idleruntime-cro20:55:000
1890802992622,2cyclictest0-21swapper/021:10:000
1890802992621,4cyclictest20865-21cron23:00:010
1890802992621,4cyclictest2086066-21unixbench_singl22:24:260
1890802992621,3cyclictest1976271-21needreboot20:34:180
1890802992620,4cyclictest2154936-21needreboot23:34:180
1890802992620,4cyclictest1-21systemd20:40:000
1890802992619,5cyclictest1942068-21latency_hist20:00:010
189080299261,24cyclictest1922341-21kworker/0:0+events20:04:070
1890808992522,2cyclictest2181669-21fschecks_count00:04:122
1890808992522,2cyclictest2116725-21fschecks_count22:59:142
1890808992516,7cyclictest1967857-21tr20:29:112
1890808992515,8cyclictest2161602-21diskstats23:44:102
1890808992514,4cyclictest161rcu_preempt22:29:142
1890805992520,4cyclictest1890674-21kworker/u8:0+events_unbound22:34:101
1890805992520,2cyclictest0-21swapper/123:09:151
1890805992512,8cyclictest278-21systemd-journal23:24:491
189080299256,18cyclictest2180797-21kworker/0:2+events00:04:230
189080299252,22cyclictest1922341-21kworker/0:0+events20:24:150
1890802992521,3cyclictest0-21swapper/022:10:000
1890802992520,4cyclictest2190769-21kworker/u8:0+flush-8:000:39:230
1890802992520,3cyclictest2180800-21kworker/u8:1+events_unbound00:10:010
1890802992512,4cyclictest1-21systemd20:40:160
188614622510,10sleep10-21swapper/119:06:411
189080899248,4cyclictest0-21swapper/221:54:072
189080899246,3cyclictest21255362timerwakeupswit23:04:272
1890808992420,3cyclictest2112065-21sed22:54:132
1890808992418,4cyclictest2195558-21unixbench_multi00:14:282
189080899240,9cyclictest1916780-21ntpq19:34:202
1890805992419,3cyclictest2056126-21unixbench_multi21:54:271
1890805992418,5cyclictest2101057-21kworker/u8:3+events_unbound22:54:091
1890805992412,9cyclictest278-21systemd-journal20:56:491
1890805992412,9cyclictest278-21systemd-journal20:56:491
189080299242,21cyclictest0-21swapper/022:54:060
1890802992418,4cyclictest1890674-21kworker/u8:0+flush-8:021:34:300
1890802992417,5cyclictest2066144-21latency_hist22:05:000
1890802992413,2cyclictest0-21swapper/023:09:110
189080299241,22cyclictest1922341-21kworker/0:0+events21:14:190
189080899232,4cyclictest0-21swapper/220:59:092
189080899232,4cyclictest0-21swapper/220:59:092
1890808992320,2cyclictest371rcuc/219:58:462
1890808992319,3cyclictest1937114-21cron19:55:002
1890808992318,3cyclictest2166509-21cpuspeed_turbos23:49:112
1890808992318,3cyclictest2141346-21cpuspeed_turbos23:24:112
1890808992318,3cyclictest0-21swapper/221:15:012
189080899230,12cyclictest1996041-21ntpq20:54:202
1890805992318,4cyclictest1991634-21unixbench_multi20:49:321
1890805992318,3cyclictest0-21swapper/122:15:001
1890805992317,4cyclictest2091095-21kworker/u8:1+events_unbound22:49:181
1890805992317,4cyclictest1957295-21kworker/u8:2+events_unbound20:29:251
1890802992319,2cyclictest0-21swapper/022:40:000
189080899229,9cyclictest2216092-21apt-get00:39:072
189080899227,8cyclictest0-21swapper/219:49:152
189080899227,4cyclictest0-21swapper/223:39:092
189080899226,6cyclictest0-21swapper/221:59:122
189080899223,10cyclictest0-21swapper/222:17:342
189080899223,10cyclictest0-21swapper/222:17:342
1890808992213,4cyclictest2151254-21apt-get23:34:072
189080899220,11cyclictest2131611-21hddtemp_smartct23:14:132
189080899220,10cyclictest1899098-21irqstats19:19:162
1890805992217,3cyclictest1907117-21mailstats19:24:241
189080299224,17cyclictest2110931-21kworker/0:0+events23:04:150
189080299222,19cyclictest2180797-21kworker/0:2+events00:32:270
189080299222,19cyclictest2041394-21kworker/0:2+events22:42:120
1890802992219,2cyclictest838-21mta-sts-daemon20:59:170
1890802992219,2cyclictest838-21mta-sts-daemon20:59:160
1890802992219,2cyclictest0-21swapper/023:25:000
1890802992218,3cyclictest2176982-21sort23:59:150
1890802992218,2cyclictest0-21swapper/021:39:270
1890802992218,2cyclictest0-21swapper/021:25:000
1890802992217,4cyclictest1922159-21unixbench_multi19:39:270
1890802992217,3cyclictest0-21swapper/019:30:010
1890802992212,7cyclictest2195155-21ntpq00:14:240
189080899216,4cyclictest0-21swapper/223:19:102
189080899215,5cyclictest0-21swapper/200:07:212
189080899212,9cyclictest0-21swapper/221:25:152
189080899212,6cyclictest0-21swapper/223:29:492
189080899212,13cyclictest2106565-21apt-get22:49:112
1890808992117,2cyclictest1963017-21fschecks_time20:24:112
1890808992112,7cyclictest2213758-21tr00:34:182
1890808992112,2cyclictest161rcu_preempt00:29:272
189080899210,5cyclictest2042126-21cpuspeed21:44:102
189080899210,11cyclictest39-21ksoftirqd/219:11:302
189080899210,11cyclictest2082018-21diskstats22:24:102
1890805992117,2cyclictest0-21swapper/122:39:201
189080299214,16cyclictest1922341-21kworker/0:0+events21:04:190
189080299214,16cyclictest1902603-21kworker/0:2+events19:24:070
1890802992116,3cyclictest0-21swapper/020:14:270
189080899202,4cyclictest2007122-21apt-get21:09:092
1890808992017,2cyclictest371rcuc/220:45:522
1890808992017,2cyclictest2101006-21cron22:40:002
1890808992016,3cyclictest2095965-21unixbench_singl22:34:272
1890808992012,4cyclictest1922886-21apt-get19:44:082
189080899200,11cyclictest2065560-21ld22:04:202
189080899200,10cyclictest2046953-21apt-get21:49:092
18858162204,9sleep20-21swapper/219:05:012
189080899192,9cyclictest0-21swapper/221:21:132
189080899192,9cyclictest0-21swapper/200:22:432
189080899192,8cyclictest0-21swapper/219:27:562
189080899192,4cyclictest0-21swapper/220:45:002
1890808991916,2cyclictest371rcuc/200:17:472
1890808991915,2cyclictest0-21swapper/221:39:142
18861332193,9sleep30-21swapper/319:06:313
189080899185,5cyclictest0-21swapper/223:09:102
189080899183,6cyclictest0-21swapper/223:52:482
189080899183,5cyclictest0-21swapper/223:57:592
189080899182,8cyclictest0-21swapper/222:40:492
189080899182,4cyclictest0-21swapper/222:09:112
1890808991815,2cyclictest371rcuc/220:02:232
1890808991814,3cyclictest0-21swapper/219:24:262
19171952170,5sleep30-21swapper/319:34:263
189080899170,4cyclictest0-21swapper/220:35:562
18861102163,7sleep00-21swapper/019:06:110
19706032150,3sleep3481ktimers/320:29:193
22098562132,7sleep30-21swapper/300:29:193
21950972132,7sleep30-21swapper/300:14:233
21754632134,5sleep30-21swapper/323:54:263
21518652132,7sleep30-21swapper/323:34:153
20960472132,6sleep30-21swapper/322:35:013
20661302132,7sleep30-21swapper/322:05:003
20413232132,6sleep30-21swapper/321:40:023
20016682132,6sleep30-21swapper/321:00:013
19810222132,8sleep30-21swapper/320:39:193
19075022130,8sleep30-21swapper/319:25:003
22155522122,6sleep30-21swapper/300:35:013
22115092122,6sleep30-21swapper/300:34:133
21852952123,5sleep30-21swapper/300:04:243
21768322122,6sleep30-21swapper/323:59:143
21501882122,6sleep30-21swapper/323:29:263
21454812122,7sleep30-21swapper/323:25:003
21356042122,6sleep30-21swapper/323:15:013
21350582122,6sleep30-21swapper/323:14:253
21117232122,6sleep30-21swapper/322:54:113
20916502122,6sleep30-21swapper/322:34:093
20812222122,6sleep30-21swapper/322:20:013
20772912122,6sleep30-21swapper/322:19:173
20772912122,6sleep30-21swapper/322:19:173
20752112122,6sleep30-21swapper/322:14:193
20563032122,6sleep30-21swapper/321:55:013
20521732122,6sleep30-21swapper/321:54:143
20417192122,6sleep30-21swapper/321:41:493
20120662122,6sleep30-21swapper/321:14:093
19618322120,7sleep30-21swapper/320:20:013
19487692123,5sleep30-21swapper/320:09:193
19418992122,6sleep30-21swapper/319:59:273
19367612122,6sleep30-21swapper/319:54:263
19278402122,6sleep30-21swapper/319:49:123
19266882123,5sleep30-21swapper/319:44:223
19216442122,6sleep30-21swapper/319:39:213
19089652121,6sleep30-21swapper/319:29:143
19022372122,6sleep30-21swapper/319:19:273
18916262122,6sleep30-21swapper/319:14:133
21959512112,6sleep30-21swapper/300:15:153
21862772112,6sleep30-21swapper/300:07:493
21662632112,5sleep30-21swapper/323:49:073
21605752110,6sleep30-21swapper/323:40:013
21598952112,5sleep30-21swapper/323:39:213
21251572112,5sleep30-21swapper/323:04:223
21164952112,5sleep30-21swapper/322:59:123
21063082113,5sleep30-21swapper/322:46:093
21018552112,5sleep30-21swapper/322:44:123
20467092112,6sleep30-21swapper/321:46:193
20325752112,6sleep30-21swapper/321:34:153
20268002112,6sleep30-21swapper/321:25:203
20224282112,5sleep30-21swapper/321:24:123
20107152112,5sleep30-21swapper/321:09:203
19975892112,5sleep30-21swapper/320:59:133
19975892112,5sleep30-21swapper/320:59:133
19921242112,6sleep30-21swapper/320:51:543
19871032112,6sleep30-21swapper/320:45:283
19827132112,5sleep30-21swapper/320:44:123
19729962112,5sleep30-21swapper/320:34:133
19627372112,5sleep30-21swapper/320:24:103
19428962112,6sleep30-21swapper/320:04:123
21259922102,5sleep30-21swapper/323:05:303
20863892102,5sleep30-21swapper/322:25:223
20664032102,5sleep30-21swapper/322:05:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional