You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 05:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 09, 2025 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
238252323460,3sleep3586-21kworker/3:2+events23:56:013
234620222210,2sleep3586-21kworker/3:2-events23:16:163
22621132750,2sleep013-21ksoftirqd/021:51:130
2097366996359,3cyclictest2302847-21kworker/u8:1+events_unbound22:41:180
2097366996053,3cyclictest2071367-21kworker/u8:0+events_unbound19:46:140
2097366995753,3cyclictest1746288-21kworker/u8:5+events_unbound19:11:240
2097366995544,8cyclictest2187548-21ntpq20:36:140
2097366995544,8cyclictest2187548-21ntpq20:36:140
2097366995446,3cyclictest2336878-21kworker/u8:0+events_unbound23:51:220
2097369995343,7cyclictest2281914-21ntpq22:11:151
2097366995344,7cyclictest2108244-21ntpq19:16:150
23361082520,3chrt0-21swapper/023:06:140
2097366995248,3cyclictest2411731-21kworker/u8:3+events_unbound00:36:060
2097366995248,3cyclictest2371799-21kworker/u8:1+events_unbound23:56:240
2097366995147,3cyclictest2071367-21kworker/u8:0+events_unbound19:41:150
2097366995139,10cyclictest282-21systemd-journal20:15:000
2097366994945,3cyclictest2258303-21kworker/u8:0+events_unbound22:06:180
2097366994942,3cyclictest1746288-21kworker/u8:5+events_unbound21:21:060
2097373994843,4cyclictest2397255-21gpgv00:10:002
2097366994844,3cyclictest1746288-21kworker/u8:5+events_unbound19:56:210
2097366994840,3cyclictest2071367-21kworker/u8:0+events_unbound19:51:030
2097366994840,3cyclictest2045107-21kworker/u8:1+events_unbound21:31:080
22637872470,3sleep00-21swapper/021:56:070
2097373994736,9cyclictest2217208-21ntpq21:06:152
2097366994743,3cyclictest2347307-21kworker/u8:2+events_unbound23:41:050
2097366994743,3cyclictest2183320-21kworker/u8:2+events_unbound20:51:040
2097366994743,3cyclictest2071367-21kworker/u8:0+events_unbound20:01:090
2097366994743,3cyclictest2045107-21kworker/u8:1+events_unbound20:16:240
2097366994740,3cyclictest2282742-21kworker/u8:1+events_unbound22:21:040
2097369994638,6cyclictest282-21systemd-journal19:16:061
2097366994642,3cyclictest2336878-21kworker/u8:0+events_unbound23:31:190
2097366994642,3cyclictest2071367-21kworker/u8:0+events_unbound19:33:070
2097366994541,3cyclictest2371799-21kworker/u8:1+events_unbound00:31:250
2097366994541,3cyclictest2183320-21kworker/u8:2+events_unbound21:36:080
2097366994541,3cyclictest2071367-21kworker/u8:0+events_unbound19:28:040
2097366994541,3cyclictest1746288-21kworker/u8:5+events_unbound20:56:280
2097366994540,4cyclictest2045107-21kworker/u8:1+events_unbound20:26:240
2097366994537,3cyclictest1746288-21kworker/u8:5+events_unbound22:32:160
2097366994440,3cyclictest2411731-21kworker/u8:3+events_unbound00:21:240
2097366994440,3cyclictest2347307-21kworker/u8:2+events_unbound23:46:240
2097366994436,3cyclictest1746288-21kworker/u8:5+events_unbound22:11:080
2097366994339,3cyclictest2302847-21kworker/u8:1+events_unbound22:56:250
2097366994339,3cyclictest2183320-21kworker/u8:2+events_unbound21:15:170
2097366994339,3cyclictest1746288-21kworker/u8:5+events_unbound20:48:170
2097366994339,3cyclictest1746288-21kworker/u8:5+events_unbound20:43:160
2097366994327,3cyclictest161rcu_preempt00:11:070
2097366994238,3cyclictest2336878-21kworker/u8:0+events_unbound23:16:200
2097366994238,3cyclictest1746288-21kworker/u8:5+events_unbound21:06:040
2097366994235,3cyclictest1746288-21kworker/u8:5+events_unbound22:26:050
2097369994131,8cyclictest282-21systemd-journal21:36:161
2097366994137,3cyclictest2387440-21kworker/u8:2+events_unbound00:18:500
2097366994137,3cyclictest2387440-21kworker/u8:2+events_unbound00:07:180
2097366994137,3cyclictest2268252-21kworker/u8:2+events_unbound22:01:230
2097366994137,3cyclictest2045107-21kworker/u8:1+events_unbound20:24:140
2097366994137,3cyclictest1746288-21kworker/u8:5+events_unbound20:07:070
2097369994034,4cyclictest2407644-21apt-get00:21:011
2097366994036,3cyclictest2411731-21kworker/u8:3+events_unbound00:26:040
2097366994036,3cyclictest2347307-21kworker/u8:2+events_unbound23:38:170
2097366994036,3cyclictest2302847-21kworker/u8:1+events_unbound23:03:240
2097366994036,3cyclictest2268252-21kworker/u8:2+events_unbound22:16:230
2097366994036,3cyclictest2071367-21kworker/u8:0+events_unbound19:38:050
2097366994025,3cyclictest161rcu_preempt19:21:050
2097369993928,9cyclictest2293294-21diskstats22:26:061
2097366993935,3cyclictest2347307-21kworker/u8:2+events_unbound23:22:250
2097366993935,3cyclictest2268252-21kworker/u8:2+events_unbound22:53:210
2097366993935,3cyclictest2183320-21kworker/u8:2+events_unbound21:46:240
2097366993935,3cyclictest2183320-21kworker/u8:2+events_unbound21:26:230
2097366993935,3cyclictest1746288-21kworker/u8:5+events_unbound20:33:160
21870352380,4sleep3586-21kworker/3:2+events20:36:123
21870352380,4sleep3586-21kworker/3:2+events20:36:123
2097369993830,5cyclictest2386331-21ntpq23:56:151
2097366993834,3cyclictest2381678-21kworker/u8:3+events_unbound00:00:030
2097366993834,3cyclictest2183320-21kworker/u8:2+events_unbound21:11:400
2097366993832,4cyclictest282-21systemd-journal23:13:260
2097366993733,3cyclictest2302847-21kworker/u8:1+events_unbound22:48:190
2097366993733,3cyclictest2183320-21kworker/u8:2+events_unbound21:01:390
2097366993632,3cyclictest2347307-21kworker/u8:2+events_unbound23:28:310
2097366993632,3cyclictest2302847-21kworker/u8:1+events_unbound22:37:570
2097369993527,6cyclictest282-21systemd-journal21:20:001
2097369993525,8cyclictest2197480-21ntpq20:46:161
2097369993522,9cyclictest282-21systemd-journal00:19:161
2097366993531,3cyclictest2045107-21kworker/u8:1+events_unbound21:40:190
2097373993424,7cyclictest2387187-21awk00:00:002
2097369993430,2cyclictest2367450-21tr23:41:051
2097369993429,3cyclictest2159553-21irqrtprio20:11:091
2097369993411,10cyclictest0-21swapper/120:26:171
20971472344,10sleep10-21swapper/119:09:271
22335632330,2sleep3586-21kworker/3:2+events21:26:043
2097373993223,7cyclictest282-21systemd-journal21:55:012
209736999328,6cyclictest587-21runrttasks20:01:211
209736999327,9cyclictest2302393-21runrttasks22:32:201
2097369993228,2cyclictest0-21swapper/120:20:001
2097369993226,4cyclictest2397541-21wc00:10:011
2097369993224,6cyclictest2341240-21ntpq23:11:141
2097369993224,5cyclictest282-21systemd-journal23:23:151
2097369993222,7cyclictest282-21systemd-journal23:20:001
209736999322,12cyclictest2390212-21kthreadcore00:01:121
2097369993214,9cyclictest161rcu_preempt00:36:141
209736999320,20cyclictest0-21swapper/121:41:211
209737399318,11cyclictest0-21swapper/222:51:162
2097373993126,3cyclictest2322952-21cpuspeed_turbos22:56:072
209736999316,3cyclictest2109478-21apt-get19:21:011
209736999315,4cyclictest2178870-21apt-get20:31:011
2097369993122,7cyclictest2317782-21/usr/sbin/munin22:51:151
209736999312,14cyclictest2202392-21ntpq20:51:131
209736999311,15cyclictest2232121-21ntpq21:21:201
209736999311,11cyclictest2146351-21kthreadcore19:56:111
2097373993022,6cyclictest282-21systemd-journal23:35:012
2097373993018,3cyclictest831-21mta-sts-daemon19:21:102
209736999308,7cyclictest2377332-21runrttasks23:50:451
209736999307,14cyclictest2158333-21taskset20:07:591
209736999304,16cyclictest2417187-21runrttasks00:29:521
209736999304,15cyclictest2312336-21runrttasks22:43:051
209736999304,11cyclictest2189800-21cut20:41:091
209736999303,16cyclictest2258357-21runrttasks21:50:521
2097369993026,2cyclictest0-21swapper/119:26:161
2097369993024,4cyclictest2357633-21grep23:31:061
2097369993023,5cyclictest2312827-21apt-get22:46:001
209736999302,17cyclictest0-21swapper/121:33:551
2097369993021,6cyclictest282-21systemd-journal00:32:161
2097369993019,9cyclictest282-21systemd-journal19:31:201
2097369993015,2cyclictest161rcu_preempt23:09:161
209736999301,19cyclictest2209664-21grep21:01:121
209736999301,18cyclictest2187679-21ntpq20:36:181
209736999301,18cyclictest2187679-21ntpq20:36:171
209736999301,15cyclictest2263350-21apt-get21:56:011
209736999300,9cyclictest2237411-21mailstats21:26:201
209708223019,6sleep30-21swapper/319:08:353
2097373992926,2cyclictest2332931-21fschecks_time23:06:062
2097373992925,2cyclictest2397821-21aten2_r5power_v00:11:052
2097373992925,2cyclictest2193087-21unixbench_singl20:41:212
209736999295,6cyclictest2169264-21expr20:21:051
209736999294,5cyclictest2137993-21ntpq19:46:171
209736999294,13cyclictest2374218-21cut23:46:111
209736999292,5cyclictest2125204-21tail19:36:091
2097369992925,2cyclictest0-21swapper/123:00:001
2097369992924,3cyclictest2283848-21irqrtprio22:16:091
2097369992923,4cyclictest2273262-21apt-get22:06:011
209736999291,16cyclictest2207414-21ntpq20:56:211
209736999290,11cyclictest2139058-21taskset19:50:451
2097373992824,2cyclictest2337549-21aten2_r5power_e23:11:042
2097373992824,2cyclictest2164005-21cpuspeed_turbos20:16:042
2097373992824,2cyclictest2124504-21cpuspeed_turbos19:36:042
2097373992823,4cyclictest2252904-21apt-get21:45:012
2097373992820,6cyclictest2412555-21munin-node00:26:022
209736999286,7cyclictest2356814-21runrttasks23:27:531
209736999286,11cyclictest2271411-21grep22:01:121
209736999284,14cyclictest2218333-21taskset21:10:191
209736999283,15cyclictest2332179-21taskset23:04:121
209736999281,7cyclictest282-21systemd-journal22:24:161
209736999281,12cyclictest2215606-21cut21:06:111
209736999280,7cyclictest2362498-21df_inode23:36:051
209736999280,7cyclictest2257213-21ntpq21:46:151
209736999280,4cyclictest2402386-21munin-run00:14:591
209736999280,15cyclictest2101433-21ntpq19:11:191
209737399273,4cyclictest2134193-21apt-get19:46:022
2097373992723,3cyclictest2372714-21fschecks_time23:46:062
2097373992723,2cyclictest2418059-21fschecks_count00:31:062
2097373992723,2cyclictest2283481-21fschecks_time22:16:062
2097373992723,2cyclictest2174018-21aten2_r5power_e20:26:052
2097373992722,3cyclictest2207859-21unixbench_singl20:56:262
2097373992721,4cyclictest2218678-21fschecks_count21:11:072
209736999270,8cyclictest0-21swapper/122:36:091
209737399269,8cyclictest0-21swapper/219:41:132
2097373992623,2cyclictest2179159-21fschecks_count20:31:052
2097373992623,2cyclictest2169009-21aten2_r5power_c20:21:032
2097373992621,4cyclictest2372012-21base6423:45:002
2097373992621,3cyclictest2298209-21cpuspeed_turbos22:31:062
2097373992617,6cyclictest2188063-21grep20:36:222
2097373992617,6cyclictest2188063-21grep20:36:222
2097373992612,2cyclictest0-21swapper/222:38:472
2097373992611,2cyclictest161rcu_preempt21:21:112
209737399260,17cyclictest0-21swapper/219:17:252
209737399260,11cyclictest2239299-21/usr/sbin/munin21:31:102
209736999263,12cyclictest2131387-21kthreadcore19:41:111
20970792262,6sleep00-21swapper/019:08:330
209737399253,4cyclictest0-21swapper/200:36:162
2097373992518,6cyclictest2310059-21kthreadcore22:41:112
209737399251,12cyclictest39-21ksoftirqd/219:26:062
209737399250,13cyclictest2267260-21ps21:56:182
209737399250,12cyclictest2233446-21apt-get21:26:012
209737399242,5cyclictest0-21swapper/222:21:102
209737399242,4cyclictest0-21swapper/221:36:122
209737399242,4cyclictest0-21swapper/200:21:162
2097373992421,2cyclictest2273375-21aten2_r5power_v22:06:032
209737399242,10cyclictest39-21ksoftirqd/222:46:092
2097373992418,4cyclictest2158189-21unixbench_singl20:06:232
2097373992417,4cyclictest381ktimers/223:50:562
2097373992413,1cyclictest161rcu_preempt20:01:232
2097373992410,3cyclictest161rcu_preempt19:10:012
209737399240,12cyclictest2208929-21basename21:01:092
209737399240,11cyclictest2268326-21apt22:01:002
209737399240,11cyclictest2097640-21cut19:11:062
209737399232,8cyclictest0-21swapper/223:26:162
209737399232,3cyclictest0-21swapper/219:51:002
209737399230,8cyclictest2148196-21ls19:56:212
209737399230,11cyclictest2357770-21awk23:31:082
209737399230,10cyclictest2296824-21ntpq22:26:162
209737399227,2cyclictest0-21swapper/222:11:032
209737399223,4cyclictest0-21swapper/221:16:202
209737399222,9cyclictest0-21swapper/220:12:312
209737399222,4cyclictest0-21swapper/221:46:132
209737399222,4cyclictest0-21swapper/200:16:132
2097373992218,2cyclictest2327675-21aten2_r5power_c23:01:022
209737399220,11cyclictest2194455-21ps20:46:102
209737399212,4cyclictest0-21swapper/223:16:072
2097373992117,2cyclictest2123946-21cron19:35:002
209737399210,8cyclictest2387643-21cut00:01:042
209737399210,7cyclictest2201797-21cut20:51:122
209737399202,4cyclictest0-21swapper/223:21:052
22533582152,8sleep30-21swapper/321:45:023
22637202142,8sleep30-21swapper/321:56:073
23761752132,7sleep30-21swapper/323:46:153
22487952132,7sleep30-21swapper/321:41:103
21343542132,7sleep30-21swapper/319:46:053
24065372122,6sleep30-21swapper/300:16:213
23921872122,6sleep30-21swapper/300:05:013
23893532122,6sleep30-21swapper/300:01:113
23777502122,6sleep30-21swapper/323:51:093
23672062122,6sleep30-21swapper/323:41:013
23562552122,6sleep30-21swapper/323:26:203
23322792122,6sleep30-21swapper/323:05:023
23181532122,6sleep30-21swapper/322:51:093
23132042122,6sleep30-21swapper/322:46:073
23076052122,6sleep30-21swapper/322:40:013
22984932123,5sleep30-21swapper/322:31:113
22952892123,5sleep30-21swapper/322:26:133
22820502122,6sleep30-21swapper/322:11:203
22743802123,5sleep30-21swapper/322:06:103
22085452122,6sleep30-21swapper/321:01:053
22055112122,6sleep30-21swapper/320:56:153
21983132121,6sleep30-21swapper/320:50:013
21834672122,5sleep30-21swapper/320:35:003
21736582122,6sleep30-21swapper/320:25:013
21694562122,6sleep30-21swapper/320:21:083
21574922122,6sleep30-21swapper/320:06:153
21181462123,5sleep30-21swapper/319:26:143
24227062112,6sleep30-21swapper/300:36:033
24176922112,6sleep30-21swapper/300:30:213
24134652112,5sleep30-21swapper/300:26:123
24078832112,5sleep30-21swapper/300:21:063
23976212113,5sleep30-21swapper/300:10:153
23626342112,5sleep30-21swapper/323:36:083
23609882112,5sleep30-21swapper/323:31:143
23473602113,5sleep30-21swapper/323:20:473
23374942112,6sleep30-21swapper/323:11:033
23276182112,5sleep30-21swapper/323:01:003
23227612112,5sleep30-21swapper/322:56:073
23071462112,5sleep30-21swapper/322:36:233
22880412112,5sleep30-21swapper/322:20:113
22830692113,5sleep30-21swapper/322:15:333
22683002112,5sleep30-21swapper/322:01:013
22583672112,5sleep30-21swapper/321:51:013
22477032112,5sleep30-21swapper/321:37:213
22386292112,6sleep30-21swapper/321:31:073
22327382112,5sleep30-21swapper/321:23:163
22233192112,5sleep30-21swapper/321:16:023
22222442112,5sleep30-21swapper/321:11:203
22134702112,5sleep30-21swapper/321:06:033
21988962112,5sleep30-21swapper/320:51:063
21890932112,5sleep30-21swapper/320:41:063
21640472112,5sleep30-21swapper/320:16:063
21588632112,5sleep30-21swapper/320:11:053
21486662112,5sleep30-21swapper/320:00:013
21439242112,5sleep30-21swapper/319:55:113
21394702112,5sleep30-21swapper/319:51:063
21291402112,5sleep30-21swapper/319:40:063
21239432112,5sleep30-21swapper/319:35:013
21205222110,7sleep30-21swapper/319:31:123
21099492112,5sleep30-21swapper/319:21:083
21043452112,5sleep30-21swapper/319:15:063
20978502112,5sleep30-21swapper/319:11:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional