You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 04:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Mon Jan 05, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2192071995631,7cyclictest131rcu_preempt21:25:122
2192071995036,9cyclictest2254347-21seq22:05:252
2192074994740,4cyclictest2216561-21unixbench_singl20:15:303
2192071994733,11cyclictest311ktimers/220:30:132
2192074994531,11cyclictest391ktimers/300:35:133
2192074994434,7cyclictest2297968-21grep00:10:243
2192071994234,4cyclictest0-21swapper/220:20:012
2192071994232,8cyclictest311ktimers/220:20:152
2192068994232,7cyclictest2282613-21latency_hist23:30:001
2192068994133,4cyclictest2203068-21munin-plugin-st19:40:011
2192063994132,5cyclictest0-21swapper/021:05:010
2192071994033,4cyclictest0-21swapper/200:00:182
2192071994030,5cyclictest0-21swapper/222:00:162
2192063994033,4cyclictest2221669-21unixbench_singl20:30:270
2192063994033,4cyclictest2196002-21cron19:20:010
2192063994032,5cyclictest2197266-21unixbench_multi19:20:280
2192074993926,8cyclictest2275757-21cron23:10:003
2192063993928,7cyclictest2282209-21grep23:25:280
2192074993826,7cyclictest2283841-21grep23:30:243
2192074993730,4cyclictest2296558-21latency_hist00:10:013
2192071993730,4cyclictest0-21swapper/220:15:012
2192068993729,4cyclictest0-21swapper/123:45:161
2192063993730,3cyclictest2293099-21sendmail00:00:010
2192063993728,6cyclictest2219906-21unixbench_multi20:25:260
2192063993727,6cyclictest0-21swapper/021:40:000
2192063993727,6cyclictest0-21swapper/021:40:000
2192068993625,7cyclictest2195579-21grep19:15:281
2192063993629,4cyclictest0-21swapper/022:20:000
2192063993627,6cyclictest2223819-21sendmail20:40:010
2192074993525,6cyclictest2258694-21fschecks_time22:20:163
2192071993527,4cyclictest0-21swapper/221:05:212
2192071993523,9cyclictest2303547-21cron00:30:002
2192068993528,4cyclictest2237496-21munin-plugin-st21:20:001
2192068993527,4cyclictest0-21swapper/122:30:011
2192063993527,5cyclictest2242180-21unixbench_multi21:30:260
2192063993527,5cyclictest2242180-21unixbench_multi21:30:260
2192063993525,6cyclictest0-21swapper/023:45:260
2192074993427,4cyclictest2203056-21sh19:40:003
2192071993427,5cyclictest2203892-21kworker/u8:2+events_unbound19:41:512
2192071993424,6cyclictest0-21swapper/221:15:002
2192068993425,5cyclictest2216538-21unixbench_singl20:15:291
2192068993425,5cyclictest0-21swapper/119:50:201
2192063993424,6cyclictest0-21swapper/000:05:010
2192074993325,4cyclictest2268718-21munin-plugin-st22:50:013
2192074993324,6cyclictest0-21swapper/320:05:013
219207199332,5cyclictest131rcu_preempt21:15:132
2192071993325,4cyclictest0-21swapper/223:10:312
2192071993324,5cyclictest2291359-21sh23:55:012
2192068993326,4cyclictest0-21swapper/120:25:011
2192068993324,6cyclictest2200730-21grep19:30:271
2192068993323,5cyclictest0-21swapper/121:40:171
2192063993323,6cyclictest0-21swapper/022:30:260
2192074993225,4cyclictest208-21systemd-logind23:02:123
2192074993225,4cyclictest0-21swapper/322:30:263
2192074993224,5cyclictest2206500-21idleruntime-cro19:50:013
2192074993224,4cyclictest0-21swapper/319:55:003
2192074993212,17cyclictest2208642-21apt-get19:55:133
2192071993225,5cyclictest2257897-21kworker/u8:2+events_unbound23:28:412
2192071993224,4cyclictest0-21swapper/223:22:132
2192071993224,4cyclictest0-21swapper/220:00:272
2192071993223,5cyclictest2201137-21cron19:35:012
2192071993220,7cyclictest0-21swapper/222:30:262
2192068993224,4cyclictest0-21swapper/123:39:591
2192068993223,4cyclictest0-21swapper/123:05:171
2192068993220,9cyclictest0-21swapper/122:30:161
2192063993222,6cyclictest0-21swapper/022:45:260
2192063993222,6cyclictest0-21swapper/000:30:280
2192063993219,9cyclictest121ktimers/000:35:130
219206399320,29cyclictest0-21swapper/020:55:140
2192074993125,3cyclictest2240519-21unixbench_singl21:25:263
2192074993116,7cyclictest131rcu_preempt21:57:003
2192074993111,6cyclictest40-21ksoftirqd/322:25:223
2192071993124,5cyclictest2257897-21kworker/u8:2+events_unbound22:26:412
2192071993124,4cyclictest2199441-21latency_hist19:30:012
2192071993124,4cyclictest0-21swapper/223:45:262
2192071993124,4cyclictest0-21swapper/200:05:262
2192071993122,4cyclictest0-21swapper/220:50:012
2192071993121,6cyclictest0-21swapper/222:15:002
2192068993122,4cyclictest0-21swapper/122:20:251
2192068993118,9cyclictest0-21swapper/121:30:171
2192068993118,9cyclictest0-21swapper/121:30:161
2192063993125,3cyclictest0-21swapper/021:20:000
2192063993121,6cyclictest0-21swapper/022:05:260
2192063993121,6cyclictest0-21swapper/019:35:270
219207499309,4cyclictest391ktimers/321:00:243
2192074993024,3cyclictest0-21swapper/300:30:173
2192074993023,3cyclictest0-21swapper/320:35:263
2192074993021,7cyclictest2238270-21grep21:20:213
2192074993011,8cyclictest131rcu_preempt22:40:223
2192074993011,5cyclictest40-21ksoftirqd/321:41:293
2192071993022,6cyclictest2199371-21kworker/u8:1+events_unbound19:51:512
2192071993022,4cyclictest0-21swapper/220:40:272
2192068993023,4cyclictest0-21swapper/121:55:001
2192068993023,4cyclictest0-21swapper/100:15:261
2192068993022,4cyclictest0-21swapper/120:55:011
2192068993020,7cyclictest2303557-21idleruntime-cro00:29:591
2192068993020,7cyclictest0-21swapper/100:35:001
2192063993021,5cyclictest0-21swapper/020:15:300
2192063993020,5cyclictest0-21swapper/021:40:270
2192074992919,4cyclictest131rcu_preempt23:10:183
2192074992912,5cyclictest40-21ksoftirqd/323:35:213
2192074992910,11cyclictest131rcu_preempt19:42:023
2192071992922,5cyclictest2201088-21kworker/u8:0+events_unbound19:36:502
2192068992921,5cyclictest2203525-21fschecks_time19:40:181
2192068992921,4cyclictest2225074-21tail20:40:271
2192068992919,6cyclictest2254379-21grep22:05:261
2192068992918,7cyclictest0-21swapper/119:25:011
2192063992923,4cyclictest2204794-21munin-plugin-st19:45:010
2192063992921,5cyclictest2261222-21unixbench_singl22:25:270
2192063992920,6cyclictest0-21swapper/023:40:260
2192063992920,6cyclictest0-21swapper/020:50:010
2192063992920,6cyclictest0-21swapper/019:50:310
2192063992919,6cyclictest0-21swapper/019:35:010
219207499284,7cyclictest40-21ksoftirqd/300:00:013
2192074992820,4cyclictest0-21swapper/322:15:253
2192074992820,4cyclictest0-21swapper/320:30:273
2192074992819,5cyclictest2253122-21munin-plugin-st22:05:013
2192074992819,5cyclictest0-21swapper/323:00:003
2192071992821,5cyclictest2299655-21unixbench_multi00:15:262
2192071992820,5cyclictest311ktimers/222:20:122
2192071992820,5cyclictest0-21swapper/221:55:172
2192071992819,6cyclictest0-21swapper/220:00:002
2192071992818,6cyclictest0-21swapper/222:40:012
2192071992816,9cyclictest2270457-21sed22:55:012
219207199281,3cyclictest131rcu_preempt21:45:112
219207199280,4cyclictest131rcu_preempt20:50:122
219207199280,4cyclictest131rcu_preempt19:20:142
219206899286,4cyclictest22208672idleruntime20:30:181
2192068992820,4cyclictest0-21swapper/100:03:171
2192068992819,4cyclictest0-21swapper/120:10:191
2192068992816,8cyclictest2296101-21grep00:05:261
2192063992820,5cyclictest0-21swapper/000:15:170
2192063992819,6cyclictest0-21swapper/022:00:260
2192063992819,6cyclictest0-21swapper/000:30:000
2192063992818,6cyclictest0-21swapper/019:15:000
219207499279,3cyclictest2232602-21apt-get21:05:173
2192074992720,4cyclictest0-21swapper/300:20:173
2192074992719,5cyclictest0-21swapper/321:20:003
2192074992719,4cyclictest0-21swapper/300:15:263
2192074992718,3cyclictest131rcu_preempt22:38:303
2192074992717,6cyclictest0-21swapper/320:10:013
2192074992713,7cyclictest131rcu_preempt20:13:533
2192071992721,3cyclictest0-21swapper/223:30:242
2192071992719,5cyclictest0-21swapper/223:35:162
2192071992717,6cyclictest2292614-21grep23:55:262
2192068992720,4cyclictest0-21swapper/119:10:191
2192068992719,4cyclictest0-21swapper/100:15:001
2192068992716,7cyclictest0-21swapper/122:00:001
2192063992721,3cyclictest0-21swapper/020:00:270
2192063992720,3cyclictest0-21swapper/022:00:010
2192063992718,5cyclictest0-21swapper/022:50:250
2192063992718,5cyclictest0-21swapper/020:50:170
2192063992717,6cyclictest0-21swapper/021:05:310
2192063992717,6cyclictest0-21swapper/019:25:290
219207499269,8cyclictest131rcu_preempt21:50:213
219207499267,5cyclictest40-21ksoftirqd/320:45:203
2192074992614,8cyclictest2270448-21gpgv22:55:013
2192074992613,10cyclictest2290965-21/usr/sbin/munin23:50:263
2192074992611,8cyclictest131rcu_preempt19:33:113
2192071992620,4cyclictest2257897-21kworker/u8:2+events_unbound22:42:102
2192071992620,4cyclictest2235574-21kworker/u8:1+events_unbound21:22:022
2192071992616,7cyclictest2206022-21grep19:45:242
2192068992620,3cyclictest0-21swapper/123:00:011
2192068992614,8cyclictest0-21swapper/123:30:171
219206399265,14cyclictest11-21ksoftirqd/000:22:510
2192063992619,4cyclictest0-21swapper/019:59:590
2192063992619,3cyclictest0-21swapper/022:15:000
2192063992618,4cyclictest0-21swapper/022:40:280
2192063992617,6cyclictest0-21swapper/023:05:170
219207499259,9cyclictest131rcu_preempt21:10:463
219207499258,5cyclictest40-21ksoftirqd/300:25:133
219207499257,12cyclictest40-21ksoftirqd/321:38:383
219207499257,12cyclictest40-21ksoftirqd/321:38:383
219207499256,5cyclictest40-21ksoftirqd/319:20:133
219207499254,4cyclictest0-21swapper/321:47:423
2192074992515,4cyclictest131rcu_preempt19:16:073
2192074992512,10cyclictest2193303-21/usr/sbin/munin19:10:253
2192074992511,4cyclictest131rcu_preempt22:07:453
2192071992519,4cyclictest2186703-21kworker/u8:3+events_unbound19:10:052
2192071992518,5cyclictest2222066-21kworker/u8:0+events_unbound21:02:142
2192071992517,6cyclictest2240808-21kworker/u8:1+events_unbound21:33:132
2192071992517,6cyclictest2240808-21kworker/u8:1+events_unbound21:33:132
2192071992514,7cyclictest204-21dbus-daemon20:36:552
2192068992519,3cyclictest0-21swapper/100:20:261
2192068992518,5cyclictest2235574-21kworker/u8:1+events_unbound21:22:191
2192068992517,6cyclictest2291971-21latency23:55:191
2192068992517,5cyclictest0-21swapper/122:40:181
2192068992516,5cyclictest0-21swapper/119:25:191
2192068992515,7cyclictest0-21swapper/122:10:181
2192063992516,6cyclictest0-21swapper/020:15:010
219206399251,20cyclictest0-21swapper/023:32:030
219206399251,20cyclictest0-21swapper/020:06:010
219206399251,20cyclictest0-21swapper/000:06:380
219207499248,9cyclictest131rcu_preempt23:46:513
219207499246,12cyclictest40-21ksoftirqd/323:15:243
2192074992417,5cyclictest391ktimers/319:25:253
2192074992417,3cyclictest0-21swapper/320:20:273
2192074992416,5cyclictest391ktimers/320:53:033
2192074992414,5cyclictest131rcu_preempt00:04:473
219207499241,16cyclictest0-21swapper/323:41:243
219207499241,13cyclictest0-21swapper/321:31:063
219207499241,13cyclictest0-21swapper/321:31:063
2192074992411,10cyclictest2279678-21/usr/sbin/munin23:20:173
2192074992410,8cyclictest131rcu_preempt22:10:123
2192071992417,5cyclictest2242847-21kworker/u8:0+events_unbound21:38:202
2192071992417,5cyclictest2242847-21kworker/u8:0+events_unbound21:38:202
2192071992417,3cyclictest0-21swapper/221:50:222
2192071992416,4cyclictest0-21swapper/222:45:262
2192071992415,6cyclictest2275291-21grep23:05:262
2192071992413,8cyclictest2277908-21grep23:15:172
2192071992411,3cyclictest131rcu_preempt20:29:452
219207199240,4cyclictest131rcu_preempt20:05:122
2192068992418,4cyclictest2199371-21kworker/u8:1+events_unbound19:56:511
2192068992417,4cyclictest0-21swapper/120:35:211
2192068992416,5cyclictest2240509-21unixbench_singl21:25:261
2192068992416,5cyclictest2237296-21kworker/u8:2+events_unbound21:45:161
2192068992416,5cyclictest164-21systemd-journal22:02:051
2192068992416,5cyclictest0-21swapper/120:55:171
2192068992414,7cyclictest2256851-21ls22:15:131
2192068992414,7cyclictest2210840-21sed20:00:221
2192068992413,8cyclictest2234076-21pluginstate21:10:011
2192063992418,4cyclictest0-21swapper/022:22:090
2192063992418,3cyclictest0-21swapper/021:10:240
219206399241,19cyclictest0-21swapper/021:50:480
219206399241,19cyclictest0-21swapper/021:29:170
219206399241,19cyclictest0-21swapper/021:20:530
219206399241,19cyclictest0-21swapper/020:20:120
2192074992315,2cyclictest131rcu_preempt20:25:233
2192074992312,4cyclictest131rcu_preempt20:57:083
2192071992316,4cyclictest0-21swapper/220:55:272
2192071992315,6cyclictest2257897-21kworker/u8:2+events_unbound23:02:142
2192071992315,4cyclictest2304797-21tail00:30:282
2192071992313,7cyclictest2288052-21date23:45:002
2192068992316,4cyclictest0-21swapper/122:45:161
2192063992316,3cyclictest0-21swapper/023:19:110
219206399231,18cyclictest0-21swapper/021:45:030
219206399231,18cyclictest0-21swapper/000:14:230
219206399230,21cyclictest0-21swapper/020:40:280
2192071992217,3cyclictest2268372-21kworker/u8:0+events_unbound22:58:272
2192071992215,5cyclictest2301481-21kworker/u8:0+events_unbound00:23:382
2192068992216,4cyclictest231ktimers/123:22:491
2192068992214,5cyclictest0-21swapper/123:10:311
2192068992214,4cyclictest0-21swapper/123:40:161
2192068992213,7cyclictest2219454-21ntpq20:25:211
2192068992213,5cyclictest0-21swapper/121:35:261
2192068992213,5cyclictest0-21swapper/121:35:261
219206399221,19cyclictest0-21swapper/023:38:220
2192071992115,4cyclictest0-21swapper/200:35:142
2192071992114,4cyclictest2257773-21unixbench_multi22:15:252
219206899211,5cyclictest0-21swapper/121:01:251
2192068992115,3cyclictest0-21swapper/119:45:121
2192068992114,5cyclictest231ktimers/123:15:171
219206399211,3cyclictest0-21swapper/023:04:120
2192063992112,5cyclictest0-21swapper/019:45:240
219206399210,19cyclictest0-21swapper/022:36:130
2192071992011,6cyclictest2245132-21tr21:40:222
2192068992013,4cyclictest0-21swapper/123:55:011
2192068992013,3cyclictest0-21swapper/120:45:211
2192068992011,6cyclictest0-21swapper/121:10:151
2192063992015,3cyclictest0-21swapper/023:10:530
219206399201,3cyclictest0-21swapper/023:22:170
219206399200,18cyclictest0-21swapper/023:50:030
2192068991912,5cyclictest231ktimers/120:05:131
2192068991912,4cyclictest0-21swapper/122:35:271
219206899187,8cyclictest2305496-21apt-get00:35:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional