You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 20:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Aug 26, 2026 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2261100994842,4cyclictest2313220-21kworker/u8:1+events_unbound09:43:393
2261091994833,11cyclictest231ktimers/109:00:131
2261096994534,7cyclictest2361400-21grep12:00:002
2261087994536,6cyclictest121ktimers/009:25:130
2261091994433,7cyclictest2347277-21grep11:15:251
2261100994235,5cyclictest2349346-21kworker/u8:1+events_unbound11:24:003
2261096994235,3cyclictest0-21swapper/210:00:012
2261087994236,4cyclictest2277176-21kworker/u8:0+events_unbound07:53:130
2261096994134,4cyclictest2313022-21unixbench_singl09:35:262
2261091994133,5cyclictest2346048-21kthreadd11:15:001
2261091994129,8cyclictest2268874-21munin-plugin-st07:30:011
2261087994134,4cyclictest2299568-21cut09:00:010
2261087994132,6cyclictest2264761-21unixbench_multi07:15:250
2261100994033,5cyclictest2273603-21kworker/u8:1+events_unbound08:28:183
226110099401,15cyclictest0-21swapper/311:30:113
2261091994032,5cyclictest2320248-21munin-plugin-st10:00:011
2261091994029,5cyclictest131rcu_preempt09:18:121
2261087994032,5cyclictest2339226-21kthreadd10:55:000
2261096993929,7cyclictest2327088-21sendmail10:20:002
2261087993933,4cyclictest2307916-21kworker/u8:0+events_unbound09:33:360
2261087993931,5cyclictest2375277-21sendmail12:40:000
2261087993929,7cyclictest438-21cron10:20:000
2261100993830,5cyclictest2311732-21munin-plugin-st09:35:013
2261100993828,6cyclictest2334120-21sendmail10:40:013
2261091993827,7cyclictest0-21swapper/109:55:011
2261091993826,6cyclictest0-21swapper/109:23:331
2261087993830,5cyclictest2352404-21unixbench_multi11:30:240
2261100993730,4cyclictest2285938-21sendmail08:20:013
2261100993728,5cyclictest2320239-21cron10:00:013
2261100993726,7cyclictest2346491-21fschecks_time11:15:163
2261100993719,5cyclictest2294297-21kworker/u8:2+events_unbound08:59:043
226109199378,6cyclictest22846502cut08:15:161
2261091993728,6cyclictest2265245-21munin-plugin-st07:20:001
2261087993727,6cyclictest0-21swapper/012:29:150
2261100993626,6cyclictest0-21swapper/307:40:003
2261100993624,8cyclictest2297856-21auditctl08:55:013
226110099361,14cyclictest0-21swapper/309:00:123
2261091993628,5cyclictest0-21swapper/110:05:161
2261091993626,5cyclictest0-21swapper/111:05:261
2261091993625,6cyclictest0-21swapper/112:35:001
2261091993622,7cyclictest131rcu_preempt12:35:251
2261087993627,5cyclictest0-21swapper/008:30:250
226108799361,4cyclictest131rcu_preempt08:20:120
2261100993517,6cyclictest2366193-21kworker/u8:0+events_unbound12:11:563
2261096993526,6cyclictest2294902-21fschecks_time08:45:152
2261091993526,6cyclictest2368212-21cron12:20:001
2261091993525,6cyclictest2274002-21idleruntime-cro07:45:011
2261091993523,8cyclictest0-21swapper/110:45:281
2261091993522,7cyclictest0-21swapper/107:13:071
2261087993526,5cyclictest0-21swapper/007:15:010
2261091993423,7cyclictest2266950-21sh07:25:001
2261091993410,6cyclictest221rcuc/108:40:001
226108799346,5cyclictest131rcu_preempt09:50:120
2261087993427,5cyclictest2351180-21cut11:30:000
2261087993420,7cyclictest2296063-21kworker/u8:0+events_unbound08:50:170
2261100993327,4cyclictest2277176-21kworker/u8:0+events_unbound08:00:093
2261100993325,4cyclictest0-21swapper/309:35:263
2261100993324,4cyclictest0-21swapper/310:18:453
2261100993314,6cyclictest131rcu_preempt09:05:113
2261096993322,8cyclictest2340485-21grep10:55:242
2261091993325,4cyclictest0-21swapper/108:45:151
2261091993323,7cyclictest2355881-21grep11:40:261
2261091993322,6cyclictest0-21swapper/108:28:181
2261087993325,4cyclictest0-21swapper/008:15:010
2261087993325,4cyclictest0-21swapper/007:40:260
2261087993324,5cyclictest0-21swapper/012:05:250
2261087993323,6cyclictest0-21swapper/009:05:160
2261087993323,5cyclictest2334119-21sendmail10:40:010
2261100993222,6cyclictest2370375-21grep12:25:143
2261100993222,6cyclictest0-21swapper/310:30:003
2261100993222,6cyclictest0-21swapper/310:05:263
2261100993217,5cyclictest2287305-21kworker/u8:2+events_unbound08:32:463
2261096993226,4cyclictest2338860-21kworker/u8:0+events_unbound11:08:562
2261096993223,5cyclictest0-21swapper/211:00:272
2261096993222,6cyclictest0-21swapper/207:20:002
226109699321,6cyclictest131rcu_preempt08:00:112
2261091993225,5cyclictest2314738-21unixbench_singl09:40:251
2261091993224,5cyclictest0-21swapper/110:10:251
2261091993221,7cyclictest0-21swapper/111:45:261
2261091993218,10cyclictest2272281-21ls07:40:001
226108799324,4cyclictest131rcu_preempt10:25:130
2261087993224,4cyclictest0-21swapper/010:08:420
2261087993221,7cyclictest0-21swapper/008:05:260
2261087993215,7cyclictest2349346-21kworker/u8:1+events_unbound12:00:170
226110099312,4cyclictest0-21swapper/310:50:123
2261100993123,4cyclictest0-21swapper/308:05:263
2261100993122,5cyclictest0-21swapper/312:20:183
2261100993115,4cyclictest2275445-21kworker/u8:2+events_unbound07:50:223
2261096993123,4cyclictest0-21swapper/209:50:252
2261096993122,6cyclictest2354565-21cron11:40:002
226109199316,6cyclictest221rcuc/110:20:011
226109199315,5cyclictest24-21ksoftirqd/112:25:011
2261091993121,7cyclictest221rcuc/110:20:171
2261091993119,9cyclictest2286325-21grep08:20:161
2261087993124,3cyclictest0-21swapper/007:35:250
2261087993123,5cyclictest0-21swapper/009:40:010
2261087993123,4cyclictest0-21swapper/011:00:000
2261087993121,6cyclictest0-21swapper/009:20:160
2261100993022,4cyclictest0-21swapper/311:50:003
2261100993022,3cyclictest0-21swapper/310:30:163
2261100993021,5cyclictest0-21swapper/307:15:013
2261100993019,6cyclictest0-21swapper/308:45:243
2261100993014,5cyclictest2299401-21kworker/u8:1+events_unbound09:13:353
2261100993012,13cyclictest381rcuc/311:40:003
226110099301,13cyclictest2361399-21sendmail12:00:003
2261096993023,5cyclictest2294297-21kworker/u8:2+events_unbound08:53:272
2261096993023,3cyclictest0-21swapper/207:20:252
2261096993022,5cyclictest2347270-21unixbench_multi11:15:242
226109199305,5cyclictest24-21ksoftirqd/110:30:011
226109199304,7cyclictest24-21ksoftirqd/110:35:251
2261087993019,7cyclictest2304251-21grep09:10:250
226110099297,5cyclictest131rcu_preempt09:50:013
226110099294,6cyclictest131rcu_preempt07:30:123
2261100992921,4cyclictest0-21swapper/312:15:243
2261100992911,5cyclictest2277176-21kworker/u8:0+events_unbound07:56:133
2261096992923,4cyclictest2366193-21kworker/u8:0+events_unbound12:19:132
2261096992923,4cyclictest2282170-21kworker/u8:0+events_unbound08:23:192
226109199296,7cyclictest24-21ksoftirqd/107:50:011
226109199295,5cyclictest24-21ksoftirqd/108:45:011
226109199293,7cyclictest24-21ksoftirqd/110:35:011
226109199293,5cyclictest24-21ksoftirqd/110:00:161
2261091992921,5cyclictest2302557-21head09:05:251
2261091992921,4cyclictest0-21swapper/110:40:241
2261091992920,6cyclictest0-21swapper/108:00:251
2261091992919,4cyclictest131rcu_preempt07:57:301
2261091992918,8cyclictest2312958-21grep09:35:261
2261091992916,9cyclictest2360940-21grep11:55:251
2261091992912,6cyclictest2352172-21awk11:30:231
2261091992912,3cyclictest131rcu_preempt12:25:151
226108799298,3cyclictest23433422sed11:05:200
226108799298,14cyclictest11-21ksoftirqd/008:15:030
2261087992920,6cyclictest2342223-21grep11:00:270
2261087992920,5cyclictest0-21swapper/008:45:010
226108799291,4cyclictest131rcu_preempt11:10:120
2261100992821,5cyclictest2273603-21kworker/u8:1+events_unbound07:46:443
2261100992821,4cyclictest0-21swapper/310:40:223
2261100992819,4cyclictest0-21swapper/310:55:153
2261100992818,5cyclictest0-21swapper/312:05:243
2261100992810,5cyclictest2267953-21ntp_offset07:25:203
2261096992821,4cyclictest0-21swapper/210:30:002
2261096992819,7cyclictest2310031-21latency_hist09:30:012
2261096992818,6cyclictest2348987-21tail11:20:252
226109199286,6cyclictest24-21ksoftirqd/110:50:211
226109199285,6cyclictest0-21swapper/111:00:251
226109199284,7cyclictest24-21ksoftirqd/112:10:011
226109199284,7cyclictest24-21ksoftirqd/108:08:481
226109199283,7cyclictest24-21ksoftirqd/109:10:181
226109199282,8cyclictest2277185-21taskset07:52:411
2261091992819,7cyclictest231ktimers/111:00:011
2261091992818,4cyclictest131rcu_preempt08:50:041
226109199281,7cyclictest24-21ksoftirqd/111:20:221
2261091992817,5cyclictest131rcu_preempt08:58:351
226109199280,6cyclictest2365591-21grep12:10:211
2261087992823,3cyclictest13550irq/42-30be0000.ethernet11:45:230
2261087992821,4cyclictest2347781-21idleruntime-cro11:20:000
2261087992818,6cyclictest0-21swapper/010:15:000
2261087992818,6cyclictest0-21swapper/009:00:250
2261087992813,9cyclictest131rcu_preempt10:00:120
2261087992813,7cyclictest131rcu_preempt07:25:160
2261087992813,6cyclictest2366193-21kworker/u8:0+events_unbound12:19:110
2261100992721,3cyclictest2318093-21unixbench_multi09:50:253
2261100992720,5cyclictest2342311-21kworker/u8:1+events_unbound11:01:103
2261100992720,3cyclictest0-21swapper/311:25:243
2261100992718,5cyclictest2264801-21head07:15:263
2261100992714,3cyclictest0-21swapper/312:03:223
2261096992721,4cyclictest2262838-21service07:15:012
2261096992720,5cyclictest2364431-21kworker/u8:2+events_unbound12:14:132
2261096992720,5cyclictest2274380-21grep07:45:162
2261096992719,4cyclictest0-21swapper/208:55:162
226109199276,7cyclictest24-21ksoftirqd/112:00:121
226109199276,6cyclictest24-21ksoftirqd/111:35:251
226109199274,6cyclictest24-21ksoftirqd/109:30:021
226109199273,5cyclictest24-21ksoftirqd/108:35:011
226109199272,7cyclictest24-21ksoftirqd/111:50:141
2261091992721,4cyclictest2349346-21kworker/u8:1+events_unbound11:25:411
226109199271,7cyclictest24-21ksoftirqd/108:10:261
2261091992711,5cyclictest131rcu_preempt07:30:141
226108799278,13cyclictest131rcu_preempt11:40:180
226108799278,12cyclictest11-21ksoftirqd/008:35:190
2261087992721,3cyclictest13550irq/42-30be0000.ethernet11:55:250
2261087992715,8cyclictest2316372-21grep09:45:260
2261100992620,4cyclictest2317473-21kworker/u8:1+events_unbound10:03:423
2261100992619,5cyclictest391ktimers/309:15:133
2261100992619,5cyclictest2342311-21kworker/u8:1+events_unbound11:05:503
2261100992619,5cyclictest2292528-21kworker/u8:1+events_unbound08:38:343
2261100992617,6cyclictest2354961-21cut11:40:163
2261100992616,6cyclictest0-21swapper/307:40:263
226110099261,14cyclictest2309566-21taskset09:27:143
2261096992619,5cyclictest0-21swapper/207:35:152
2261096992618,4cyclictest0-21swapper/210:33:482
2261096992618,4cyclictest0-21swapper/210:10:202
2261091992610,4cyclictest131rcu_preempt09:25:121
226109199260,8cyclictest2315374-21/usr/sbin/munin09:45:141
226108799268,11cyclictest11-21ksoftirqd/011:35:220
2261087992619,4cyclictest0-21swapper/012:10:260
2261087992617,6cyclictest2373408-21latency_hist12:35:010
2261087992617,6cyclictest0-21swapper/009:55:260
226108799260,5cyclictest131rcu_preempt07:55:120
226110099259,9cyclictest0-21swapper/310:10:173
226110099252,11cyclictest40-21ksoftirqd/308:11:493
2261100992519,4cyclictest2317473-21kworker/u8:1+events_unbound10:20:123
2261100992519,4cyclictest2282170-21kworker/u8:0+events_unbound08:22:193
2261100992518,5cyclictest2349346-21kworker/u8:1+events_unbound11:53:313
2261100992514,7cyclictest2345574-21grep11:10:253
2261096992519,3cyclictest0-21swapper/211:30:142
2261096992519,3cyclictest0-21swapper/210:35:252
2261096992514,8cyclictest2337857-21df10:50:132
2261087992519,4cyclictest2317473-21kworker/u8:1+events_unbound10:23:470
2261087992519,3cyclictest0-21swapper/007:30:160
2261087992518,5cyclictest2325592-21kworker/u8:2+events_unbound10:41:020
2261087992517,5cyclictest0-21swapper/008:25:190
2261087992516,4cyclictest2294297-21kworker/u8:2+events_unbound08:45:240
226108799251,20cyclictest0-21swapper/009:17:270
226108799251,20cyclictest0-21swapper/008:01:480
2261100992416,5cyclictest0-21swapper/308:40:263
2261100992416,4cyclictest0-21swapper/312:35:253
226110099241,3cyclictest131rcu_preempt07:20:123
2261100992410,5cyclictest2371989-21kworker/u8:0+events_unbound12:32:213
2261096992417,4cyclictest2305451-21ntpq09:15:202
2261096992416,5cyclictest0-21swapper/209:10:252
226108799242,4cyclictest131rcu_preempt11:20:130
2261087992417,5cyclictest2366193-21kworker/u8:0+events_unbound12:23:410
2261087992417,3cyclictest0-21swapper/007:47:450
226108799241,2cyclictest2313674-21apt-get09:40:130
2261096992317,3cyclictest0-21swapper/207:55:242
2261096992316,4cyclictest2357990-21auditctl11:50:002
226108799231,7cyclictest2331109-21grep10:30:160
2261087992317,4cyclictest2349346-21kworker/u8:1+events_unbound11:53:450
2261087992317,3cyclictest0-21swapper/010:45:180
2261087992317,3cyclictest0-21swapper/007:20:250
226109699229,9cyclictest0-21swapper/210:05:262
2261096992216,3cyclictest0-21swapper/208:10:262
2261096992215,4cyclictest645-21runrttasks08:05:182
2261096992213,5cyclictest0-21swapper/207:40:262
2261096992211,7cyclictest2355817-21grep11:40:252
2261096992115,3cyclictest0-21swapper/209:30:152
2261096992115,3cyclictest0-21swapper/208:35:182
2261096992115,3cyclictest0-21swapper/208:25:132
2261096992115,2cyclictest0-21swapper/207:35:012
2261096992114,5cyclictest2345140-21ntp_states11:10:212
2261096992114,5cyclictest2317473-21kworker/u8:1+events_unbound10:00:412
2261096992114,4cyclictest2358750-21ntpq11:50:212
2261096992114,4cyclictest2337090-21grep10:45:282
2261096992113,4cyclictest2373921-21fschecks_count12:35:162
2261096992112,7cyclictest2315224-21sed09:45:012
2261096992112,6cyclictest0-21swapper/212:05:202
2261096992110,7cyclictest204-21dbus-daemon12:24:142
2261096992014,3cyclictest0-21swapper/210:24:592
2261096992014,3cyclictest0-21swapper/209:20:182
2261096992013,3cyclictest0-21swapper/209:00:252
2261096992012,5cyclictest53-21kcompactd007:25:122
2261096992012,5cyclictest0-21swapper/208:15:252
226109699201,16cyclictest2334623-21cat10:40:152
226109699199,6cyclictest0-21swapper/209:05:152
2261096991913,4cyclictest311ktimers/211:29:432
2261096991912,4cyclictest2294455-21apt08:45:012
2261096991912,4cyclictest0-21swapper/207:50:202
2261096991910,6cyclictest2290175-21/usr/sbin/munin08:30:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional