You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-01 - 19:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sat Nov 01, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2924721995442,7cyclictest2997332-21idleruntime-cro10:40:002
2924725995345,5cyclictest2926618-21munin-node07:15:023
2924712995136,11cyclictest121ktimers/012:10:130
2924725994737,4cyclictest2950961-21kworker/u8:1+events_unbound08:25:383
2924721994741,4cyclictest2974793-21kworker/u8:0+events_unbound09:40:502
2924716994738,5cyclictest2980273-21idleruntime-cro09:50:001
2924721994639,5cyclictest2985196-21kworker/u8:1+events_unbound10:05:522
2924721994626,9cyclictest131rcu_preempt08:56:272
2924721994532,9cyclictest440-21cron07:50:022
2924721994523,11cyclictest131rcu_preempt08:52:082
2924725994433,7cyclictest0-21swapper/307:50:193
2924721994427,4cyclictest2999015-21kworker/u8:0+events_unbound10:49:432
2924725994335,5cyclictest2987101-21munin-plugin-st10:10:003
2924721994335,4cyclictest0-21swapper/209:40:012
2924721994333,7cyclictest3023111-21cron11:55:002
2924716994336,4cyclictest3004344-21cron11:00:011
2924716994336,4cyclictest2999015-21kworker/u8:0+events_unbound11:01:011
292471299431,11cyclictest11-21ksoftirqd/011:35:130
2924725994230,6cyclictest2999015-21kworker/u8:0+events_unbound11:06:023
2924725994230,6cyclictest2999015-21kworker/u8:0+events_unbound11:06:013
2924721994234,6cyclictest2990354-21kworker/u8:0+events_unbound10:30:552
2924721994220,13cyclictest131rcu_preempt12:00:262
2924721994134,5cyclictest2943912-21kworker/u8:2+events_unbound08:07:422
2924716994135,4cyclictest2937146-21kworker/u8:1+events_unbound07:55:211
2924725994034,4cyclictest2956117-21kworker/u8:1+events_unbound09:05:443
2924725994030,6cyclictest0-21swapper/311:19:593
2924725994019,9cyclictest2928308-21kworker/u8:1+events_unbound07:16:083
2924721994034,4cyclictest2974793-21kworker/u8:0+events_unbound09:45:512
2924721994034,4cyclictest2956117-21kworker/u8:1+events_unbound08:45:432
2924712994033,5cyclictest2964584-21kworker/u8:2+events_unbound09:20:470
2924712994033,5cyclictest2964584-21kworker/u8:2+events_unbound09:20:460
292472199398,8cyclictest32-21ksoftirqd/211:55:172
2924721993933,4cyclictest2956117-21kworker/u8:1+events_unbound09:20:492
2924721993933,4cyclictest2956117-21kworker/u8:1+events_unbound09:20:482
2924721993929,5cyclictest0-21swapper/207:20:182
2924721993922,5cyclictest131rcu_preempt10:50:222
2924721993918,9cyclictest131rcu_preempt08:12:412
2924716993920,12cyclictest131rcu_preempt08:50:271
2924712993931,4cyclictest2993920-21auditctl10:30:000
2924725993829,6cyclictest0-21swapper/310:24:593
2924725993817,12cyclictest3021120-21kworker/u8:2+events_unbound12:06:483
2924721993831,4cyclictest3017549-21tail11:35:272
2924721993827,7cyclictest2936774-21grep07:40:272
2924721993816,10cyclictest131rcu_preempt09:30:552
2924721993813,5cyclictest131rcu_preempt10:00:022
2924716993829,7cyclictest2939116-21kworker/u8:0+events_unbound08:20:391
2924716993828,6cyclictest3012895-21apt11:24:591
2924716993820,6cyclictest2947394-21kworker/u8:2+events_unbound08:15:281
2924712993817,6cyclictest0-21swapper/010:20:260
2924725993730,4cyclictest2969819-21munin-plugin-st09:20:003
2924725993730,4cyclictest2969819-21munin-plugin-st09:20:003
2924725993729,4cyclictest0-21swapper/308:50:183
2924725993727,6cyclictest0-21swapper/311:55:273
2924725993727,6cyclictest0-21swapper/308:15:023
2924725993725,6cyclictest2956117-21kworker/u8:1+events_unbound09:10:133
2924725993718,7cyclictest2928308-21kworker/u8:1+events_unbound07:25:433
2924721993726,4cyclictest131rcu_preempt07:14:032
2924721993725,9cyclictest131rcu_preempt10:00:172
2924721993723,4cyclictest131rcu_preempt09:08:172
2924721993720,4cyclictest131rcu_preempt08:18:542
2924721993719,4cyclictest131rcu_preempt12:29:412
2924721993717,5cyclictest131rcu_preempt07:55:192
2924721993717,5cyclictest131rcu_preempt07:35:202
2924716993729,5cyclictest2945297-21grep08:05:291
2924712993728,6cyclictest2998630-21unixbench_singl10:40:260
2924712993728,5cyclictest2975135-21cron09:35:000
2924712993715,6cyclictest3005746-21kworker/u8:1+events_unbound11:04:250
2924725993627,6cyclictest0-21swapper/309:40:003
2924721993627,5cyclictest2957893-21munin-plugin-st08:45:012
2924721993625,7cyclictest3012477-21grep11:20:262
2924721993620,4cyclictest131rcu_preempt09:25:572
2924721993619,5cyclictest131rcu_preempt09:00:222
2924721993619,4cyclictest131rcu_preempt12:22:302
2924721993619,4cyclictest131rcu_preempt12:22:302
2924721993616,5cyclictest131rcu_preempt07:30:172
2924721993612,10cyclictest131rcu_preempt07:54:542
2924716993627,5cyclictest2990515-21sendmail10:20:001
2924716993626,6cyclictest2967654-21grep09:10:261
2924716993621,6cyclictest2988631-21kworker/u8:1+events_unbound10:30:171
2924716993621,5cyclictest131rcu_preempt10:10:241
2924716993611,6cyclictest24-21ksoftirqd/108:50:021
2924712993626,6cyclictest0-21swapper/010:40:010
2924712993616,9cyclictest131rcu_preempt08:46:370
2924712993614,9cyclictest11-21ksoftirqd/009:15:140
2924712993614,9cyclictest11-21ksoftirqd/009:15:130
2924725993523,6cyclictest2939116-21kworker/u8:0+events_unbound08:05:323
2924721993523,9cyclictest2954025-21grep08:30:272
2924721993523,9cyclictest2954025-21grep08:30:272
2924721993521,4cyclictest131rcu_preempt11:17:292
2924721993520,5cyclictest131rcu_preempt08:21:252
2924721993520,4cyclictest131rcu_preempt08:00:212
2924721993517,4cyclictest131rcu_preempt07:18:392
2924721993515,5cyclictest131rcu_preempt11:05:202
2924721993515,5cyclictest131rcu_preempt11:05:192
2924721993515,4cyclictest131rcu_preempt10:25:192
2924721993514,5cyclictest131rcu_preempt12:15:262
2924716993519,4cyclictest131rcu_preempt09:35:251
292471299358,5cyclictest131rcu_preempt09:50:110
2924712993525,6cyclictest0-21swapper/011:25:000
292472599348,16cyclictest40-21ksoftirqd/312:30:143
2924725993425,4cyclictest0-21swapper/310:10:173
2924725993424,6cyclictest0-21swapper/312:20:273
2924725993424,6cyclictest0-21swapper/312:20:273
2924725993424,6cyclictest0-21swapper/309:50:253
2924725993423,7cyclictest2964702-21sh09:05:023
2924725993423,7cyclictest0-21swapper/308:00:403
2924725993418,9cyclictest131rcu_preempt08:55:233
2924721993428,4cyclictest2974793-21kworker/u8:0-events_freezable_power_09:50:172
2924721993423,7cyclictest311ktimers/212:40:002
2924721993419,5cyclictest131rcu_preempt11:50:002
2924721993417,5cyclictest2997281-21kworker/u8:1-events_freezable_power_10:43:022
2924721993413,9cyclictest131rcu_preempt12:07:102
2924721993411,11cyclictest131rcu_preempt11:30:262
292471699348,14cyclictest24-21ksoftirqd/108:40:221
2924716993427,4cyclictest2962974-21cron09:00:011
2924716993426,5cyclictest3038711-21sendmail12:40:011
2924716993425,4cyclictest0-21swapper/111:56:081
2924716993417,7cyclictest3015914-21kworker/u8:1+events_unbound11:34:241
2924716993411,12cyclictest24-21ksoftirqd/107:45:171
2924712993427,4cyclictest2990504-21munin-plugin-st10:20:000
2924712993425,4cyclictest0-21swapper/008:45:000
2924712993423,6cyclictest0-21swapper/009:45:260
2924725993326,4cyclictest0-21swapper/307:45:183
2924725993325,4cyclictest0-21swapper/311:20:163
2924725993323,6cyclictest0-21swapper/312:25:263
2924725993322,6cyclictest0-21swapper/311:00:263
2924725993318,5cyclictest2995275-21kworker/u8:2+events_unbound10:38:443
2924725993316,9cyclictest2999015-21kworker/u8:0+events_unbound10:57:383
292472199338,14cyclictest0-21swapper/208:35:262
2924721993318,5cyclictest131rcu_preempt10:10:172
2924721993318,3cyclictest131rcu_preempt10:55:242
2924721993314,4cyclictest131rcu_preempt11:40:172
2924721993314,10cyclictest131rcu_preempt12:30:492
2924721993312,9cyclictest131rcu_preempt09:14:482
2924716993327,4cyclictest2964942-21kworker/u8:3+events_unbound09:15:471
2924716993327,4cyclictest2964942-21kworker/u8:3+events_unbound09:15:471
2924716993325,4cyclictest0-21swapper/112:00:261
2924716993325,4cyclictest0-21swapper/110:30:011
2924716993323,7cyclictest2998602-21grep10:40:261
2924716993323,7cyclictest231ktimers/108:35:141
2924716993323,7cyclictest0-21swapper/109:30:001
2924716993317,4cyclictest131rcu_preempt12:15:131
2924716993310,12cyclictest24-21ksoftirqd/108:15:011
2924712993324,7cyclictest2935495-21sendmail07:40:010
2924712993324,6cyclictest0-21swapper/010:50:000
2924712993324,6cyclictest0-21swapper/008:00:410
2924712993324,4cyclictest0-21swapper/011:10:010
2924712993324,4cyclictest0-21swapper/011:10:000
2924712993323,6cyclictest0-21swapper/010:00:000
2924712993323,6cyclictest0-21swapper/008:55:280
2924712993323,6cyclictest0-21swapper/007:45:010
2924712993323,6cyclictest0-21swapper/007:15:250
2924712993316,11cyclictest2986910-21kworker/u8:2+events_unbound10:11:500
2924712993312,18cyclictest11-21ksoftirqd/012:20:010
2924725993222,6cyclictest0-21swapper/309:30:003
2924725993219,5cyclictest131rcu_preempt09:40:263
2924725993217,6cyclictest3017644-21kworker/u8:2+events_unbound11:37:163
2924725993215,6cyclictest2999015-21kworker/u8:0+events_unbound10:52:263
2924721993214,5cyclictest131rcu_preempt09:15:162
2924721993214,5cyclictest131rcu_preempt09:15:162
2924721993213,9cyclictest131rcu_preempt07:28:062
2924721993213,3cyclictest131rcu_preempt12:13:312
2924716993225,4cyclictest0-21swapper/108:30:271
2924716993225,4cyclictest0-21swapper/108:30:271
2924716993222,7cyclictest0-21swapper/110:00:011
2924716993213,10cyclictest131rcu_preempt11:45:221
2924716993210,11cyclictest24-21ksoftirqd/109:10:011
2924712993226,4cyclictest2964584-21kworker/u8:2+events_unbound09:25:470
2924712993223,5cyclictest0-21swapper/010:50:270
2924712993223,5cyclictest0-21swapper/008:30:000
2924712993222,6cyclictest0-21swapper/012:35:260
2924712993221,7cyclictest0-21swapper/007:45:330
2924712993221,6cyclictest0-21swapper/008:00:010
2924712993220,7cyclictest0-21swapper/011:55:270
2924712993211,19cyclictest11-21ksoftirqd/012:10:000
2924725993124,3cyclictest0-21swapper/308:35:283
2924725993122,5cyclictest0-21swapper/307:40:283
2924725993121,6cyclictest0-21swapper/311:30:183
2924725993119,7cyclictest0-21swapper/311:10:253
2924725993117,8cyclictest131rcu_preempt11:45:013
2924725993114,6cyclictest2945662-21kworker/u8:1+events_unbound08:17:493
2924721993115,4cyclictest131rcu_preempt10:23:192
2924721993114,4cyclictest131rcu_preempt11:25:532
2924721993112,9cyclictest131rcu_preempt11:10:172
2924716993124,5cyclictest2981617-21kworker/u8:2+events_unbound10:00:331
2924716993124,5cyclictest2978255-21kworker/u8:1+events_unbound09:53:161
2924716993123,4cyclictest0-21swapper/107:30:021
2924716993122,6cyclictest2933312-21grep07:30:271
2924716993121,6cyclictest221rcuc/111:05:131
2924716993121,6cyclictest221rcuc/111:05:131
2924716993118,4cyclictest131rcu_preempt07:50:161
2924716993116,5cyclictest2925510-21kworker/u8:0+events_unbound07:20:471
2924716993114,8cyclictest131rcu_preempt10:50:211
2924716993111,12cyclictest24-21ksoftirqd/112:25:241
292471299319,15cyclictest3018671-21cat11:40:190
292471299313,5cyclictest11-21ksoftirqd/009:35:140
292471299312,4cyclictest131rcu_preempt10:00:120
2924712993123,4cyclictest0-21swapper/012:25:000
2924712993123,4cyclictest0-21swapper/012:24:590
2924712993122,6cyclictest0-21swapper/007:25:010
2924712993121,6cyclictest2933355-21unixbench_singl07:30:260
2924712993121,6cyclictest0-21swapper/011:10:250
2924712993115,4cyclictest131rcu_preempt11:15:140
292471299311,4cyclictest11-21ksoftirqd/012:30:140
2924712993114,6cyclictest2945662-21kworker/u8:1+events_unbound08:12:030
2924712993110,15cyclictest0-21swapper/009:40:200
2924725993024,4cyclictest2995275-21kworker/u8:2+events_unbound10:47:413
2924725993020,6cyclictest0-21swapper/307:55:273
2924725993019,6cyclictest0-21swapper/309:55:263
2924725993015,3cyclictest131rcu_preempt08:33:363
2924725993015,3cyclictest131rcu_preempt08:33:353
2924721993022,4cyclictest0-21swapper/208:25:192
2924721993010,12cyclictest32-21ksoftirqd/211:00:162
292472199300,15cyclictest0-21swapper/210:15:292
292471699308,11cyclictest24-21ksoftirqd/109:30:271
2924716993024,4cyclictest3009183-21kworker/u8:0+events_unbound11:12:441
2924716993022,4cyclictest0-21swapper/112:10:281
2924716993019,4cyclictest131rcu_preempt10:45:171
2924716993017,9cyclictest231ktimers/110:20:231
2924716993017,5cyclictest131rcu_preempt11:35:251
2924716993016,10cyclictest231ktimers/112:30:151
2924716993013,4cyclictest131rcu_preempt11:25:261
2924716993013,3cyclictest131rcu_preempt07:10:191
2924716993010,12cyclictest24-21ksoftirqd/111:55:011
2924712993022,4cyclictest0-21swapper/011:30:270
2924712993019,7cyclictest0-21swapper/010:35:010
2924712993018,5cyclictest3019386-21kworker/u8:1+events_unbound11:45:140
2924712993017,3cyclictest131rcu_preempt11:52:220
2924712993012,10cyclictest2921020-21kworker/u8:2+events_unbound07:29:420
2924725992920,6cyclictest0-21swapper/308:45:273
2924725992920,5cyclictest0-21swapper/308:45:003
2924725992920,5cyclictest0-21swapper/307:40:013
2924725992914,7cyclictest3021120-21kworker/u8:2+events_unbound12:00:313
2924725992912,9cyclictest131rcu_preempt07:33:563
2924725992912,14cyclictest40-21ksoftirqd/310:40:223
292472599291,13cyclictest2993463-21grep10:25:263
292472599291,11cyclictest0-21swapper/312:10:183
292471699299,11cyclictest0-21swapper/111:40:531
2924716992913,8cyclictest131rcu_preempt09:43:011
292471699291,16cyclictest0-21swapper/111:15:141
2924716992910,10cyclictest24-21ksoftirqd/107:45:001
2924712992922,4cyclictest2926342-21auditctl07:15:010
2924712992920,5cyclictest0-21swapper/007:55:010
2924712992918,5cyclictest2999015-21kworker/u8:0+events_unbound10:57:400
2924712992918,5cyclictest2954388-21kworker/u8:2+events_unbound08:34:160
2924712992918,5cyclictest2954388-21kworker/u8:2+events_unbound08:34:160
2924725992822,4cyclictest2950130-21ntp_kernel_pll_08:20:213
2924725992819,4cyclictest0-21swapper/309:45:173
2924725992818,6cyclictest0-21swapper/309:20:543
2924725992818,6cyclictest0-21swapper/309:20:543
292471699287,13cyclictest24-21ksoftirqd/107:15:231
2924716992822,3cyclictest0-21swapper/112:20:171
2924716992822,3cyclictest0-21swapper/112:20:171
2924716992812,7cyclictest2985839-21fschecks_time10:05:161
2924716992812,10cyclictest131rcu_preempt10:35:321
292471699280,9cyclictest24-21ksoftirqd/108:30:011
292471299287,12cyclictest131rcu_preempt10:05:190
292471299287,12cyclictest131rcu_preempt08:20:170
292471299285,12cyclictest131rcu_preempt08:05:280
2924712992819,5cyclictest0-21swapper/009:00:340
2924712992819,5cyclictest0-21swapper/008:15:290
2924712992814,5cyclictest2954388-21kworker/u8:2+events_unbound08:37:120
292472599277,10cyclictest40-21ksoftirqd/309:30:243
292472599276,13cyclictest2934172-21kworker/3:1-mm_percpu_wq12:36:343
2924725992721,4cyclictest3007466-21kworker/u8:2+events_unbound11:25:183
2924725992711,7cyclictest40-21ksoftirqd/311:50:193
2924716992719,6cyclictest2956117-21kworker/u8:1+events_unbound09:00:031
2924716992712,9cyclictest131rcu_preempt09:25:021
2924716992712,9cyclictest131rcu_preempt09:25:021
2924712992721,4cyclictest3022862-21kworker/u8:1+events_unbound12:01:320
2924712992711,13cyclictest11-21ksoftirqd/009:05:200
2924725992613,4cyclictest131rcu_preempt12:15:183
2924725992612,6cyclictest3019386-21kworker/u8:1+events_unbound11:45:163
2924725992610,10cyclictest40-21ksoftirqd/307:20:193
292471699267,9cyclictest24-21ksoftirqd/108:05:021
2924716992620,4cyclictest3021120-21kworker/u8:2+events_unbound12:10:011
2924712992620,4cyclictest2956117-21kworker/u8:1+events_unbound09:10:190
2924712992610,8cyclictest131rcu_preempt08:50:220
2924725992519,3cyclictest0-21swapper/310:15:303
2924725992513,9cyclictest391ktimers/310:00:113
292472599251,15cyclictest0-21swapper/310:30:233
292471299252,13cyclictest0-21swapper/012:25:030
292471299246,11cyclictest131rcu_preempt11:25:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional