You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 16:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Aug 20, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3092084995541,9cyclictest3164900-21sendmail10:40:002
3092080995141,7cyclictest3173407-21cron11:05:001
3092075995116,32cyclictest11-21ksoftirqd/011:10:110
3092089994837,7cyclictest3169582-21grep10:50:243
3092075994836,8cyclictest3123533-21idleruntime-cro08:40:000
3092075994836,8cyclictest3123533-21idleruntime-cro08:40:000
3092080994637,5cyclictest1-21systemd08:15:271
3092089994537,4cyclictest3206018-21auditctl12:40:003
3092075994538,4cyclictest3185377-21idleruntime-cro11:40:000
3092089994432,8cyclictest3103065-21sendmail07:40:013
3092084994335,6cyclictest3119921-21kworker/u8:1+events_unbound09:00:412
3092075994330,9cyclictest3135665-21cron09:15:010
3092089994233,5cyclictest1-21systemd08:30:283
3092084994236,4cyclictest3126639-21kworker/u8:2+events_unbound08:55:402
3092084994229,9cyclictest311ktimers/207:10:112
3092080994233,6cyclictest3169519-21unixbench_multi10:50:251
3092075994232,6cyclictest3143944-21grep09:35:270
3092075994131,6cyclictest3109859-21cron08:00:010
3092084994031,7cyclictest3126639-21kworker/u8:2+events_unbound08:50:412
3092089993931,4cyclictest0-21swapper/308:15:263
3092084993933,4cyclictest3164497-21kworker/u8:0+events_unbound11:31:042
3092084993933,4cyclictest3154432-21kworker/u8:1+events_unbound10:20:502
3092084993929,7cyclictest311ktimers/212:25:102
3092084993927,8cyclictest3133502-21grep09:05:242
3092084993832,4cyclictest3176518-21kworker/u8:1+events_unbound11:15:582
3092084993832,4cyclictest3147502-21kworker/u8:1+events_unbound09:50:482
3092084993827,7cyclictest3197065-21grep12:10:252
3092084993826,9cyclictest3092070-21cyclictest12:20:112
3092080993830,4cyclictest0-21swapper/111:45:251
3092075993826,7cyclictest3183172-21grep11:30:240
3092089993727,7cyclictest3180661-21fschecks_time11:25:173
3092084993725,9cyclictest311ktimers/211:40:152
3092080993726,7cyclictest0-21swapper/112:05:261
3092075993729,4cyclictest0-21swapper/012:20:010
3092084993630,4cyclictest3164497-21kworker/u8:0+events_unbound11:10:592
3092084993625,7cyclictest3152483-21grep10:00:252
3092080993626,6cyclictest0-21swapper/112:35:171
3092080993626,6cyclictest0-21swapper/110:55:231
3092080993620,10cyclictest0-21swapper/111:35:251
3092089993527,5cyclictest1-21systemd08:05:253
3092084993529,4cyclictest3164497-21kworker/u8:0+events_unbound11:00:572
3092084993529,4cyclictest3161451-21kworker/u8:2+events_unbound10:40:542
3092084993527,4cyclictest0-21swapper/209:55:262
3092084993521,4cyclictest131rcu_preempt11:39:282
3092080993526,5cyclictest0-21swapper/111:55:231
3092080993525,5cyclictest0-21swapper/112:21:061
3092089993424,6cyclictest0-21swapper/311:20:253
3092084993423,3cyclictest131rcu_preempt10:47:142
3092084993420,10cyclictest311ktimers/212:15:092
3092084993419,3cyclictest131rcu_preempt09:34:272
309208499341,7cyclictest0-21swapper/209:40:112
3092080993426,4cyclictest0-21swapper/109:55:001
3092080993426,4cyclictest0-21swapper/108:10:261
3092080993424,6cyclictest0-21swapper/107:55:241
3092080993423,7cyclictest0-21swapper/111:40:291
3092075993429,3cyclictest0-21swapper/008:45:110
3092075993428,3cyclictest3202619-21kthreadd12:30:000
3092089993327,4cyclictest3128410-21kworker/u8:3+events_unbound09:10:423
3092089993325,4cyclictest0-21swapper/309:30:253
3092089993323,6cyclictest0-21swapper/311:15:243
309208499338,15cyclictest32-21ksoftirqd/207:40:252
3092084993327,4cyclictest3167975-21kworker/u8:1+events_unbound10:50:562
3092084993322,8cyclictest3097477-21grep07:20:252
3092084993319,6cyclictest131rcu_preempt07:55:112
3092084993317,5cyclictest131rcu_preempt11:49:162
3092080993325,4cyclictest0-21swapper/108:30:271
3092075993324,5cyclictest0-21swapper/010:35:260
3092089993225,5cyclictest3173441-21latency_hist11:05:013
3092089993225,4cyclictest3194098-21idleruntime-cro12:05:013
3092089993225,4cyclictest3191894-21unixbench_multi11:55:243
3092089993223,6cyclictest0-21swapper/307:35:013
3092089993221,7cyclictest0-21swapper/309:05:253
3092084993223,6cyclictest3117080-21grep08:20:142
3092084993215,5cyclictest3164497-21kworker/u8:0-events_power_efficient11:08:332
3092084993213,5cyclictest131rcu_preempt08:45:182
3092084993212,5cyclictest131rcu_preempt10:15:182
3092084993211,12cyclictest32-21ksoftirqd/208:05:252
3092084993210,11cyclictest32-21ksoftirqd/209:25:182
3092080993224,5cyclictest204-21dbus-daemon07:45:201
3092080993223,4cyclictest0-21swapper/110:45:551
3092080993222,6cyclictest0-21swapper/109:15:251
3092080993221,7cyclictest0-21swapper/112:00:241
3092075993223,7cyclictest3187729-21fschecks_time11:45:150
3092075993223,5cyclictest11-21ksoftirqd/008:55:120
309208499318,7cyclictest32-21ksoftirqd/210:29:592
3092084993125,4cyclictest3118198-21kworker/u8:0+events_unbound08:42:412
3092084993123,6cyclictest3135402-21kworker/u8:1+events_unbound09:20:432
3092084993118,5cyclictest131rcu_preempt12:00:012
3092084993114,5cyclictest3119921-21kworker/u8:1-events_unbound08:36:452
3092084993114,5cyclictest3119921-21kworker/u8:1-events_unbound08:36:452
3092084993111,6cyclictest131rcu_preempt10:05:132
3092080993119,7cyclictest0-21swapper/110:05:281
3092075993125,4cyclictest3142523-21apt-get09:35:010
3092075993124,4cyclictest3103041-21cron07:40:000
3092075993123,4cyclictest0-21swapper/012:00:010
3092075993123,4cyclictest0-21swapper/009:20:150
3092075993122,4cyclictest0-21swapper/012:06:040
3092075993120,8cyclictest3145707-21grep09:40:260
3092089993023,4cyclictest0-21swapper/310:35:003
3092089993023,4cyclictest0-21swapper/310:35:003
3092089993022,4cyclictest0-21swapper/312:30:253
3092089993022,4cyclictest0-21swapper/311:40:003
3092089993022,4cyclictest0-21swapper/308:35:263
3092089993021,5cyclictest0-21swapper/310:00:253
309208499308,8cyclictest32-21ksoftirqd/207:15:032
3092084993023,3cyclictest0-21swapper/210:15:012
3092084993021,5cyclictest3119129-21missed_timers08:25:182
3092084993018,4cyclictest3185318-21kworker/u8:1+events_unbound12:03:212
3092084993016,3cyclictest131rcu_preempt09:18:352
3092084993015,6cyclictest3114651-21kworker/u8:0+events_unbound08:16:252
3092084993011,8cyclictest32-21ksoftirqd/211:20:192
309208499301,13cyclictest32-21ksoftirqd/209:10:112
3092084993010,4cyclictest0-21swapper/209:45:312
3092080993020,7cyclictest0-21swapper/112:10:151
3092080993020,6cyclictest0-21swapper/107:50:231
3092080993018,8cyclictest3151238-21grep10:00:011
3092075993019,7cyclictest3157592-21grep10:15:240
309207599301,25cyclictest3178058-21grep11:15:250
3092089992921,4cyclictest0-21swapper/311:45:243
3092089992921,4cyclictest0-21swapper/307:25:263
3092089992920,6cyclictest0-21swapper/309:45:253
309208499295,8cyclictest32-21ksoftirqd/208:10:162
3092084992916,4cyclictest131rcu_preempt08:34:342
3092084992911,11cyclictest131rcu_preempt11:00:012
3092080992922,4cyclictest0-21swapper/109:05:011
3092080992921,4cyclictest0-21swapper/111:05:151
3092080992918,7cyclictest0-21swapper/110:20:261
3092075992922,5cyclictest3180126-21kworker/u8:1+events_unbound11:26:030
3092075992921,4cyclictest0-21swapper/012:39:590
3092075992921,4cyclictest0-21swapper/010:25:250
3092089992819,6cyclictest3105999-21unixbench_multi07:45:243
3092089992819,6cyclictest0-21swapper/308:05:013
3092089992819,5cyclictest3164879-21sh10:40:003
3092089992817,6cyclictest0-21swapper/312:25:253
309208499289,12cyclictest32-21ksoftirqd/207:35:162
309208499289,12cyclictest131rcu_preempt07:50:182
309208499289,10cyclictest131rcu_preempt08:00:262
309208499289,10cyclictest0-21swapper/207:32:302
309208499288,12cyclictest32-21ksoftirqd/210:30:212
309208499288,12cyclictest32-21ksoftirqd/210:30:202
3092084992817,3cyclictest131rcu_preempt12:05:162
3092084992816,5cyclictest131rcu_preempt12:30:182
3092084992815,5cyclictest3203296-21kworker/u8:1+events_unbound12:35:452
3092084992812,5cyclictest131rcu_preempt07:45:172
3092080992820,4cyclictest0-21swapper/111:10:191
3092080992820,4cyclictest0-21swapper/108:25:141
3092080992819,6cyclictest0-21swapper/109:30:161
3092080992819,6cyclictest0-21swapper/108:55:001
3092080992818,6cyclictest0-21swapper/108:25:011
3092080992817,7cyclictest1-21systemd09:25:431
3092075992821,4cyclictest0-21swapper/008:30:270
3092075992821,4cyclictest0-21swapper/008:00:250
3092075992821,4cyclictest0-21swapper/007:10:230
3092075992821,3cyclictest0-21swapper/009:00:240
3092075992821,3cyclictest0-21swapper/007:15:010
3092075992820,4cyclictest0-21swapper/010:20:150
3092075992819,4cyclictest0-21swapper/007:20:260
3092075992818,6cyclictest0-21swapper/011:25:010
3092089992719,4cyclictest0-21swapper/311:50:263
3092089992718,5cyclictest3140790-21cron09:30:003
3092089992718,4cyclictest0-21swapper/307:20:133
3092089992717,7cyclictest3093748-21apt-key07:15:013
3092089992717,5cyclictest0-21swapper/307:40:173
3092084992719,4cyclictest0-21swapper/211:50:232
3092084992718,7cyclictest311ktimers/209:35:072
3092080992715,8cyclictest0-21swapper/107:15:021
3092075992718,4cyclictest0-21swapper/009:15:410
3092075992715,8cyclictest3128207-21grep08:50:280
3092089992620,3cyclictest0-21swapper/307:55:243
3092089992620,3cyclictest0-21swapper/307:15:053
3092089992618,4cyclictest0-21swapper/311:00:013
3092089992618,4cyclictest0-21swapper/310:05:283
3092089992616,6cyclictest3119127-21cat08:25:193
3092089992616,6cyclictest0-21swapper/310:15:253
3092089992615,7cyclictest0-21swapper/311:40:233
309208499269,10cyclictest0-21swapper/207:25:522
3092084992611,7cyclictest32-21ksoftirqd/211:30:012
3092080992619,4cyclictest0-21swapper/111:20:251
3092080992618,5cyclictest3104758-21cron07:45:011
3092080992618,5cyclictest0-21swapper/111:25:191
3092080992618,5cyclictest0-21swapper/110:30:171
3092080992618,5cyclictest0-21swapper/110:30:161
3092080992618,4cyclictest0-21swapper/110:40:251
3092080992616,6cyclictest0-21swapper/112:20:011
3092075992619,4cyclictest13850irq/36-mmc109:50:010
3092075992618,5cyclictest0-21swapper/008:20:010
3092075992618,4cyclictest0-21swapper/008:25:240
3092075992616,6cyclictest0-21swapper/008:20:250
309207599261,3cyclictest3199447-21apt-get12:20:140
3092089992518,5cyclictest3161451-21kworker/u8:2+events_unbound10:45:553
3092089992516,5cyclictest0-21swapper/310:40:243
3092080992518,4cyclictest0-21swapper/110:15:241
3092080992517,5cyclictest0-21swapper/110:39:591
3092080992517,5cyclictest0-21swapper/110:00:261
3092080992517,4cyclictest3156342-21cron10:15:001
3092080992517,4cyclictest0-21swapper/111:50:171
3092080992513,8cyclictest3133550-21head09:05:261
3092075992521,2cyclictest13850irq/36-mmc111:10:000
3092075992519,3cyclictest0-21swapper/008:40:180
3092075992518,4cyclictest121ktimers/009:09:150
3092075992517,4cyclictest0-21swapper/010:55:200
3092075992515,6cyclictest0-21swapper/009:55:250
3092075992514,6cyclictest0-21swapper/011:50:260
3092089992416,5cyclictest391ktimers/309:42:243
3092089992416,5cyclictest0-21swapper/309:00:243
3092089992416,4cyclictest0-21swapper/309:20:263
3092089992415,6cyclictest0-21swapper/309:55:253
3092080992419,2cyclictest3108129-21kworker/u8:2+events_unbound08:05:271
3092080992416,5cyclictest0-21swapper/109:35:081
3092080992416,5cyclictest0-21swapper/109:20:231
3092080992416,4cyclictest0-21swapper/108:35:171
3092080992416,4cyclictest0-21swapper/108:35:171
3092080992415,6cyclictest0-21swapper/109:40:251
3092080992412,9cyclictest3101798-21cut07:35:151
3092075992418,4cyclictest3080960-21kworker/u8:3+events_unbound07:30:160
3092075992416,5cyclictest0-21swapper/010:30:270
3092075992416,5cyclictest0-21swapper/010:30:270
309207599241,5cyclictest3186141-21irqstats11:40:200
309207599241,19cyclictest0-21swapper/012:11:470
309207599241,19cyclictest0-21swapper/010:51:240
309207599241,19cyclictest0-21swapper/010:48:230
309207599241,19cyclictest0-21swapper/008:06:110
309207599241,19cyclictest0-21swapper/007:40:050
3092089992317,3cyclictest0-21swapper/308:20:223
3092089992316,4cyclictest3196720-21mailstats12:10:223
3092089992316,4cyclictest0-21swapper/310:10:253
3092089992316,4cyclictest0-21swapper/308:45:233
3092089992315,6cyclictest3148057-21/usr/sbin/munin09:50:243
3092089992315,5cyclictest0-21swapper/311:30:153
3092089992314,6cyclictest0-21swapper/310:25:143
3092089992313,6cyclictest0-21swapper/310:20:253
3092089992313,6cyclictest0-21swapper/309:20:013
3092080992317,3cyclictest0-21swapper/109:00:001
3092080992315,5cyclictest0-21swapper/112:25:241
3092080992314,6cyclictest3096470-21kworker/u8:1+events_unbound07:25:151
3092080992314,6cyclictest0-21swapper/111:30:141
3092080992313,6cyclictest0-21swapper/108:45:151
3092075992317,3cyclictest0-21swapper/012:31:070
3092075992317,3cyclictest0-21swapper/008:10:160
3092075992317,3cyclictest0-21swapper/007:50:200
3092075992316,5cyclictest0-21swapper/009:53:400
309207599231,18cyclictest0-21swapper/010:14:110
309207599231,18cyclictest0-21swapper/007:46:280
309207599230,19cyclictest0-21swapper/012:04:110
3092089992215,4cyclictest0-21swapper/308:40:263
3092080992216,3cyclictest0-21swapper/108:40:251
3092080992216,3cyclictest0-21swapper/107:20:141
3092080992215,5cyclictest3110114-21kworker/u8:1+events_unbound08:00:131
3092080992215,4cyclictest0-21swapper/109:10:141
309207599226,3cyclictest3153061-21cut10:05:010
309207599226,3cyclictest0-21swapper/011:04:530
309207599220,18cyclictest0-21swapper/010:05:080
3092089992115,3cyclictest0-21swapper/312:15:113
3092089992115,3cyclictest0-21swapper/307:50:143
3092089992114,4cyclictest3200906-21cron12:25:003
3092089992114,4cyclictest3130557-21idleruntime-cro09:00:013
3092089992114,4cyclictest0-21swapper/309:35:273
3092089992114,3cyclictest0-21swapper/311:10:153
3092075992114,5cyclictest13550irq/42-30be0000.ethernet07:25:120
309207599210,19cyclictest0-21swapper/009:27:320
3092080992013,4cyclictest3101337-21sh07:35:001
3092080992011,6cyclictest3147390-21grep09:45:241
3092089991912,4cyclictest3173758-21df_inode11:05:153
3092089991711,3cyclictest3194505-21fschecks_time12:05:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional