You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 16:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue May 05, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3305140995244,5cyclictest3408198-21run-parts12:20:001
3305148995144,4cyclictest3408189-21munin-plugin-st12:20:013
3305140994737,7cyclictest3350216-21grep09:15:251
3305140994736,7cyclictest3338104-21grep08:40:271
3305148994624,18cyclictest3348953-21munin-plugin-st09:15:013
3305148994616,27cyclictest3385293-21cat11:10:243
3305143994538,4cyclictest3406494-21munin-plugin-st12:15:002
3305148994419,21cyclictest0-21swapper/312:25:013
3305140994432,7cyclictest0-21swapper/107:15:001
3305148994334,5cyclictest3347238-21kthreadd09:10:013
3305148994320,20cyclictest0-21swapper/308:20:003
3305148994320,20cyclictest0-21swapper/308:20:003
3305148994312,6cyclictest3366865-21basename10:20:003
3305143994335,5cyclictest1-21systemd10:20:092
3305148994213,4cyclictest3387513-21sh11:20:003
3305143994218,9cyclictest3380471-21cron11:00:062
3305140994229,9cyclictest231ktimers/110:50:121
3305148994117,20cyclictest0-21swapper/311:50:003
3305148994116,22cyclictest3320595-21head07:50:253
3305148994115,6cyclictest3362164-21sendmail10:00:003
3305148994115,22cyclictest0-21swapper/310:05:003
330514899411,12cyclictest3410884-21ntpq12:25:203
330514899411,12cyclictest3318031-21cut07:45:163
3305135994130,7cyclictest0-21swapper/010:40:260
330514899409,9cyclictest3332714-21grep08:25:263
3305148994014,22cyclictest0-21swapper/312:35:243
3305148994013,4cyclictest3338735-21/usr/sbin/munin08:45:223
3305143994025,12cyclictest3382645-21apt-get11:05:132
3305135994034,4cyclictest121ktimers/008:40:130
330514899396,8cyclictest3343827-21run-parts09:00:003
330514899391,9cyclictest3322251-21grep07:55:273
3305148993913,22cyclictest0-21swapper/310:55:013
3305148993911,6cyclictest3345727-21sed09:05:023
3305148993911,4cyclictest3381044-21cstates11:00:133
3305140993929,7cyclictest3361675-21unixbench_multi09:55:261
3305140993928,7cyclictest0-21swapper/107:50:261
3305135993932,4cyclictest3397761-21idleruntime-cro11:50:000
3305135993930,6cyclictest3409643-21unixbench_multi12:20:250
3305135993926,9cyclictest0-21swapper/008:55:260
3305148993828,6cyclictest3324209-21grep08:00:273
3305148993828,6cyclictest3324209-21grep08:00:263
3305148993814,3cyclictest3316140-21/usr/sbin/munin07:40:153
3305148993813,3cyclictest0-21swapper/312:30:143
3305148993813,21cyclictest0-21swapper/307:10:173
3305148993811,4cyclictest0-21swapper/309:20:013
330514899381,12cyclictest3331488-21awk08:25:003
330514899381,11cyclictest3369608-21taskset10:25:253
330514899381,10cyclictest3406627-21wc12:15:013
3305143993825,10cyclictest3323179-21apt-get08:00:142
3305143993825,10cyclictest3323179-21apt-get08:00:132
3305143993823,11cyclictest3338870-21/usr/sbin/munin08:45:162
3305143993820,13cyclictest3341067-21/usr/sbin/munin08:50:232
3305135993829,6cyclictest0-21swapper/012:05:000
330514899372,8cyclictest3364642-21latency_hist10:10:013
330514899372,8cyclictest3364642-21latency_hist10:10:003
330514899372,10cyclictest3315431-21sed07:35:253
3305148993713,3cyclictest3326577-21/usr/sbin/munin08:10:173
330514899371,12cyclictest3388772-21sed11:20:243
3305148993711,2cyclictest0-21swapper/310:10:293
3305143993729,4cyclictest3315424-21unixbench_multi07:35:242
3305143993727,7cyclictest3372598-21/usr/sbin/munin10:35:182
3305143993724,10cyclictest3364961-21cron10:13:002
3305143993723,11cyclictest3330001-21munin-node08:20:122
3305143993722,11cyclictest3391170-21/usr/sbin/munin11:30:132
3305143993720,3cyclictest3333853-21memory08:30:202
3305140993730,4cyclictest3308600-21unixbench_multi07:15:261
3305140993726,6cyclictest0-21swapper/110:05:031
3305140993726,6cyclictest0-21swapper/110:05:031
3305140993724,9cyclictest231ktimers/108:45:111
3305135993727,6cyclictest0-21swapper/010:20:130
3305148993625,8cyclictest3354843-21ntp_offset09:30:203
3305148993613,4cyclictest391ktimers/308:40:243
3305148993612,2cyclictest0-21swapper/311:05:223
3305148993611,5cyclictest391ktimers/310:20:113
330514899361,12cyclictest3357462-21munin-plugin-st09:40:013
3305143993626,7cyclictest3309805-21/usr/sbin/munin07:20:202
3305143993625,7cyclictest3342690-21/usr/sbin/munin08:55:182
3305143993624,9cyclictest3356442-21/usr/sbin/munin09:35:212
3305143993623,8cyclictest3396285-21apt-get11:45:132
3305143993623,10cyclictest3305975-21/usr/sbin/munin07:10:252
3305143993622,9cyclictest3389729-21/usr/sbin/munin11:25:172
3305143993622,11cyclictest3349765-21/usr/sbin/munin09:15:222
3305143993622,11cyclictest3320624-21sshd07:50:272
3305140993623,10cyclictest3351891-21grep09:20:261
3305135993626,6cyclictest0-21swapper/011:55:270
3305135993626,6cyclictest0-21swapper/010:15:000
3305135993625,7cyclictest0-21swapper/010:45:240
3305148993527,4cyclictest3401377-21idleruntime-cro12:00:013
3305148993524,8cyclictest3399660-21debian-sa111:54:593
330514899352,10cyclictest3341898-21cron08:55:003
330514899351,9cyclictest3395629-21unixbench_singl11:40:263
330514899351,8cyclictest3325883-21sed08:05:263
330514899351,8cyclictest3325883-21sed08:05:263
3305148993514,4cyclictest3375378-21debian-sa110:45:003
3305143993526,6cyclictest3378642-21sshd10:53:262
3305143993525,7cyclictest3374760-21/usr/sbin/munin10:40:252
3305143993525,7cyclictest3322275-21/usr/sbin/munin07:55:272
3305143993524,7cyclictest3407162-21/usr/sbin/munin12:15:182
3305143993524,7cyclictest3358466-21/usr/sbin/munin09:45:162
3305143993523,9cyclictest3354289-21munin-node09:30:102
3305143993523,9cyclictest3347812-21/usr/sbin/munin09:10:182
3305143993523,8cyclictest3388313-21/usr/sbin/munin11:20:202
3305143993521,11cyclictest3332010-21/usr/sbin/munin08:25:182
3305143993518,12cyclictest3402645-21grep12:00:252
3305140993527,4cyclictest0-21swapper/109:05:011
3305140993523,8cyclictest0-21swapper/108:30:251
3305135993526,6cyclictest0-21swapper/009:40:000
3305135993525,6cyclictest0-21swapper/010:05:260
3305135993525,6cyclictest0-21swapper/010:05:260
3305135993510,6cyclictest11-21ksoftirqd/010:40:000
3305148993412,5cyclictest391ktimers/307:30:133
3305148993411,5cyclictest0-21swapper/310:30:133
330514899341,10cyclictest3310786-21cron07:25:003
3305143993428,3cyclictest3326683-21df08:10:152
3305143993427,3cyclictest0-21swapper/212:30:162
3305143993424,7cyclictest3403834-21/usr/sbin/munin12:05:202
3305143993424,7cyclictest3394242-21cron11:39:012
3305143993424,7cyclictest3370491-21munin-node10:30:102
3305143993424,7cyclictest3308674-21/usr/sbin/munin07:15:262
3305143993423,8cyclictest3351416-21/usr/sbin/munin09:20:212
3305143993423,8cyclictest3328281-21apt-get08:15:112
3305143993423,8cyclictest3328281-21apt-get08:15:112
3305143993423,8cyclictest3316225-21/usr/sbin/munin07:40:132
3305143993422,9cyclictest3408757-21/usr/sbin/munin12:20:142
3305143993422,9cyclictest3344827-21swap09:00:242
3305143993421,9cyclictest3312808-21/usr/sbin/munin07:30:142
3305143993421,10cyclictest3384691-21kernelversion11:10:172
3305143993419,12cyclictest3361378-21/usr/sbin/munin09:55:242
3305143993417,14cyclictest0-21swapper/208:40:132
3305143993416,4cyclictest3334873-21apt-get08:35:042
3305143993416,15cyclictest3345984-21fschecks_time09:05:172
3305140993427,4cyclictest0-21swapper/108:05:181
3305140993427,4cyclictest0-21swapper/108:05:171
3305140993424,7cyclictest3348500-21grep09:10:251
330513599347,6cyclictest11-21ksoftirqd/008:15:190
330513599347,6cyclictest11-21ksoftirqd/008:15:180
3305135993424,6cyclictest0-21swapper/012:30:250
3305148993325,5cyclictest3379173-21grep10:55:163
3305143993323,7cyclictest3398634-21/usr/sbin/munin11:50:192
3305143993323,7cyclictest3311148-21/usr/sbin/munin07:25:172
3305143993322,8cyclictest3394691-21df11:40:142
3305143993322,7cyclictest3363275-21/usr/sbin/munin10:05:182
3305143993322,7cyclictest3363275-21/usr/sbin/munin10:05:172
3305143993321,9cyclictest3368936-21/usr/sbin/munin10:25:162
3305143993320,10cyclictest3375953-21/usr/sbin/munin10:45:162
3305140993326,4cyclictest0-21swapper/108:25:271
3305140993326,4cyclictest0-21swapper/108:00:261
3305140993326,4cyclictest0-21swapper/108:00:261
3305140993321,7cyclictest0-21swapper/108:10:261
3305135993324,6cyclictest0-21swapper/007:55:190
3305135993323,6cyclictest0-21swapper/008:05:260
3305135993323,6cyclictest0-21swapper/008:05:260
3305148993224,4cyclictest0-21swapper/309:25:273
3305148993223,6cyclictest3392629-21sh11:35:003
3305143993226,3cyclictest3379132-21diskstats10:55:142
3305143993222,7cyclictest3410447-21/usr/sbin/munin12:25:142
3305143993222,7cyclictest3325158-21/usr/sbin/munin08:05:192
3305143993222,7cyclictest3325158-21/usr/sbin/munin08:05:182
3305143993221,8cyclictest3386160-21diskstats11:15:132
3305143993221,8cyclictest3362463-21cron10:01:002
3305143993221,8cyclictest3353159-21ntp_states09:25:222
3305143993221,7cyclictest3414019-21/usr/sbin/munin12:35:152
3305143993216,12cyclictest3365558-21fschecks_time10:15:112
3305140993224,4cyclictest0-21swapper/110:55:151
3305140993224,4cyclictest0-21swapper/109:45:251
3305140993223,5cyclictest0-21swapper/112:05:251
3305140993220,7cyclictest0-21swapper/108:39:491
3305140993219,9cyclictest1-21systemd11:15:181
330513599328,4cyclictest11-21ksoftirqd/010:25:260
3305135993224,4cyclictest0-21swapper/007:20:000
3305135993218,10cyclictest121ktimers/008:45:110
3305148993123,4cyclictest0-21swapper/312:05:253
330514899311,11cyclictest3373651-21cron10:40:003
3305143993121,7cyclictest3357807-21sshd09:41:272
3305143993119,10cyclictest3399893-21/usr/sbin/munin11:55:272
3305143993116,12cyclictest3318082-21/usr/sbin/munin07:45:172
3305143993116,10cyclictest3360287-21seq09:53:122
3305140993120,6cyclictest0-21swapper/107:49:431
330513599318,7cyclictest380-21ntpd10:15:170
330513599316,7cyclictest11-21ksoftirqd/007:30:260
3305135993124,4cyclictest3336805-21sendmail08:40:010
3305135993124,4cyclictest0-21swapper/012:10:250
3305135993123,4cyclictest0-21swapper/009:30:240
3305135993122,6cyclictest0-21swapper/011:30:250
3305135993122,6cyclictest0-21swapper/009:15:250
330513599312,10cyclictest3390337-21sed11:25:250
330513599311,15cyclictest0-21swapper/007:22:030
3305135993110,4cyclictest11-21ksoftirqd/008:10:260
3305148993019,7cyclictest0-21swapper/309:45:253
3305140993021,6cyclictest0-21swapper/109:35:271
3305140993021,5cyclictest0-21swapper/112:25:001
3305140993019,8cyclictest3315906-21run-parts07:40:011
330513599309,5cyclictest0-21swapper/007:25:250
3305135993021,4cyclictest131rcu_preempt10:55:210
3305135993017,8cyclictest131rcu_preempt11:42:000
3305135993011,11cyclictest0-21swapper/011:50:140
3305148992921,4cyclictest0-21swapper/307:20:003
3305148992920,6cyclictest0-21swapper/311:40:003
3305140992920,6cyclictest3313275-21awk07:30:211
3305135992923,4cyclictest3348834-21kworker/u8:2+events_unbound09:45:010
3305135992921,4cyclictest0-21swapper/009:05:260
3305135992920,6cyclictest3315430-21unixbench_multi07:35:240
3305135992919,6cyclictest0-21swapper/009:00:250
3305135992915,5cyclictest131rcu_preempt07:49:040
3305135992915,3cyclictest131rcu_preempt11:06:280
330513599291,25cyclictest0-21swapper/007:50:110
3305148992821,4cyclictest0-21swapper/310:45:243
3305140992821,5cyclictest3327782-21kworker/u8:1+events_unbound10:00:021
3305140992818,6cyclictest3393935-21grep11:35:241
3305140992817,8cyclictest3322296-21grep07:55:281
330513599288,5cyclictest0-21swapper/009:55:260
330513599288,4cyclictest11-21ksoftirqd/010:50:240
330513599287,9cyclictest131rcu_preempt09:24:590
330513599287,5cyclictest0-21swapper/008:25:180
330513599284,4cyclictest11-21ksoftirqd/008:25:000
3305135992822,3cyclictest0-21swapper/011:10:150
3305135992820,4cyclictest0-21swapper/011:25:010
3305135992820,4cyclictest0-21swapper/008:35:010
3305135992819,6cyclictest0-21swapper/008:55:000
3305135992819,5cyclictest0-21swapper/009:45:160
3305135992818,6cyclictest0-21swapper/009:25:240
3305135992817,5cyclictest131rcu_preempt11:35:340
3305148992715,9cyclictest3390253-21cat11:25:253
3305140992719,4cyclictest0-21swapper/109:05:261
330513599274,5cyclictest11-21ksoftirqd/012:25:240
3305135992715,4cyclictest131rcu_preempt11:00:110
330513599271,22cyclictest0-21swapper/011:18:160
3305148992618,4cyclictest0-21swapper/308:35:233
3305148992617,6cyclictest3351050-21tune2fs09:20:163
330514099269,5cyclictest221rcuc/109:00:011
3305140992618,6cyclictest3410590-21sort12:25:161
3305140992618,4cyclictest0-21swapper/110:15:211
3305140992618,4cyclictest0-21swapper/107:25:011
3305140992617,5cyclictest0-21swapper/111:00:161
3305140992616,6cyclictest0-21swapper/111:50:011
3305140992615,8cyclictest3399215-21grep11:50:261
330513599263,15cyclictest11-21ksoftirqd/012:15:230
3305135992619,3cyclictest0-21swapper/007:40:120
3305140992519,4cyclictest3411769-21kworker/u8:1+events_unbound12:35:361
3305140992517,5cyclictest0-21swapper/111:25:161
3305140992517,5cyclictest0-21swapper/111:05:261
3305140992515,5cyclictest3371531-21head10:30:251
330513599258,11cyclictest0-21swapper/009:50:470
330513599254,5cyclictest0-21swapper/008:00:140
330513599254,5cyclictest0-21swapper/008:00:140
330513599253,5cyclictest3370936-21taskset10:30:170
3305135992518,5cyclictest3348517-21unixbench_singl09:10:250
330513599251,20cyclictest0-21swapper/010:00:420
3305135992510,4cyclictest131rcu_preempt07:10:130
3305140992417,4cyclictest0-21swapper/111:55:271
3305140992415,6cyclictest3376629-21grep10:45:251
3305140992414,7cyclictest0-21swapper/110:20:211
3305140992414,7cyclictest0-21swapper/108:50:161
330513599248,3cyclictest131rcu_preempt12:09:080
3305135992410,3cyclictest131rcu_preempt12:35:150
3305148992315,5cyclictest0-21swapper/309:55:013
3305140992318,3cyclictest3388892-21kworker/u8:3+events_unbound12:00:281
3305140992317,3cyclictest0-21swapper/112:10:231
3305140992316,4cyclictest0-21swapper/107:40:231
3305148992214,5cyclictest0-21swapper/308:30:163
3305148992213,5cyclictest0-21swapper/309:45:003
3305140992216,4cyclictest3364989-21kworker/u8:2+events_unbound11:42:331
3305140992214,6cyclictest145-21jbd2/mmcblk1p2-811:20:061
3305140992213,6cyclictest0-21swapper/111:30:191
3305148992110,8cyclictest3401786-21cut12:00:153
330514099218,4cyclictest3364989-21kworker/u8:2+events_unbound10:25:101
3305140992114,4cyclictest0-21swapper/110:40:231
3305140992113,4cyclictest0-21swapper/107:25:171
3305140992014,3cyclictest3365214-21latency_hist10:15:001
3305140992014,3cyclictest0-21swapper/111:10:181
3305140992013,5cyclictest3330885-21sort08:20:241
3305140992012,5cyclictest33544822sleep109:30:151
3305140992012,5cyclictest3328486-21fschecks_time08:15:151
3305140992012,5cyclictest3328486-21fschecks_time08:15:151
330514099194,11cyclictest3352782-21fschecks_time09:25:181
3305140991912,5cyclictest231ktimers/112:30:171
3305140991912,4cyclictest3360447-21latency_hist09:55:011
3305140991911,4cyclictest0-21swapper/110:35:151
3305140991710,5cyclictest231ktimers/109:45:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional