You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 19:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Apr 27, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2989435997971,6cyclictest3008821-21kworker/u8:2+events_unbound08:20:121
2989444995931,9cyclictest391ktimers/312:20:113
2989439995237,11cyclictest311ktimers/208:20:132
2989444995134,12cyclictest391ktimers/309:55:103
2989435995136,11cyclictest231ktimers/107:20:131
2989431995043,4cyclictest3000414-21sendmail07:40:000
2989444994935,10cyclictest391ktimers/310:20:103
298943999481,41cyclictest3019601-21apt-get08:35:122
2989435994633,9cyclictest3007235-21sendmail08:00:001
2989431994638,5cyclictest3103785-21idleruntime-cro12:40:010
2989439994515,26cyclictest0-21swapper/209:45:002
298943999450,2cyclictest0-21swapper/210:10:112
2989444994436,5cyclictest3083106-21munin-plugin-st11:40:003
298943999441,38cyclictest3064582-21apt-get10:45:132
2989439994323,15cyclictest0-21swapper/211:40:242
298943999431,39cyclictest3082651-21/usr/sbin/munin11:35:262
298943999431,38cyclictest3061766-21/usr/sbin/munin10:35:232
298943999423,36cyclictest3089105-21/usr/sbin/munin11:55:192
298943999421,38cyclictest3008316-21/usr/sbin/munin08:00:242
298943999421,36cyclictest3085600-21/usr/sbin/munin11:45:202
298943999421,36cyclictest3085600-21/usr/sbin/munin11:45:202
298943999421,36cyclictest3069983-21/usr/sbin/munin11:00:162
298943999421,36cyclictest3032082-21/usr/sbin/munin09:10:152
298943999421,36cyclictest3010872-21/usr/sbin/munin08:10:132
2989444994132,6cyclictest3076668-21fschecks_count11:20:163
298943999412,34cyclictest3009168-21apt-get08:05:122
298943999412,33cyclictest3028560-21apt-get09:00:122
298943999411,37cyclictest3033750-21/usr/sbin/munin09:15:152
298943999411,37cyclictest3027364-21/usr/sbin/munin08:55:222
298943999411,35cyclictest3077086-21/usr/sbin/munin11:20:202
298943999411,35cyclictest3059974-21/usr/sbin/munin10:30:182
2989435994131,5cyclictest0-21swapper/112:31:281
298943999403,32cyclictest3079927-21apt-get11:30:132
298943999402,35cyclictest2997757-21/usr/sbin/munin07:30:192
298943999402,32cyclictest3095478-21apt-get12:15:122
2989439994016,21cyclictest0-21swapper/211:50:172
298943999401,36cyclictest3100858-21/usr/sbin/munin12:30:152
298943999401,36cyclictest3100025-21cron12:26:002
298943999401,36cyclictest3074228-21cron11:11:002
298943999401,36cyclictest3074228-21cron11:10:592
298943999401,36cyclictest3068326-21/usr/sbin/munin10:55:182
298943999401,36cyclictest3056903-21/usr/sbin/munin10:20:232
298943999401,36cyclictest3051506-21/usr/sbin/munin10:05:222
298943999401,35cyclictest2992018-21/usr/sbin/munin07:15:152
298943999401,34cyclictest3102455-21/usr/sbin/munin12:35:142
298943999401,34cyclictest3097538-21/usr/sbin/munin12:20:182
298943999401,34cyclictest3049466-21grep10:00:162
2989435994030,7cyclictest3074568-21sh11:15:001
2989435994030,7cyclictest3074568-21sh11:15:001
2989431994034,4cyclictest2996795-21munin-plugin-st07:30:010
298943999392,34cyclictest3031535-21sshd09:07:452
298943999392,32cyclictest30040542sleep207:50:112
298943999391,35cyclictest3078749-21/usr/sbin/munin11:25:212
298943999391,35cyclictest3066840-21/usr/sbin/munin10:50:202
298943999391,35cyclictest3045216-21sshd09:45:432
298943999391,35cyclictest3045216-21sshd09:45:432
298943999391,35cyclictest3040827-21/usr/sbin/munin09:35:182
298943999391,35cyclictest3026452-21latency_hist08:55:012
298943999391,35cyclictest3002921-21ntp_states07:45:202
298943999391,35cyclictest2999480-21/usr/sbin/munin07:35:222
298943999391,33cyclictest3090536-21/usr/sbin/munin12:00:152
298943999391,33cyclictest3037089-21apt-get09:25:132
298943999391,33cyclictest3024825-21latency_hist08:50:022
298943999391,33cyclictest3016562-21ntp_states08:25:242
2989435993931,5cyclictest3062632-21latency_hist10:40:001
2989435993928,7cyclictest0-21swapper/111:55:001
2989444993830,4cyclictest0-21swapper/311:20:003
2989444993829,6cyclictest3018959-21unixbench_singl08:30:253
298943999383,32cyclictest3046489-21/usr/sbin/munin09:50:232
298943999382,33cyclictest3000777-21/usr/sbin/munin07:40:162
298943999382,33cyclictest3000777-21/usr/sbin/munin07:40:152
298943999381,34cyclictest3092643-21ntp_states12:05:202
298943999381,34cyclictest3063220-21irqstats10:40:192
298943999381,34cyclictest3058327-21/usr/sbin/munin10:25:222
298943999381,34cyclictest3055451-21sshd10:15:502
298943999381,34cyclictest3012683-21/usr/sbin/munin08:15:152
298943999381,34cyclictest3006107-21/usr/sbin/munin07:55:202
298943999381,34cyclictest2994069-21meminfo07:20:182
298943999381,34cyclictest2990117-21/usr/sbin/munin07:10:202
298943999381,32cyclictest2995327-21/usr/sbin/munin07:25:122
2989435993827,7cyclictest0-21swapper/111:00:011
2989431993828,6cyclictest0-21swapper/008:30:250
298943999371,33cyclictest3072088-21/usr/sbin/munin11:05:232
298943999371,33cyclictest3072088-21/usr/sbin/munin11:05:232
298943999371,33cyclictest3047650-21/usr/sbin/munin09:55:142
298943999371,33cyclictest3021905-21/usr/sbin/munin08:40:192
298943999371,31cyclictest3074805-21apt-get11:15:122
298943999371,31cyclictest3017890-21apt-get08:30:072
298943999371,30cyclictest3038786-21apt-get09:30:102
2989435993726,6cyclictest0-21swapper/111:56:211
2989435993716,7cyclictest131rcu_preempt12:35:101
2989431993728,6cyclictest3038568-21idleruntime-cro09:30:000
2989444993629,3cyclictest3062653-21sendmail10:40:013
2989444993626,6cyclictest0-21swapper/309:30:373
298943999361,32cyclictest3094228-21/usr/sbin/munin12:10:182
298943999361,32cyclictest3094228-21/usr/sbin/munin12:10:182
298943999361,31cyclictest3035388-21apt-get09:20:142
2989435993628,5cyclictest3036865-21idleruntime-cro09:25:001
2989435993625,8cyclictest231ktimers/107:35:121
2989435993624,8cyclictest3011872-21grep08:10:261
2989435993624,10cyclictest231ktimers/109:25:131
2989431993625,8cyclictest3015757-21auditctl08:25:000
2989444993525,6cyclictest0-21swapper/312:04:593
2989435993526,4cyclictest0-21swapper/111:00:251
2989431993529,4cyclictest3021074-21munin-run08:40:010
2989431993527,5cyclictest3048511-21unixbench_multi09:55:230
2989431993525,6cyclictest3034670-21grep09:15:270
2989444993424,7cyclictest3072422-21grep11:05:253
2989444993424,7cyclictest3072422-21grep11:05:243
2989444993423,8cyclictest3064356-21sh10:45:003
2989435993425,5cyclictest0-21swapper/107:40:161
2989435993425,5cyclictest0-21swapper/107:40:161
2989431993423,7cyclictest0-21swapper/011:09:590
2989431993423,7cyclictest0-21swapper/011:09:590
2989444993324,4cyclictest0-21swapper/309:35:163
2989435993325,5cyclictest0-21swapper/108:20:001
2989435993324,6cyclictest0-21swapper/108:55:011
298943599331,7cyclictest131rcu_preempt11:35:141
2989435993224,4cyclictest0-21swapper/109:05:271
2989435993221,7cyclictest0-21swapper/108:55:281
2989431993222,6cyclictest0-21swapper/008:15:270
2989444993123,4cyclictest0-21swapper/311:25:263
2989444993123,4cyclictest0-21swapper/308:10:263
2989444993121,5cyclictest0-21swapper/309:25:363
298943599313,4cyclictest131rcu_preempt10:05:131
2989431993115,14cyclictest121ktimers/010:30:140
2989444993022,4cyclictest0-21swapper/308:55:173
2989444993022,4cyclictest0-21swapper/307:10:253
2989444993019,7cyclictest0-21swapper/310:05:003
2989435993023,4cyclictest0-21swapper/112:05:011
2989435993021,5cyclictest0-21swapper/107:15:261
2989435993019,8cyclictest3022525-21grep08:40:261
2989435993014,13cyclictest24-21ksoftirqd/112:15:101
2989431993022,6cyclictest121ktimers/010:50:110
2989431993022,4cyclictest0-21swapper/007:25:010
2989444992922,4cyclictest3024707-21munin-plugin-st08:50:013
2989444992921,5cyclictest3048636-21kworker/u8:1+events_unbound12:36:303
2989444992921,5cyclictest0-21swapper/311:40:243
2989444992921,4cyclictest0-21swapper/307:25:283
2989444992920,6cyclictest0-21swapper/312:20:003
298943599293,4cyclictest131rcu_preempt08:00:111
2989435992922,5cyclictest3036541-21kworker/u8:2+events_unbound09:55:511
2989435992920,6cyclictest0-21swapper/111:30:151
2989435992919,7cyclictest3041551-21grep09:35:261
2989435992918,8cyclictest3016679-21sshd08:25:251
298943199293,5cyclictest3057135-21users10:20:240
2989431992921,4cyclictest0-21swapper/010:05:000
2989431992919,6cyclictest0-21swapper/011:50:250
2989444992820,6cyclictest3000444-21grep07:40:003
2989444992820,5cyclictest3021085-21sendmail08:40:003
2989444992818,6cyclictest0-21swapper/310:30:243
2989435992821,4cyclictest3024710-21idleruntime-cro08:50:001
2989435992820,6cyclictest3063230-21kernelversion10:40:181
2989435992820,4cyclictest0-21swapper/112:25:241
2989435992820,4cyclictest0-21swapper/109:50:001
2989435992820,4cyclictest0-21swapper/109:50:001
2989435992819,6cyclictest3086756-21apt-key11:50:021
2989435992819,6cyclictest3086756-21apt-key11:50:011
2989435992818,7cyclictest3043883-21latency_hist09:45:011
2989431992818,6cyclictest3051997-21unixbench_singl10:05:270
2989431992812,13cyclictest0-21swapper/009:40:250
2989444992720,4cyclictest0-21swapper/310:05:273
2989435992720,5cyclictest3054077-21kworker/u8:2+events_unbound11:19:181
2989435992720,4cyclictest0-21swapper/110:25:011
2989435992719,6cyclictest3094266-21sort12:10:191
2989435992719,6cyclictest3094266-21sort12:10:191
2989435992718,6cyclictest0-21swapper/107:25:271
2989435992716,8cyclictest231ktimers/110:30:111
298943599271,10cyclictest30789802cat11:25:231
2989431992720,4cyclictest3081400-21sh11:35:000
2989431992720,3cyclictest0-21swapper/011:50:010
2989431992720,3cyclictest0-21swapper/011:50:010
2989431992717,6cyclictest3045109-21grep09:45:250
2989431992717,6cyclictest3045109-21grep09:45:250
2989444992616,6cyclictest1-21systemd08:15:203
2989444992615,7cyclictest0-21swapper/310:15:243
2989444992615,7cyclictest0-21swapper/309:45:013
2989435992619,5cyclictest3029872-21kworker/u8:0+events_unbound09:10:341
2989435992619,5cyclictest2973333-21kworker/u8:3+events_unbound07:30:041
2989435992619,3cyclictest0-21swapper/110:50:011
2989435992618,6cyclictest3054077-21kworker/u8:2+events_unbound12:21:261
2989435992616,5cyclictest0-21swapper/111:40:251
2989431992619,4cyclictest13850irq/36-mmc109:00:000
2989431992619,3cyclictest0-21swapper/009:30:140
2989431992617,6cyclictest3096524-21grep12:15:240
2989431992617,6cyclictest3026680-21cat08:55:010
2989431992614,8cyclictest121ktimers/012:30:120
2989444992517,5cyclictest0-21swapper/312:15:003
2989444992517,5cyclictest0-21swapper/312:15:003
2989444992517,5cyclictest0-21swapper/311:50:163
2989444992517,5cyclictest0-21swapper/309:45:263
2989444992517,5cyclictest0-21swapper/309:45:253
2989444992517,4cyclictest0-21swapper/308:00:133
2989444992516,7cyclictest3048636-21kworker/u8:1+events_unbound10:54:153
2989444992516,6cyclictest208-21systemd-logind08:40:273
2989444992516,6cyclictest0-21swapper/308:00:013
2989444992515,6cyclictest0-21swapper/311:45:263
2989444992515,6cyclictest0-21swapper/311:45:263
2989444992513,7cyclictest0-21swapper/312:25:223
2989435992517,4cyclictest0-21swapper/110:15:161
2989435992514,7cyclictest0-21swapper/109:15:261
2989431992519,4cyclictest3000368-21kworker/u8:1+events_unbound07:45:080
2989431992519,3cyclictest3062854-21latency_hist10:40:020
2989431992518,4cyclictest3077067-21ntpq11:20:210
2989431992518,4cyclictest0-21swapper/012:00:000
2989431992516,6cyclictest3012332-21sh08:15:010
2989431992516,6cyclictest1-21systemd10:44:060
2989431992511,11cyclictest3041972-21tr09:40:010
2989444992417,4cyclictest0-21swapper/310:45:243
2989444992417,4cyclictest0-21swapper/310:10:243
2989444992417,4cyclictest0-21swapper/307:40:253
2989444992417,4cyclictest0-21swapper/307:40:253
2989444992417,3cyclictest0-21swapper/311:00:013
2989444992415,6cyclictest391ktimers/309:05:243
2989435992418,4cyclictest3093277-21kworker/u8:0+events_unbound12:06:551
2989435992418,3cyclictest2991154-21munin-setwarn07:15:011
2989435992415,6cyclictest3053182-21ntpq10:10:191
2989431992417,5cyclictest2997228-21kworker/u8:4+events_unbound07:40:070
2989431992417,5cyclictest2997228-21kworker/u8:4+events_unbound07:40:070
2989431992417,3cyclictest0-21swapper/011:25:250
2989431992416,5cyclictest0-21swapper/008:00:000
298943199241,19cyclictest3076398-21latency_hist11:20:010
298943199241,19cyclictest0-21swapper/012:10:380
298943199241,19cyclictest0-21swapper/012:10:380
298943199241,19cyclictest0-21swapper/012:04:340
298943199241,19cyclictest0-21swapper/010:12:120
298943199241,19cyclictest0-21swapper/009:01:030
298943199241,19cyclictest0-21swapper/007:17:450
2989431992411,10cyclictest121ktimers/008:05:120
2989444992317,3cyclictest0-21swapper/311:05:013
2989444992316,4cyclictest3073651-21ntpq11:10:193
2989444992316,4cyclictest3073651-21ntpq11:10:193
2989444992315,6cyclictest391ktimers/307:30:053
2989444992315,4cyclictest0-21swapper/308:50:183
2989435992317,3cyclictest0-21swapper/109:55:011
2989435992316,3cyclictest0-21swapper/109:05:011
298943199238,12cyclictest0-21swapper/012:29:590
2989431992316,4cyclictest3058796-21head10:25:270
2989431992316,3cyclictest0-21swapper/009:51:310
2989431992316,3cyclictest0-21swapper/009:12:090
2989431992315,5cyclictest0-21swapper/009:05:270
2989431992315,5cyclictest0-21swapper/008:25:270
2989431992312,8cyclictest3007992-21awk08:00:190
298943199231,19cyclictest3066203-21cut10:50:000
298943199231,18cyclictest0-21swapper/011:36:070
298943199230,19cyclictest0-21swapper/010:19:360
298943199230,19cyclictest0-21swapper/009:20:480
2989444992216,4cyclictest0-21swapper/309:10:243
2989444992216,3cyclictest0-21swapper/310:25:173
2989444992216,3cyclictest0-21swapper/309:25:013
2989444992216,3cyclictest0-21swapper/307:50:093
2989444992215,4cyclictest3090135-21sendmail12:00:003
2989444992214,5cyclictest3100758-21uniq12:30:143
2989444992211,8cyclictest3034743-21users09:15:273
298943599223,5cyclictest131rcu_preempt08:35:131
2989435992216,4cyclictest3054077-21kworker/u8:2+events_unbound10:54:421
2989435992216,3cyclictest0-21swapper/108:30:261
2989435992215,4cyclictest3059231-21idleruntime-cro10:30:011
2989435992213,6cyclictest0-21swapper/107:50:251
2989435992211,8cyclictest3002357-21apt-get07:45:111
2989431992216,4cyclictest2997228-21kworker/u8:4+events_unbound07:50:110
2989431992216,2cyclictest0-21swapper/007:13:110
2989431992214,5cyclictest3098674-21idleruntime-cro12:24:590
2989431992214,5cyclictest0-21swapper/012:05:230
298943199221,19cyclictest0-21swapper/011:14:530
298943199221,19cyclictest0-21swapper/011:14:530
298943199221,17cyclictest0-21swapper/010:56:410
298943199220,18cyclictest0-21swapper/011:02:410
2989444992116,3cyclictest0-21swapper/307:20:123
2989444992115,3cyclictest0-21swapper/308:05:243
2989444992114,3cyclictest0-21swapper/312:05:173
2989444992112,6cyclictest0-21swapper/307:45:213
2989444992112,6cyclictest0-21swapper/307:15:253
2989435992113,5cyclictest0-21swapper/111:05:241
2989435992113,5cyclictest0-21swapper/111:05:241
2989435992113,4cyclictest0-21swapper/109:30:251
2989431992115,3cyclictest0-21swapper/008:45:240
298943199210,19cyclictest0-21swapper/011:45:000
2989444992014,3cyclictest3014287-21/usr/sbin/munin08:20:123
2989435992014,3cyclictest0-21swapper/108:05:471
2989435992013,4cyclictest3049393-21fschecks_count10:00:151
2989444991913,3cyclictest0-21swapper/309:00:223
2989444991812,3cyclictest0-21swapper/311:30:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional