You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 23:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Sep 11, 2026 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3258581995343,7cyclictest3453849-21latency_hist10:25:010
3258583994738,6cyclictest3533180-21latency_hist11:45:001
3258583994637,7cyclictest3448896-21latency_hist10:20:011
3258586994434,8cyclictest3345105-21cp08:35:002
3258586994236,4cyclictest3379610-21kworker/u8:3+flush-8:009:14:212
3258583994131,7cyclictest3513438-21latency_hist11:25:011
3258581994135,4cyclictest3233990-21kworker/u8:1+flush-8:007:19:210
3258581993831,5cyclictest2405913-21kworker/u8:3+flush-8:007:49:080
3258581993628,6cyclictest3498513-21latency_hist11:10:010
3258583993527,6cyclictest3310690-21/usr/sbin/munin08:04:161
3258581993528,5cyclictest3385362-21diskstats09:19:070
3258586993428,4cyclictest3498530-21kworker/u8:2+flush-8:012:29:222
325858399343,13cyclictest3439556-21apt-get10:14:051
325858399342,17cyclictest0-21swapper/108:34:031
3258586993328,4cyclictest3409547-21kworker/u8:1+events_unbound10:54:202
3258586993328,4cyclictest3345137-21kworker/u8:2+events_unbound10:09:212
3258586993328,3cyclictest3379610-21kworker/u8:3+flush-8:009:19:122
3258581993328,3cyclictest3345137-21kworker/u8:2+events_unbound09:30:000
3258581993325,6cyclictest3370226-21/usr/sbin/munin09:04:150
3258581993325,5cyclictest3438958-21kworker/u8:0+events_unbound10:45:010
32540712334,9sleep20-21swapper/207:08:542
35284422320,3sleep3451irq_work/311:40:013
34636042320,0sleep0201rcuc/010:34:220
3258583993228,2cyclictest3390766-21irqrtprio09:24:101
3258583993227,3cyclictest3475125-21irqrtprio10:49:101
3258583993227,3cyclictest3349890-21awk08:40:001
3258583993225,5cyclictest3489228-21apt-get11:04:041
3258583993223,6cyclictest3463721-21latency_hist10:35:001
3258581993213,5cyclictest3258575-21cyclictest07:10:000
325858399313,15cyclictest3545108-21cat11:59:111
3258583993127,3cyclictest3503353-21unixbench_singl11:14:221
3258581993124,5cyclictest3364765-21latency_hist08:55:010
3258581993122,7cyclictest3334832-21latency_hist08:25:000
3258581993121,7cyclictest3508482-21latency_hist11:20:010
3258583993020,8cyclictest3483090-21ntpq10:54:151
3258583993014,6cyclictest3280780-21apt-get07:34:031
325858399301,14cyclictest3557278-21ntpq12:09:171
3258581993020,8cyclictest3527599-21ntpq11:39:220
325858699290,27cyclictest3548840-21cpuspeed_turbos12:04:052
325858399296,12cyclictest3305758-21apt-get07:59:031
325858399295,12cyclictest3428527-21ntpq09:59:231
325858399293,16cyclictest0-21swapper/110:24:111
325858399293,13cyclictest3359213-21ntpq08:49:191
3258583992926,2cyclictest3384573-21systemd-run09:15:001
3258583992924,4cyclictest3538148-21true11:50:001
3258583992924,4cyclictest3538148-21true11:50:001
3258583992923,4cyclictest3498530-21kworker/u8:2+flush-8:011:19:201
3258583992912,7cyclictest3262838-21ntpq07:14:181
325858199298,3cyclictest33295452switchtime08:19:220
3258581992922,5cyclictest3409856-21/usr/sbin/munin09:44:150
3258581992922,5cyclictest3340298-21apt-get08:34:030
3258581992922,5cyclictest3315090-21latency_hist08:05:010
3258581992922,3cyclictest0-21swapper/007:44:170
3258581992921,5cyclictest3404343-21latency_hist09:35:000
3258581992921,5cyclictest3404343-21latency_hist09:35:000
3258581992917,10cyclictest3221732-21kworker/u8:0+flush-8:008:59:190
3258586992824,2cyclictest3464393-21aten2_r5power_v10:39:062
3258586992824,2cyclictest3355518-21aten2_r5power_p08:49:072
325858399284,12cyclictest3582077-21ntpq12:34:171
325858399283,15cyclictest0-21swapper/111:30:001
325858399283,14cyclictest3473295-21ntpq10:44:201
3258583992824,3cyclictest3233990-21kworker/u8:1-ext4-rsv-conversion07:55:001
3258583992823,3cyclictest3399262-21unixbench_singl09:29:231
325858399281,9cyclictest3315408-21sshd08:06:161
3258583992814,2cyclictest0-21swapper/110:04:211
3258583992813,3cyclictest0-21swapper/107:15:041
325858399281,17cyclictest3330452-21apt-get08:24:041
325858399281,15cyclictest3299463-21ntpq07:49:171
325858399280,18cyclictest3575251-21grep12:29:121
325858399280,11cyclictest3290317-21latency_hist07:40:011
3258581992824,3cyclictest3233990-21kworker/u8:1+flush-8:009:09:090
3258581992824,2cyclictest3275183-21unixbench_singl07:24:220
3258581992822,4cyclictest3324803-21unixbench_multi08:14:230
3258581992821,5cyclictest3259027-21apt-get07:14:050
3258586992721,5cyclictest3221732-21kworker/u8:0+flush-8:008:59:172
325858399273,11cyclictest3388888-21ntpq09:19:171
3258583992722,3cyclictest3337533-21kthreadcore08:29:131
3258583992722,3cyclictest0-21swapper/111:54:091
3258583992721,3cyclictest0-21swapper/107:10:001
325858399272,12cyclictest3364114-21ntpq08:54:151
325858399271,17cyclictest3571121-21kthreadcore12:24:131
325858399271,16cyclictest3378995-21ntpq09:09:181
325858399271,16cyclictest3274666-21ntpq07:24:151
325858399271,14cyclictest3522714-21ntpq11:34:161
325858399270,15cyclictest3373990-21ntpq09:04:151
325858399270,14cyclictest0-21swapper/110:09:041
3258581992723,2cyclictest3513438-21sh11:25:000
325858199272,24cyclictest3263467-21kworker/0:2+events08:37:310
3258581992722,3cyclictest3390336-21fschecks_count09:24:070
3258581992721,4cyclictest3542948-21unixbench_multi11:54:210
3258581992719,6cyclictest3583457-21diskstats12:39:130
3258581992718,7cyclictest3429108-21latency_hist10:00:010
325858199270,25cyclictest1-21systemd08:46:160
3258586992622,3cyclictest3521565-21kworker/u8:0+events_unbound12:34:092
3258586992622,2cyclictest3345529-21aten2_r5power_e08:39:062
3258586992621,3cyclictest3533044-21unixbench_multi11:44:232
3258586992621,3cyclictest3508469-21cron11:20:012
3258586992620,4cyclictest3438958-21kworker/u8:0+flush-8:010:44:242
325858399267,10cyclictest0-21swapper/107:44:061
325858399263,12cyclictest3458127-21ntpq10:29:151
325858399263,11cyclictest3562315-21ntpq12:14:181
325858399262,14cyclictest3413686-21ntpq09:44:181
325858399262,14cyclictest0-21swapper/110:40:001
325858399262,12cyclictest3552430-21ntpq12:04:181
325858399262,12cyclictest3369123-21ntpq08:59:171
325858399262,11cyclictest3415816-21kthreadcore09:49:111
3258583992618,6cyclictest3320585-21apt-get08:14:041
325858399261,10cyclictest3583929-21irqrtprio12:39:161
325858399261,10cyclictest3279731-21ps07:29:191
325858399260,16cyclictest3404756-21taskset09:37:311
325858399260,15cyclictest3355007-21latency_hist08:45:011
3258581992622,3cyclictest3290158-21idleruntime-cro07:40:000
3258581992622,2cyclictest3567107-21needreboot12:19:190
3258581992622,2cyclictest3454997-21irqcore10:29:100
3258581992621,4cyclictest3537974-21unixbench_multi11:49:220
3258581992621,4cyclictest3537974-21unixbench_multi11:49:220
3258581992621,3cyclictest3284517-21sed07:34:150
3258581992620,4cyclictest3478680-21unixbench_singl10:49:230
3258581992618,6cyclictest3562849-21latency_hist12:15:010
3258581992616,2cyclictest421rcuog/210:04:090
3258586992521,3cyclictest2405913-21kworker/u8:3+flush-8:008:14:132
3258586992520,4cyclictest3379610-21kworker/u8:3+flush-8:011:34:112
325858399254,11cyclictest3400586-21irqcore09:34:101
325858399254,11cyclictest3400586-21irqcore09:34:101
325858399253,8cyclictest3564997-21kthreadcore12:19:171
325858399252,12cyclictest3527608-21ntpq11:39:231
325858399251,12cyclictest3423624-21ntpq09:54:191
325858399251,11cyclictest3487085-21kthreadcore10:59:141
3258583992510,2cyclictest3494303-21awk11:09:061
325858399250,12cyclictest0-21swapper/108:15:151
325858199256,18cyclictest3263467-21kworker/0:2+events07:56:230
3258581992521,3cyclictest3379610-21kworker/u8:3+events_unbound11:29:070
3258581992520,3cyclictest3523158-21unixbench_multi11:34:220
3258581992520,3cyclictest3233990-21kworker/u8:1+flush-8:007:50:090
3258581992519,4cyclictest3488537-21unixbench_singl10:59:250
3258581992519,4cyclictest3409224-21unixbench_singl09:39:250
3258581992519,4cyclictest3319930-21unixbench_singl08:09:220
325858199251,22cyclictest3443955-21kworker/0:0+events11:14:120
3258586992421,2cyclictest3286011-21fschecks_count07:39:082
3258586992419,3cyclictest3405127-21cpuspeed_turbos09:39:082
325858199247,16cyclictest3349933-21kworker/0:0+events09:14:190
325858199242,21cyclictest3443955-21kworker/0:0+events12:24:070
325858199242,21cyclictest3443955-21kworker/0:0+events10:39:230
325858199242,16cyclictest20926-21sendmail-mta10:54:030
3258581992419,4cyclictest3424074-21unixbench_singl09:54:230
325858199241,22cyclictest3443955-21kworker/0:0+events12:04:070
325858199241,22cyclictest3443955-21kworker/0:0+events10:19:230
325858199241,22cyclictest3263467-21kworker/0:2+events07:29:160
3258586992320,2cyclictest3395116-21aten2_r5power_v09:29:062
3258586992319,2cyclictest3509324-21fschecks_count11:24:062
3258586992319,2cyclictest3410105-21cpuspeed_turbos09:44:062
3258586992318,4cyclictest3379610-21kworker/u8:3+flush-8:010:59:192
3258586992318,4cyclictest3221732-21kworker/u8:0+flush-8:007:15:062
3258586992318,3cyclictest3334668-21unixbench_multi08:24:222
325858199232,20cyclictest3443955-21kworker/0:0+events11:44:120
325858199232,20cyclictest3263467-21kworker/0:2+events08:44:190
3258581992316,5cyclictest3492926-21ntpq11:04:160
325858199231,21cyclictest3379615-21kworker/0:2+events10:14:150
3258581992311,9cyclictest278-21systemd-journal12:10:010
3258586992218,2cyclictest3400143-21cpuspeed_turbos09:34:062
3258586992218,2cyclictest3400143-21cpuspeed_turbos09:34:062
3258586992217,4cyclictest3221732-21kworker/u8:0+events_unbound08:44:162
3258586992216,4cyclictest3547947-21unixbench_singl11:59:222
3258586992216,4cyclictest3543093-21turbostat.cron11:54:592
325858199225,16cyclictest3379615-21kworker/0:2+events10:09:070
325858199221,7cyclictest596-21lldpd12:29:120
3258581992215,5cyclictest278-21systemd-journal12:33:210
325858699219,4cyclictest0-21swapper/207:14:242
325858699212,14cyclictest3459344-21apt-get10:34:032
3258586992117,3cyclictest3379610-21kworker/u8:3+flush-8:010:14:112
3258586992117,3cyclictest2405913-21kworker/u8:3+flush-8:007:29:132
3258581992116,3cyclictest0-21swapper/008:29:060
3258581992116,2cyclictest0-21swapper/011:59:140
34983532200,3sleep375-21kworker/3:1+events11:09:233
325858699208,4cyclictest0-21swapper/207:32:302
325858699202,13cyclictest3489228-21apt-get11:04:052
3258586992017,2cyclictest3315707-21aten2_r5power_e08:09:042
3258586992016,2cyclictest3310939-21cpuspeed_turbos08:04:072
3258586992016,2cyclictest0-21swapper/209:04:122
325858199205,14cyclictest3379615-21kworker/0:2+events09:48:030
325858699197,4cyclictest0-21swapper/211:14:132
3258586991915,2cyclictest3514213-21cpuspeed_turbos11:29:062
3258586991915,2cyclictest3454495-21aten2_r5power_p10:29:052
3258586991915,2cyclictest0-21swapper/212:14:192
3258586991915,2cyclictest0-21swapper/212:09:062
3258586991915,2cyclictest0-21swapper/208:29:142
3258586991914,3cyclictest3425643-21sed09:59:162
3258586991911,6cyclictest3295083-21cron07:45:002
325858699182,11cyclictest3567181-21ntpq12:19:212
3258586991815,2cyclictest3375505-21fschecks_time09:09:082
3258586991815,2cyclictest3300726-21aten2_r5power_v07:54:052
3258586991814,3cyclictest3438958-21kworker/u8:0+flush-8:010:24:202
3258586991814,2cyclictest3583431-21cpuspeed_turbos12:39:122
3258586991814,2cyclictest0-21swapper/209:54:162
3258586991814,2cyclictest0-21swapper/209:50:002
3258586991814,2cyclictest0-21swapper/208:19:202
3258586991813,3cyclictest0-21swapper/212:25:002
3258586991812,4cyclictest3478177-21ntpq10:49:182
3258586991812,4cyclictest0-21swapper/210:04:062
325858699181,12cyclictest3494140-21apt-get11:09:052
325858699181,12cyclictest3296543-21/usr/sbin/munin07:49:112
3258586991810,6cyclictest3447665-21tr10:19:182
32539302183,9sleep30-21swapper/307:07:073
34896972177,6sleep30-21swapper/311:04:113
35140432160,2sleep3481ktimers/311:29:053
325858699167,7cyclictest3392682-21cut09:24:122
3258586991613,2cyclictest0-21swapper/208:54:202
3258586991612,3cyclictest0-21swapper/207:59:092
325858699156,7cyclictest3537812-21grep11:49:222
325858699156,7cyclictest3537812-21grep11:49:222
325858699152,12cyclictest0-21swapper/211:35:422
3258586991512,2cyclictest0-21swapper/207:22:242
35226612142,8sleep30-21swapper/311:34:163
33795712143,7sleep30-21swapper/309:10:003
32635342144,5sleep30-21swapper/307:15:013
34489372132,6sleep30-21swapper/310:20:013
33944292132,6sleep30-21swapper/309:25:013
33010862132,7sleep30-21swapper/307:54:093
32896412132,7sleep30-21swapper/307:39:213
32599452133,6sleep30-21swapper/307:14:133
35732832122,6sleep30-21swapper/312:29:043
35569842122,6sleep30-21swapper/312:09:143
35486092122,6sleep30-21swapper/312:04:053
35049852122,6sleep30-21swapper/311:19:113
34738672122,6sleep30-21swapper/310:45:013
34591792122,6sleep30-21swapper/310:32:173
34404422122,6sleep30-21swapper/310:14:123
34247942122,6sleep30-21swapper/309:59:113
34050022122,6sleep30-21swapper/309:39:093
33850862122,6sleep30-21swapper/309:19:033
33805002122,6sleep30-21swapper/309:14:093
33696832122,6sleep30-21swapper/309:00:013
33640422122,6sleep30-21swapper/308:54:153
33591542122,7sleep30-21swapper/308:49:183
33493122122,6sleep30-21swapper/308:39:193
33299162122,5sleep30-21swapper/308:20:013
33240212122,6sleep30-21swapper/308:14:153
33154072122,6sleep30-21swapper/308:06:173
33050632122,6sleep30-21swapper/307:55:013
35829712112,6sleep30-21swapper/312:36:273
35779982112,6sleep30-21swapper/312:31:173
35683392112,6sleep30-21swapper/312:24:033
35631842112,6sleep30-21swapper/312:16:293
35582512112,6sleep30-21swapper/312:11:323
35433902112,6sleep30-21swapper/311:56:023
35381452112,5sleep30-21swapper/311:50:013
35334212112,6sleep30-21swapper/311:45:193
35334212112,6sleep30-21swapper/311:45:193
35090642112,5sleep30-21swapper/311:24:053
34988372112,6sleep30-21swapper/311:11:213
34841242112,6sleep30-21swapper/310:57:293
34830702112,5sleep30-21swapper/310:54:163
34691242112,5sleep30-21swapper/310:40:153
34642532112,6sleep30-21swapper/310:39:033
34582702112,5sleep30-21swapper/310:29:203
34443712113,5sleep30-21swapper/310:17:493
34343512112,5sleep30-21swapper/310:05:533
34300592112,5sleep30-21swapper/310:04:103
34196732112,6sleep30-21swapper/309:52:493
34146382112,6sleep30-21swapper/309:46:483
34094382112,5sleep30-21swapper/309:40:013
33996382112,6sleep30-21swapper/309:30:473
33996382112,6sleep30-21swapper/309:30:463
33897362112,6sleep30-21swapper/309:20:233
33653252112,5sleep30-21swapper/308:59:053
33402132112,5sleep30-21swapper/308:33:173
33350872113,5sleep30-21swapper/308:25:313
33258672112,5sleep30-21swapper/308:19:093
33104292112,6sleep30-21swapper/308:00:433
32955652112,6sleep30-21swapper/307:48:113
32945882112,5sleep30-21swapper/307:44:223
32806952112,6sleep30-21swapper/307:33:193
32755992112,6sleep30-21swapper/307:26:173
32712552112,5sleep30-21swapper/307:24:083
35286712102,5sleep30-21swapper/311:42:463
33501342102,5sleep30-21swapper/308:40:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional