You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 17:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 16, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34933212530,2sleep3481ktimers/311:19:083
3246629994740,6cyclictest2876797-21kworker/u8:2+flush-8:008:39:150
34900192450,2chrt575-21kworker/3:2-events11:14:143
3246629994433,9cyclictest3268015-21unixbench_multi07:29:170
3246629994333,7cyclictest3455766-21latency_hist10:40:010
3246629994232,8cyclictest278-21systemd-journal08:35:000
3246632994135,4cyclictest3570184-21apt-get12:38:541
3246629993930,6cyclictest3520290-21latency_hist11:45:010
3246632993731,4cyclictest2876797-21kworker/u8:2+flush-8:007:54:131
3246632993728,6cyclictest3406300-21latency_hist09:50:011
3246629993726,3cyclictest421rcuog/211:59:070
3246632993629,5cyclictest3441539-21apt-get10:28:581
3246632993627,7cyclictest3411741-21/usr/sbin/munin09:59:091
3246629993630,4cyclictest3258540-21kworker/u8:1+flush-8:008:29:060
324210023628,3sleep00-21swapper/007:08:490
324204823625,6sleep30-21swapper/307:08:073
3246629993526,7cyclictest278-21systemd-journal12:10:000
3246629993526,7cyclictest278-21systemd-journal12:10:000
33712032340,7sleep3575-21kworker/3:2+mm_percpu_wq09:14:133
33712032340,7sleep3575-21kworker/3:2+mm_percpu_wq09:14:133
32748332340,4sleep10-21swapper/107:39:061
3246632993429,3cyclictest3372060-21kworker/u8:3+events_unbound10:24:091
3246632993428,4cyclictest3505305-21apt-get11:30:021
3246632993428,4cyclictest3377315-21apt-get09:23:581
3246629993428,5cyclictest3391517-21kworker/u8:2+events_unbound10:55:000
3246629993427,5cyclictest2876797-21kworker/u8:2+flush-8:008:24:130
3246629993426,6cyclictest278-21systemd-journal07:40:000
3246636993329,3cyclictest3302152-21kworker/u8:3+flush-8:008:04:162
324662999333,25cyclictest3441005-21kworker/0:2+events12:11:050
3246636993224,6cyclictest278-21systemd-journal08:17:532
3246629993228,3cyclictest3352154-21systemd-run08:55:000
3246629993227,4cyclictest3391517-21kworker/u8:2+flush-8:009:45:310
3246629993226,4cyclictest3302152-21kworker/u8:3+flush-8:008:09:090
3246629993225,4cyclictest3391517-21kworker/u8:2+flush-8:010:45:310
3246629993224,6cyclictest3510971-21/usr/sbin/munin11:39:100
3246629993224,5cyclictest3559834-21latency_hist12:25:010
3246636993127,2cyclictest3511029-21aten2_r5power_c11:39:002
3246632993127,2cyclictest3306902-21needreboot08:09:081
3246632993126,3cyclictest3311835-21needreboot08:14:081
3246632993125,5cyclictest3197901-21kworker/u8:3+flush-8:007:49:021
3246629993126,3cyclictest3395738-21needreboot09:39:080
3246629993126,3cyclictest3367810-21fschecks_time09:14:020
3246629993126,3cyclictest3367810-21fschecks_time09:14:020
3246629993125,4cyclictest3372060-21kworker/u8:3+events_unbound10:04:140
3246629993125,4cyclictest3372060-21kworker/u8:3+events_unbound09:19:120
3246629993125,4cyclictest3313381-21fschecks_count08:19:030
3246629993124,3cyclictest0-21swapper/011:03:580
3246629993121,8cyclictest0-21swapper/009:10:000
3246629993118,11cyclictest3342544-21kworker/u8:0+flush-8:009:04:110
3246636993025,3cyclictest3278609-21/usr/sbin/munin07:44:132
3246632993026,2cyclictest3268184-21systemd-run07:30:011
3246629993025,3cyclictest3496958-21kthreadcore11:24:060
3246629993025,3cyclictest3282993-21munin-plugin-st07:45:000
3246629993024,4cyclictest3352950-21fschecks_count08:59:030
3246629993024,3cyclictest0-21swapper/011:20:000
3246629993022,6cyclictest3490750-21kworker/u8:0+flush-8:012:19:000
3246636992925,3cyclictest3258540-21kworker/u8:1+events_unbound10:35:022
3246636992923,4cyclictest3342071-21gpgv08:45:002
3246632992924,4cyclictest20643-21cron11:00:001
3246632992923,4cyclictest3258540-21kworker/u8:1+flush-8:009:29:071
3246632992922,5cyclictest3376737-21awk09:19:591
3246632992922,5cyclictest20643-21cron10:15:001
3246632992921,6cyclictest278-21systemd-journal12:24:541
3246629992924,3cyclictest3565993-21irqrtprio12:34:040
3246629992924,3cyclictest3308414-21fschecks_count08:14:000
3246629992923,4cyclictest3397358-21fschecks_time09:44:020
3246629992923,4cyclictest3391517-21kworker/u8:2+flush-8:012:29:150
324662999292,25cyclictest3401412-21kworker/0:0+events09:59:450
3246629992922,4cyclictest3570449-21fschecks_count12:38:580
3246629992922,4cyclictest3288688-21cpuspeed_turbos07:54:000
3246629992920,7cyclictest3501182-21cpuspeed_turbos11:29:020
32464402293,8sleep20-21swapper/207:09:392
3246636992820,6cyclictest278-21systemd-journal12:05:002
3246636992819,7cyclictest3273925-21fschecks_count07:39:022
324662999283,24cyclictest3347240-21kworker/0:2+events09:34:210
324662999282,25cyclictest3441005-21kworker/0:2+events10:25:380
324662999282,25cyclictest3241950-21kworker/0:0+events07:48:130
3246629992822,4cyclictest3475375-21unixbench_multi10:59:170
3246629992820,6cyclictest3461217-21kworker/u8:3+flush-8:011:14:040
3246629992814,10cyclictest3298554-21diskstats08:04:020
324662999280,26cyclictest3347240-21kworker/0:2+events09:21:050
3246636992723,2cyclictest3318285-21fschecks_count08:24:012
3246636992722,4cyclictest3302152-21kworker/u8:3+events_unbound08:34:202
3246632992724,2cyclictest3270864-21kthreadcore07:34:071
3246632992723,2cyclictest3470562-21cron10:55:001
3246632992723,2cyclictest0-21swapper/109:10:001
3246632992722,3cyclictest3257599-21needreboot07:19:101
3246632992722,3cyclictest3257599-21needreboot07:19:101
3246632992722,2cyclictest0-21swapper/111:09:161
3246632992721,5cyclictest3372060-21kworker/u8:3+flush-8:010:04:161
3246632992721,4cyclictest3391517-21kworker/u8:2+flush-8:012:30:251
324662999272,24cyclictest3441005-21kworker/0:2+events11:31:250
3246629992722,3cyclictest3450880-21systemd-run10:35:000
3246629992721,4cyclictest3407143-21fschecks_count09:54:010
3246629992718,7cyclictest3540155-21latency_hist12:05:000
324662999271,25cyclictest3441005-21kworker/0:2+events11:05:490
35714542260,6chrt0-21swapper/212:39:022
3246636992623,2cyclictest3430747-21unixbench_multi10:14:162
3246636992621,3cyclictest3342544-21kworker/u8:0+events_unbound09:09:032
3246632992622,2cyclictest0-21swapper/109:00:001
3246632992621,4cyclictest3371661-21unixbench_multi09:14:191
3246632992621,4cyclictest3371661-21unixbench_multi09:14:191
3246632992620,4cyclictest3447040-21irqcore10:34:031
3246632992620,4cyclictest3251484-21latency_hist07:15:001
324662999266,19cyclictest3241950-21kworker/0:0+events07:21:170
324662999266,18cyclictest3401412-21kworker/0:0+events10:24:530
3246629992622,2cyclictest0-21swapper/011:50:000
3246629992620,4cyclictest3287923-21kworker/u8:0+flush-8:007:58:590
3246629992620,3cyclictest3342055-21/usr/sbin/munin08:45:010
3246629992620,3cyclictest0-21swapper/007:15:040
3246629992620,3cyclictest0-21swapper/007:15:040
3246629992619,5cyclictest3526248-21fschecks_count11:54:020
3246629992617,6cyclictest3386587-21latency_hist09:30:010
324662999261,20cyclictest3441005-21kworker/0:2+events10:40:020
324662999260,25cyclictest3401412-21kworker/0:0+events10:13:260
3246636992522,2cyclictest3554787-21unixbench_singl12:19:172
3246636992522,2cyclictest3259216-21fschecks_time07:24:012
3246636992521,3cyclictest3560416-21aten2_r5power_c12:28:592
3246636992521,3cyclictest3480901-21kworker/u8:1+flush-8:012:09:182
3246636992521,3cyclictest3480901-21kworker/u8:1+flush-8:012:09:172
3246636992520,4cyclictest3372060-21kworker/u8:3+flush-8:009:39:172
3246636992515,8cyclictest3387138-21apt-get09:33:582
3246632992521,2cyclictest3352154-21systemd-run08:55:001
3246632992520,4cyclictest2876797-21kworker/u8:2+flush-8:008:37:551
3246632992520,3cyclictest3535220-21cron12:00:001
3246632992519,5cyclictest3480901-21kworker/u8:1+flush-8:012:09:161
3246632992519,5cyclictest3480901-21kworker/u8:1+flush-8:012:09:161
3246632992519,4cyclictest3318019-21apt-get08:23:571
3246632992519,4cyclictest0-21swapper/108:30:011
3246632992517,4cyclictest3297576-21unixbench_multi07:59:181
3246629992521,3cyclictest3258540-21kworker/u8:1+flush-8:007:34:160
32459182252,16sleep13245937-21ntpq07:09:101
3246636992421,2cyclictest3441853-21fschecks_time10:29:022
3246636992418,4cyclictest3440897-21unixbench_singl10:24:172
3246636992416,5cyclictest3466241-21aten2_r5power_c10:53:592
3246632992420,2cyclictest3283017-21systemctl07:45:001
3246632992420,2cyclictest0-21swapper/110:20:001
3246632992420,2cyclictest0-21swapper/109:34:041
3246632992420,2cyclictest0-21swapper/108:34:101
3246632992419,3cyclictest3495349-21unixbench_singl11:19:171
3246632992418,5cyclictest3525242-21unin-run11:50:001
3246632992418,4cyclictest20643-21cron12:20:001
3246632992417,6cyclictest3461217-21kworker/u8:3+flush-8:010:49:161
3246632992417,6cyclictest3372060-21kworker/u8:3+events_unbound09:40:001
3246632992415,2cyclictest421rcuog/211:39:091
324662999242,21cyclictest3401412-21kworker/0:0+events10:08:170
3246636992320,2cyclictest3308367-21cpuspeed_turbos08:13:592
3246636992320,2cyclictest3258307-21idleruntime-cro07:20:002
3246636992320,2cyclictest3258307-21idleruntime-cro07:20:002
3246636992319,2cyclictest3520897-21aten2_r5power_e11:48:592
3246636992319,2cyclictest0-21swapper/211:29:102
3246636992319,2cyclictest0-21swapper/210:40:002
3246636992318,4cyclictest3490750-21kworker/u8:0+flush-8:011:59:122
3246636992318,4cyclictest3391517-21kworker/u8:2+flush-8:010:59:122
3246636992318,4cyclictest3372060-21kworker/u8:3+flush-8:009:24:062
324663699230,11cyclictest3361966-21idleruntime-cro09:05:002
3246632992319,2cyclictest0-21swapper/109:04:121
3246632992317,4cyclictest3535801-21apt-get12:03:571
3246632992317,4cyclictest3500299-21unixbench_singl11:24:181
3246632992313,7cyclictest3519659-21ntpq11:44:121
3246632992312,9cyclictest3479897-21ntpq11:04:131
324662999236,16cyclictest3401412-21kworker/0:0+events10:15:010
324662999232,20cyclictest3241950-21kworker/0:0+events07:10:370
3246629992317,4cyclictest2876797-21kworker/u8:2+flush-8:008:45:310
3246636992218,3cyclictest3510275-21unixbench_multi11:34:172
3246636992217,3cyclictest3465539-21unixbench_singl10:49:182
3246632992218,2cyclictest907-21mta-sts-daemon12:28:331
3246632992218,2cyclictest0-21swapper/109:54:041
3246632992218,2cyclictest0-21swapper/109:44:161
324663299221,20cyclictest291ktimers/111:14:161
3246636992118,2cyclictest3406939-21aten2_r5power_p09:53:592
3246636992115,4cyclictest3347219-21cat08:50:012
324663299217,5cyclictest0-21swapper/108:04:521
3246632992117,3cyclictest3456582-21sh10:44:001
3246632992117,2cyclictest3550006-21sh12:14:591
3246632992117,2cyclictest3342326-21apt-key08:45:011
3246632992116,4cyclictest3530239-21unixbench_singl11:54:181
3246632992116,4cyclictest3452140-21irqrtprio10:39:051
3246632992116,3cyclictest3258897-21aten2_r5power_c07:23:591
324663699202,13cyclictest3382249-21apt-get09:29:002
3246636992017,2cyclictest3491111-21aten2_r5power_c11:19:002
3246636992017,2cyclictest3373285-21kthreadcore09:19:062
3246636992017,2cyclictest3371635-21unixbench_multi09:14:192
3246636992017,2cyclictest3371635-21unixbench_multi09:14:192
3246636992017,2cyclictest3263910-21aten2_r5power_p07:29:002
3246636992016,3cyclictest3476345-21fschecks_count11:04:012
3246636992016,2cyclictest3283839-21fschecks_count07:49:022
3246636992016,2cyclictest0-21swapper/210:00:002
3246636992013,5cyclictest3297634-21grep07:59:172
3246636992011,7cyclictest3530344-21cat11:55:002
324663699201,14cyclictest3303216-21apt-get08:08:582
3246632992016,2cyclictest0-21swapper/110:09:181
3246636991915,2cyclictest3516265-21fschecks_time11:44:032
3246636991915,2cyclictest0-21swapper/209:00:002
3246636991913,4cyclictest0-21swapper/208:30:012
3246636991911,6cyclictest3436192-21sed10:20:022
324663299192,12cyclictest3506093-21apt-get11:33:591
32490972180,2sleep20-21swapper/207:14:072
324663699189,8cyclictest3559439-21mailstats12:24:132
324663699183,8cyclictest3549472-21ntpq12:14:132
324663699182,12cyclictest3401943-21apt-get09:48:582
3246636991814,2cyclictest3332987-21cpuspeed_turbos08:38:592
3246636991814,2cyclictest0-21swapper/207:54:122
3246636991812,4cyclictest3486880-21tr11:14:042
324663699180,16cyclictest3350523-21tr08:54:072
3246632991815,2cyclictest0-21swapper/108:19:041
3246632991814,2cyclictest0-21swapper/108:49:151
324663699176,7cyclictest3496033-21apt-get11:23:592
324663699172,12cyclictest3456342-21apt-get10:43:582
324663699172,11cyclictest3268964-21diskstats07:34:012
324663699171,12cyclictest3425459-21ntpq10:09:152
324663699162,10cyclictest3400831-21ntpq09:44:132
3246636991613,2cyclictest0-21swapper/210:00:362
324663699161,11cyclictest3481230-21apt-get11:08:592
34557542152,9sleep30-21swapper/310:40:003
33047092156,5sleep30-21swapper/308:09:063
3246636991512,2cyclictest3565334-21aten2_r5power_e12:33:592
34711002142,8sleep30-21swapper/310:58:583
34458822142,7sleep30-21swapper/310:30:013
35690022133,7sleep30-21swapper/312:34:113
35367202134,5sleep30-21swapper/312:04:063
34308882132,7sleep30-21swapper/310:15:013
33662642132,7sleep30-21swapper/309:09:123
33412602132,7sleep30-21swapper/308:44:093
35592912122,6sleep30-21swapper/312:24:123
35514522122,6sleep30-21swapper/312:19:063
35458682122,6sleep30-21swapper/312:14:013
35262312122,6sleep30-21swapper/311:54:033
35094002122,6sleep30-21swapper/311:34:103
34960002125,4sleep30-21swapper/311:23:533
34662402122,6sleep30-21swapper/310:54:003
34613052122,6sleep30-21swapper/310:48:593
34572262122,6sleep30-21swapper/310:44:053
34312792122,6sleep30-21swapper/310:17:013
34219642122,6sleep30-21swapper/310:09:033
34114602122,6sleep30-21swapper/309:55:233
34060632122,6sleep30-21swapper/309:49:173
33973602122,6sleep30-21swapper/309:44:033
33816812122,6sleep30-21swapper/309:25:013
33801082122,6sleep30-21swapper/309:24:093
33727322122,6sleep30-21swapper/309:19:043
33562502122,6sleep30-21swapper/308:59:093
33501222122,6sleep30-21swapper/308:54:083
33420652122,5sleep30-21swapper/308:45:013
33280722123,5sleep30-21swapper/308:34:023
33022772122,6sleep30-21swapper/308:04:183
32937692122,6sleep30-21swapper/307:59:033
32780972122,6sleep30-21swapper/307:40:013
32737192122,6sleep30-21swapper/307:39:013
32684482122,6sleep30-21swapper/307:30:543
35701002112,5sleep30-21swapper/312:38:133
35601742112,6sleep30-21swapper/312:26:373
35406592113,5sleep30-21swapper/312:08:353
35406592113,5sleep30-21swapper/312:08:353
35306202112,5sleep30-21swapper/311:55:473
35208122112,5sleep30-21swapper/311:48:583
35159532112,5sleep30-21swapper/311:44:003
35145812112,5sleep30-21swapper/311:39:103
35006812112,5sleep30-21swapper/311:25:543
34811212112,5sleep30-21swapper/311:07:573
34758162112,5sleep30-21swapper/311:00:553
34468272112,5sleep30-21swapper/310:34:023
34363912112,6sleep30-21swapper/310:21:183
34166322112,6sleep30-21swapper/310:03:453
34062882112,5sleep30-21swapper/309:50:013
33917292112,6sleep30-21swapper/309:35:083
33868532113,5sleep30-21swapper/309:30:393
33576142112,5sleep30-21swapper/309:03:593
33326572112,5sleep30-21swapper/308:37:593
33229372112,6sleep30-21swapper/308:29:003
33176992112,5sleep30-21swapper/308:20:103
33129072112,5sleep30-21swapper/308:17:013
33080122112,5sleep30-21swapper/308:12:313
32883022112,5sleep30-21swapper/307:52:173
32832232112,6sleep30-21swapper/307:45:083
32632902112,5sleep30-21swapper/307:25:013
32624792112,5sleep30-21swapper/307:24:083
32517232112,5sleep30-21swapper/307:15:023
32517232112,5sleep30-21swapper/307:15:023
32470472112,6sleep30-21swapper/307:13:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional