You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 18:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed May 06, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
397421522170,3sleep375-21kworker/3:1+events09:21:153
39916632870,3sleep20-21swapper/209:41:062
38543662790,5sleep20-21swapper/207:21:092
39818432780,5sleep10-21swapper/109:31:051
39365232780,3sleep375-21kworker/3:1+events08:46:053
3838729997566,7cyclictest3833665-21kworker/u8:2+flush-8:007:31:161
3838733997266,4cyclictest4059386-21kworker/u8:2+flush-8:011:06:162
3838729996858,7cyclictest3964710-21latency_hist09:15:011
3838729996857,8cyclictest3929845-21latency_hist08:40:011
3838729996555,7cyclictest3944916-21latency_hist08:55:011
3838729996151,7cyclictest3949851-21latency_hist09:00:011
3838727995955,3cyclictest3786722-21kworker/u8:3+flush-8:008:26:050
3838729995646,7cyclictest280-21systemd-journal08:19:591
3838729995443,9cyclictest4038913-21apt-get10:30:001
3838727995448,4cyclictest4119052-21apt-get11:50:570
3838729995144,5cyclictest3865680-21apt-get07:35:571
3838729995142,6cyclictest4128837-21latency_hist12:00:001
3838729995141,8cyclictest280-21systemd-journal12:40:001
3838727995146,3cyclictest3989729-21kworker/u8:0+flush-8:010:01:010
3838727995141,8cyclictest3984285-21kworker/u8:3+flush-8:010:51:170
3838729994940,7cyclictest280-21systemd-journal08:35:001
3838727994943,5cyclictest3959975-21kworker/u8:1+flush-8:011:36:130
3838727994940,7cyclictest280-21systemd-journal07:35:010
3838727994842,4cyclictest3959975-21kworker/u8:1+events_unbound10:41:010
38733232470,1chrt3873326-21kthreadcore07:41:040
3838729994738,6cyclictest3905149-21latency_hist08:15:011
3838727994737,8cyclictest4103041-21ntpq11:31:090
41677222460,3sleep20-21swapper/212:36:142
3838727994639,5cyclictest3934827-21latency_hist08:45:010
3838729994539,4cyclictest4009585-21apt-get10:00:561
3838727994535,7cyclictest4009247-21latency_hist10:00:010
39586332440,2sleep3471rcuc/309:06:063
3838727994438,5cyclictest3890552-21kworker/u8:2+events_unbound08:16:160
3838727994438,5cyclictest3865363-21kworker/u8:1+events_unbound07:40:010
3838727994433,8cyclictest3959975-21kworker/u8:1+flush-8:009:41:070
3838729994335,5cyclictest3910308-21kworker/u8:1+flush-8:008:46:011
3838727994339,3cyclictest3959975-21kworker/u8:1+flush-8:010:21:170
3838727994337,4cyclictest3786722-21kworker/u8:3+events_unbound08:00:000
3838729994236,4cyclictest3994750-21apt-get09:45:551
3838729994131,7cyclictest4108825-21latency_hist11:40:011
3838727994130,8cyclictest3890619-21/usr/sbin/munin08:01:150
3838729994035,4cyclictest3843726-21kworker/u8:0+flush-8:007:16:141
3838729994032,6cyclictest3786722-21kworker/u8:3+flush-8:007:51:011
3838727994034,4cyclictest3944174-21kworker/u8:2+flush-8:009:36:150
3838727994034,3cyclictest8550irq/124-ahci[0000:00:12.0]12:16:000
3838733993931,6cyclictest280-21systemd-journal09:20:012
3838729993933,4cyclictest3843726-21kworker/u8:0+flush-8:009:06:011
3838727993934,4cyclictest3843726-21kworker/u8:0+events_unbound08:11:040
3838727993933,4cyclictest4139029-21apt-get12:10:560
3838727993933,4cyclictest3843726-21kworker/u8:0+events_unbound09:16:000
3838729993833,4cyclictest3843726-21kworker/u8:0+flush-8:007:26:011
3838729993833,4cyclictest3786722-21kworker/u8:3+flush-8:007:11:141
3838729993833,4cyclictest3786722-21kworker/u8:3+flush-8:007:11:131
3838729993826,9cyclictest280-21systemd-journal08:25:001
3838727993833,4cyclictest4099141-21kworker/u8:0+flush-8:012:01:160
3838727993833,4cyclictest3843726-21kworker/u8:0+events_unbound07:26:150
3838727993833,3cyclictest3984285-21kworker/u8:3+flush-8:010:16:060
3838727993832,3cyclictest3984285-21kworker/u8:3+events_unbound10:26:010
3838727993827,8cyclictest4149193-21diskstats12:21:010
3838733993726,8cyclictest4084277-21cat11:15:002
3838729993733,3cyclictest3959975-21kworker/u8:1+flush-8:011:16:021
3838729993730,5cyclictest4039463-21apt-get10:30:541
3838727993732,4cyclictest3959975-21kworker/u8:1+events_unbound12:26:000
3838727993731,4cyclictest3843726-21kworker/u8:0+flush-8:007:16:170
3838727993730,5cyclictest3843726-21kworker/u8:0+events_unbound08:21:000
3838727993729,6cyclictest3843726-21kworker/u8:0+flush-8:009:01:050
3838727993729,6cyclictest3843726-21kworker/u8:0+flush-8:009:01:050
3838727993729,6cyclictest3786722-21kworker/u8:3+flush-8:008:36:110
3838727993728,7cyclictest3938875-21ntpq08:46:090
3838729993631,4cyclictest3959975-21kworker/u8:1+flush-8:010:41:151
3838729993630,4cyclictest280-21systemd-journal09:19:161
3838729993628,6cyclictest4113568-21kworker/u8:2+events_unbound12:31:121
3838727993631,4cyclictest3944174-21kworker/u8:2+flush-8:009:26:160
3838727993630,4cyclictest3984285-21kworker/u8:3+flush-8:011:06:000
3838727993630,4cyclictest3879331-21ntpq07:46:090
3838727993629,5cyclictest3989729-21kworker/u8:0+events_unbound10:35:010
3838727993629,5cyclictest280-21systemd-journal07:12:300
3838727993629,5cyclictest280-21systemd-journal07:12:300
3838727993626,8cyclictest3884256-21ntpq07:51:090
383832223625,8sleep20-21swapper/207:07:012
3838733993530,3cyclictest4053973-21apt-get10:44:592
3838733993529,4cyclictest3939750-21gpgv08:50:002
3838729993529,5cyclictest3786722-21kworker/u8:3+flush-8:008:26:151
3838729993529,4cyclictest3999731-21apt-get09:50:561
3838729993529,4cyclictest3959975-21kworker/u8:1+events_unbound10:46:021
3838729993528,4cyclictest3786722-21kworker/u8:3+flush-8:007:56:131
3838729993527,6cyclictest4078936-21cron11:10:001
3838729993431,2cyclictest4083882-21apt-get11:15:011
3838729993428,5cyclictest4099141-21kworker/u8:0+flush-8:011:51:151
3838729993426,6cyclictest280-21systemd-journal09:00:301
3838729993426,6cyclictest280-21systemd-journal09:00:291
3838727993430,3cyclictest3833665-21kworker/u8:2+flush-8:007:21:030
3838727993429,3cyclictest4059386-21kworker/u8:2+flush-8:010:56:140
3838727993429,3cyclictest4059386-21kworker/u8:2+flush-8:010:56:140
3838727993426,6cyclictest4112882-21ntpq11:41:100
3838729993327,4cyclictest4143963-21apt-get12:15:561
3838729993326,5cyclictest280-21systemd-journal09:45:001
3838727993326,5cyclictest4082993-21ntpq11:11:090
3838729993228,3cyclictest3930904-21irqrtprio08:41:041
3838729993227,3cyclictest4134131-21aten2_r5power_e12:05:591
3838729993227,3cyclictest4059386-21kworker/u8:2+flush-8:010:55:001
3838729993227,3cyclictest4059386-21kworker/u8:2+events_unbound10:56:141
3838729993227,3cyclictest4059386-21kworker/u8:2+events_unbound10:56:131
3838729993225,5cyclictest3984810-21apt-get09:35:561
3838729993224,6cyclictest3786722-21kworker/u8:3+flush-8:008:01:011
3838727993227,4cyclictest3989729-21kworker/u8:0+flush-8:010:06:100
3838727993227,4cyclictest3959975-21kworker/u8:1+flush-8:011:15:310
3838727993227,3cyclictest3786722-21kworker/u8:3+events_unbound09:00:000
3838733993125,4cyclictest3843726-21kworker/u8:0+flush-8:008:21:012
3838729993127,3cyclictest3944174-21kworker/u8:2+flush-8:009:21:151
3838729993126,4cyclictest4113568-21kworker/u8:2+flush-8:012:11:151
3838729993126,3cyclictest4069504-21aten2_r5power_v11:00:581
3838729993124,5cyclictest3865363-21kworker/u8:1+flush-8:007:46:101
3838729993122,7cyclictest280-21systemd-journal10:07:281
3838727993127,3cyclictest3944174-21kworker/u8:2+events_unbound09:31:080
3838727993125,5cyclictest4113568-21kworker/u8:2+events_unbound12:40:000
3838727993125,5cyclictest3984285-21kworker/u8:3+flush-8:009:46:080
3838727993124,5cyclictest3910308-21kworker/u8:1+events_unbound08:50:020
3838727993123,6cyclictest4044401-21apt-get10:35:560
3838733993025,3cyclictest4043736-21unixbench_singl10:31:142
3838729993026,3cyclictest4045120-21irqrtprio10:36:041
3838729993025,3cyclictest4113568-21kworker/u8:2+events_unbound12:21:141
3838729993024,5cyclictest4030313-21kthreadcore10:21:051
3838727993026,3cyclictest4059386-21kworker/u8:2+events_unbound11:01:020
3838727993026,3cyclictest3890552-21kworker/u8:2+events_unbound08:10:010
3838727993023,5cyclictest4099141-21kworker/u8:0+events_unbound11:46:110
3838727993022,5cyclictest280-21systemd-journal09:50:010
3838727993020,8cyclictest4058265-21ntpq10:46:100
3838727993020,7cyclictest4024132-21latency_hist10:15:010
3838733992923,5cyclictest401-21dbus-daemon10:00:002
3838733992920,7cyclictest4138708-21cat12:10:002
3838729992924,4cyclictest3984285-21kworker/u8:3+flush-8:011:31:151
3838729992923,5cyclictest3900222-21/usr/sbin/munin08:10:011
3838729992923,5cyclictest3843726-21kworker/u8:0+flush-8:007:21:121
3838727992923,5cyclictest3959975-21kworker/u8:1+events_unbound11:25:000
3838729992824,3cyclictest4133776-21systemd-run12:05:011
3838733992722,3cyclictest3919596-21unixbench_singl08:26:172
3838733992721,4cyclictest4024565-21aten2_r5power_v10:15:592
3838729992721,4cyclictest4094405-21aten2_r5power_v11:25:581
3838727992722,4cyclictest3843726-21kworker/u8:0+events_unbound08:31:090
3838733992621,3cyclictest3850134-21unixbench_singl07:16:172
3838733992620,4cyclictest0-21swapper/212:25:002
3838729992622,3cyclictest4099141-21kworker/u8:0+events_unbound11:46:051
3838729992619,5cyclictest3944174-21kworker/u8:2+events_unbound09:26:081
3838727992622,3cyclictest4099141-21kworker/u8:0+flush-8:012:06:170
3838727992621,3cyclictest3959420-21unixbench_singl09:06:170
3838733992519,5cyclictest3974627-21cat09:25:012
3838729992521,2cyclictest0-21swapper/110:11:091
3838733992421,2cyclictest4009803-21cpuspeed_turbos10:01:002
3838733992420,2cyclictest3890959-21fschecks_time08:01:012
3838733992419,4cyclictest3786722-21kworker/u8:3+flush-8:009:06:152
3838727992419,4cyclictest3944174-21kworker/u8:2+events_unbound09:21:030
3838727992418,4cyclictest4113568-21kworker/u8:2+flush-8:012:31:050
3838727992418,4cyclictest3959975-21kworker/u8:1+flush-8:009:11:020
3838733992320,2cyclictest4054874-21fschecks_time10:46:022
3838733992320,2cyclictest3999020-21unixbench_multi09:46:162
3838733992319,3cyclictest4059697-21cpuspeed_turbos10:51:002
3838733992319,2cyclictest3925424-21cpuspeed_turbos08:35:582
3838733992318,3cyclictest4112848-21needreboot11:41:092
3838733992318,3cyclictest0-21swapper/207:45:002
3838733992317,4cyclictest4101404-21kthreadcore11:31:052
3838733992317,4cyclictest4073659-21unixbench_singl11:01:162
3838733992317,4cyclictest4038567-21unixbench_singl10:26:162
3838733992317,4cyclictest3984133-21unixbench_singl09:31:162
3838729992319,2cyclictest0-21swapper/112:26:071
3838729992319,2cyclictest0-21swapper/107:41:161
3838729992318,4cyclictest4090301-21kthreadcore11:21:061
3838729992318,4cyclictest3984285-21kworker/u8:3+flush-8:010:16:161
3838729992318,3cyclictest3959975-21kworker/u8:1+flush-8:011:41:121
3838729992318,3cyclictest0-21swapper/109:56:151
3838727992318,3cyclictest0-21swapper/011:26:040
38385542232,13sleep03838604-21munin-run07:10:000
3838733992219,2cyclictest4089647-21fschecks_count11:21:022
3838733992219,2cyclictest3975022-21aten2_r5power_p09:25:582
3838733992217,4cyclictest3875855-21fschecks_count07:46:002
3838733992217,3cyclictest0-21swapper/207:40:012
3838733992216,4cyclictest3887612-21kthreadcore07:56:052
3838733992216,4cyclictest3860936-21cpuspeed_turbos07:30:592
3838727992218,2cyclictest0-21swapper/012:00:000
38379632224,10sleep10-21swapper/107:06:161
383873399218,11cyclictest3885127-21cron07:55:002
3838733992117,2cyclictest0-21swapper/212:00:002
3838733992117,2cyclictest0-21swapper/208:20:002
3838733992115,4cyclictest4133424-21unixbench_singl12:01:162
3838733992115,4cyclictest4098502-21unixbench_multi11:26:152
3838733992115,4cyclictest4019810-21fschecks_time10:11:002
3838733992113,6cyclictest3949887-21sendmail-msp09:00:002
3838733992016,2cyclictest4143261-21unixbench_multi12:11:162
3838733992016,2cyclictest4104557-21fschecks_time11:36:012
3838733992016,2cyclictest0-21swapper/211:50:002
3838733992015,3cyclictest3860397-21turbostat.cron07:30:012
383873399192,16cyclictest0-21swapper/212:26:152
3838733991916,2cyclictest3960296-21cpuspeed_turbos09:11:002
3838733991916,2cyclictest3920535-21fschecks_count08:31:002
3838733991915,3cyclictest4068658-21unixbench_multi10:56:162
3838733991915,3cyclictest4068658-21unixbench_multi10:56:162
3838733991915,3cyclictest4045326-21kthreadcore10:36:052
3838733991911,6cyclictest3900755-21cpuspeed_turbos08:10:582
3838733991911,6cyclictest0-21swapper/212:20:002
383873399190,5cyclictest4162789-21runrttasks12:31:132
38382762194,8sleep30-21swapper/307:06:253
3838733991814,3cyclictest0-21swapper/208:54:592
3838733991814,2cyclictest3842404-21kthreadcore07:11:072
3838733991814,2cyclictest3842404-21kthreadcore07:11:072
3838733991813,3cyclictest0-21swapper/208:45:002
403946621711,4sleep30-21swapper/310:30:563
40290332175,8sleep30-21swapper/310:20:003
383873399178,7cyclictest3898519-21tr08:06:062
383873399172,4cyclictest0-21swapper/209:01:102
383873399172,4cyclictest0-21swapper/209:01:102
3838733991712,3cyclictest4033994-21sh10:25:002
38452792165,7sleep30-21swapper/307:15:043
383873399162,2cyclictest0-21swapper/209:50:042
3838733991611,3cyclictest0-21swapper/211:51:072
3838733991611,3cyclictest0-21swapper/210:05:582
383873399161,10cyclictest3986165-21kthreadcore09:36:042
3838733991610,4cyclictest0-21swapper/211:16:062
41127752140,3sleep3451irq_work/311:41:093
41478382132,6sleep30-21swapper/312:16:123
41327302132,7sleep30-21swapper/312:01:073
40829112132,7sleep30-21swapper/311:11:083
40092892132,6sleep30-21swapper/310:00:023
39885612132,7sleep30-21swapper/309:36:103
39754062133,6sleep30-21swapper/309:26:033
39298282132,7sleep30-21swapper/308:40:003
38851622132,6sleep30-21swapper/307:55:023
38644172132,7sleep30-21swapper/307:31:093
41585872122,6sleep30-21swapper/312:30:023
41337782122,5sleep30-21swapper/312:05:023
41241282122,6sleep30-21swapper/311:55:063
41198782123,6sleep30-21swapper/311:51:053
41145692122,6sleep30-21swapper/311:46:033
41078932122,6sleep30-21swapper/311:36:083
40893872122,6sleep30-21swapper/311:21:003
40838932122,5sleep30-21swapper/311:15:023
40737182122,6sleep30-21swapper/311:01:293
40649692122,6sleep30-21swapper/310:56:043
40649692122,6sleep30-21swapper/310:56:033
40593342122,6sleep30-21swapper/310:50:023
40519122122,6sleep30-21swapper/310:41:073
40381502122,6sleep30-21swapper/310:26:143
40239242122,6sleep30-21swapper/310:12:293
40089242122,6sleep30-21swapper/309:56:163
39993582122,6sleep30-21swapper/309:49:303
39798242122,6sleep30-21swapper/309:30:563
39638182122,6sleep30-21swapper/309:11:103
39501982122,6sleep30-21swapper/309:00:593
39501982122,6sleep30-21swapper/309:00:593
39212072122,6sleep30-21swapper/308:31:053
39010052122,6sleep30-21swapper/308:11:033
38934052122,6sleep30-21swapper/308:01:083
38841142122,6sleep30-21swapper/307:51:083
38755942122,6sleep30-21swapper/307:45:593
38751252123,5sleep30-21swapper/307:43:223
38657112122,6sleep30-21swapper/307:36:003
38557512122,6sleep30-21swapper/307:25:563
41636982112,5sleep30-21swapper/312:35:563
41537862112,6sleep30-21swapper/312:25:243
41493132112,5sleep30-21swapper/312:21:033
41390012112,5sleep30-21swapper/312:10:563
40991282112,5sleep30-21swapper/311:30:023
40952182112,5sleep30-21swapper/311:26:053
40766202112,5sleep30-21swapper/311:06:073
40544382112,5sleep30-21swapper/310:45:113
40440672112,5sleep30-21swapper/310:35:013
40293032112,6sleep30-21swapper/310:20:123
40183822112,5sleep30-21swapper/310:06:123
39996342112,5sleep30-21swapper/309:50:023
39902442112,6sleep30-21swapper/309:41:043
39650752112,5sleep30-21swapper/309:16:003
39454882112,5sleep30-21swapper/308:56:013
39405172112,6sleep30-21swapper/308:51:003
39302852112,5sleep30-21swapper/308:41:003
39192992112,5sleep30-21swapper/308:26:163
39101052112,5sleep30-21swapper/308:20:013
39096922112,5sleep30-21swapper/308:16:163
39000762112,6sleep30-21swapper/308:08:253
38507292112,5sleep30-21swapper/307:20:073
38390112112,5sleep30-21swapper/307:11:003
38390112112,5sleep30-21swapper/307:11:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional