You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 07:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Apr 09, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324599221960,3sleep375-21kworker/3:1-events21:06:253
33446402890,2sleep3471rcuc/322:46:213
33446402890,2sleep3471rcuc/322:46:213
34489812840,6chrt0-21swapper/100:30:011
34192932680,4sleep30-21swapper/300:00:013
34548032600,4sleep375-21kworker/3:1-events00:36:253
3128835995851,5cyclictest3022356-21kworker/u8:4+flush-8:019:11:351
3128835995845,9cyclictest280-21systemd-journal21:05:011
31598402570,5chrt0-21swapper/219:36:352
3128835995746,9cyclictest280-21systemd-journal19:20:001
3128830995634,18cyclictest280-21systemd-journal22:11:200
3128830995538,14cyclictest3175181-21latency_hist19:55:010
3128835995247,4cyclictest3413912-21kworker/u8:3+flush-8:000:21:341
3128835995145,4cyclictest3264281-21kworker/u8:0+events_unbound21:26:341
3128835995145,4cyclictest3215290-21kworker/u8:0+events_unbound21:11:341
3128830995027,21cyclictest3194166-21ntpq20:11:310
3128830995020,16cyclictest3161654-21kthreadcore19:41:260
3128835994942,5cyclictest3234612-21kworker/u8:2+flush-8:022:31:341
3128835994839,7cyclictest3264281-21kworker/u8:0+flush-8:021:46:361
3128830994741,4cyclictest3419384-21kworker/u8:4+events_unbound00:06:200
3128830994730,15cyclictest3320261-21grep22:21:240
3128835994641,3cyclictest3189742-21kworker/u8:3+events_unbound21:31:211
3128835994640,4cyclictest3338197-21kworker/u8:0+events_unbound22:41:221
3128835994640,4cyclictest3189742-21kworker/u8:3+flush-8:020:41:201
3128835994639,5cyclictest3444152-21kworker/u8:1+flush-8:000:31:361
3128835994638,6cyclictest3135809-21kworker/u8:0+flush-8:019:51:351
3128835994541,3cyclictest3329100-21kworker/u8:1+events_unbound23:06:341
3128835994539,4cyclictest3329100-21kworker/u8:1+flush-8:023:16:211
3128840994438,4cyclictest3199947-21gpgv20:20:002
3128835994438,4cyclictest3363766-21kworker/u8:3+events_unbound23:41:191
3128835994337,4cyclictest3389419-21kworker/u8:1+flush-8:000:11:211
3128830994325,15cyclictest3359882-21irqrtprio23:01:320
3128835994237,4cyclictest3234612-21kworker/u8:2+flush-8:022:21:311
3128835994236,4cyclictest3189742-21kworker/u8:3+events_unbound20:26:201
3128835994233,6cyclictest3165339-21latency_hist19:45:011
312883099422,35cyclictest0-21swapper/022:51:230
3128835994136,4cyclictest3293379-21kworker/u8:1+events_unbound22:01:361
3128835994135,4cyclictest3379346-21kworker/u8:2+events_unbound23:51:361
3128830994125,14cyclictest3285033-21fschecks_time21:46:220
3128830994120,19cyclictest3384596-21cpuspeed_turbos23:26:200
312883099411,5cyclictest589-21runrttasks21:51:190
3128835994035,4cyclictest3135809-21kworker/u8:0+events_unbound19:56:191
3128835994034,4cyclictest3215290-21kworker/u8:0+flush-8:020:46:311
3128835994031,6cyclictest280-21systemd-journal21:06:331
3128835993934,3cyclictest3413912-21kworker/u8:3+events_unbound00:16:311
3128835993933,4cyclictest3419384-21kworker/u8:4+events_unbound00:06:341
3128835993932,5cyclictest3234612-21kworker/u8:2+flush-8:022:11:301
3128835993930,7cyclictest3258681-21ntpq21:16:291
3128830993931,5cyclictest3269130-21grep21:26:370
3128830993928,9cyclictest3448054-21ntpq00:26:310
3128835993832,4cyclictest3234612-21kworker/u8:2+flush-8:022:36:311
3128830993823,13cyclictest3343012-21needreboot22:41:290
3128830993820,15cyclictest3304142-21latency_hist22:05:010
3128835993732,3cyclictest3155156-21kworker/u8:1+events_unbound20:01:201
3128835993731,5cyclictest3234612-21kworker/u8:2+flush-8:021:36:311
3128835993731,4cyclictest3338197-21kworker/u8:0+flush-8:022:51:381
3128835993731,4cyclictest3234612-21kworker/u8:2+events_unbound22:46:301
3128835993731,4cyclictest3234612-21kworker/u8:2+events_unbound22:46:301
3128835993731,3cyclictest3234612-21kworker/u8:2+events_unbound22:56:241
3128835993730,5cyclictest3189742-21kworker/u8:3+flush-8:020:11:301
3128830993720,15cyclictest3279371-21cron21:40:000
3128830993719,16cyclictest3433136-21ntpq00:11:290
3128830993719,16cyclictest3239467-21unixbench_multi20:56:360
31285112374,10sleep10-21swapper/119:08:131
3128835993630,4cyclictest3234612-21kworker/u8:2+flush-8:021:41:191
3128835993626,8cyclictest3234057-21ntpq20:51:301
3128830993626,7cyclictest280-21systemd-journal20:20:340
3128830993626,7cyclictest280-21systemd-journal00:20:000
3128835993530,4cyclictest3128688-21kworker/u8:2+events_unbound20:31:311
3128835993530,4cyclictest3128688-21kworker/u8:2+events_unbound20:31:311
3128835993529,4cyclictest3284043-21kworker/u8:3+flush-8:022:26:311
3128835993529,4cyclictest3284043-21kworker/u8:3+flush-8:021:56:301
312883099352,13cyclictest3155777-21chrt19:36:170
312883099350,8cyclictest3329928-21/usr/sbin/munin22:31:250
3128835993427,5cyclictest3389419-21kworker/u8:1+events_unbound23:46:311
312883099342,8cyclictest583-21snmpd23:11:170
3128830993428,4cyclictest3264196-21grep21:21:380
3128830993426,5cyclictest3199909-21latency_hist20:20:000
3128830993414,18cyclictest3358773-21cron23:00:010
3128835993329,3cyclictest3419384-21kworker/u8:4+flush-8:000:36:331
3128835993329,3cyclictest3234612-21kworker/u8:2+events_unbound21:21:351
3128835993328,4cyclictest3379346-21kworker/u8:2+events_unbound23:21:281
3128835993327,4cyclictest3413912-21kworker/u8:3+events_unbound23:56:301
3128830993325,5cyclictest3318973-21latency_hist22:20:010
3128830993318,13cyclictest0-21swapper/023:21:200
3128830993316,15cyclictest3308769-21unixbench_singl22:06:370
3128830993313,18cyclictest3150458-21cron19:30:000
312883099331,30cyclictest3249717-21kworker/0:2+events21:41:140
3128830993312,19cyclictest3189183-21ntpq20:06:300
3128830993312,18cyclictest3234858-21cron20:55:000
312883099331,12cyclictest3245107-21seq21:06:180
3128830993311,19cyclictest1-21systemd19:20:470
3128840993228,2cyclictest3343899-21cron22:45:002
3128840993227,4cyclictest3128688-21kworker/u8:2+flush-8:019:26:352
3128835993227,4cyclictest3379346-21kworker/u8:2+events_unbound23:26:201
312883099321,9cyclictest3452947-21/usr/sbin/munin00:31:310
312883099321,9cyclictest3328489-21/usr/sbin/munin22:26:340
312883099321,8cyclictest3443589-21/usr/sbin/munin00:21:360
312883099321,8cyclictest3374526-21/usr/sbin/munin23:16:200
312883099321,8cyclictest3367834-21/usr/sbin/munin23:06:310
3128830993218,12cyclictest0-21swapper/000:36:220
3128830993216,14cyclictest3420032-21sort00:01:230
3128830993216,14cyclictest0-21swapper/019:31:330
3128830993215,15cyclictest3294665-21aten2_r5power_v21:56:190
3128830993215,15cyclictest0-21swapper/023:36:280
3128830993215,15cyclictest0-21swapper/020:36:240
31240202324,9sleep20-21swapper/219:05:092
3128840993126,3cyclictest3184758-21unixbench_singl20:01:372
3128840993124,5cyclictest401-21dbus-daemon23:35:012
3128840993123,6cyclictest3324307-21base6422:25:012
3128840993123,6cyclictest280-21systemd-journal22:20:002
3128835993125,5cyclictest3189742-21kworker/u8:3+events_unbound20:36:311
3128835993125,4cyclictest3135809-21kworker/u8:0+flush-8:019:36:291
3128830993124,5cyclictest3135809-21kworker/u8:0+flush-8:020:01:340
312883099311,9cyclictest3418293-21ntpq23:56:300
312883099311,9cyclictest3335102-21ps22:36:250
312883099311,9cyclictest3273578-21ntpq21:31:310
312883099311,9cyclictest3250754-21/usr/sbin/munin21:11:230
312883099311,9cyclictest3229294-21/usr/sbin/munin20:46:340
312883099311,8cyclictest3400162-21/usr/sbin/munin23:41:230
312883099311,8cyclictest3136005-21/usr/sbin/munin19:16:180
312883099311,7cyclictest3389958-21/usr/sbin/munin23:31:220
312883099311,10cyclictest3169383-21ntpq19:46:280
3128830993110,6cyclictest3409603-21cut23:51:190
312883099310,8cyclictest3220428-21/usr/sbin/munin20:41:180
312883099310,10cyclictest61350lldpd21:00:220
3128835993020,8cyclictest3293370-21ntpq21:51:311
312883099301,9cyclictest3404896-21/usr/sbin/munin23:46:190
312883099301,8cyclictest3214245-21ntpq20:31:320
312883099301,8cyclictest3214245-21ntpq20:31:320
3128830993013,15cyclictest0-21swapper/019:56:180
312883099301,10cyclictest589-21runrttasks22:46:170
312883099301,10cyclictest589-21runrttasks22:46:170
312883099300,8cyclictest3129239-21/usr/sbin/munin19:11:190
3128835992926,2cyclictest3398601-21proc_pri23:36:341
3128835992925,3cyclictest3189742-21kworker/u8:3+events_unbound20:16:181
3128835992923,5cyclictest3234612-21kworker/u8:2+flush-8:023:01:331
312883099299,2cyclictest0-21swapper/021:16:210
3128830992910,3cyclictest32055622sleep020:26:180
32665052280,5sleep20-21swapper/221:26:262
3128840992824,3cyclictest3333724-21unixbench_singl22:31:392
3128840992824,3cyclictest3174859-21unixbench_singl19:51:362
3128840992824,3cyclictest3169927-21unixbench_singl19:46:362
3128840992824,2cyclictest3384657-21fschecks_count23:26:222
3128840992822,4cyclictest280-21systemd-journal21:00:002
3128835992824,3cyclictest3363766-21kworker/u8:3+events_unbound23:31:211
3128840992723,3cyclictest3150875-21aten2_r5power_e19:31:192
3128840992722,3cyclictest3419119-21idleruntime-cro00:00:002
3128835992723,3cyclictest3128688-21kworker/u8:2+flush-8:019:26:301
3128835992723,3cyclictest3022356-21kworker/u8:4+flush-8:019:31:271
3128835992722,4cyclictest3419384-21kworker/u8:4+events_unbound00:01:201
3128835992722,4cyclictest3308816-21kworker/u8:0+events_unbound22:16:201
3128835992721,5cyclictest3363766-21kworker/u8:3+events_unbound23:11:201
3128840992622,2cyclictest3284024-21grep21:41:352
3128840992622,2cyclictest3210505-21aten2_r5power_c20:31:202
3128840992622,2cyclictest3210505-21aten2_r5power_c20:31:202
3128840992621,3cyclictest3161021-21fschecks_count19:41:222
3128840992522,2cyclictest3190418-21aten2_r5power_e20:11:192
3128840992521,2cyclictest3378821-21cron23:20:002
3128840992518,5cyclictest3379346-21kworker/u8:2+events_unbound23:21:352
3128840992518,5cyclictest280-21systemd-journal23:00:012
31284282252,5sleep00-21swapper/019:07:080
3128840992421,2cyclictest3429639-21cpuspeed_turbos00:11:192
3128840992421,2cyclictest3215494-21aten2_r5power_p20:36:182
3128840992421,2cyclictest3133693-21cron19:15:002
3128835992420,2cyclictest3205204-21cron20:25:001
3128835992419,3cyclictest3155156-21kworker/u8:1+events_unbound19:46:211
3128835992417,5cyclictest3140943-21apt-get19:21:161
312884099238,2cyclictest32078752cut20:26:262
3128840992319,2cyclictest3338197-21kworker/u8:0-ext4-rsv-conversion22:55:002
3128840992319,2cyclictest3298808-21grep21:56:372
3128840992318,4cyclictest3180115-21idleruntime-cro20:00:002
3128840992318,3cyclictest3279054-21unixbench_singl21:36:362
3128840992317,4cyclictest280-21systemd-journal22:30:002
3128840992316,5cyclictest280-21systemd-journal21:20:002
3128840992315,6cyclictest280-21systemd-journal23:51:332
3128835992319,2cyclictest3304707-21cpuspeed_turbos22:06:201
3128835992319,2cyclictest0-21swapper/120:06:231
3128840992219,2cyclictest3220675-21fschecks_count20:41:212
3128835992215,5cyclictest3239516-21grep20:56:371
3128840992118,2cyclictest3369081-21aten2_r5power_c23:11:182
3128840992115,4cyclictest3303825-21unixbench_singl22:01:382
312884099210,18cyclictest3134013-21cut19:15:022
3128840992017,2cyclictest3419816-21fschecks_time00:01:212
3128840992016,2cyclictest3394952-21cpuspeed_turbos23:36:202
3128840992015,3cyclictest3438573-21unixbench_multi00:16:352
3128840992014,4cyclictest3368336-21unixbench_multi23:06:392
3128840992013,5cyclictest3360779-21sshd23:01:332
312884099200,4cyclictest3270211-21hddtemp_smartct21:31:222
3128840991911,6cyclictest3348858-21cron22:50:002
3128840991911,6cyclictest3348858-21cron22:50:002
3128840991910,7cyclictest3446845-21tr00:26:262
31238942192,8sleep30-21swapper/319:05:023
33728132189,6sleep30-21swapper/323:11:303
312884099188,8cyclictest280-21systemd-journal21:00:332
3128840991815,2cyclictest3403924-21unixbench_multi23:41:362
3128840991814,2cyclictest3454252-21aten2_r5power_v00:36:202
3128840991813,4cyclictest3128688-21kworker/u8:2+flush-8:020:06:332
3128840991813,2cyclictest0-21swapper/222:06:282
3128840991812,4cyclictest3229588-21unixbench_multi20:46:362
34515552170,2sleep3471rcuc/300:31:273
32945522172,9sleep30-21swapper/321:56:183
312884099173,8cyclictest3439309-21apt-get00:21:172
3128840991713,3cyclictest3425409-21kthreadcore00:06:242
3128840991713,2cyclictest0-21swapper/200:31:182
3128840991712,3cyclictest3204513-21grep20:21:342
3128840991711,4cyclictest0-21swapper/219:21:212
3128840991710,5cyclictest3291731-21tr21:51:272
3128840991710,5cyclictest3247791-21tr21:06:272
3128840991710,5cyclictest3230651-21sort20:51:202
312884099166,6cyclictest3312357-21kthreadcore22:11:252
3128840991613,2cyclictest0-21swapper/223:49:542
3128840991612,2cyclictest0-21swapper/221:11:202
3128840991611,3cyclictest0-21swapper/222:36:262
312884099161,10cyclictest3259916-21apt-get21:21:182
34294192152,9sleep30-21swapper/300:11:183
32686692142,8sleep30-21swapper/321:26:323
32598912142,7sleep30-21swapper/321:21:193
32104472142,8sleep30-21swapper/320:31:183
32104472142,8sleep30-21swapper/320:31:183
312884099141,2cyclictest32856911kthreadcore21:46:262
33942692132,6sleep30-21swapper/323:35:023
33859782133,6sleep30-21swapper/323:26:273
33052802132,7sleep30-21swapper/322:06:253
32705532132,7sleep30-21swapper/321:31:263
31962352134,5sleep30-21swapper/320:16:263
31604802132,6sleep30-21swapper/319:40:023
31501172132,6sleep30-21swapper/319:26:373
31337312132,6sleep30-21swapper/319:15:013
34383652122,6sleep30-21swapper/300:16:353
34215322122,6sleep30-21swapper/300:01:263
34095802123,6sleep30-21swapper/323:51:193
34046452122,6sleep30-21swapper/323:46:183
34037192122,6sleep30-21swapper/323:41:363
33897802122,6sleep30-21swapper/323:31:213
33831842122,6sleep30-21swapper/323:21:303
33778302122,6sleep30-21swapper/323:16:273
33679912122,6sleep30-21swapper/323:06:373
33591652122,6sleep30-21swapper/323:01:273
33356732122,6sleep30-21swapper/322:36:273
33290872122,5sleep30-21swapper/322:30:013
33280752123,5sleep30-21swapper/322:26:283
33148712122,6sleep30-21swapper/322:16:243
33140182122,6sleep30-21swapper/322:15:003
32999102122,6sleep30-21swapper/322:01:243
32900542122,6sleep30-21swapper/321:51:243
32885302122,6sleep30-21swapper/321:46:353
32781322122,6sleep30-21swapper/321:36:283
32552262121,7sleep30-21swapper/321:16:213
32401512122,6sleep30-21swapper/321:01:083
32349292122,6sleep30-21swapper/320:55:023
32241392122,6sleep30-21swapper/320:41:303
32194742122,6sleep30-21swapper/320:36:363
32058012122,6sleep30-21swapper/320:26:213
32051602122,6sleep30-21swapper/320:24:323
31930942122,6sleep30-21swapper/320:11:283
31810722122,6sleep30-21swapper/320:01:253
31748962122,6sleep30-21swapper/319:51:383
31656592122,6sleep30-21swapper/319:46:163
31511862122,6sleep30-21swapper/319:31:223
31414382122,6sleep30-21swapper/319:21:243
34441462112,5sleep30-21swapper/300:25:023
34436292112,5sleep30-21swapper/300:21:373
34244552112,5sleep30-21swapper/300:06:153
33544232112,5sleep30-21swapper/322:56:213
33495072112,6sleep30-21swapper/322:51:283
33192532112,6sleep30-21swapper/322:20:343
32797482112,5sleep30-21swapper/321:41:173
32540612112,5sleep30-21swapper/321:11:353
32305592112,5sleep30-21swapper/320:51:203
32257862112,5sleep30-21swapper/320:46:233
31854262112,5sleep30-21swapper/320:06:183
31760382112,5sleep30-21swapper/319:56:233
31556872112,6sleep30-21swapper/319:35:323
31293182112,6sleep30-21swapper/319:11:203
33392132102,5sleep30-21swapper/322:40:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional