You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 18:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 16, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36132602700,5chrt0-21swapper/212:32:302
35597052700,2sleep1161rcu_preempt11:37:331
32977902660,3sleep3584-21kworker/3:2-events07:15:033
32977902660,3sleep3584-21kworker/3:2-events07:15:033
3292320996054,4cyclictest3423883-21kworker/u8:3+events_unbound09:22:421
3292320996052,6cyclictest3563010-21kworker/u8:0+flush-8:011:50:001
3292320996050,7cyclictest3527736-21latency_hist11:05:001
3292320995751,4cyclictest3537238-21kworker/u8:2+flush-8:012:32:411
3292320995746,8cyclictest3542771-21apt-get11:20:001
3292316995647,7cyclictest281-21systemd-journal12:35:000
3292320995447,4cyclictest3260549-21kworker/u8:1+flush-8:009:47:461
3292320995346,5cyclictest3260549-21kworker/u8:1+flush-8:009:17:271
3292320995345,6cyclictest3251715-21kworker/u8:0+flush-8:007:22:261
3292320995239,9cyclictest281-21systemd-journal11:45:001
3292320995144,5cyclictest3260549-21kworker/u8:1+events_unbound09:07:271
34665712500,2sleep3584-21kworker/3:2+events10:02:333
33095932500,1sleep03309595-21aten2_r5power_e07:27:270
3292320995044,4cyclictest3587677-21kworker/u8:3+flush-8:012:22:311
3292320995043,5cyclictest3502828-21kworker/u8:2+flush-8:010:47:281
3292320995042,6cyclictest3260549-21kworker/u8:1+events_unbound08:02:391
3292320995038,3cyclictest3611499-21kworker/u8:0+flush-8:012:37:361
3292320994943,5cyclictest3537238-21kworker/u8:2+flush-8:011:22:281
3292320994943,4cyclictest3260549-21kworker/u8:1+flush-8:009:12:281
3292316994944,4cyclictest3318890-21kworker/u8:0+flush-8:007:35:010
3292320994843,4cyclictest3338874-21kworker/u8:0+flush-8:008:42:441
3292320994842,4cyclictest1951005-21kworker/u8:2+events_unbound07:55:001
3292320994841,5cyclictest3537238-21kworker/u8:2+flush-8:011:32:381
3292316994839,6cyclictest3323962-21latency_hist07:40:010
329231699480,46cyclictest3582531-21true12:00:000
3292320994741,5cyclictest3349226-21kworker/u8:3+flush-8:008:12:411
3292320994740,5cyclictest3438285-21kworker/u8:2+events_unbound10:07:291
3292320994739,6cyclictest3423883-21kworker/u8:3+events_unbound09:27:401
3292320994739,6cyclictest3328940-21latency_hist07:45:011
3292320994640,4cyclictest3473136-21kworker/u8:0+flush-8:010:52:291
3292320994639,5cyclictest3349226-21kworker/u8:3+flush-8:008:22:341
3292320994638,6cyclictest3493082-21latency_hist10:30:011
3292316994640,4cyclictest3338874-21kworker/u8:0+flush-8:008:47:290
3292316994637,6cyclictest281-21systemd-journal12:30:000
3292320994539,4cyclictest3518105-21kworker/u8:1+flush-8:011:07:371
3292320994539,4cyclictest3473136-21kworker/u8:0+events_unbound10:42:401
3292320994539,4cyclictest3260549-21kworker/u8:1+flush-8:008:52:321
3292320994439,3cyclictest3260549-21kworker/u8:1+events_unbound08:07:271
3292320994438,5cyclictest3308363-21kworker/u8:3+flush-8:007:32:391
3292320994438,4cyclictest3587677-21kworker/u8:3+flush-8:012:12:441
3292320994438,4cyclictest3587677-21kworker/u8:3+flush-8:012:12:441
3292316994438,5cyclictest3260549-21kworker/u8:1+flush-8:009:52:450
3292316994434,7cyclictest3309103-21latency_hist07:25:010
3292320994338,4cyclictest3587677-21kworker/u8:3+events_unbound12:10:001
3292320994338,3cyclictest3438285-21kworker/u8:2+events_unbound10:02:271
3292320994338,3cyclictest3318890-21kworker/u8:0+flush-8:007:37:301
3292320994338,3cyclictest3260549-21kworker/u8:1+events_unbound10:17:431
3292320994337,4cyclictest3260549-21kworker/u8:1+flush-8:009:02:391
3292320994337,4cyclictest3260549-21kworker/u8:1+events_unbound08:00:001
3292320994331,9cyclictest281-21systemd-journal11:12:391
3292316994336,5cyclictest281-21systemd-journal07:42:220
3292316994333,8cyclictest3528407-21diskstats11:07:270
3292320994236,5cyclictest3338874-21kworker/u8:0+flush-8:008:27:391
3292320994236,5cyclictest1951005-21kworker/u8:2+flush-8:007:47:431
3292320994235,5cyclictest3260549-21kworker/u8:1+events_unbound08:17:381
3292320994235,5cyclictest3260549-21kworker/u8:1+events_unbound08:17:381
3292316994235,5cyclictest281-21systemd-journal11:33:190
329231699421,39cyclictest3413511-21munin-run09:10:010
3292320994138,2cyclictest3563010-21kworker/u8:0+events_unbound11:52:401
3292320994136,3cyclictest3438285-21kworker/u8:2+events_unbound10:00:011
3292320994135,4cyclictest3587677-21kworker/u8:3+events_unbound12:17:291
3292320994134,5cyclictest3438285-21kworker/u8:2+events_unbound09:52:381
3292320994133,5cyclictest3338874-21kworker/u8:0+events_unbound08:37:421
3292320994034,4cyclictest3518105-21kworker/u8:1+events_unbound11:30:011
3292320994033,5cyclictest3563010-21kworker/u8:0+events_unbound11:57:301
329232799398,15cyclictest0-21swapper/210:52:242
3292316993929,8cyclictest3588128-21diskstats12:07:290
3292316993928,9cyclictest281-21systemd-journal10:35:000
3292320993833,3cyclictest3260549-21kworker/u8:1+events_unbound08:57:351
3292320993832,5cyclictest3260549-21kworker/u8:1+events_unbound10:32:271
3292320993832,4cyclictest3587677-21kworker/u8:3+events_unbound12:27:291
3292320993832,4cyclictest3260549-21kworker/u8:1+flush-8:008:32:361
3292320993832,4cyclictest1951005-21kworker/u8:2+events_unbound07:12:291
3292320993831,5cyclictest3260549-21kworker/u8:1+flush-8:009:42:321
3292327993621,13cyclictest0-21swapper/208:30:002
3292327993618,16cyclictest3343770-21cron08:00:002
3292320993630,4cyclictest3518105-21kworker/u8:1+events_unbound11:00:011
3292320993630,4cyclictest3260549-21kworker/u8:1+flush-8:008:47:401
3292316993630,4cyclictest3368847-21cut08:25:000
3292316993627,7cyclictest3349398-21/usr/sbin/munin08:07:360
3292320993529,4cyclictest3518105-21kworker/u8:1+flush-8:012:02:271
3292320993525,7cyclictest281-21systemd-journal09:37:551
3292316993531,3cyclictest3438285-21kworker/u8:2+flush-8:010:02:280
3292316993530,4cyclictest3537238-21kworker/u8:2+flush-8:011:37:450
3292316993530,4cyclictest3260549-21kworker/u8:1+events_unbound08:17:420
3292316993530,4cyclictest3260549-21kworker/u8:1+events_unbound08:17:420
3292327993425,6cyclictest281-21systemd-journal12:05:002
3292320993427,5cyclictest1951005-21kworker/u8:2+flush-8:007:17:401
3292320993427,5cyclictest1951005-21kworker/u8:2+flush-8:007:17:401
3292316993430,3cyclictest3260549-21kworker/u8:1+events_unbound08:05:000
3292316993429,4cyclictest3260549-21kworker/u8:1+flush-8:007:57:380
3292316993424,7cyclictest3398634-21latency_hist08:55:010
3292320993327,5cyclictest3260549-21kworker/u8:1+flush-8:010:12:361
3292320993327,5cyclictest3260549-21kworker/u8:1+flush-8:010:12:361
3292316993329,3cyclictest3518105-21kworker/u8:1+flush-8:012:04:000
3292316993327,4cyclictest3458827-21apt-get09:57:220
3292316993326,5cyclictest3482431-21ntpq10:17:370
329232799322,23cyclictest3508356-21apt-get10:47:252
3292327993221,9cyclictest3507933-21cat10:45:002
3292327993218,12cyclictest3568258-21aten2_r5power_v11:47:262
329232799321,11cyclictest3303382-21ntpq07:17:382
329232799321,11cyclictest3303382-21ntpq07:17:372
3292316993227,4cyclictest1951005-21kworker/u8:2+flush-8:007:52:450
3292316993223,6cyclictest3373688-21latency_hist08:30:010
3292327993121,8cyclictest3537602-21apt-get11:15:002
329232799311,24cyclictest3493508-21apt-get10:32:252
3292316993128,2cyclictest3333912-21systemd-run07:50:000
3292316993126,3cyclictest3537238-21kworker/u8:2+flush-8:011:26:450
3292316993123,6cyclictest3503396-21/usr/sbin/munin10:42:360
3292316993121,7cyclictest3423563-21latency_hist09:20:000
3292327993026,2cyclictest3488887-21fschecks_count10:27:282
329232799302,22cyclictest3292643-21apt-get07:12:232
3292327993018,9cyclictest3413555-21cp09:10:002
3292327993015,12cyclictest3374428-21fschecks_time08:32:272
3292327993015,12cyclictest0-21swapper/211:37:252
3292327993014,14cyclictest3379340-21uniq08:37:272
3292327993014,14cyclictest0-21swapper/210:12:432
3292327993014,14cyclictest0-21swapper/210:12:432
3292316993026,3cyclictest3537590-21cron11:15:000
3292316993026,3cyclictest3438285-21kworker/u8:2+events_unbound09:47:370
3292316993025,4cyclictest3473136-21kworker/u8:0+flush-8:010:36:450
3292316993024,4cyclictest3542931-21base6411:20:000
3292316993023,5cyclictest281-21systemd-journal09:12:520
3292316993020,8cyclictest3468715-21/usr/sbin/munin10:07:360
3292316993020,8cyclictest3399309-21diskstats08:57:260
3292316993019,9cyclictest0-21swapper/008:45:000
329232799293,21cyclictest3601609-21ntpq12:17:402
3292327992925,2cyclictest3429055-21aten2_r5power_p09:27:272
329232799291,9cyclictest3318241-21ntpq07:32:372
329232799291,5cyclictest3439052-21apt-get09:37:242
3292327992914,13cyclictest3578303-21fschecks_time11:57:272
329232799291,2cyclictest3453870-21apt-get09:52:242
3292316992926,2cyclictest3527734-21awk11:05:000
3292316992925,3cyclictest3260549-21kworker/u8:1+flush-8:009:28:240
3292316992923,5cyclictest3260549-21kworker/u8:1+flush-8:008:31:110
3292327992824,2cyclictest3444085-21aten2_r5power_e09:42:262
329232799281,8cyclictest3482277-21/usr/sbin/munin10:17:352
3292327992814,12cyclictest0-21swapper/212:07:382
3292327992813,13cyclictest0-21swapper/212:25:022
329232799280,26cyclictest3323727-21grep07:37:422
3292320992823,3cyclictest3314032-21cron07:30:001
3292320992818,2cyclictest161rcu_preempt10:37:311
329157422821,3sleep0452-21mta-sts-daemon07:07:420
329232799279,16cyclictest0-21swapper/211:20:002
329232799271,9cyclictest3304578-21/usr/sbin/munin07:22:232
329232799271,8cyclictest3353247-21ntpq08:07:392
3292327992714,11cyclictest0-21swapper/207:47:252
3292327992713,12cyclictest0-21swapper/210:57:372
3292327992713,12cyclictest0-21swapper/208:05:002
3292327992710,15cyclictest3362617-21tr08:17:342
3292327992710,15cyclictest3362617-21tr08:17:342
3292327992710,15cyclictest0-21swapper/211:02:332
329232799270,24cyclictest3400566-21cut08:57:312
3292316992722,4cyclictest3260549-21kworker/u8:1+flush-8:009:31:450
3292316992711,14cyclictest3473137-21kworker/0:3+events11:51:350
329232799266,18cyclictest3556867-21sed11:32:342
329232799263,18cyclictest3437677-21ntpq09:32:372
3292327992621,3cyclictest3338561-21unixbench_multi07:52:432
329232799261,9cyclictest3417907-21ntpq09:12:382
329232799261,8cyclictest3548581-21/usr/sbin/munin11:27:262
329232799261,8cyclictest3462521-21/usr/sbin/munin09:57:342
329232799261,7cyclictest3593088-21/usr/sbin/munin12:12:302
329232799261,7cyclictest3593088-21/usr/sbin/munin12:12:292
3292327992616,9cyclictest3469054-21fschecks_time10:07:292
329232799261,4cyclictest3384899-21/usr/sbin/munin08:42:322
329232799261,21cyclictest3328231-21ntpq07:42:382
329232799260,9cyclictest3528658-21/usr/sbin/munin11:07:292
329232799260,9cyclictest3419482-21/usr/sbin/munin09:17:282
329232799260,8cyclictest3498938-21/usr/sbin/munin10:37:292
329232799260,3cyclictest3367808-21/usr/sbin/munin08:22:362
3292320992617,7cyclictest3437641-21ntpq09:32:361
3292316992622,3cyclictest3424237-21cpuspeed_turbos09:22:280
3292316992621,3cyclictest3537238-21kworker/u8:2+flush-8:012:21:100
3292316992621,3cyclictest3502828-21kworker/u8:2+flush-8:010:55:000
3292316992619,6cyclictest3338874-21kworker/u8:0+flush-8:009:40:020
3292316992617,7cyclictest3444276-21diskstats09:42:280
3292316992616,7cyclictest281-21systemd-journal11:50:000
329232799259,13cyclictest0-21swapper/210:22:322
329232799257,16cyclictest3610569-21cut12:27:312
329232799252,18cyclictest3313326-21ntpq07:27:402
329232799251,9cyclictest3617583-21/usr/sbin/munin12:37:232
329232799251,8cyclictest3463780-21/usr/sbin/munin10:02:232
329232799251,7cyclictest3573314-21/usr/sbin/munin11:52:252
3292327992513,10cyclictest0-21swapper/208:52:412
329232799250,7cyclictest3543457-21/usr/sbin/munin11:22:242
329232799250,3cyclictest3448969-21/usr/sbin/munin09:47:282
3292320992520,3cyclictest3488170-21latency_hist10:25:011
3292316992520,4cyclictest3547723-21unixbench_singl11:22:430
329232799246,15cyclictest0-21swapper/208:12:282
329232799244,7cyclictest3404081-21cut09:02:262
329232799241,8cyclictest3428338-21/usr/sbin/munin09:22:442
329232799241,19cyclictest3566944-21ntpq11:42:352
3292316992419,3cyclictest3598016-21cpuspeed_turbos12:17:290
3292316992417,4cyclictest0-21swapper/009:02:250
3292316992411,10cyclictest281-21systemd-journal10:27:400
329232799230,7cyclictest3389417-21seq08:47:282
329231699236,3cyclictest35185952fw_packets10:57:280
3292316992320,2cyclictest3301776-21kthreadcore07:17:340
3292316992320,2cyclictest3301776-21kthreadcore07:17:340
3292316992318,4cyclictest3621826-21unixbench_multi12:37:430
3292316992318,4cyclictest3502828-21kworker/u8:2+events_unbound10:47:260
3292316992315,6cyclictest3537238-21kworker/u8:2+flush-8:011:42:360
3292316992219,2cyclictest3597385-21systemd-run12:15:000
3292316992219,2cyclictest3597385-21systemd-run12:15:000
3292316992218,2cyclictest0-21swapper/008:12:280
3292316992217,4cyclictest3487958-21unixbench_singl10:22:420
3292316992217,3cyclictest0-21swapper/008:37:430
3292316992117,2cyclictest0-21swapper/007:12:400
32875362214,11sleep10-21swapper/107:05:141
3292316991915,3cyclictest3260549-21kworker/u8:1+flush-8:010:12:280
3292316991915,3cyclictest3260549-21kworker/u8:1+flush-8:010:12:280
32881032193,9sleep30-21swapper/307:07:293
32875222174,9sleep20-21swapper/207:05:032
33929762165,8sleep30-21swapper/308:47:403
32964262143,7sleep30-21swapper/307:12:353
34692362132,7sleep30-21swapper/310:07:323
34440012131,7sleep30-21swapper/309:42:243
34208892133,6sleep30-21swapper/309:17:333
33438252132,6sleep30-21swapper/308:00:013
33041712132,6sleep30-21swapper/307:20:013
36213182120,8sleep30-21swapper/312:37:373
36168572122,6sleep30-21swapper/312:32:443
36113862122,6sleep30-21swapper/312:27:343
36045132122,6sleep30-21swapper/312:22:333
35978012122,6sleep30-21swapper/312:17:273
35924292122,6sleep30-21swapper/312:10:013
35924292122,6sleep30-21swapper/312:10:013
35831832122,6sleep30-21swapper/312:02:273
35622672122,6sleep30-21swapper/311:37:433
35554872123,6sleep30-21swapper/311:32:343
35439762122,6sleep30-21swapper/311:22:313
35341942122,6sleep30-21swapper/311:12:323
35286272122,6sleep30-21swapper/311:07:303
35222512122,6sleep30-21swapper/310:57:443
35086032122,6sleep30-21swapper/310:47:283
34834802122,6sleep30-21swapper/310:20:403
34826822122,6sleep30-21swapper/310:17:433
34732372122,6sleep30-21swapper/310:10:013
34732372122,6sleep30-21swapper/310:10:013
34541062122,6sleep30-21swapper/309:52:273
34488042122,6sleep30-21swapper/309:45:413
34419092122,6sleep30-21swapper/309:37:353
34376402122,6sleep30-21swapper/309:32:373
34181392122,6sleep30-21swapper/309:12:433
34085112122,6sleep30-21swapper/309:05:013
33835782122,6sleep30-21swapper/308:40:013
33746142122,6sleep30-21swapper/308:32:313
33687512122,6sleep30-21swapper/308:25:023
33647002122,6sleep30-21swapper/308:22:323
33593082122,6sleep30-21swapper/308:17:273
33593082122,6sleep30-21swapper/308:17:263
33543292122,6sleep30-21swapper/308:12:253
33430642122,6sleep30-21swapper/307:57:363
33285792122,6sleep30-21swapper/307:42:443
35883972112,5sleep30-21swapper/312:07:323
35778682112,5sleep30-21swapper/311:56:093
35729022112,6sleep30-21swapper/311:50:273
35677422112,5sleep30-21swapper/311:45:013
35669642112,5sleep30-21swapper/311:42:383
35481882112,6sleep30-21swapper/311:25:073
35421212112,6sleep30-21swapper/311:17:413
35230422112,5sleep30-21swapper/311:00:403
35131572113,5sleep30-21swapper/310:51:013
35034372112,5sleep30-21swapper/310:42:263
34988132112,6sleep30-21swapper/310:37:293
34934822112,5sleep30-21swapper/310:32:233
34884192112,6sleep30-21swapper/310:25:253
34586692112,5sleep30-21swapper/309:55:403
34288002112,6sleep30-21swapper/309:25:313
34240182112,5sleep30-21swapper/309:22:263
34039882112,5sleep30-21swapper/309:02:243
33990342112,5sleep30-21swapper/308:57:233
33939682112,6sleep30-21swapper/308:50:413
33793952112,6sleep30-21swapper/308:37:293
33493752112,6sleep30-21swapper/308:07:073
33344832112,6sleep30-21swapper/307:52:273
33293702112,5sleep30-21swapper/307:47:253
33194032112,5sleep30-21swapper/307:37:223
33143792112,6sleep30-21swapper/307:31:333
33095432112,5sleep30-21swapper/307:27:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional