You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 00:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 17, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3087606997448,23cyclictest3223726-21latency_hist09:25:010
3087609996151,7cyclictest281-21systemd-journal11:10:001
3087609996047,9cyclictest3253326-21apt-get09:55:011
3087606995931,25cyclictest281-21systemd-journal12:25:410
3087606995133,16cyclictest3238977-21apt-get09:42:250
32644892500,6chrt451irq_work/310:07:293
3087606994938,8cyclictest3337784-21latency_hist11:20:010
3087611994739,6cyclictest281-21systemd-journal10:27:412
3087611994633,10cyclictest3272589-21ntpq10:12:362
3087609994638,6cyclictest3082762-21kworker/u8:1+flush-8:007:47:281
3087606994534,9cyclictest3158472-21ntpq08:17:360
3087606994534,8cyclictest3376624-21ntpq11:57:350
31748332440,3chrt0-21swapper/208:37:292
3087609994436,5cyclictest3233589-21latency_hist09:35:001
3087609994337,4cyclictest3214263-21apt-get09:17:231
3087609994336,5cyclictest3149328-21kworker/u8:3+events_unbound10:02:431
3087606994333,7cyclictest281-21systemd-journal09:30:000
3087606994315,13cyclictest281-21systemd-journal09:00:410
3087611994235,5cyclictest281-21systemd-journal10:00:002
3087611994135,4cyclictest3030332-21kworker/u8:0+flush-8:008:22:422
3087611994134,5cyclictest3232802-21ntpq09:32:342
3087609994133,6cyclictest3094843-21apt-get07:17:231
3087609994027,10cyclictest281-21systemd-journal10:22:411
3087606994020,3cyclictest3099117-21unixbench_multi07:17:440
3087609993926,9cyclictest3119415-21latency_hist07:40:001
3087606993922,15cyclictest0-21swapper/007:40:000
3087606993921,2cyclictest3303098-21systemd-run10:45:010
3087606993919,4cyclictest3183719-21unixbench_singl08:42:430
3087606993919,3cyclictest384-21dbus-daemon09:10:000
3087609993832,4cyclictest3313219-21kworker/u8:4+flush-8:011:42:361
3087611993729,6cyclictest3183250-21ntpq08:42:382
3087609993729,6cyclictest3308482-21/usr/sbin/munin10:52:411
3087609993729,5cyclictest281-21systemd-journal08:16:421
3087606993729,6cyclictest3273371-21latency_hist10:15:020
3087611993631,4cyclictest3149328-21kworker/u8:3+flush-8:008:17:392
3087611993627,7cyclictest281-21systemd-journal08:55:002
3087606993626,8cyclictest3398080-21diskstats12:22:270
308760699362,22cyclictest0-21swapper/011:52:400
3087606993618,4cyclictest3173290-21ntp_kernel_pll_08:32:360
3087609993530,4cyclictest3030332-21kworker/u8:0+flush-8:007:22:431
3087609993530,3cyclictest3417158-21idleruntime-cro12:40:001
3087609993529,4cyclictest3373191-21cut11:57:261
3087609993525,8cyclictest3391715-21ntpq12:12:361
308760699358,5cyclictest3166095-21tr08:27:320
308760699358,5cyclictest3166095-21tr08:27:320
3087606993526,7cyclictest3308081-21latency_hist10:50:010
3087606993518,2cyclictest0-21swapper/008:37:270
3087609993428,4cyclictest3139874-21apt-get08:02:241
3087609993428,4cyclictest3030332-21kworker/u8:0+flush-8:007:52:421
3087609993427,5cyclictest3313218-21kworker/u8:3+events_unbound11:27:261
3087609993427,5cyclictest3208920-21kworker/u8:2+events_unbound09:30:001
3087606993425,6cyclictest3312990-21latency_hist10:55:010
308760699342,31cyclictest0-21swapper/007:52:430
3087611993328,4cyclictest3233421-21kworker/u8:0+flush-8:010:07:422
3087611993326,5cyclictest281-21systemd-journal07:30:002
3087611993325,6cyclictest281-21systemd-journal09:45:002
3087609993328,3cyclictest3030332-21kworker/u8:0+flush-8:008:42:421
3087609993326,5cyclictest3313219-21kworker/u8:4+events_unbound11:15:011
3087609993326,5cyclictest3271007-21kthreadcore10:12:331
3087606993326,5cyclictest3030332-21kworker/u8:0+flush-8:008:22:480
3087606993322,8cyclictest281-21systemd-journal11:35:000
3087609993228,3cyclictest3082762-21kworker/u8:1+flush-8:007:40:351
3087609993227,4cyclictest3030332-21kworker/u8:0+events_unbound07:32:411
3087609993227,4cyclictest3030332-21kworker/u8:0+events_unbound07:32:411
3087609993226,5cyclictest3313219-21kworker/u8:4+flush-8:012:02:341
3087609993226,4cyclictest3204677-21fschecks_time09:07:271
3087609993226,4cyclictest3203920-21cron09:05:001
3087609993225,5cyclictest3401645-21kworker/u8:0+flush-8:012:27:401
3087609993223,6cyclictest281-21systemd-journal09:23:411
3087606993226,4cyclictest3030332-21kworker/u8:0+flush-8:008:12:310
3087606993221,1cyclictest0-21swapper/007:32:420
3087606993221,1cyclictest0-21swapper/007:32:420
30828392324,9sleep20-21swapper/207:06:062
3087611993125,4cyclictest3293151-21kworker/u8:2+events_unbound10:35:002
3087609993126,3cyclictest384-21dbus-daemon10:00:001
3087609993126,3cyclictest0-21swapper/109:40:001
3087609993125,4cyclictest3372462-21cron11:55:001
3087609993125,4cyclictest3174487-21apt-get08:37:241
3087609993123,6cyclictest3149328-21kworker/u8:3+events_unbound09:12:381
3087609993122,7cyclictest3173378-21ntpq08:32:381
3087609993121,7cyclictest3169117-21latency_hist08:30:011
3087609993121,7cyclictest3169117-21latency_hist08:30:001
3087606993124,5cyclictest281-21systemd-journal12:02:090
3087609993026,2cyclictest3268209-21kworker/u8:1+events_unbound10:27:261
3087609993023,5cyclictest3149328-21kworker/u8:3+events_unbound09:47:411
3087606993027,2cyclictest1-21systemd11:04:410
3087606993026,3cyclictest3332804-21cron11:15:000
3087606993022,6cyclictest3092483-21latency_hist07:15:010
3087611992918,8cyclictest281-21systemd-journal07:47:422
3087609992925,2cyclictest3298125-21idleruntime-cro10:40:001
3087609992924,4cyclictest3313219-21kworker/u8:4+flush-8:011:37:421
3087609992924,4cyclictest3313219-21kworker/u8:4+flush-8:011:37:421
3087609992924,3cyclictest3304234-21irqrtprio10:47:301
3087609992924,3cyclictest3188866-21systemd-run08:50:001
3087609992923,4cyclictest3293151-21kworker/u8:2+events_unbound11:22:411
3087609992922,5cyclictest3091828-21ntpq07:12:401
3087609992920,6cyclictest3154245-21latency_hist08:15:011
3087606992925,3cyclictest3340457-21kthreadcore11:22:320
3087606992925,2cyclictest0-21swapper/012:20:000
3087606992922,6cyclictest3293151-21kworker/u8:2+flush-8:011:25:310
3087611992823,4cyclictest3030332-21kworker/u8:0+flush-8:008:57:392
3087609992824,2cyclictest3412246-21cron12:35:001
3087609992821,5cyclictest3087725-21kworker/u8:2+flush-8:007:27:391
3087609992820,6cyclictest3293151-21kworker/u8:2+flush-8:010:57:391
3087606992819,7cyclictest281-21systemd-journal12:35:000
3087606992813,13cyclictest3067693-21kworker/0:2+events07:42:250
308760699281,25cyclictest3203970-21kworker/0:1+events09:37:370
3087611992724,2cyclictest3408041-21fschecks_time12:32:272
3087611992723,3cyclictest3388312-21fschecks_time12:12:272
3087611992722,3cyclictest3358365-21fschecks_count11:42:262
3087611992711,4cyclictest0-21swapper/207:12:362
3087609992720,5cyclictest3030332-21kworker/u8:0+events_unbound08:52:281
3087606992723,3cyclictest19289-21cron09:55:000
3087606992722,4cyclictest3233380-21unixbench_singl09:32:410
308760699271,25cyclictest3203970-21kworker/0:1+events10:56:370
3087611992623,2cyclictest3110006-21aten2_r5power_p07:32:262
3087611992623,2cyclictest3110006-21aten2_r5power_p07:32:252
3087611992622,3cyclictest3119401-21cron07:39:592
3087611992621,3cyclictest3213825-21turbostat.cron09:15:002
3087609992623,2cyclictest3298852-21cut10:42:261
3087609992622,3cyclictest3149328-21kworker/u8:3+flush-8:009:42:421
3087609992622,2cyclictest0-21swapper/108:07:411
3087609992620,4cyclictest3392901-21apt-get12:17:241
3087609992620,4cyclictest3149328-21kworker/u8:3+flush-8:008:22:331
3087609992619,5cyclictest3198726-21apt-get09:00:011
3087609992618,6cyclictest281-21systemd-journal11:47:411
3087606992622,3cyclictest3392456-21cron12:15:000
3087606992622,2cyclictest0-21swapper/007:30:000
3087606992621,2cyclictest0-21swapper/007:57:380
3087606992619,5cyclictest281-21systemd-journal08:46:310
3087606992616,8cyclictest3218034-21ntpq09:17:370
3087606992615,9cyclictest3262702-21ntpq10:02:380
308760699260,25cyclictest3352755-21kworker/0:0+events12:07:250
3087611992522,2cyclictest3199436-21aten2_r5power_c09:02:252
3087611992520,4cyclictest3302577-21kworker/u8:1+events_unbound10:42:412
3087611992516,6cyclictest3377788-21base6412:00:012
3087611992510,4cyclictest0-21swapper/207:42:292
3087609992520,4cyclictest3149328-21kworker/u8:3+flush-8:010:07:411
3087609992519,4cyclictest3082762-21kworker/u8:1+flush-8:007:57:331
3087609992515,7cyclictest3401645-21kworker/u8:0+flush-8:012:22:411
308760699258,15cyclictest3203970-21kworker/0:1+events10:22:370
3087606992519,4cyclictest3355922-21seq11:37:340
3087606992519,4cyclictest3355922-21seq11:37:340
3087611992421,2cyclictest3333338-21aten2_r5power_p11:17:272
3087611992420,3cyclictest3253044-21unixbench_multi09:52:442
3087611992420,2cyclictest3135250-21fschecks_time07:57:292
3087611992417,5cyclictest3313219-21kworker/u8:4+flush-8:012:17:362
3087609992418,3cyclictest0-21swapper/112:07:291
308760999241,20cyclictest3319034-21grep11:02:321
308760999240,9cyclictest421rcuog/211:17:451
308760699249,14cyclictest3352755-21kworker/0:0+events11:49:050
308760699249,14cyclictest3203970-21kworker/0:1+events09:14:130
3087611992320,2cyclictest3367504-21cron11:50:002
3087611992319,3cyclictest3348409-21cpuspeed_turbos11:32:252
3087611992318,4cyclictest3283031-21unixbench_singl10:22:452
3087611992318,3cyclictest3184637-21fschecks_count08:47:282
3087611992318,3cyclictest3103615-21ntpq07:22:392
3087609992317,4cyclictest3347777-21kworker/u8:0+flush-8:011:32:301
308760699232,20cyclictest0-21swapper/009:47:440
3087606992320,2cyclictest3295748-21kthreadcore10:37:330
3087606992318,3cyclictest3323910-21sort11:07:310
3087606992318,3cyclictest0-21swapper/008:57:370
3087606992317,5cyclictest3313219-21kworker/u8:4+flush-8:012:37:180
3087611992217,4cyclictest3377086-21kworker/u8:1+events_unbound12:02:442
3087611992217,3cyclictest3308821-21fschecks_time10:52:282
3087611992216,5cyclictest3283282-21kworker/u8:3+events_unbound10:35:042
3087609992218,2cyclictest0-21swapper/110:32:441
308760699225,16cyclictest3203970-21kworker/0:1+events10:32:350
308760699222,19cyclictest0-21swapper/007:47:420
3087606992218,3cyclictest3148555-21ntp_kernel_pll_08:07:390
3087606992218,3cyclictest3140465-21tr08:02:310
3087606992213,7cyclictest3253963-21/usr/sbin/munin09:57:430
30873942224,11sleep10-21swapper/107:09:421
308761199212,14cyclictest3224152-21apt-get09:27:242
3087611992118,2cyclictest3417154-21cron12:40:002
3087611992116,3cyclictest3095069-21tr07:17:262
3087611992115,5cyclictest3149328-21kworker/u8:3+events_unbound09:22:312
3087611992115,5cyclictest3134226-21unixbench_singl07:52:452
3087606992117,2cyclictest0-21swapper/007:22:240
3087606992116,3cyclictest3362582-21turbostat.cron11:45:000
3087606992116,3cyclictest0-21swapper/010:27:270
3087606992113,6cyclictest3193198-21ps08:52:400
30828732216,8sleep30-21swapper/307:06:313
3087611992017,2cyclictest0-21swapper/211:15:002
3087611992014,4cyclictest3302577-21kworker/u8:1+events_unbound10:47:342
3087611992014,4cyclictest0-21swapper/211:37:412
3087611992014,4cyclictest0-21swapper/211:37:412
308760999203,9cyclictest0-21swapper/110:16:441
3087611991914,3cyclictest3218479-21unixbench_multi09:17:432
3087611991911,6cyclictest3248407-21turbostat.cron09:50:012
3087606991914,3cyclictest0-21swapper/010:15:410
308760699191,14cyclictest3087437-21latency_hist07:10:010
31723822180,3chrt584-21kworker/3:2+events08:32:343
308761199189,7cyclictest3383305-21fschecks_count12:07:262
3087611991814,3cyclictest3082762-21kworker/u8:1+events_unbound08:07:352
3087611991814,2cyclictest0-21swapper/211:27:322
3087611991810,6cyclictest3397830-21apt-get12:22:222
3087611991810,6cyclictest3327868-21cron11:10:002
3087606991814,2cyclictest0-21swapper/010:07:410
308761199177,7cyclictest3318538-21cut11:02:262
3087611991713,3cyclictest3164838-21cpuspeed_turbos08:27:262
3087611991713,3cyclictest3164838-21cpuspeed_turbos08:27:262
3087611991713,2cyclictest0-21swapper/210:57:442
3087611991713,2cyclictest0-21swapper/209:07:302
308761199171,12cyclictest3139874-21apt-get08:02:262
308761199169,5cyclictest3236256-21tr09:37:322
308761199162,2cyclictest0-21swapper/212:27:422
308761199162,2cyclictest0-21swapper/208:10:082
308761199162,13cyclictest0-21swapper/211:52:012
3087611991612,3cyclictest3233421-21kworker/u8:0+events_unbound10:01:502
3087611991612,2cyclictest0-21swapper/211:22:312
3087611991612,2cyclictest0-21swapper/210:17:242
33978332152,9sleep30-21swapper/312:22:233
32483982152,8sleep30-21swapper/309:50:013
32081072156,5sleep30-21swapper/309:07:363
308761199152,12cyclictest0-21swapper/208:30:312
31405942142,8sleep30-21swapper/308:02:323
31041472148,4sleep30-21swapper/307:22:563
33732762132,6sleep30-21swapper/311:57:283
33666092132,7sleep30-21swapper/311:47:373
33382802134,6sleep30-21swapper/311:22:253
32984032132,7sleep30-21swapper/310:40:413
32927102134,5sleep30-21swapper/310:32:463
31941922132,7sleep30-21swapper/308:57:253
31189192130,2sleep3584-21kworker/3:2-mm_percpu_wq07:37:443
34113412122,6sleep30-21swapper/312:32:353
34067862122,6sleep30-21swapper/312:27:413
33924812122,6sleep30-21swapper/312:15:013
33898382122,7sleep30-21swapper/312:12:323
33873262122,6sleep30-21swapper/312:07:443
33684682122,6sleep30-21swapper/311:52:303
33596822122,6sleep30-21swapper/311:42:313
33527422122,6sleep30-21swapper/311:35:013
33527422122,6sleep30-21swapper/311:35:013
33499132122,6sleep30-21swapper/311:32:323
33437042122,6sleep30-21swapper/311:27:313
33237242122,6sleep30-21swapper/311:07:303
33211282122,6sleep30-21swapper/311:02:353
33037552122,6sleep30-21swapper/310:47:273
32976922122,6sleep30-21swapper/310:37:443
32832462120,7sleep30-21swapper/310:25:003
32694072122,6sleep30-21swapper/310:12:323
32340262122,6sleep30-21swapper/309:37:253
32312342122,6sleep30-21swapper/309:32:323
32178522123,5sleep30-21swapper/309:17:353
31797472122,6sleep30-21swapper/308:42:293
31744912122,6sleep30-21swapper/308:37:273
31551482122,6sleep30-21swapper/308:17:293
31443682122,5sleep30-21swapper/308:05:023
31352942122,6sleep30-21swapper/307:57:313
31043462122,6sleep30-21swapper/307:25:013
30948152122,6sleep30-21swapper/307:17:233
30917022122,7sleep30-21swapper/307:12:373
34150302112,5sleep30-21swapper/312:37:333
33778992112,6sleep30-21swapper/312:00:333
33331332112,6sleep30-21swapper/311:16:153
33282572112,5sleep30-21swapper/311:12:023
33172282112,5sleep30-21swapper/310:57:383
33126902112,5sleep30-21swapper/310:52:453
32847402112,6sleep30-21swapper/310:27:333
32736322112,6sleep30-21swapper/310:15:333
32592142112,5sleep30-21swapper/310:02:293
32538582112,6sleep30-21swapper/309:56:033
32487582112,5sleep30-21swapper/309:51:423
32389032112,6sleep30-21swapper/309:41:473
32241242111,6sleep30-21swapper/309:27:223
32191022112,6sleep30-21swapper/309:21:163
32088752111,5sleep30-21swapper/309:10:013
31998432112,6sleep30-21swapper/309:02:313
31937692112,5sleep30-21swapper/308:55:003
31839522112,5sleep30-21swapper/308:45:023
31648642112,5sleep30-21swapper/308:27:283
31648642112,5sleep30-21swapper/308:27:283
31495432112,6sleep30-21swapper/308:10:113
31298892112,6sleep30-21swapper/307:51:293
31248812113,5sleep30-21swapper/307:45:313
31201012112,6sleep30-21swapper/307:42:263
31136212112,5sleep30-21swapper/307:32:353
31136212112,5sleep30-21swapper/307:32:353
31594972102,5sleep30-21swapper/308:20:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional