You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 20:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Jun 20, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325190922020,2sleep3451irq_work/310:05:413
329304621940,3sleep375-21kworker/3:1+events10:50:293
3070847997563,9cyclictest3074769-21ntpq07:10:340
3070847997057,10cyclictest3292120-21kworker/u8:2+flush-8:011:50:300
31578132690,6sleep30-21swapper/308:35:253
3070852996554,8cyclictest3251362-21ntpq10:05:341
3070852996554,8cyclictest3241480-21ntpq09:55:341
3070852996457,5cyclictest3281971-21latency_hist10:40:001
3070847996254,5cyclictest3182487-21apt-get09:00:210
3070847996151,7cyclictest3306992-21apt-get11:05:000
3070852996048,8cyclictest3306984-21latency_hist11:05:011
3070852996046,10cyclictest1704890-21systemd-journal08:30:251
3070852996046,10cyclictest1704890-21systemd-journal08:30:251
3070847996051,6cyclictest3345961-21kworker/u8:0+flush-8:012:15:360
3070847995951,6cyclictest3051140-21kworker/u8:3+flush-8:007:55:350
3070847995949,8cyclictest3400506-21ntpq12:35:330
3070856995852,4cyclictest3301899-21gpgv11:00:002
3070847995849,7cyclictest3326153-21ntpq11:20:320
3070847995847,8cyclictest3212408-21latency_hist09:30:010
3070847995548,5cyclictest3112654-21kworker/u8:0+flush-8:008:15:270
3070847995548,5cyclictest3112654-21kworker/u8:0+flush-8:008:15:270
3070847995543,9cyclictest3327566-21diskstats11:25:250
3070847995444,7cyclictest3147055-21latency_hist08:25:000
3070847995345,6cyclictest3242409-21latency_hist10:00:010
3070847995342,9cyclictest3246502-21ntpq10:00:340
3070852995241,9cyclictest3091647-21ntpq07:25:331
3070847995246,4cyclictest3267165-21kworker/u8:0+events_unbound10:45:270
3070847995246,4cyclictest3087849-21kworker/u8:0+flush-8:007:30:360
3070847995244,5cyclictest3197329-21latency_hist09:15:020
3070847995241,8cyclictest3362191-21diskstats12:00:250
3070852995144,5cyclictest3296836-21latency_hist10:55:001
3070852995141,8cyclictest3276218-21ntpq10:30:381
3070847995043,5cyclictest3301442-21kworker/u8:1+events_unbound11:40:390
3070847995041,6cyclictest3281044-21ntpq10:35:330
3070852994941,5cyclictest3102496-21latency_hist07:40:011
3070856994844,3cyclictest3172113-21apt-get08:50:012
3070852994842,4cyclictest3112654-21kworker/u8:0+flush-8:009:10:361
3070847994841,5cyclictest3271167-21ntpq10:25:350
3070856994740,5cyclictest3212814-21base6409:30:022
3070856994540,4cyclictest3096909-21kworker/u8:1+flush-8:007:40:402
3070852994536,7cyclictest3117659-21apt-get07:55:201
3070847994536,6cyclictest3351762-21latency_hist11:50:010
3070852994437,5cyclictest3287219-21apt-get10:45:201
3070852994433,8cyclictest1704890-21systemd-journal09:45:241
3070847994437,5cyclictest3187168-21kworker/u8:2+flush-8:009:35:430
3070847994436,6cyclictest3166266-21ntpq08:40:360
3070847994435,6cyclictest3376467-21latency_hist12:15:000
3070847994338,4cyclictest3051140-21kworker/u8:3+events_unbound08:10:400
3070847994338,4cyclictest3051140-21kworker/u8:3+events_unbound08:10:390
3070847994337,5cyclictest3221711-21kworker/u8:0+flush-8:009:40:360
3070847994335,6cyclictest3078280-21kworker/u8:4+flush-8:008:05:430
3070847994334,7cyclictest3312444-21/usr/sbin/munin11:10:390
30658222434,34sleep10-21swapper/107:05:021
3070847994238,3cyclictest3187168-21kworker/u8:2+events_unbound09:30:410
3070847994232,8cyclictest1704890-21systemd-journal07:25:000
3070856994136,4cyclictest3078280-21kworker/u8:4+flush-8:007:20:312
3070852994132,6cyclictest3082638-21latency_hist07:20:011
3070847994136,3cyclictest3112654-21kworker/u8:0+events_unbound08:50:020
3070847994135,4cyclictest3078280-21kworker/u8:4+flush-8:007:50:370
3070852994029,9cyclictest3106601-21ntpq07:40:361
3070847994036,3cyclictest3345961-21kworker/u8:0+events_unbound12:20:390
3070847994034,4cyclictest3096909-21kworker/u8:1+flush-8:007:35:250
3070856993931,6cyclictest3152035-21apt-get08:30:002
3070852993930,7cyclictest3345961-21kworker/u8:0+flush-8:012:20:311
3070847993934,3cyclictest3051140-21kworker/u8:3+flush-8:008:25:380
3070847993933,4cyclictest3096909-21kworker/u8:1+events_unbound07:45:410
3070847993929,7cyclictest3371516-21latency_hist12:10:010
3070852993831,5cyclictest3237677-21kworker/u8:1+flush-8:010:40:421
3070852993830,6cyclictest3297085-21/usr/sbin/munin10:55:391
3070852993830,5cyclictest1704890-21systemd-journal08:25:251
3070852993826,8cyclictest1704890-21systemd-journal11:27:251
3070847993834,3cyclictest3301442-21kworker/u8:1+events_unbound11:35:370
3070847993834,3cyclictest3187168-21kworker/u8:2+events_unbound09:20:380
3070847993832,4cyclictest3051140-21kworker/u8:3+events_unbound08:00:260
3070847993831,5cyclictest3207679-21kworker/u8:3+events_unbound10:20:410
3070847993830,6cyclictest3322076-21latency_hist11:20:010
3070847993829,6cyclictest3232490-21latency_hist09:50:020
3070852993732,3cyclictest3342141-21apt-get11:40:201
3070852993728,7cyclictest3132479-21apt-get08:10:211
3070852993728,7cyclictest3132479-21apt-get08:10:201
3070847993733,3cyclictest3207679-21kworker/u8:3+flush-8:010:30:250
3070847993732,4cyclictest3051140-21kworker/u8:3+events_unbound07:15:350
3070847993731,4cyclictest3147282-21kworker/u8:1+events_unbound08:30:260
3070847993731,4cyclictest3147282-21kworker/u8:1+events_unbound08:30:250
3070847993730,5cyclictest3147282-21kworker/u8:1+flush-8:008:45:370
3070847993729,6cyclictest3391751-21/usr/sbin/munin12:30:310
3070847993727,7cyclictest3361650-21latency_hist12:00:010
30660832373,6sleep20-21swapper/207:05:232
3070852993626,7cyclictest3147282-21kworker/u8:1+flush-8:009:00:361
3070847993632,2cyclictest3292120-21kworker/u8:2+events_unbound11:05:240
3070847993630,4cyclictest3345961-21kworker/u8:0+events_unbound12:25:330
3070847993630,4cyclictest3112654-21kworker/u8:0+events_unbound08:35:380
3070847993629,5cyclictest3237448-21latency_hist09:55:020
307084799361,32cyclictest3192190-21munin-run09:10:000
3070856993530,4cyclictest3112654-21kworker/u8:0+flush-8:008:20:252
3070847993531,3cyclictest3312215-21kworker/u8:3+events_unbound11:30:370
3070847993530,3cyclictest3112654-21kworker/u8:0+events_unbound08:55:240
3070856993427,5cyclictest3292120-21kworker/u8:2+events_unbound10:50:212
3070852993427,5cyclictest1704890-21systemd-journal10:29:251
3070852993427,5cyclictest1704890-21systemd-journal08:43:251
3070852993424,8cyclictest1704890-21systemd-journal11:55:001
3070856993328,4cyclictest3292120-21kworker/u8:2+flush-8:011:20:362
3070856993325,6cyclictest3341463-21grep11:35:422
3070852993328,3cyclictest3247384-21apt10:05:001
3070852993327,4cyclictest3187423-21apt-get09:05:211
3070852993327,4cyclictest3167436-21apt-get08:45:211
3070847993328,4cyclictest3096909-21kworker/u8:1+events_unbound07:40:410
3070856993227,4cyclictest3207679-21kworker/u8:3+flush-8:010:35:342
3070852993225,5cyclictest1704890-21systemd-journal09:32:241
3070852993223,7cyclictest1704890-21systemd-journal07:34:521
3070847993227,4cyclictest3112654-21kworker/u8:0+flush-8:009:15:270
3070856993125,5cyclictest3147282-21kworker/u8:1+flush-8:008:50:362
3070856993123,7cyclictest3187168-21kworker/u8:2+flush-8:009:35:382
3070852993126,3cyclictest3147282-21kworker/u8:1+flush-8:009:25:311
3070852993119,7cyclictest0-21swapper/112:00:361
3070852993116,7cyclictest0-21swapper/109:55:011
3070847993125,4cyclictest3187168-21kworker/u8:2+events_unbound10:05:390
3070856993026,3cyclictest3237677-21kworker/u8:1+flush-8:010:15:262
3070856993025,3cyclictest3107859-21aten2_r5power_v07:45:232
3070856993022,5cyclictest1704890-21systemd-journal09:55:252
307085299308,5cyclictest0-21swapper/111:10:211
3070852993023,5cyclictest1704890-21systemd-journal08:01:251
3070852993010,5cyclictest3336945-21wc11:35:011
3070847993025,4cyclictest3237677-21kworker/u8:1+events_unbound10:40:350
32381482290,6sleep3451irq_work/309:55:273
3070856992925,3cyclictest3078280-21kworker/u8:4+flush-8:007:30:402
3070856992924,3cyclictest3292120-21kworker/u8:2+events_unbound11:15:352
3070852992926,2cyclictest3086838-21proc_pri07:20:381
3070852992925,3cyclictest3201683-21threads09:15:401
3070852992924,3cyclictest3207345-21systemd09:25:011
3070852992921,6cyclictest3107748-21apt-get07:45:201
3070856992824,2cyclictest3247739-21aten2_r5power_p10:05:222
3070856992821,5cyclictest3187737-21fschecks_time09:05:252
307085299285,14cyclictest3263695-21cut10:20:301
3070852992823,3cyclictest3177302-21systemd-run08:54:591
3070847992823,3cyclictest3256875-21unixbench_singl10:10:420
3070847992823,3cyclictest3207679-21kworker/u8:3+flush-8:010:53:560
3070856992723,2cyclictest3222958-21aten2_r5power_p09:40:232
3070856992723,2cyclictest3177587-21aten2_r5power_c08:55:222
3070856992723,2cyclictest3157612-21aten2_r5power_p08:35:222
3070856992722,3cyclictest3386422-21seq12:25:002
3070856992722,3cyclictest3228207-21fschecks_time09:45:262
3070856992721,3cyclictest3376964-21cpuspeed_turbos12:15:222
3070852992723,2cyclictest3347429-21fschecks_time11:45:271
3070852992722,3cyclictest0-21swapper/108:05:251
3070852992713,2cyclictest0-21swapper/111:15:311
3070856992623,2cyclictest3233050-21fschecks_count09:50:232
3070856992622,3cyclictest3292120-21kworker/u8:2+flush-8:011:00:422
3070856992622,2cyclictest3397026-21fschecks_count12:35:242
3070856992620,4cyclictest3207587-21latency_hist09:25:022
3070852992622,2cyclictest3392040-21cut12:30:231
3070852992622,2cyclictest0-21swapper/110:15:321
3070852992621,3cyclictest3162217-21cron08:39:591
3070852992619,5cyclictest3337189-21apt-get11:35:201
3070852992613,2cyclictest589-21runrttasks07:50:221
3070852992612,2cyclictest0-21swapper/108:20:281
3070852992611,3cyclictest0-21swapper/111:20:291
3070847992622,2cyclictest3299662-21runrttasks10:55:310
3070847992621,4cyclictest3237677-21kworker/u8:1+flush-8:010:15:350
3070856992521,3cyclictest3292120-21kworker/u8:2+flush-8:011:40:252
3070856992521,3cyclictest3256822-21unixbench_multi10:10:422
3070856992520,3cyclictest3137707-21fschecks_count08:15:262
3070856992520,3cyclictest3137707-21fschecks_count08:15:252
3070856992519,4cyclictest3212412-21apt-get09:30:032
307085299254,11cyclictest0-21swapper/111:55:371
307085299254,10cyclictest0-21swapper/107:10:221
307085299253,12cyclictest3376061-21tail12:10:421
307085299252,12cyclictest0-21swapper/108:15:381
307085299252,12cyclictest0-21swapper/108:15:381
307085299252,11cyclictest0-21swapper/108:55:211
307085299250,15cyclictest3390560-21awk12:25:321
307085299250,14cyclictest3380560-21ntpq12:15:371
307085299250,14cyclictest3222873-21apt-get09:40:211
307084799252,22cyclictest0-21swapper/007:25:380
31535872240,5sleep3451irq_work/308:30:313
31535872240,5sleep3451irq_work/308:30:303
3070856992420,3cyclictest3372079-21fschecks_count12:10:272
307085299242,9cyclictest30-21ksoftirqd/112:05:291
307085299241,5cyclictest3219155-21kthreadcore09:35:321
307085299241,12cyclictest3257113-21taskset10:13:201
307085299240,13cyclictest3396765-21wget12:35:221
3070856992316,5cyclictest3078280-21kworker/u8:4+flush-8:007:50:312
307085699230,11cyclictest3269187-21cut10:25:302
307085299230,9cyclictest3307438-21latency_hist11:05:001
307085699223,13cyclictest3132479-21apt-get08:10:232
307085699223,13cyclictest3132479-21apt-get08:10:232
3070856992218,2cyclictest3361647-21turbostat.cron11:59:592
3070856992218,2cyclictest0-21swapper/208:05:002
3070856992217,3cyclictest3347300-21cpuspeed_turbos11:45:252
307085699220,12cyclictest3392681-21tr12:30:262
307085699212,3cyclictest31526522cut08:30:252
307085699212,3cyclictest31526522cut08:30:252
3070856992118,2cyclictest3387180-21fschecks_time12:25:252
3070856992118,2cyclictest3312785-21fschecks_time11:10:242
3070856992117,2cyclictest0-21swapper/211:50:202
3070856992117,2cyclictest0-21swapper/208:09:592
3070856992116,4cyclictest3187141-21cron09:05:012
3070856992114,5cyclictest3367799-21kthreadcore12:05:292
3070856992112,7cyclictest3247374-21cron10:05:012
307085699202,13cyclictest3117659-21apt-get07:55:222
3070856992015,4cyclictest3087849-21kworker/u8:0+flush-8:007:25:252
3070856992011,7cyclictest3332564-21fschecks_time11:30:242
3070856992010,7cyclictest3364410-21tr12:00:302
3070856991915,2cyclictest0-21swapper/207:39:522
3070856991914,4cyclictest3112654-21kworker/u8:0+flush-8:008:40:352
3070856991914,3cyclictest3075271-21unixbench_multi07:10:412
3070856991913,4cyclictest3266729-21grep10:20:402
3070856991911,6cyclictest3328241-21kthreadcore11:25:282
30698572192,9sleep03069891-21/usr/sbin/munin07:05:360
3070856991814,2cyclictest0-21swapper/209:10:352
3070856991814,2cyclictest0-21swapper/207:15:402
30703352183,9sleep30-21swapper/307:05:443
31322212170,2sleep3481ktimers/308:09:593
307085699179,6cyclictest3291435-21unixbench_multi10:45:402
3070856991713,2cyclictest0-21swapper/209:15:252
3070856991712,3cyclictest0-21swapper/211:05:312
3070856991712,3cyclictest0-21swapper/210:35:012
3070856991711,3cyclictest0-21swapper/210:40:292
33863462167,5sleep30-21swapper/312:25:003
33922452142,8sleep30-21swapper/312:30:253
33754662132,7sleep30-21swapper/312:10:363
33616342131,8sleep30-21swapper/312:00:003
33084112132,7sleep30-21swapper/311:05:303
32216662132,7sleep30-21swapper/309:35:363
31709882132,7sleep30-21swapper/308:45:333
30973442132,7sleep30-21swapper/307:33:243
34013602122,6sleep30-21swapper/312:39:253
33711342123,6sleep30-21swapper/312:05:423
33418922122,5sleep30-21swapper/311:40:023
33171462122,5sleep30-21swapper/311:15:023
33067682122,6sleep30-21swapper/311:02:253
32910292122,6sleep30-21swapper/310:45:363
32813712122,6sleep30-21swapper/310:35:413
32617372122,6sleep30-21swapper/310:15:423
32526032122,6sleep30-21swapper/310:10:243
32332182122,6sleep30-21swapper/309:50:253
32232452122,6sleep30-21swapper/309:40:273
32077252122,6sleep30-21swapper/309:25:223
31898672122,6sleep30-21swapper/309:05:313
31780372122,6sleep30-21swapper/308:55:283
31725782122,6sleep30-21swapper/308:50:063
31627882123,5sleep30-21swapper/308:40:263
31411372122,7sleep30-21swapper/308:15:353
31411372122,7sleep30-21swapper/308:15:343
31360732122,6sleep30-21swapper/308:10:333
31360732122,6sleep30-21swapper/308:10:333
31217722122,6sleep30-21swapper/307:55:413
31140162122,6sleep30-21swapper/307:50:303
31074552122,5sleep30-21swapper/307:45:013
30878352122,5sleep30-21swapper/307:25:033
30874602123,6sleep30-21swapper/307:23:143
30751262122,6sleep30-21swapper/307:10:423
33868392112,5sleep30-21swapper/312:25:203
33764702112,5sleep30-21swapper/312:15:003
33624002112,6sleep30-21swapper/312:00:273
33520592112,5sleep30-21swapper/311:50:213
33508222112,5sleep30-21swapper/311:45:343
33372202112,5sleep30-21swapper/311:35:243
33322552112,6sleep30-21swapper/311:30:233
33279252110,7sleep30-21swapper/311:25:283
33259712112,5sleep30-21swapper/311:20:313
33164662112,6sleep30-21swapper/311:10:393
33008482112,5sleep30-21swapper/310:55:343
32832962112,5sleep30-21swapper/310:40:293
32732822112,5sleep30-21swapper/310:30:313
32679462112,5sleep30-21swapper/310:25:283
32669012112,6sleep30-21swapper/310:22:003
32463752112,5sleep30-21swapper/310:00:333
32132262112,5sleep30-21swapper/309:30:273
32025702112,5sleep30-21swapper/309:20:243
31975632112,6sleep30-21swapper/309:15:143
31926132112,5sleep30-21swapper/309:10:213
31860812112,5sleep30-21swapper/309:00:333
31472812112,5sleep30-21swapper/308:25:063
31429562112,6sleep30-21swapper/308:20:293
31235022112,5sleep30-21swapper/308:00:303
31082332112,5sleep30-21swapper/307:45:293
31016592112,5sleep30-21swapper/307:35:383
30817062112,5sleep30-21swapper/307:15:353
32278052102,5sleep30-21swapper/309:45:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional