You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 22:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 18, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320914921980,2sleep3451irq_work/312:12:323
292333721640,3sleep3584-21kworker/3:2-events07:27:293
299412121070,4sleep2371rcuc/208:37:332
299412121070,4sleep2371rcuc/208:37:332
2905518995953,4cyclictest2073007-21kworker/u8:2+flush-8:007:42:260
2905519995548,5cyclictest2073007-21kworker/u8:2+events_unbound07:27:381
2905519995446,6cyclictest3130917-21kworker/u8:1+flush-8:011:10:001
2905519995346,5cyclictest3050828-21kworker/u8:3+flush-8:010:47:371
2905519995346,5cyclictest2991725-21kworker/u8:1+flush-8:008:52:391
2905519995345,6cyclictest2545837-21kworker/u8:4+flush-8:007:47:411
2905523995035,13cyclictest281-21systemd-journal10:35:002
2905519995043,5cyclictest2967185-21kworker/u8:0+flush-8:009:17:431
2905519995041,7cyclictest2073007-21kworker/u8:2+flush-8:008:22:421
2905519995041,6cyclictest3071398-21latency_hist09:55:011
2905518995038,9cyclictest2990921-21ntpq08:32:340
2905519994943,5cyclictest2991725-21kworker/u8:1+flush-8:009:22:311
2905519994941,6cyclictest2991725-21kworker/u8:1+flush-8:008:57:391
2905519994840,6cyclictest2798536-21kworker/u8:0+events_unbound07:15:021
2905518994742,4cyclictest2927146-21kworker/u8:1+flush-8:007:30:000
2905518994736,9cyclictest3060688-21ntpq09:42:340
2905519994641,4cyclictest3165561-21kworker/u8:0+events_unbound11:37:341
2905519994641,4cyclictest3165561-21kworker/u8:0+events_unbound11:37:341
2905519994638,6cyclictest2967185-21kworker/u8:0+flush-8:009:02:371
2905519994541,2cyclictest3195690-21kworker/u8:0+events_unbound12:32:311
2905519994538,5cyclictest2967185-21kworker/u8:0+flush-8:008:17:371
2905519994538,4cyclictest3195690-21kworker/u8:0+events_unbound12:05:011
2905518994538,5cyclictest2937296-21latency_hist07:40:000
2905518994535,7cyclictest3215455-21latency_hist12:20:010
2905518994533,9cyclictest2932086-21latency_hist07:35:010
2905519994438,5cyclictest2545837-21kworker/u8:4+flush-8:008:02:371
2905519994436,6cyclictest3145986-21kworker/u8:3+flush-8:011:57:371
2905518994435,6cyclictest3140805-21latency_hist11:05:010
2905519994336,5cyclictest3050828-21kworker/u8:3+flush-8:010:32:431
2905519994330,3cyclictest2545837-21kworker/u8:4+flush-8:007:42:401
2905518994334,7cyclictest3022524-21diskstats09:07:270
30265312420,2sleep3471rcuc/309:07:433
2905519994236,4cyclictest3076561-21kworker/u8:0+events_unbound10:07:261
2905519994136,4cyclictest3050828-21kworker/u8:3+flush-8:009:42:251
2905519994135,4cyclictest3076561-21kworker/u8:0+flush-8:011:02:321
2905519994135,4cyclictest2545837-21kworker/u8:4+flush-8:007:57:301
2905519994134,5cyclictest3145986-21kworker/u8:3+flush-8:011:12:271
2905523994036,3cyclictest2545837-21kworker/u8:4+flush-8:007:57:272
2905519994035,4cyclictest3195690-21kworker/u8:0+events_unbound12:17:281
2905519994035,4cyclictest3061471-21kworker/u8:2+flush-8:011:22:281
2905519994035,4cyclictest2991725-21kworker/u8:1+flush-8:009:27:401
2905519994035,4cyclictest2967185-21kworker/u8:0+flush-8:008:32:281
2905519994035,4cyclictest2967185-21kworker/u8:0+events_unbound08:50:021
2905519994034,4cyclictest3076561-21kworker/u8:0+flush-8:010:57:311
2905519994034,4cyclictest3031739-21kworker/u8:2+flush-8:009:37:411
2905519994034,4cyclictest2545837-21kworker/u8:4+flush-8:008:12:401
2905519994033,5cyclictest3145986-21kworker/u8:3+flush-8:011:52:381
2905519994032,6cyclictest3220833-21/usr/sbin/munin12:27:351
2905519994031,7cyclictest2928279-21irqrtprio07:32:281
2905523993933,3cyclictest3076561-21kworker/u8:0+events_unbound10:10:022
2905523993929,8cyclictest281-21systemd-journal10:00:002
2905519993933,4cyclictest3061471-21kworker/u8:2+flush-8:010:17:431
2905518993929,7cyclictest281-21systemd-journal12:35:000
2905519993833,3cyclictest3061471-21kworker/u8:2+flush-8:011:27:301
2905519993832,4cyclictest2073007-21kworker/u8:2+flush-8:007:37:321
2905519993831,5cyclictest3190280-21kworker/u8:1+flush-8:012:37:351
2905519993831,5cyclictest3190280-21kworker/u8:1+flush-8:012:37:351
2905518993834,3cyclictest3076561-21kworker/u8:0+flush-8:010:09:000
2905523993732,4cyclictest3001142-21kworker/u8:2+flush-8:008:42:352
2905519993731,5cyclictest3190280-21kworker/u8:1+flush-8:012:22:361
2905519993731,4cyclictest2991725-21kworker/u8:1+events_unbound09:15:011
2905519993730,5cyclictest3050828-21kworker/u8:3+flush-8:010:22:371
2905518993733,3cyclictest3056273-21kworker/u8:1+flush-8:009:57:260
2905518993728,6cyclictest2971890-21latency_hist08:15:010
2905519993631,3cyclictest3001142-21kworker/u8:2+events_unbound08:42:381
2905519993629,5cyclictest3061471-21kworker/u8:2+events_unbound10:12:371
2905519993629,5cyclictest2798536-21kworker/u8:0+flush-8:007:12:271
2905518993629,5cyclictest3016917-21latency_hist09:00:010
2905519993529,4cyclictest3145986-21kworker/u8:3+flush-8:011:47:301
2905519993529,4cyclictest3056273-21kworker/u8:1+flush-8:009:47:281
2905519993528,5cyclictest2073007-21kworker/u8:2+flush-8:008:27:351
2905519993430,3cyclictest3190280-21kworker/u8:1+flush-8:012:05:311
2905519993430,3cyclictest3190280-21kworker/u8:1+events_unbound12:12:331
2905519993427,5cyclictest3061471-21kworker/u8:2+flush-8:009:57:361
2905519993427,5cyclictest3022275-21apt-get09:07:231
2905519993426,6cyclictest3061471-21kworker/u8:2+flush-8:011:17:381
2905519993420,10cyclictest3115828-21awk10:40:001
2905518993325,6cyclictest281-21systemd-journal08:40:000
2905518993324,7cyclictest3011752-21apt-get08:55:000
2905518993324,6cyclictest2976886-21latency_hist08:20:010
2905523993228,3cyclictest2972123-21kworker/u8:3+flush-8:008:27:452
2905523993227,4cyclictest2967185-21kworker/u8:0+flush-8:009:32:312
2905523993227,4cyclictest2967185-21kworker/u8:0+flush-8:009:32:312
2905519993229,2cyclictest2073007-21kworker/u8:2+events_unbound07:20:421
2905519993226,4cyclictest2545837-21kworker/u8:4+flush-8:007:52:341
2905519993224,6cyclictest3061471-21kworker/u8:2+flush-8:010:42:321
2905518993227,3cyclictest2947246-21systemd-run07:50:010
2905523993127,3cyclictest2910536-21install07:15:012
2905519993126,4cyclictest3145986-21kworker/u8:3+flush-8:011:42:311
2905519993126,4cyclictest2991725-21kworker/u8:1+flush-8:009:30:301
2905519993126,4cyclictest2991725-21kworker/u8:1+flush-8:009:30:301
2905518993125,5cyclictest3061471-21kworker/u8:2+flush-8:012:38:540
2905518993125,5cyclictest3061471-21kworker/u8:2+flush-8:012:38:540
290551899310,28cyclictest2953090-21sshd07:57:300
2905523993024,4cyclictest3052028-21aten2_r5power_p09:37:252
2905523993022,6cyclictest2966673-21unixbench_multi08:07:422
2905523993020,7cyclictest2932519-21cp07:35:002
2905519993025,3cyclictest3081288-21awk10:05:001
2905519993024,5cyclictest3165561-21kworker/u8:0+events_unbound11:32:251
2905518993026,3cyclictest384-21dbus-daemon08:30:000
2905518993025,3cyclictest2996677-21sendmail08:40:000
2905518993025,3cyclictest2996677-21sendmail08:40:000
2905519992925,3cyclictest3061471-21kworker/u8:2+events_unbound10:52:451
2905519992923,4cyclictest2927146-21kworker/u8:1+events_unbound08:07:261
2905518992926,2cyclictest2961762-21unixbench_multi08:02:420
2905518992925,2cyclictest3077021-21fschecks_count10:02:270
2905518992924,4cyclictest2073007-21kworker/u8:2+flush-8:007:14:350
2905518992924,3cyclictest3176130-21aten2_r5power_c11:42:230
2905518992919,8cyclictest3040918-21ntpq09:22:360
31959472280,6sleep20-21swapper/212:02:242
2905523992824,2cyclictest3076561-21kworker/u8:0+events_unbound10:37:382
2905523992823,4cyclictest2798536-21kworker/u8:0+flush-8:007:22:392
2905523992822,4cyclictest3018089-21irqrtprio09:02:312
2905523992822,4cyclictest2971660-21unixbench_singl08:12:432
2905523992821,6cyclictest3129830-21needreboot10:52:342
2905523992820,6cyclictest3161451-21cpuspeed_turbos11:27:252
2905519992822,4cyclictest3061471-21kworker/u8:2+events_unbound10:27:241
29052792282,5sleep00-21swapper/007:09:210
2905523992719,6cyclictest281-21systemd-journal07:50:002
2905518992722,3cyclictest3210032-21unixbench_singl12:12:410
2905518992722,3cyclictest3161541-21fschecks_time11:27:270
2905518992720,5cyclictest3165561-21kworker/u8:0+events_unbound11:37:220
2905518992720,5cyclictest3165561-21kworker/u8:0+events_unbound11:37:220
2905523992620,4cyclictest3023002-21irqrtprio09:07:312
2905523992618,7cyclictest3209439-21needreboot12:12:332
2905519992621,3cyclictest2992431-21fschecks_count08:37:291
2905519992621,3cyclictest2992431-21fschecks_count08:37:281
2905518992622,3cyclictest3130917-21kworker/u8:1+events_unbound11:07:410
2905518992620,5cyclictest3031739-21kworker/u8:2+flush-8:009:37:280
2905518992620,4cyclictest3170427-21unixbench_multi11:32:430
2905523992522,2cyclictest3105711-21unixbench_singl10:27:402
2905523992521,3cyclictest3230290-21cron12:35:002
2905523992520,4cyclictest3165561-21kworker/u8:0+events_unbound11:47:422
2905523992517,6cyclictest3125438-21unixbench_multi10:47:422
2905523992516,7cyclictest2912919-21cpuspeed_turbos07:17:272
2905523992515,8cyclictest3140804-21apt-get11:05:002
2905518992521,2cyclictest3018625-21kthreadcore09:02:320
2905518992520,4cyclictest3185988-21aten2_r5power_c11:52:250
2905518992520,3cyclictest3216474-21irqcore12:22:300
2905518992520,3cyclictest3121480-21fschecks_count10:47:270
2905518992520,3cyclictest0-21swapper/011:00:010
290552399248,8cyclictest29485741kthreadcore07:52:322
2905523992421,2cyclictest3007294-21aten2_r5power_e08:52:232
2905523992420,3cyclictest2991725-21kworker/u8:1+events_unbound08:57:372
2905523992416,6cyclictest3062471-21irqcore09:47:312
290552399241,10cyclictest30440492tr09:27:302
2905518992418,4cyclictest3159925-21wc11:22:360
2905518992417,5cyclictest3066390-21latency_hist09:50:010
2905518992417,5cyclictest2991725-21kworker/u8:1+flush-8:009:12:410
2905518992416,6cyclictest2977303-21/usr/sbin/munin08:22:340
29046792241,15sleep22904713-21/usr/sbin/munin07:07:382
2905523992319,3cyclictest3061471-21kworker/u8:2+flush-8:010:02:422
2905523992319,2cyclictest2987428-21cpuspeed_turbos08:32:252
2905523992318,3cyclictest3214614-21needreboot12:17:362
2905523992318,3cyclictest3086240-21apt10:10:002
2905523992317,4cyclictest3037330-21cpuspeed_turbos09:22:252
2905518992319,2cyclictest0-21swapper/007:20:000
2905518992318,4cyclictest2967185-21kworker/u8:0+flush-8:009:32:010
2905518992318,4cyclictest2967185-21kworker/u8:0+flush-8:009:32:000
2905518992318,3cyclictest0-21swapper/011:17:290
2905518992318,3cyclictest0-21swapper/010:22:290
2905518992317,4cyclictest3112176-21irqrtprio10:37:290
2905518992317,4cyclictest3067572-21irqcore09:52:310
29008502234,12sleep10-21swapper/107:07:211
290552399222,7cyclictest0-21swapper/209:52:382
2905523992219,2cyclictest3235225-21idleruntime-cro12:40:002
2905523992219,2cyclictest3235225-21idleruntime-cro12:40:002
2905523992219,2cyclictest3200903-21aten2_r5power_e12:07:262
2905523992219,2cyclictest3141814-21fschecks_time11:07:282
2905523992218,3cyclictest3215988-21aten2_r5power_p12:22:252
2905523992217,3cyclictest0-21swapper/207:42:312
2905523992216,4cyclictest3097131-21irqcore10:22:302
290552399220,3cyclictest31800722mailstats11:42:402
2905518992218,3cyclictest451-21mta-sts-daemon07:22:280
2905518992218,3cyclictest3110924-21/usr/sbin/munin10:35:000
2905518992217,3cyclictest0-21swapper/010:17:370
2905518992217,3cyclictest0-21swapper/008:07:420
2905518992216,4cyclictest2991725-21kworker/u8:1+events_unbound08:47:300
2905518992216,4cyclictest0-21swapper/009:27:220
2905518992215,5cyclictest3101817-21cut10:27:250
2905518992214,6cyclictest281-21systemd-journal11:57:300
2905518992213,7cyclictest3150929-21latency_hist11:15:010
2905518992212,8cyclictest3129884-21ntpq10:52:360
2905518992210,10cyclictest0-21swapper/011:47:310
2905523992117,3cyclictest2961238-21ntp_kernel_err08:02:342
2905523992116,3cyclictest0-21swapper/210:45:002
2905523992114,6cyclictest3166384-21cpuspeed_turbos11:32:252
2905518992117,2cyclictest0-21swapper/012:07:390
2905518992116,3cyclictest0-21swapper/009:17:440
2905518992115,4cyclictest2073007-21kworker/u8:2+events_unbound07:55:000
290551899210,10cyclictest3225365-21munin-run12:30:000
2905523992016,2cyclictest3002367-21aten2_r5power_p08:47:242
2905523992016,2cyclictest0-21swapper/209:15:002
2905523992015,3cyclictest0-21swapper/209:42:322
2905523992011,7cyclictest3155866-21awk11:20:002
2905518992015,4cyclictest3061471-21kworker/u8:2+flush-8:010:12:390
290552399192,8cyclictest0-21swapper/212:00:012
290552399192,12cyclictest2922622-21apt-get07:27:232
2905523991915,2cyclictest0-21swapper/210:20:002
2905523991913,4cyclictest3157217-21kthreadcore11:22:322
2905518991915,3cyclictest3061471-21kworker/u8:2+flush-8:012:00:310
29012542193,9sleep30-21swapper/307:07:273
290552399183,3cyclictest1511647-21kworker/2:0-events08:22:322
290552399182,11cyclictest3032154-21apt-get09:17:242
2905523991814,2cyclictest3146622-21cpuspeed_turbos11:12:252
2905523991812,4cyclictest0-21swapper/211:37:382
2905523991812,4cyclictest0-21swapper/211:37:382
2905518991814,2cyclictest0-21swapper/010:42:390
290552399178,7cyclictest3190300-21sshd11:53:112
2905523991713,3cyclictest3061471-21kworker/u8:2+flush-8:012:30:002
2905523991713,2cyclictest2936156-21kthreadcore07:37:332
2905523991712,3cyclictest0-21swapper/208:17:432
31162822162,9sleep30-21swapper/310:42:253
2905523991611,3cyclictest0-21swapper/210:57:432
31399842142,8sleep30-21swapper/311:02:353
30672002142,8sleep30-21swapper/309:52:303
32265002133,6sleep30-21swapper/312:32:313
32197712132,7sleep30-21swapper/312:22:413
32128402132,7sleep30-21swapper/312:17:343
31958562132,6sleep30-21swapper/312:02:223
31805932132,6sleep30-21swapper/311:45:003
31010312132,7sleep30-21swapper/310:25:013
30911392132,6sleep30-21swapper/310:15:013
30871562131,8sleep30-21swapper/310:12:283
30076932132,7sleep30-21swapper/308:52:283
29966492132,7sleep30-21swapper/308:40:013
29966492132,7sleep30-21swapper/308:40:003
29906882130,3sleep3584-21kworker/3:2+mm_percpu_wq08:32:333
29620242132,6sleep30-21swapper/308:05:013
29320732132,7sleep30-21swapper/307:35:003
32311082123,5sleep30-21swapper/312:37:283
32311082123,5sleep30-21swapper/312:37:283
32208622122,6sleep30-21swapper/312:27:253
32009172122,6sleep30-21swapper/312:07:273
31908872122,6sleep30-21swapper/311:57:243
31859422122,6sleep30-21swapper/311:52:233
31764772122,6sleep30-21swapper/311:42:283
31699812122,6sleep30-21swapper/311:32:373
31610572122,6sleep30-21swapper/311:25:303
31600162122,7sleep30-21swapper/311:22:383
31414672122,6sleep30-21swapper/311:07:253
31218572122,6sleep30-21swapper/310:47:313
31113492122,6sleep30-21swapper/310:37:253
31021832122,6sleep30-21swapper/310:27:293
30860412122,6sleep30-21swapper/310:07:433
30656042122,6sleep30-21swapper/309:47:363
30515292122,5sleep30-21swapper/309:35:013
30469872122,6sleep30-21swapper/309:32:243
30469872122,6sleep30-21swapper/309:32:243
30463502122,6sleep30-21swapper/309:27:423
30375852122,6sleep30-21swapper/309:22:293
30321872122,6sleep30-21swapper/309:17:273
30127552122,6sleep30-21swapper/308:57:293
30018402122,5sleep30-21swapper/308:45:013
29978692122,6sleep30-21swapper/308:42:293
29809242122,6sleep30-21swapper/308:22:343
29766292122,6sleep30-21swapper/308:17:453
29528152122,7sleep30-21swapper/307:57:283
29331262122,6sleep30-21swapper/307:37:293
29181882122,6sleep30-21swapper/307:22:283
29131362122,6sleep30-21swapper/307:17:313
29062302122,6sleep30-21swapper/307:12:293
31708442112,5sleep30-21swapper/311:35:013
31708442112,5sleep30-21swapper/311:35:013
31511782112,6sleep30-21swapper/311:15:233
31462282112,5sleep30-21swapper/311:10:303
31309112112,6sleep30-21swapper/310:55:293
31300112112,5sleep30-21swapper/310:52:413
31088762112,5sleep30-21swapper/310:32:343
30766712112,6sleep30-21swapper/310:01:373
30716962113,5sleep30-21swapper/309:56:073
30568172112,6sleep30-21swapper/309:41:393
30267832112,5sleep30-21swapper/309:10:013
30173292112,6sleep30-21swapper/309:02:193
29822682112,5sleep30-21swapper/308:27:253
29672432113,5sleep30-21swapper/308:10:523
29618602112,6sleep30-21swapper/308:03:043
29480322112,5sleep30-21swapper/307:52:293
29425282112,6sleep30-21swapper/307:45:153
29414392112,5sleep30-21swapper/307:42:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional