You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 22:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat May 30, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
338192823290,2sleep3481ktimers/310:05:013
32970082850,1chrt3297009-21/usr/sbin/munin08:35:552
32291512680,6sleep20-21swapper/207:30:472
32465812650,6sleep20-21swapper/207:45:482
3205975995746,9cyclictest1704890-21systemd-journal08:15:011
3205977995651,4cyclictest3342188-21kworker/u8:1+flush-8:009:35:562
34317312540,2chrt371rcuc/210:55:002
34317312540,2chrt371rcuc/210:55:002
3205975995348,3cyclictest3242685-21kworker/u8:2+events_unbound08:35:551
3205977995248,3cyclictest3375962-21kworker/u8:2+flush-8:009:55:562
3205975995145,5cyclictest3221805-21kworker/u8:1+flush-8:007:30:571
3205975995044,4cyclictest3242685-21kworker/u8:2+events_unbound08:05:581
3205975995040,8cyclictest3273222-21/usr/sbin/munin08:15:551
3205975994944,3cyclictest3221805-21kworker/u8:1+flush-8:008:00:551
3205975994843,3cyclictest3242685-21kworker/u8:2+events_unbound09:25:581
3205970994837,9cyclictest3460742-21ntpq11:20:490
3205977994743,3cyclictest3351990-21kworker/u8:0+flush-8:009:45:552
3205975994641,4cyclictest3466593-21kworker/u8:2+flush-8:012:25:541
3205975994640,5cyclictest3437136-21kworker/u8:1+flush-8:011:45:561
3205975994639,4cyclictest1704890-21systemd-journal11:15:581
3205975994638,6cyclictest3242685-21kworker/u8:2+flush-8:007:45:521
3205975994539,4cyclictest3466593-21kworker/u8:2+flush-8:011:40:421
3205975994539,4cyclictest3242685-21kworker/u8:2+events_unbound09:05:511
3205975994537,6cyclictest3252797-21cp07:55:001
3205975994537,6cyclictest3252797-21cp07:54:591
3205970994537,7cyclictest3375962-21kworker/u8:2+events_unbound10:15:010
32312792440,4chrt0-21swapper/007:30:490
3205977994440,3cyclictest3530875-21kworker/u8:3+flush-8:012:36:002
3205977994439,4cyclictest3221805-21kworker/u8:1+events_unbound07:35:502
3205975994439,3cyclictest3351990-21kworker/u8:0+events_unbound10:15:581
3205975994438,5cyclictest2370656-21kworker/u8:4+flush-8:007:25:571
3205975994436,6cyclictest3425907-21ntpq10:45:521
3205970994437,5cyclictest3501792-21diskstats12:05:400
3205975994339,3cyclictest3466593-21kworker/u8:2+events_unbound11:50:391
3205975994338,3cyclictest3317490-21kworker/u8:3+events_unbound09:30:581
3205975994337,5cyclictest3342188-21kworker/u8:1+events_unbound09:35:411
3205977994238,3cyclictest3437136-21kworker/u8:1+events_unbound11:15:002
3205975994238,3cyclictest3426429-21kworker/u8:3+flush-8:010:50:521
3205975994238,3cyclictest3426429-21kworker/u8:3+flush-8:010:50:511
3205970994232,8cyclictest1704890-21systemd-journal12:24:590
3205975994135,4cyclictest2370656-21kworker/u8:4+flush-8:007:15:591
3205975994133,6cyclictest3414905-21kworker/u8:2+events_unbound10:35:501
32054972412,32sleep1583-21snmpd07:06:061
3205975994036,3cyclictest3437136-21kworker/u8:1+events_unbound11:10:461
3205975994036,3cyclictest3190847-21kworker/u8:0+events_unbound08:20:411
3205975994036,3cyclictest2369189-21kworker/u8:3+events_unbound07:10:591
3205975994034,4cyclictest3466593-21kworker/u8:2+events_unbound11:35:561
3205975994034,4cyclictest3190847-21kworker/u8:0+events_unbound08:30:451
3205975994033,5cyclictest3437136-21kworker/u8:1+flush-8:011:20:561
3205975994031,7cyclictest3367177-21/usr/sbin/munin09:50:521
3205970994030,8cyclictest3445904-21ntpq11:05:490
3205975993933,5cyclictest3466593-21kworker/u8:2+events_unbound12:10:531
3205975993933,4cyclictest3351990-21kworker/u8:0+events_unbound12:05:531
3205975993933,4cyclictest3242685-21kworker/u8:2+flush-8:008:55:441
3205970993933,4cyclictest1704890-21systemd-journal09:36:150
3205970993929,8cyclictest1704890-21systemd-journal11:59:590
3205977993834,3cyclictest2370656-21kworker/u8:4+events_unbound07:16:022
3205975993832,4cyclictest3190847-21kworker/u8:0+events_unbound09:00:391
3205970993832,4cyclictest3414905-21kworker/u8:2+events_unbound10:45:470
3205975993730,5cyclictest3466593-21kworker/u8:2+flush-8:011:30:511
3205975993730,5cyclictest3351990-21kworker/u8:0+flush-8:011:25:511
3205975993730,5cyclictest3190847-21kworker/u8:0+flush-8:008:40:561
3205975993729,6cyclictest3531123-21/usr/sbin/munin12:35:491
3205975993728,6cyclictest3307852-21/usr/sbin/munin08:50:511
3205970993730,5cyclictest1704890-21systemd-journal09:51:160
3205977993632,3cyclictest3351990-21kworker/u8:0+events_unbound10:35:582
3205975993630,4cyclictest3437136-21kworker/u8:1+events_unbound12:00:411
3205977993531,3cyclictest3366615-21kworker/u8:3+flush-8:009:51:022
3205977993531,3cyclictest3351990-21kworker/u8:0+flush-8:010:11:132
3205975993530,4cyclictest3437136-21kworker/u8:1+events_unbound11:05:561
3205975993530,4cyclictest3351990-21kworker/u8:0+events_unbound12:20:441
3205975993529,4cyclictest3437136-21kworker/u8:1+flush-8:011:55:531
3205975993528,5cyclictest3242685-21kworker/u8:2+flush-8:009:15:541
3205975993528,5cyclictest3242685-21kworker/u8:2+flush-8:009:15:531
3205975993528,5cyclictest3242685-21kworker/u8:2+flush-8:008:45:571
3205975993528,5cyclictest3221805-21kworker/u8:1+flush-8:007:20:541
3205970993528,5cyclictest3436873-21cron11:00:000
3205977993430,3cyclictest3242685-21kworker/u8:2+events_unbound09:21:012
3205975993429,4cyclictest3342188-21kworker/u8:1+events_unbound10:25:501
3205975993429,3cyclictest3516074-21systemd-run12:20:001
3205975993429,3cyclictest3516074-21systemd-run12:19:591
3205975993429,3cyclictest3411136-21ntpq10:30:541
3205975993428,4cyclictest3466593-21kworker/u8:2+events_unbound12:30:511
3205975993428,3cyclictest3351990-21kworker/u8:0+events_unbound11:00:461
3205975993427,5cyclictest3342188-21kworker/u8:1+flush-8:010:40:581
3205970993429,3cyclictest3218756-21irqrtprio07:20:450
32055652344,10sleep20-21swapper/207:07:002
3205975993329,3cyclictest3375962-21kworker/u8:2+events_unbound09:56:001
3205975993328,3cyclictest3375962-21kworker/u8:2+events_unbound10:10:421
3205970993324,6cyclictest1704890-21systemd-journal10:20:010
3205977993227,3cyclictest3437136-21kworker/u8:1+events_unbound11:15:032
3205975993228,3cyclictest3242685-21kworker/u8:2+events_unbound09:10:451
3205975993228,3cyclictest3190847-21kworker/u8:0+events_unbound08:26:001
3205975993226,4cyclictest3414905-21kworker/u8:2+events_unbound10:55:531
3205975993220,5cyclictest3375962-21kworker/u8:2+flush-8:010:00:431
3205977993127,3cyclictest3242685-21kworker/u8:2+events_unbound09:18:052
3205977993127,3cyclictest3242685-21kworker/u8:2+events_unbound09:18:052
3205975993125,4cyclictest3342188-21kworker/u8:1+flush-8:009:40:441
3205970993125,4cyclictest3351990-21kworker/u8:0+events_unbound11:35:010
3205970993123,6cyclictest3233157-21diskstats07:35:410
3205970993122,7cyclictest3242552-21latency_hist07:45:010
3205975993025,4cyclictest3351990-21kworker/u8:0+events_unbound10:20:531
3205970993025,4cyclictest3437136-21kworker/u8:1+events_unbound11:20:010
3205970993025,3cyclictest3287778-21sh08:30:000
3205970993024,4cyclictest3258158-21latency_hist08:00:010
3205970993024,4cyclictest3258158-21latency_hist08:00:000
3205970993021,6cyclictest3535836-21latency_hist12:40:000
3205977992925,3cyclictest3414905-21kworker/u8:2+events_unbound10:55:012
3205977992924,3cyclictest3282419-21unixbench_multi08:20:562
3205975992921,5cyclictest3386022-21ntpq10:05:491
3205975992921,4cyclictest0-21swapper/107:55:541
3205975992921,4cyclictest0-21swapper/107:55:541
3205975992920,6cyclictest1704890-21systemd-journal09:49:581
3205970992922,4cyclictest3342188-21kworker/u8:1+events_unbound10:40:000
3205970992918,8cyclictest3402293-21/usr/sbin/munin10:25:530
3205977992824,3cyclictest3242685-21kworker/u8:2+flush-8:008:40:212
3205977992823,3cyclictest3422469-21fschecks_time10:45:422
3205977992823,3cyclictest3386517-21unixbench_multi10:05:572
3205975992824,3cyclictest3221805-21kworker/u8:1+events_unbound07:35:441
3205975992821,5cyclictest3242685-21kworker/u8:2+flush-8:009:20:531
3205970992823,4cyclictest3466593-21kworker/u8:2+flush-8:011:49:290
3205970992823,4cyclictest3190847-21kworker/u8:0+flush-8:008:40:540
3205970992819,7cyclictest3490494-21ntpq11:50:500
3205970992819,6cyclictest3402020-21latency_hist10:25:000
32610502270,5sleep2371rcuc/208:00:482
3205977992724,2cyclictest3190847-21kworker/u8:0+events_unbound08:31:532
3205975992723,3cyclictest3221805-21kworker/u8:1+events_unbound07:40:551
320597099279,8cyclictest1704890-21systemd-journal07:54:590
320597099279,8cyclictest1704890-21systemd-journal07:54:590
3205970992722,4cyclictest3466593-21kworker/u8:2+flush-8:012:30:560
3205970992722,4cyclictest3351990-21kworker/u8:0+flush-8:012:01:300
3205970992720,5cyclictest3281939-21ntpq08:20:500
3205970992719,6cyclictest3381782-21latency_hist10:05:010
3205977992622,3cyclictest3190847-21kworker/u8:0+events_unbound08:45:492
3205977992621,4cyclictest3426429-21kworker/u8:3+flush-8:011:21:042
3205977992619,5cyclictest1704890-21systemd-journal12:25:002
3205970992622,3cyclictest3351990-21kworker/u8:0+flush-8:011:01:090
3205970992622,3cyclictest3217760-21systemd-run07:20:010
320597099262,23cyclictest0-21swapper/009:05:550
3205970992621,3cyclictest3472564-21irqrtprio11:35:450
3205970992618,6cyclictest3516029-21latency_hist12:20:010
3205970992618,6cyclictest3516029-21latency_hist12:20:010
3205977992522,2cyclictest3382007-21base6410:05:012
3205977992519,4cyclictest3481040-21unixbench_multi11:40:582
3205977992517,6cyclictest3258241-21cat08:00:012
3205977992517,6cyclictest3258241-21cat08:00:012
3205977992511,1cyclictest2369189-21kworker/u8:3+writeback07:20:512
3205970992521,3cyclictest3221805-21kworker/u8:1+flush-8:008:13:290
3205970992520,3cyclictest3362464-21cpuspeed_turbos09:45:390
3205970992520,3cyclictest3361543-21unixbench_multi09:40:590
3205977992420,3cyclictest3277561-21kworker/u8:3+events_unbound08:16:152
320597099242,21cyclictest0-21swapper/009:00:550
3205970992420,3cyclictest3437136-21kworker/u8:1+events_unbound11:10:420
3205970992420,3cyclictest3242685-21kworker/u8:2+events_unbound08:15:470
3205970992420,2cyclictest0-21swapper/008:10:010
3205970992420,2cyclictest0-21swapper/007:50:000
3205970992419,4cyclictest3375962-21kworker/u8:2+events_unbound10:10:000
3205970992419,3cyclictest3293735-21tr08:35:450
3205970992418,5cyclictest3317490-21kworker/u8:3+flush-8:009:30:500
35124092230,3sleep20-21swapper/212:15:462
35124092230,3sleep20-21swapper/212:15:452
3205977992320,2cyclictest3441492-21unixbench_singl11:00:592
3205977992320,2cyclictest3322780-21aten2_r5power_e09:05:382
3205977992319,3cyclictest3318115-21cut09:00:422
3205977992318,4cyclictest3471549-21cron11:35:002
320597099232,1cyclictest0-21swapper/009:20:580
3205970992320,1cyclictest3242685-21kworker/u8:2+events_unbound09:26:000
3205970992317,4cyclictest3407589-21cut10:30:420
3205970992317,4cyclictest3337380-21latency_hist09:20:010
3205970992317,4cyclictest3337380-21latency_hist09:20:000
3205970992314,7cyclictest3525117-21ntpq12:25:540
3205977992219,2cyclictest3417221-21aten2_r5power_e10:40:402
3205977992219,2cyclictest3248071-21aten2_r5power_e07:50:392
3205977992219,2cyclictest3248071-21aten2_r5power_e07:50:382
3205977992219,1cyclictest3526525-21cut12:30:432
3205977992218,3cyclictest3317490-21kworker/u8:3+events_unbound09:27:052
3205977992218,3cyclictest3221805-21kworker/u8:1+events_unbound08:10:242
320597099222,19cyclictest0-21swapper/009:10:570
3205970992218,3cyclictest3478954-21kthreadcore11:40:480
3205970992217,3cyclictest3372378-21cpuspeed_turbos09:55:410
320597099221,19cyclictest3316625-21ntpq08:55:540
320597799213,13cyclictest3471851-21apt-get11:35:392
3205977992118,2cyclictest3392630-21cpuspeed_turbos10:15:422
3205977992118,1cyclictest3313125-21cut08:55:432
3205977992117,3cyclictest3401820-21kworker/u8:3+events_unbound10:25:242
3205977992117,3cyclictest3237896-21aten2_r5power_c07:40:382
3205970992117,2cyclictest0-21swapper/011:26:310
3205970992117,2cyclictest0-21swapper/010:55:000
3205970992117,2cyclictest0-21swapper/010:54:590
3205970992117,2cyclictest0-21swapper/007:25:480
3205970992113,6cyclictest3258385-21/usr/sbin/munin08:00:500
3205977992017,2cyclictest3486986-21fschecks_count11:50:402
3205977992016,2cyclictest0-21swapper/207:15:002
320597799200,11cyclictest371rcuc/208:50:452
320597099205,5cyclictest882-21mta-sts-daemon07:10:290
3205970992016,3cyclictest0-21swapper/008:30:440
3205970992016,2cyclictest0-21swapper/008:50:480
3205970992016,2cyclictest0-21swapper/008:45:450
3205970992014,4cyclictest3466593-21kworker/u8:2+flush-8:012:10:540
320597799192,13cyclictest3351177-21ntpq09:30:522
3205977991916,2cyclictest371rcuc/211:45:022
3205977991914,4cyclictest0-21swapper/211:05:582
3205977991913,4cyclictest3267363-21chrt08:05:582
320597799190,10cyclictest371rcuc/209:40:482
3205970991916,2cyclictest3417885-21irqrtprio10:40:460
32051722193,9sleep30-21swapper/307:05:573
3205977991814,2cyclictest0-21swapper/212:25:572
320597799180,10cyclictest371rcuc/210:30:402
320597799176,2cyclictest161rcu_preempt07:30:002
320597799172,10cyclictest3331374-21ntpq09:10:502
3205977991712,3cyclictest3496268-21sh12:00:002
3205977991712,3cyclictest0-21swapper/212:10:482
3205977991712,3cyclictest0-21swapper/212:00:452
3205977991712,3cyclictest0-21swapper/210:20:462
3205977991711,1cyclictest161rcu_preempt08:25:462
320597799166,2cyclictest161rcu_preempt12:05:442
320597799162,1cyclictest0-21swapper/211:25:462
32052512162,6sleep00-21swapper/007:05:580
35308702132,6sleep30-21swapper/312:35:023
35020672130,3sleep375-21kworker/3:1+events12:05:433
34362432132,7sleep30-21swapper/310:55:573
33979782132,7sleep30-21swapper/310:20:473
33924112132,6sleep30-21swapper/310:15:413
33819282132,6sleep30-21swapper/310:05:023
33569782132,7sleep30-21swapper/309:39:583
33377762134,6sleep30-21swapper/309:20:443
32929822135,5sleep30-21swapper/308:35:373
32337932132,7sleep30-21swapper/307:35:463
32177512132,6sleep30-21swapper/307:20:013
35265902122,6sleep30-21swapper/312:30:433
35199372122,6sleep30-21swapper/312:20:493
35157832122,6sleep30-21swapper/312:17:003
35157832122,6sleep30-21swapper/312:16:593
35063592122,6sleep30-21swapper/312:10:023
34920272122,6sleep30-21swapper/311:55:453
34907432122,6sleep30-21swapper/311:50:563
34814782122,6sleep30-21swapper/311:45:013
34789362122,6sleep30-21swapper/311:40:483
34755432123,5sleep30-21swapper/311:35:513
34623472122,6sleep30-21swapper/311:25:443
34567242122,6sleep30-21swapper/311:20:023
34525152122,6sleep30-21swapper/311:15:433
34426492122,6sleep30-21swapper/311:05:453
34168822122,5sleep30-21swapper/310:40:013
34131102122,6sleep30-21swapper/310:35:443
34109902122,6sleep30-21swapper/310:30:493
33918632121,6sleep30-21swapper/310:15:003
33730452122,6sleep30-21swapper/309:55:463
33622502122,6sleep30-21swapper/309:45:403
33577912122,6sleep30-21swapper/309:40:453
33439772122,6sleep30-21swapper/309:25:493
33369642122,6sleep30-21swapper/309:16:593
33369642122,6sleep30-21swapper/309:16:593
33174862122,5sleep30-21swapper/309:00:013
33137542122,6sleep30-21swapper/308:55:473
33026362122,6sleep30-21swapper/308:44:593
32927022122,5sleep30-21swapper/308:35:013
32828802122,6sleep30-21swapper/308:25:023
32637142122,6sleep30-21swapper/308:05:433
32622482122,6sleep30-21swapper/308:00:543
32433272122,6sleep30-21swapper/307:45:413
32419052123,6sleep30-21swapper/307:40:563
32238762122,6sleep30-21swapper/307:25:473
32138362122,6sleep30-21swapper/307:15:483
32099882122,6sleep30-21swapper/307:10:533
35221962112,5sleep30-21swapper/312:25:473
34671182112,5sleep30-21swapper/311:30:403
34470382112,5sleep30-21swapper/311:10:033
34410572113,5sleep30-21swapper/311:00:563
34304422112,6sleep30-21swapper/310:50:493
34304422112,6sleep30-21swapper/310:50:493
34224652112,5sleep30-21swapper/310:45:423
34022922112,5sleep30-21swapper/310:25:413
33701562112,5sleep30-21swapper/309:50:493
33510782112,5sleep30-21swapper/309:30:513
33280442112,6sleep30-21swapper/309:10:443
33227272112,5sleep30-21swapper/309:05:393
33077712112,5sleep30-21swapper/308:50:023
33028772112,5sleep30-21swapper/308:45:043
32828252112,5sleep30-21swapper/308:24:583
32734972112,5sleep30-21swapper/308:15:433
32686662112,5sleep30-21swapper/308:10:463
32572762112,6sleep30-21swapper/307:56:013
32572762112,6sleep30-21swapper/307:56:003
32480162111,6sleep30-21swapper/307:50:393
32480162111,6sleep30-21swapper/307:50:393
32279322112,5sleep30-21swapper/307:30:403
34965182102,5sleep30-21swapper/312:00:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional