You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 19:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jun 01, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2802814995929,18cyclictest3028269-21apt-get10:55:002
2802810995547,6cyclictest2894178-21kworker/u8:1+flush-8:009:30:561
2802810995243,7cyclictest2814888-21/usr/sbin/munin07:20:561
2802810995147,3cyclictest2894178-21kworker/u8:1+flush-8:009:20:531
2802810995039,9cyclictest2806905-21ntpq07:10:521
2802810994942,5cyclictest2988848-21kworker/u8:3+flush-8:011:20:501
2802810994940,7cyclictest3103002-21cp12:09:591
2802810994938,8cyclictest2987503-21ntpq10:10:481
2802810994842,4cyclictest3102923-21http12:10:011
2802810994839,6cyclictest2988848-21kworker/u8:3+flush-8:010:15:521
2802806994738,7cyclictest2983727-21/usr/sbin/munin10:10:530
2802810994636,8cyclictest3027393-21ntpq10:50:501
2802810994541,3cyclictest2758011-21kworker/u8:2+flush-8:007:25:531
280280699451,24cyclictest1704814-21sshd11:03:480
2802806994434,7cyclictest2888926-21latency_hist08:35:000
2802810994338,4cyclictest2758011-21kworker/u8:2+flush-8:007:35:411
2802810994332,8cyclictest2952435-21ntpq09:35:491
2802810994331,8cyclictest1704890-21systemd-journal07:31:081
2802806994337,4cyclictest2889224-21apt-get08:35:360
2802806994335,5cyclictest2839293-21latency_hist07:45:000
2802806994334,6cyclictest2948357-21latency_hist09:35:010
2802810994237,4cyclictest2894178-21kworker/u8:1+flush-8:009:45:411
2802810994237,3cyclictest2998781-21kworker/u8:1+flush-8:010:40:411
2802810994231,8cyclictest1704890-21systemd-journal11:00:001
2802806994232,8cyclictest2922692-21ntpq09:05:500
2802814994125,14cyclictest2874709-21fschecks_count08:20:412
2802814994120,18cyclictest3068793-21fschecks_count11:35:402
2802810994135,5cyclictest2843904-21kworker/u8:1+events_unbound08:05:021
2802810994134,5cyclictest2843347-21ntpq07:45:501
2802806994121,17cyclictest0-21swapper/008:45:440
2802814994026,12cyclictest3029077-21fschecks_count10:55:402
2802814994026,12cyclictest2864823-21fschecks_time08:10:442
2802814994021,17cyclictest2859922-21fschecks_time08:05:402
2802810994034,4cyclictest2758011-21kworker/u8:2+flush-8:009:25:451
2802810994033,5cyclictest2758011-21kworker/u8:2+flush-8:009:00:531
2802810994031,6cyclictest1704890-21systemd-journal10:34:471
2802806994032,5cyclictest2992645-21ntpq10:15:460
2802806994022,16cyclictest2853714-21unixbench_singl07:55:550
2802814993933,4cyclictest2983464-21munin-plugin-st10:10:002
2802814993923,14cyclictest2879667-21fschecks_count08:25:412
2802810993931,6cyclictest3127543-21kworker/u8:0+flush-8:012:35:501
280280699397,20cyclictest0-21swapper/007:32:370
2802806993925,12cyclictest2848291-21ntpq07:50:500
2802806993924,13cyclictest2897898-21needreboot08:40:480
2802806993921,16cyclictest2963475-21cron09:50:010
2802814993823,13cyclictest3083685-21fschecks_count11:50:392
2802814993823,13cyclictest3048881-21fschecks_count11:15:402
2802810993831,5cyclictest2894178-21kworker/u8:1+events_unbound08:45:491
2802810993831,4cyclictest2998518-21latency_hist10:25:011
2802810993830,6cyclictest2868829-21kworker/u8:0+flush-8:008:30:541
2802806993828,8cyclictest3132175-21ntpq12:35:480
2802806993822,14cyclictest2998176-21unixbench_singl10:20:560
2802806993821,15cyclictest3094010-21irqrtprio12:00:450
2802806993820,16cyclictest3107681-21unixbench_multi12:10:570
280280699381,24cyclictest3112126-21sshd12:15:480
2802814993722,13cyclictest2973973-21aten2_r5power_p10:00:402
2802814993722,13cyclictest2964115-21fschecks_time09:50:402
2802814993721,14cyclictest3103113-21latency_hist12:10:012
2802810993732,4cyclictest2988848-21kworker/u8:3+events_unbound11:10:491
2802810993730,5cyclictest2938468-21kworker/u8:0+events_unbound09:40:521
2802810993730,4cyclictest3059178-21irqrtprio11:25:451
2802810993729,6cyclictest1704890-21systemd-journal11:15:471
2802806993725,9cyclictest2938982-21diskstats09:25:390
2802806993716,18cyclictest1704890-21systemd-journal08:10:440
2802810993630,4cyclictest2868829-21kworker/u8:0+flush-8:008:25:511
2802810993629,5cyclictest2864508-21apt-get08:10:391
2802810993626,8cyclictest2853172-21ntpq07:55:481
2802806993626,8cyclictest2823551-21ntpq07:25:490
2802806993619,15cyclictest2815442-21irqcore07:20:440
280280699361,5cyclictest3017529-21ntpq10:40:510
280281499352,26cyclictest2869441-21apt-get08:15:382
2802814993520,13cyclictest3033963-21cpuspeed_turbos11:00:382
2802810993531,3cyclictest2758011-21kworker/u8:2+events_unbound08:35:391
2802810993530,4cyclictest3083123-21kworker/u8:2+events_unbound12:30:501
2802810993526,7cyclictest3088353-21apt-get11:55:351
280280699353,4cyclictest0-21swapper/009:40:380
2802806993520,13cyclictest3058991-21sort11:25:450
2802806993520,13cyclictest2950822-21sort09:35:440
2802806993517,16cyclictest3008435-21cron10:35:000
2802806993516,17cyclictest2969701-21kthreadcore09:55:450
2802806993514,18cyclictest0-21swapper/007:35:490
280280699350,18cyclictest3064076-21/usr/sbin/munin11:30:420
28023652353,27sleep00-21swapper/007:06:140
2802806993427,5cyclictest1704890-21systemd-journal10:36:120
2802806993418,14cyclictest0-21swapper/007:15:010
2802806993417,15cyclictest0-21swapper/012:09:590
2802810993328,4cyclictest3073218-21kworker/u8:1+flush-8:012:20:481
2802810993328,4cyclictest3073218-21kworker/u8:1+flush-8:012:20:471
280280699331,8cyclictest3118754-21/usr/sbin/munin12:25:430
280280699331,8cyclictest3044554-21/usr/sbin/munin11:10:430
2802806993318,12cyclictest0-21swapper/011:10:010
2802806993317,14cyclictest3002935-21wc10:25:560
2802806993316,14cyclictest2908856-21latency_hist08:55:010
2802806993314,17cyclictest3074399-21kthreadcore11:40:430
28023672334,9sleep20-21swapper/207:06:172
2802814993224,7cyclictest3013363-21cron10:40:002
280281499321,24cyclictest2834652-21apt-get07:40:362
280280699329,6cyclictest2812259-21tr07:15:460
280280699323,4cyclictest0-21swapper/008:55:360
2802806993227,4cyclictest2758011-21kworker/u8:2+flush-8:008:20:400
280280699322,11cyclictest2978799-21apt-get10:05:350
2802806993219,11cyclictest0-21swapper/011:40:010
280280699321,8cyclictest3078716-21/usr/sbin/munin11:45:380
2802806993217,13cyclictest2914324-21fschecks_time09:00:410
2802806993211,19cyclictest3029036-21diskstats10:55:380
280280699320,8cyclictest2924310-21/usr/sbin/munin09:10:420
280249023219,7sleep30-21swapper/307:07:543
2802814993122,7cyclictest3103722-21fschecks_count12:10:402
2802814993122,6cyclictest2830043-21fschecks_time07:35:412
2802814993116,13cyclictest0-21swapper/212:40:002
2802814993116,13cyclictest0-21swapper/210:45:472
2802810993127,3cyclictest2809864-21kworker/u8:0+events_unbound07:40:531
2802810993127,3cyclictest2758011-21kworker/u8:2+events_unbound10:25:391
2802810993125,5cyclictest1859599-21kworker/u8:3+events_unbound07:15:511
2802810993125,4cyclictest3087699-21unixbench_singl11:50:541
2802810993124,5cyclictest3073218-21kworker/u8:1+flush-8:011:40:531
2802810993124,5cyclictest2938468-21kworker/u8:0+events_unbound11:45:471
2802810993123,5cyclictest2898850-21latency_hist08:45:011
2802806993125,4cyclictest2998781-21kworker/u8:1+events_unbound10:45:360
2802806993112,17cyclictest3087681-21unixbench_singl11:50:550
2802806993111,18cyclictest2873277-21ntpq08:15:510
280280699310,8cyclictest3023652-21/usr/sbin/munin10:50:370
280280699310,8cyclictest2937804-21/usr/sbin/munin09:20:550
280280699310,8cyclictest2879382-21/usr/sbin/munin08:25:380
280280699310,8cyclictest2843837-21/usr/sbin/munin07:45:560
280280699310,29cyclictest2929576-21sshd09:15:430
280263723116,9sleep10-21swapper/107:09:491
2802814993024,4cyclictest3093574-21fschecks_count12:00:412
2802814993018,10cyclictest3003089-21unixbench_singl10:25:572
2802814993016,11cyclictest0-21swapper/210:40:522
2802814993014,14cyclictest2839700-21aten2_r5power_v07:45:382
2802814993014,14cyclictest0-21swapper/211:50:012
2802810993026,3cyclictest3073218-21kworker/u8:1+flush-8:012:02:531
2802810993026,2cyclictest3110561-21kthreadcore12:15:451
2802810993025,4cyclictest2758011-21kworker/u8:2+flush-8:008:22:401
2802810993025,3cyclictest2968410-21systemd-run09:55:011
2802810993025,3cyclictest2868829-21kworker/u8:0+flush-8:008:15:581
2802810993025,3cyclictest0-21swapper/110:05:431
2802810993024,4cyclictest2938468-21kworker/u8:0+events_unbound11:05:421
280280699301,8cyclictest3052299-21ntpq11:15:490
280280699301,7cyclictest3126772-21/usr/sbin/munin12:30:460
280280699301,7cyclictest2855303-21/usr/sbin/munin08:00:440
280280699301,10cyclictest2977613-21ntpq10:00:510
2802806993010,16cyclictest0-21swapper/009:50:370
280280699300,7cyclictest3117090-21/usr/sbin/munin12:20:480
280280699300,7cyclictest3117090-21/usr/sbin/munin12:20:470
280281499297,18cyclictest3123292-21cut12:30:392
280281499293,20cyclictest2884310-21apt-get08:30:372
280281499292,23cyclictest3112303-21ps12:15:532
2802814992920,7cyclictest2929155-21fschecks_count09:15:402
2802814992914,13cyclictest0-21swapper/209:05:462
280281499291,24cyclictest3090591-21kthreadcore11:55:452
2802814992911,15cyclictest3073553-21cut11:40:362
2802814992910,17cyclictest2972598-21cut09:55:532
2802814992910,16cyclictest0-21swapper/211:20:382
280281499290,27cyclictest3062517-21/usr/sbin/munin11:25:572
2802810992925,3cyclictest3027973-21kworker/u8:2+flush-8:011:00:551
2802810992925,2cyclictest3013385-21idleruntime-cro10:40:001
2802810992923,5cyclictest2758011-21kworker/u8:2+events_unbound09:05:391
280280699299,18cyclictest3088703-21uniq11:55:400
280280699291,8cyclictest3054046-21/usr/sbin/munin11:20:420
2802806992913,14cyclictest2859757-21cpuspeed08:05:380
280281499288,18cyclictest2892819-21grep08:35:462
2802814992819,7cyclictest2909382-21fschecks_time08:55:402
2802814992816,9cyclictest0-21swapper/209:00:412
2802814992813,13cyclictest3118500-21cpuspeed_turbos12:25:392
2802814992813,13cyclictest2814944-21aten2_r5power_c07:20:392
280281499281,22cyclictest2854924-21/usr/sbin/munin08:00:422
280281499281,22cyclictest2805337-21cut07:10:452
2802814992810,16cyclictest3005023-21tr10:30:452
280281499280,24cyclictest2938986-21/usr/sbin/munin09:25:382
280281499280,24cyclictest2820628-21sed07:25:442
2802810992824,3cyclictest3083123-21kworker/u8:2+flush-8:012:26:561
2802810992823,4cyclictest2758011-21kworker/u8:2+events_unbound08:50:531
2802810992822,4cyclictest2988848-21kworker/u8:3+flush-8:011:35:421
2802810992822,4cyclictest2894178-21kworker/u8:1+events_unbound09:55:561
2802810992816,8cyclictest1704890-21systemd-journal11:30:471
280281499278,17cyclictest2950171-21cut09:35:452
2802814992714,11cyclictest0-21swapper/211:30:362
2802814992713,12cyclictest0-21swapper/210:15:002
280281499271,23cyclictest3115547-21cut12:20:452
280281499271,23cyclictest3115547-21cut12:20:452
280281499271,23cyclictest2963483-21/usr/sbin/munin09:50:012
2802814992712,13cyclictest0-21swapper/209:25:002
2802814992711,14cyclictest0-21swapper/209:40:492
280281499270,23cyclictest3038743-21/usr/sbin/munin11:05:392
280281499270,23cyclictest2894455-21seq08:40:402
280281499270,23cyclictest2844495-21/usr/sbin/munin07:50:362
2802810992722,4cyclictest2894178-21kworker/u8:1+flush-8:008:55:481
280281499269,14cyclictest2810005-21cut07:15:392
280281499267,16cyclictest2904347-21tr08:50:402
280281499266,18cyclictest2997628-21taskset10:20:502
2802814992622,2cyclictest2849512-21aten2_r5power_e07:55:382
280281499262,20cyclictest2828571-21ntpq07:30:502
2802814992621,3cyclictest2899435-21fschecks_count08:45:402
280281499261,22cyclictest2993495-21seq10:19:152
280281499260,24cyclictest3048178-21seq11:13:362
280281499260,24cyclictest2947505-21awk09:30:522
2802810992621,3cyclictest2933552-21systemd-run09:20:001
2802810992621,3cyclictest2859031-21cron08:04:591
2802810992617,7cyclictest1704890-21systemd-journal09:10:421
280281499259,13cyclictest2924102-21tr09:10:382
29691092240,2sleep375-21kworker/3:1+events09:55:433
28577792240,5sleep3451irq_work/308:00:463
2802810992416,4cyclictest0-21swapper/110:00:391
2802810992218,2cyclictest0-21swapper/107:50:391
2802810992016,3cyclictest2998781-21kworker/u8:1+events_unbound10:49:111
28413782190,2sleep3471rcuc/307:45:443
31028282172,5sleep30-21swapper/312:09:103
30883192172,5sleep30-21swapper/311:55:293
28694082172,4sleep30-21swapper/308:15:323
30712412167,5sleep30-21swapper/311:35:483
29740452161,4sleep30-21swapper/310:00:403
28346352142,8sleep30-21swapper/307:40:373
30775262134,5sleep30-21swapper/311:40:533
30134902132,6sleep30-21swapper/310:40:023
30084232131,8sleep30-21swapper/310:34:593
29897822135,5sleep30-21swapper/310:15:413
29634952132,6sleep30-21swapper/309:50:023
29490192132,7sleep30-21swapper/309:35:413
28485282132,7sleep30-21swapper/307:50:563
28076802132,7sleep30-21swapper/307:15:013
31280042122,5sleep30-21swapper/312:35:013
31133722122,6sleep30-21swapper/312:20:383
31133722122,6sleep30-21swapper/312:20:373
31071792122,6sleep30-21swapper/312:10:503
30932892123,5sleep30-21swapper/312:00:393
30836482122,6sleep30-21swapper/311:50:403
30673152122,6sleep30-21swapper/311:30:503
30589252122,6sleep30-21swapper/311:25:443
30534482122,5sleep30-21swapper/311:20:013
30430032122,6sleep30-21swapper/311:05:573
30373172122,7sleep30-21swapper/311:00:483
30123172122,6sleep30-21swapper/310:35:483
29875782122,6sleep30-21swapper/310:10:533
29458182122,6sleep30-21swapper/309:30:483
29371902122,6sleep30-21swapper/309:20:493
29293602122,6sleep30-21swapper/309:15:433
29236062122,5sleep30-21swapper/309:10:003
29221742122,6sleep30-21swapper/309:05:483
29139042122,5sleep30-21swapper/309:00:023
29129282122,6sleep30-21swapper/308:55:523
29000642123,5sleep30-21swapper/308:45:453
28977042122,6sleep30-21swapper/308:40:473
28889602122,6sleep30-21swapper/308:35:023
28746642122,6sleep30-21swapper/308:20:413
28244742122,5sleep30-21swapper/307:30:003
28147462122,6sleep30-21swapper/307:20:023
28101532122,6sleep30-21swapper/307:15:403
31273002112,5sleep30-21swapper/312:30:573
31186722112,5sleep30-21swapper/312:25:433
31083492112,5sleep30-21swapper/312:15:243
30783952112,5sleep30-21swapper/311:45:023
30526492112,5sleep30-21swapper/311:15:573
30436302112,5sleep30-21swapper/311:10:353
30233212112,5sleep30-21swapper/310:50:013
30186372112,5sleep30-21swapper/310:45:363
29990662112,5sleep30-21swapper/310:25:413
29969572112,5sleep30-21swapper/310:20:483
29787312112,5sleep30-21swapper/310:05:033
29587832112,6sleep30-21swapper/309:45:163
29536252112,5sleep30-21swapper/309:40:393
29427552112,6sleep30-21swapper/309:25:533
29040932112,5sleep30-21swapper/308:50:353
28887712112,5sleep30-21swapper/308:33:093
28793932112,5sleep30-21swapper/308:25:393
28645522112,6sleep30-21swapper/308:10:423
28595312112,6sleep30-21swapper/308:05:243
28497632112,5sleep30-21swapper/307:55:423
28301662112,6sleep30-21swapper/307:35:433
28234092112,5sleep30-21swapper/307:25:483
30287292102,5sleep30-21swapper/310:55:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional