You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 07:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Mar 23, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28967792880,2chrt75-21kworker/3:1+events20:41:393
31014882710,2sleep3481ktimers/300:06:403
2802675995545,7cyclictest2884127-21latency_hist20:30:011
29938972540,4chrt2993900-21cpuspeed_turbos22:21:320
2802675995243,6cyclictest3122897-21latency_hist00:30:011
2802673995243,7cyclictest3107588-21latency_hist00:15:010
28702202480,2chrt0-21swapper/020:16:360
2802675994840,6cyclictest1453398-21kworker/u8:3+flush-8:021:41:321
2802675994640,4cyclictest2869270-21latency_hist20:15:001
2802675994638,5cyclictest2993298-21latency_hist22:20:011
2802675994637,6cyclictest280-21systemd-journal21:30:131
2802673994638,6cyclictest2904324-21cat20:50:010
2802673994534,9cyclictest3047934-21apt-get23:15:010
30444022440,3sleep20-21swapper/223:11:382
2802678994336,5cyclictest280-21systemd-journal20:41:132
2802675994233,6cyclictest2802508-21latency_hist19:10:011
2802675994231,9cyclictest2888339-21ntpq20:31:461
29610442410,0chrt371rcuc/221:46:392
2802673994136,4cyclictest2914251-21kworker/u8:1+events_unbound21:35:000
2802675994035,3cyclictest2983079-21kworker/u8:0+flush-8:022:11:381
2802673994036,3cyclictest1453398-21kworker/u8:3+flush-8:021:16:450
2802675993931,6cyclictest3107589-21apt-get00:15:001
2802675993830,5cyclictest280-21systemd-journal22:57:491
2802673993834,3cyclictest1453398-21kworker/u8:3+flush-8:021:36:350
2802673993732,4cyclictest1453398-21kworker/u8:3+flush-8:020:06:470
2802673993732,4cyclictest1453398-21kworker/u8:3+flush-8:020:06:470
2802675993632,3cyclictest1453398-21kworker/u8:3+flush-8:020:06:341
2802675993632,3cyclictest1453398-21kworker/u8:3+flush-8:020:06:341
2802673993628,6cyclictest280-21systemd-journal23:20:010
280235823625,6sleep30-21swapper/319:08:143
2802678993529,4cyclictest2834297-21unixbench_multi19:36:492
2802675993529,4cyclictest3092778-21kworker/u8:3+events_unbound00:36:381
2802675993528,5cyclictest280-21systemd-journal20:17:131
2802678993425,7cyclictest2819814-21cron19:25:002
2802675993428,4cyclictest1-21systemd23:15:011
2802675993426,6cyclictest280-21systemd-journal19:15:031
2802673993429,3cyclictest3022976-21kworker/u8:3+flush-8:023:21:350
2802673993330,2cyclictest2854484-21latency_hist20:00:000
2802673993324,7cyclictest2992477-21ntpq22:16:430
2802678993226,4cyclictest2878873-21unixbench_singl20:21:502
2802675993228,3cyclictest2818942-21needreboot19:21:411
2802675993227,4cyclictest2837494-21kworker/u8:2+flush-8:020:56:351
2802675993227,4cyclictest2837494-21kworker/u8:2+flush-8:019:51:371
2802675993224,6cyclictest2849886-21apt-get19:56:291
2802675993224,6cyclictest1453398-21kworker/u8:3+flush-8:021:36:381
2802675993126,4cyclictest2879152-21cron20:25:001
2802675993125,4cyclictest3127551-21unixbench_multi00:31:511
2802675993125,4cyclictest2939833-21irqrtprio21:26:371
2802675993124,5cyclictest2906644-21kthreadcore20:51:391
2802673993122,6cyclictest3008114-21latency_hist22:35:000
280267399311,26cyclictest2820066-21sshd19:25:140
28190832300,5sleep3451irq_work/319:21:453
2802678993023,5cyclictest280-21systemd-journal20:38:142
2802675993026,2cyclictest2924392-21aten2_r5power_p21:11:331
2802675993022,6cyclictest3088220-21aten2_r5power_v23:56:311
2802673993025,4cyclictest1453398-21kworker/u8:3+flush-8:021:21:450
2802673993025,3cyclictest2802534-21kworker/u8:2+events_unbound19:15:000
2802673993025,3cyclictest2761092-21kworker/u8:0+events_unbound19:36:390
2802673993024,4cyclictest2983079-21kworker/u8:0+flush-8:022:26:370
2802673993024,4cyclictest2878389-21kworker/u8:0+flush-8:020:46:490
2802673993024,4cyclictest1453398-21kworker/u8:3+events_unbound21:05:010
2802673993019,9cyclictest3067055-21ntpq23:31:430
2802678992922,5cyclictest280-21systemd-journal21:28:132
2802675992924,4cyclictest3072843-21cron23:40:001
2802675992924,4cyclictest2914251-21kworker/u8:1+flush-8:021:01:471
2802675992924,3cyclictest3004283-21irqrtprio22:31:371
2802675992924,3cyclictest2807248-21unixbench_singl19:11:491
2802673992926,2cyclictest2869268-21idleruntime-cro20:15:000
2802673992921,6cyclictest3122044-21ntpq00:26:410
2802673992915,9cyclictest2973371-21sshd21:57:370
279796022916,9sleep20-21swapper/219:06:212
30818142280,2sleep1281rcuc/123:46:401
280267599289,4cyclictest0-21swapper/121:21:371
2802675992823,4cyclictest3022976-21kworker/u8:3+events_unbound23:21:441
2802675992823,3cyclictest2898957-21cron20:45:001
2802675992822,5cyclictest2844287-21unixbench_singl19:46:491
2802675992822,4cyclictest3083106-21apt-get23:51:301
2802675992821,5cyclictest280-21systemd-journal22:41:141
2802675992821,5cyclictest280-21systemd-journal22:41:131
2802673992824,3cyclictest3112783-21munin-plugin-st00:20:000
2802673992824,2cyclictest0-21swapper/021:45:000
2802673992823,3cyclictest2837494-21kworker/u8:2+flush-8:020:56:480
2802673992822,4cyclictest2983079-21kworker/u8:0+events_unbound23:46:320
2802673992821,5cyclictest280-21systemd-journal19:22:200
2802678992724,2cyclictest3092367-21unixbench_multi23:56:482
2802678992724,2cyclictest2854947-21aten2_r5power_p20:01:312
2802678992723,2cyclictest2929457-21cpuspeed_turbos21:16:312
2802675992723,2cyclictest0-21swapper/100:20:011
2802675992722,3cyclictest3093843-21irqrtprio00:01:381
2802675992721,4cyclictest3003190-21cron22:30:001
2802675992720,6cyclictest2824405-21unixbench_multi19:26:511
2802675992720,5cyclictest2929213-21/usr/sbin/munin21:16:401
2802673992723,3cyclictest2837494-21kworker/u8:2+flush-8:022:06:490
2802673992723,3cyclictest2837494-21kworker/u8:2+flush-8:019:51:460
2802673992723,3cyclictest2802534-21kworker/u8:2+flush-8:019:15:050
2802673992722,3cyclictest3068161-21kworker/u8:1+events_unbound23:36:490
2802673992722,3cyclictest3012186-21needreboot22:36:410
2802673992721,4cyclictest3083797-21irqcore23:51:370
2802673992721,4cyclictest3042671-21unixbench_multi23:06:500
2802673992718,7cyclictest280-21systemd-journal00:25:000
2802673992718,6cyclictest280-21systemd-journal21:55:000
2802678992623,2cyclictest3013766-21fschecks_time22:41:322
2802678992623,2cyclictest3013766-21fschecks_time22:41:322
2802678992622,2cyclictest2973219-21unixbench_multi21:56:502
2802678992622,2cyclictest2888770-21unixbench_singl20:31:512
2802678992620,4cyclictest3028051-21latency_hist22:55:012
280267899260,8cyclictest3004211-21sed22:31:372
2802675992621,3cyclictest0-21swapper/122:55:011
2802675992620,5cyclictest3098137-21aten2_r5power_e00:06:321
2802675992620,4cyclictest2978860-21apt-get22:06:291
2802673992621,3cyclictest3068161-21kworker/u8:1+events_unbound00:00:010
2802673992620,4cyclictest2824004-21kworker/u8:1+flush-8:020:21:440
2802673992616,8cyclictest3027276-21sendmail_mailqu22:51:460
2802673992615,8cyclictest2883892-21sshd20:27:130
280267899253,9cyclictest39-21ksoftirqd/222:50:002
2802678992521,2cyclictest2829409-21unixbench_singl19:31:502
2802678992520,4cyclictest2807824-21apt-config19:15:012
2802678992520,3cyclictest3048834-21fschecks_time23:16:322
2802678992520,3cyclictest2998957-21fschecks_time22:26:342
2802675992521,2cyclictest880-21mta-sts-daemon23:31:301
2802675992521,2cyclictest0-21swapper/123:41:461
2802675992521,2cyclictest0-21swapper/123:05:011
280267599252,10cyclictest28942212wc20:40:011
2802675992520,4cyclictest2859423-21cron20:05:001
2802675992517,6cyclictest3038672-21diskstats23:06:331
2802675992516,7cyclictest3022175-21ntpq22:46:451
2802675992516,6cyclictest280-21systemd-journal21:57:371
2802673992521,3cyclictest2837494-21kworker/u8:2+flush-8:020:31:350
2802673992521,3cyclictest1453398-21kworker/u8:3+events_unbound22:01:470
2802673992520,3cyclictest3092778-21kworker/u8:3+events_unbound00:36:410
2802673992517,6cyclictest2963703-21latency_hist21:50:010
280267899246,4cyclictest0-21swapper/219:16:352
2802678992420,2cyclictest2954229-21fschecks_count21:41:322
280267899241,8cyclictest2823961-21ntpq19:26:442
280267899241,11cyclictest3122121-21ntpq00:26:432
2802675992421,2cyclictest2830311-21cpuspeed_turbos19:36:321
2802675992420,2cyclictest0-21swapper/123:26:331
2802675992420,2cyclictest0-21swapper/100:21:341
2802675992419,3cyclictest3028394-21kworker/u8:2+events_unbound23:16:351
2802675992419,3cyclictest2963721-21systemd-run21:50:001
2802675992419,3cyclictest2923628-21unixbench_singl21:06:511
2802675992418,5cyclictest2964173-21aten2_r5power_v21:51:321
2802675992416,6cyclictest2825124-21apt-get19:31:291
280267399246,16cyclictest3033172-21kworker/0:0+events23:01:340
2802673992420,2cyclictest2988381-21sh22:15:000
2802673992420,2cyclictest2919877-21irqcore21:06:370
2802673992419,4cyclictest2761092-21kworker/u8:0+events_unbound19:35:000
2802673992419,3cyclictest3127866-21cron00:35:000
2802673992419,2cyclictest0-21swapper/000:01:340
280267899238,9cyclictest2934194-21apt-get21:21:302
280267899235,5cyclictest0-21swapper/200:03:082
280267899233,12cyclictest39-21ksoftirqd/223:06:382
280267899232,2cyclictest0-21swapper/223:36:322
2802678992319,3cyclictest2988389-21turbostat.cron22:15:002
2802678992319,2cyclictest3033750-21fschecks_count23:01:302
2802678992319,2cyclictest2968252-21unixbench_multi21:51:492
2802678992319,2cyclictest2840195-21cpuspeed_turbos19:46:322
280267899230,6cyclictest3009025-21sed22:36:352
280267899230,11cyclictest2913178-21ntpq20:56:442
280267899230,10cyclictest880-21mta-sts-daemon00:36:432
2802675992319,3cyclictest2997959-21unixbench_singl22:21:491
2802675992319,2cyclictest0-21swapper/122:36:351
2802675992319,2cyclictest0-21swapper/120:46:471
2802675992316,5cyclictest2978164-21unixbench_multi22:01:491
280267399233,15cyclictest589-21runrttasks19:46:300
2802673992319,2cyclictest3032831-21unixbench_singl22:56:490
2802673992319,2cyclictest2928868-21cron21:15:000
28907532220,3sleep0201rcuc/020:36:380
280267899229,9cyclictest3098080-21apt-get00:06:312
280267899229,2cyclictest0-21swapper/222:21:362
280267899228,9cyclictest3053453-21apt-get23:21:282
280267899227,2cyclictest30818172sed23:46:402
280267899222,4cyclictest0-21swapper/220:06:352
280267899222,4cyclictest0-21swapper/220:06:352
280267899222,10cyclictest0-21swapper/223:33:572
2802678992220,1cyclictest371rcuc/200:24:342
2802678992218,3cyclictest371rcuc/200:13:272
2802678992218,2cyclictest2850108-21cpuspeed_turbos19:56:332
2802678992217,3cyclictest2988808-21aten2_r5power_e22:16:322
280267899220,5cyclictest2899329-21apt-get20:46:312
280267899220,11cyclictest3108178-21apt-get00:16:302
2802673992218,3cyclictest3028394-21kworker/u8:2+events_unbound23:26:430
2802673992217,3cyclictest880-21mta-sts-daemon21:28:510
2802673992217,3cyclictest2839613-21turbostat.cron19:45:000
2802673992216,4cyclictest3098779-21irqcore00:06:370
280267899215,4cyclictest0-21swapper/223:41:362
280267899213,9cyclictest0-21swapper/223:54:562
280267899212,5cyclictest0-21swapper/222:07:262
2802678992118,2cyclictest2975513-21kthreadcore22:01:382
280267899211,7cyclictest3127089-21ntpq00:31:452
280267899210,5cyclictest3060682-21cut23:26:382
280267899210,11cyclictest3027919-21apt-get22:55:032
2802675992116,3cyclictest0-21swapper/119:45:011
2802673992117,3cyclictest3018060-21latency_hist22:45:000
2802673992117,3cyclictest3018060-21latency_hist22:45:000
2802673992116,3cyclictest2855392-21sort20:01:360
2802673992113,5cyclictest3022601-21grep22:46:500
280267399211,14cyclictest589-21runrttasks20:41:480
30454232200,4sleep30-21swapper/323:11:393
280267899204,6cyclictest0-21swapper/221:01:432
280267899203,4cyclictest0-21swapper/221:30:052
280267899202,9cyclictest0-21swapper/221:11:242
280267899202,9cyclictest0-21swapper/221:08:232
280267899202,5cyclictest0-21swapper/219:50:362
280267899202,13cyclictest2864705-21apt-get20:11:322
2802678992017,2cyclictest2908767-21unixbench_singl20:51:492
2802673992011,7cyclictest0-21swapper/019:10:010
280267899192,5cyclictest0-21swapper/220:29:452
2802678991916,2cyclictest371rcuc/220:16:152
2802678991911,6cyclictest2951407-21cut21:36:402
280267899190,3cyclictest2835273-21df19:41:332
2802673991912,3cyclictest3077813-21latency_hist23:45:000
30522382153,8sleep30-21swapper/323:16:413
31228842132,6sleep30-21swapper/300:30:013
30876492132,7sleep30-21swapper/323:53:573
29648412133,6sleep30-21swapper/321:51:383
29247442134,5sleep30-21swapper/321:11:373
29048472132,7sleep30-21swapper/320:51:353
28646792132,7sleep30-21swapper/320:11:303
28503802133,6sleep30-21swapper/319:56:373
28350692132,7sleep30-21swapper/319:41:323
28033102134,5sleep30-21swapper/319:11:353
31129472121,6sleep30-21swapper/300:20:023
31070162122,6sleep30-21swapper/300:11:473
30931262122,6sleep30-21swapper/300:01:323
30720262122,6sleep30-21swapper/323:36:443
30380802122,6sleep30-21swapper/323:05:023
30275302122,6sleep30-21swapper/322:51:493
30196662122,6sleep30-21swapper/322:46:403
30138342122,6sleep30-21swapper/322:41:343
30138342122,6sleep30-21swapper/322:41:343
30093582123,5sleep30-21swapper/322:36:373
29991902122,6sleep30-21swapper/322:26:373
29885892122,6sleep30-21swapper/322:15:023
29802172122,6sleep30-21swapper/322:06:393
29735602122,5sleep30-21swapper/322:00:013
29689772122,6sleep30-21swapper/321:56:323
29494492122,6sleep30-21swapper/321:36:373
29445342122,6sleep30-21swapper/321:31:363
29387702122,6sleep30-21swapper/321:25:023
29349392122,6sleep30-21swapper/321:21:373
29140482122,6sleep30-21swapper/321:00:023
29000642122,6sleep30-21swapper/320:46:373
28890992122,6sleep30-21swapper/320:35:023
28813802122,5sleep30-21swapper/320:26:393
28736542122,6sleep30-21swapper/320:16:483
28453412122,6sleep30-21swapper/319:51:363
28397912122,6sleep30-21swapper/319:45:023
28239102122,6sleep30-21swapper/319:26:453
28091442122,6sleep30-21swapper/319:15:043
31286142112,5sleep30-21swapper/300:36:353
31236852112,5sleep30-21swapper/300:31:373
31117942112,5sleep30-21swapper/300:16:413
30877722111,5sleep30-21swapper/323:55:023
30781752112,5sleep30-21swapper/323:46:313
30731892112,5sleep30-21swapper/323:41:133
30629632112,5sleep30-21swapper/323:30:023
30590992112,5sleep30-21swapper/323:26:373
30572832112,5sleep30-21swapper/323:21:433
30288842112,5sleep30-21swapper/322:56:353
30048372112,6sleep30-21swapper/322:31:393
29936022112,6sleep30-21swapper/322:20:563
29877842112,5sleep30-21swapper/322:11:493
29591422112,5sleep30-21swapper/321:46:333
29540542112,5sleep30-21swapper/321:41:313
29316642112,5sleep30-21swapper/321:16:393
29193592112,5sleep30-21swapper/321:06:323
29093522112,6sleep30-21swapper/320:55:483
28844052112,6sleep30-21swapper/320:30:483
28745662112,5sleep30-21swapper/320:21:133
28622062112,5sleep30-21swapper/320:06:413
28622062112,5sleep30-21swapper/320:06:413
28552322112,5sleep30-21swapper/320:01:353
28299442112,5sleep30-21swapper/319:35:023
28256492112,5sleep30-21swapper/319:31:373
30333572102,5sleep30-21swapper/323:00:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional