You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 09, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32688262940,3chrt0-21swapper/022:57:550
31373302880,2sleep0161rcu_preempt20:47:510
32628902790,3sleep10-21swapper/122:52:551
32628902790,3sleep10-21swapper/122:52:541
31852772680,5sleep30-21swapper/321:33:043
3039556995747,7cyclictest3190822-21latency_hist21:40:000
32724662520,3sleep1281rcuc/123:02:531
32997762510,2chrt451irq_work/323:28:033
3039556994742,3cyclictest3015219-21kworker/u8:4+flush-8:019:18:060
31997952460,3chrt575-21kworker/3:2+events21:47:573
31997952460,3chrt575-21kworker/3:2+events21:47:563
3039560994638,5cyclictest3225804-21latency_hist22:15:011
3039556994639,5cyclictest3289857-21kworker/u8:0+flush-8:000:03:050
3039556994536,6cyclictest3319799-21latency_hist23:50:010
3039556994335,6cyclictest3091201-21kworker/u8:3+flush-8:020:07:520
3039560994237,4cyclictest3044636-21kworker/u8:0+flush-8:019:37:491
3039560994236,5cyclictest3039422-21kworker/u8:2+flush-8:019:12:501
3039560994236,5cyclictest3039422-21kworker/u8:2+flush-8:019:12:501
3039560994236,4cyclictest3116446-21kworker/u8:1+flush-8:021:03:021
3039562994034,4cyclictest3070984-21kworker/u8:2+flush-8:019:42:512
3039556994035,4cyclictest3330187-21kworker/u8:3+flush-8:000:10:300
3039560993929,7cyclictest275-21systemd-journal23:30:011
3039556993934,4cyclictest3335204-21kworker/u8:1+events_unbound00:25:010
3039556993934,3cyclictest3216060-21kworker/u8:2+events_unbound22:35:000
3039556993932,5cyclictest3091201-21kworker/u8:3+flush-8:020:52:510
3039560993826,10cyclictest3354766-21latency_hist00:25:011
3039556993830,6cyclictest3081178-21cp19:50:000
3039556993730,5cyclictest3300483-21tr23:32:460
30399482360,2sleep20-21swapper/219:12:482
30399482360,2sleep20-21swapper/219:12:472
3039562993627,7cyclictest3131119-21cp20:40:012
3039560993629,5cyclictest3116446-21kworker/u8:1+events_unbound21:23:021
3039560993530,3cyclictest3167260-21irqrtprio21:17:531
3039560993526,6cyclictest3076128-21latency_hist19:45:011
3039556993526,7cyclictest3106701-21/usr/sbin/munin20:17:580
3039556993525,8cyclictest3260877-21/usr/sbin/munin22:52:570
3039556993525,8cyclictest3260877-21/usr/sbin/munin22:52:570
3039560993429,3cyclictest3251734-21irqrtprio22:42:541
3039560993424,8cyclictest3101094-21apt-get20:10:001
3039556993429,3cyclictest3091201-21kworker/u8:3+events_unbound21:30:000
3039556993419,13cyclictest275-21systemd-journal22:22:060
3039556993329,2cyclictest3131093-21base6420:40:010
3039556993328,3cyclictest401-21dbus-daemon23:25:000
3039556993326,5cyclictest3225543-21grep22:13:040
3039562993227,4cyclictest3015219-21kworker/u8:4+flush-8:019:15:052
3039560993222,8cyclictest3185179-21ntpq21:33:011
3039556993227,4cyclictest3044636-21kworker/u8:0+flush-8:019:32:520
3039556993128,2cyclictest3320981-21irqrtprio23:52:540
3039556993127,3cyclictest3070984-21kworker/u8:2+flush-8:020:13:060
3039556993126,4cyclictest3335204-21kworker/u8:1+events_unbound00:08:060
3039556993126,3cyclictest3095327-21needreboot20:02:580
3039556993123,6cyclictest0-21swapper/022:42:590
3039556993121,8cyclictest275-21systemd-journal19:25:000
3039556993119,9cyclictest275-21systemd-journal19:30:000
3039560993026,2cyclictest3361129-21irqrtprio00:32:541
3039556993024,4cyclictest3166065-21cron21:15:010
3039562992926,2cyclictest3165825-21unixbench_multi21:13:052
3039562992925,2cyclictest3061011-21unixbench_multi19:28:052
3039560992925,3cyclictest3276479-21irqrtprio23:07:541
3039560992925,3cyclictest3171270-21kworker/u8:2+events_unbound21:43:051
3039560992925,3cyclictest3171270-21kworker/u8:2+events_unbound21:43:051
3039560992924,4cyclictest3240645-21cron22:30:001
3039560992924,4cyclictest3200712-21latency_hist21:50:001
3039560992924,4cyclictest3200712-21latency_hist21:50:001
3039560992924,3cyclictest3151001-21unixbench_singl20:58:051
3039560992923,4cyclictest3146104-21unixbench_singl20:53:061
3039556992923,4cyclictest3070984-21kworker/u8:2+events_unbound19:42:490
3039556992922,5cyclictest3200715-21turbostat.cron21:49:590
3039556992922,5cyclictest3200715-21turbostat.cron21:49:590
3039556992922,5cyclictest3195557-21unixbench_multi21:43:070
3039556992922,5cyclictest3195557-21unixbench_multi21:43:070
3039556992922,5cyclictest3171448-21/usr/sbin/munin21:23:040
3039562992825,2cyclictest3116750-21aten2_r5power_p20:27:482
3039562992825,2cyclictest0-21swapper/222:59:592
3039562992823,4cyclictest3091201-21kworker/u8:3+flush-8:023:18:052
3039560992822,4cyclictest3125870-21unixbench_singl20:33:061
3039560992817,9cyclictest3190190-21ntpq21:38:011
3039556992824,3cyclictest3116212-21idleruntime-cro20:25:000
3039556992824,2cyclictest3349053-21needreboot00:17:570
3039556992824,2cyclictest3146973-21cut20:57:500
3039556992823,3cyclictest3171036-21systemd-run21:20:000
3039562992710,3cyclictest3334947-21idleruntime-cro00:05:002
3039560992723,3cyclictest3049018-21kthreadcore19:17:561
3039560992721,4cyclictest3270134-21unixbench_singl22:58:051
3039560992720,5cyclictest3066217-21latency_hist19:35:011
3039560992720,5cyclictest0-21swapper/119:48:061
3039556992723,2cyclictest3310613-21cpuspeed_turbos23:42:490
3039556992722,2cyclictest0-21swapper/022:40:000
3039556992721,4cyclictest3305668-21cpuspeed_turbos23:37:500
3039556992721,4cyclictest0-21swapper/023:20:010
3039556992720,4cyclictest0-21swapper/000:00:000
3039556992719,6cyclictest0-21swapper/021:52:460
3039562992621,4cyclictest3076358-21kworker/u8:0+flush-8:019:48:082
3039562992620,4cyclictest3324523-21unixbench_multi23:53:072
3039560992621,3cyclictest3058943-21kthreadcore19:27:551
3039560992619,6cyclictest3161612-21aten2_r5power_c21:12:471
3039556992622,2cyclictest0-21swapper/020:45:010
3039556992621,4cyclictest3125343-21ntp_kernel_pll_20:32:590
3039556992621,3cyclictest3219980-21needreboot22:07:570
3039556992620,4cyclictest3160270-21wc21:07:570
3039556992620,4cyclictest0-21swapper/023:15:000
3039556992618,6cyclictest3230769-21latency_hist22:20:010
3039556992618,5cyclictest3085478-21ntpq19:52:580
3039556992617,7cyclictest3215814-21latency_hist22:05:010
305131922514,7sleep30-21swapper/319:20:003
3039562992522,2cyclictest3107042-21fschecks_time20:17:502
3039562992520,4cyclictest3240125-21mailstats22:28:042
3039562992520,3cyclictest3271012-21cpuspeed_turbos23:02:482
3039560992521,3cyclictest3289857-21kworker/u8:0+flush-8:000:05:101
3039560992521,3cyclictest1-21systemd20:29:461
3039560992521,2cyclictest3248212-21kthreadcore22:37:541
3039560992520,4cyclictest3210836-21sh22:00:001
3039560992520,4cyclictest0-21swapper/122:50:001
3039560992520,3cyclictest0-21swapper/100:05:011
3039560992519,4cyclictest3091201-21kworker/u8:3+flush-8:023:44:101
3039556992523,1cyclictest0-21swapper/019:38:020
3039556992521,3cyclictest3087609-21kthreadcore19:57:540
3039556992519,3cyclictest0-21swapper/021:02:450
3039556992519,3cyclictest0-21swapper/019:15:000
3039556992519,3cyclictest0-21swapper/019:15:000
3039556992518,5cyclictest3185634-21unixbench_multi21:33:060
31385032240,6sleep3451irq_work/320:47:543
3039562992421,2cyclictest3251071-21aten2_r5power_e22:42:492
3039562992421,2cyclictest3241153-21aten2_r5power_c22:32:482
3039562992421,2cyclictest3216632-21fschecks_time22:07:502
3039562992420,3cyclictest3325696-21cpuspeed_turbos23:57:482
3039562992420,3cyclictest3216060-21kworker/u8:2+events_unbound23:07:542
3039562992420,2cyclictest3121631-21aten2_r5power_c20:32:482
3039562992420,2cyclictest3066982-21fschecks_time19:37:482
3039562992419,3cyclictest3315673-21fschecks_time23:47:492
3039560992420,3cyclictest3216060-21kworker/u8:2+events_unbound22:20:001
3039560992420,2cyclictest3205929-21systemd-run21:55:021
3039560992420,2cyclictest0-21swapper/123:55:001
3039560992420,2cyclictest0-21swapper/122:33:021
3039560992420,2cyclictest0-21swapper/120:40:011
3039560992420,2cyclictest0-21swapper/119:10:001
3039560992419,4cyclictest3086038-21unixbench_singl19:53:061
3039560992419,4cyclictest0-21swapper/100:15:001
3039560992419,3cyclictest3309909-21turbostat.cron23:40:001
3039560992419,3cyclictest0-21swapper/120:00:021
3039560992416,6cyclictest3349615-21unixbench_multi00:18:051
3039560992416,6cyclictest3270647-21kworker/u8:1+flush-8:023:21:101
3039556992420,2cyclictest3237103-21kthreadcore22:27:550
3039556992416,3cyclictest3091201-21kworker/u8:3+flush-8:022:47:500
3039562992319,3cyclictest3091201-21kworker/u8:3+events_unbound20:53:062
3039562992318,4cyclictest3330187-21kworker/u8:3+flush-8:000:13:082
3039562992317,4cyclictest3052048-21cpuspeed_turbos19:22:482
3039560992319,2cyclictest3112295-21irqcore20:22:551
3039560992319,2cyclictest0-21swapper/123:48:051
3039560992319,2cyclictest0-21swapper/100:00:001
3039560992318,3cyclictest3056305-21cron19:24:591
3039560992317,4cyclictest3216998-21irqrtprio22:07:531
3039560992316,5cyclictest3161117-21latency_hist21:10:011
3039560992313,8cyclictest3135473-21ntpq20:42:591
3039562992219,2cyclictest3196531-21fschecks_count21:47:502
3039562992219,2cyclictest3196531-21fschecks_count21:47:502
3039562992219,2cyclictest3096804-21cpuspeed_turbos20:07:502
3039562992218,2cyclictest3111739-21aten2_r5power_c20:22:502
3039562992217,3cyclictest275-21systemd-journal22:40:002
3039562992217,3cyclictest0-21swapper/200:18:052
303956099228,5cyclictest0-21swapper/120:02:361
303956099227,5cyclictest0-21swapper/100:27:301
3039560992218,2cyclictest0-21swapper/120:47:521
3039560992217,3cyclictest0-21swapper/123:17:481
3039556992217,3cyclictest3360933-21irqcore00:32:530
3039556992217,3cyclictest0-21swapper/023:02:570
3039556992216,4cyclictest3359446-21mailstats00:28:030
3039556992216,4cyclictest3116446-21kworker/u8:1+flush-8:021:55:060
3039556992214,5cyclictest0-21swapper/020:27:590
3039562992118,2cyclictest3265119-21unixbench_multi22:53:052
3039562992118,2cyclictest3265119-21unixbench_multi22:53:052
3039562992117,3cyclictest3295619-21aten2_r5power_p23:27:462
3039562992117,2cyclictest3151767-21aten2_r5power_p21:02:492
3039562992117,2cyclictest0-21swapper/220:45:012
3039562992116,4cyclictest3161121-21idleruntime-cro21:10:002
3039562992116,4cyclictest2794505-21kworker/u8:1+flush-8:019:33:072
3039562992116,3cyclictest3335693-21fschecks_count00:07:512
3039562992115,4cyclictest573-21runrttasks00:22:492
303956099218,5cyclictest0-21swapper/122:04:051
3039560992117,3cyclictest3091201-21kworker/u8:3+flush-8:021:27:361
3039560992117,2cyclictest0-21swapper/122:23:051
3039560992117,2cyclictest0-21swapper/120:17:521
3039560992117,2cyclictest0-21swapper/120:12:511
3039560992117,2cyclictest0-21swapper/100:37:551
3039560992115,4cyclictest0-21swapper/123:32:491
3039556992117,3cyclictest3216060-21kworker/u8:2+flush-8:023:07:230
3039556992113,6cyclictest0-21swapper/023:27:460
3039562992017,2cyclictest3226386-21aten2_r5power_v22:17:502
3039562992016,3cyclictest3300669-21cpuspeed_turbos23:32:472
3039562992015,4cyclictest3364662-21unixbench_singl00:33:072
3039562992015,4cyclictest20823-21cron22:15:002
3039562992015,3cyclictest3355730-21fschecks_count00:27:502
3039562992012,6cyclictest3173149-21cut21:22:552
3039560992016,3cyclictest0-21swapper/123:13:061
3039556992018,1cyclictest0-21swapper/000:38:030
3039562991915,2cyclictest0-21swapper/220:02:592
3039562991914,3cyclictest3180920-21cron21:30:002
3039562991911,6cyclictest3234401-21cut22:22:562
3039562991911,6cyclictest3085640-21grep19:53:032
3039562991910,6cyclictest275-21systemd-journal22:03:052
303956299190,17cyclictest3290845-21cut23:22:492
3039556991917,1cyclictest0-21swapper/019:10:000
30349262193,9sleep30-21swapper/319:07:233
30347562196,10sleep20-21swapper/219:05:102
3039562991815,2cyclictest0-21swapper/220:13:052
3039562991814,3cyclictest0-21swapper/220:48:062
3039562991814,2cyclictest0-21swapper/223:40:002
3039562991812,4cyclictest3166773-21tr21:17:482
31906332170,2chrt575-21kworker/3:2-events21:38:053
303956299179,6cyclictest3149039-21tr20:57:552
303956299174,9cyclictest3365334-21apt-get00:37:462
3039562991714,2cyclictest3281037-21fschecks_time23:12:512
303956299171,12cyclictest3185111-21ntpq21:32:592
303956299167,7cyclictest3256833-21cut22:47:532
303956299167,7cyclictest3192208-21sed21:42:552
303956299167,7cyclictest3192208-21sed21:42:552
303956299167,7cyclictest275-21systemd-journal22:00:002
3039562991612,2cyclictest0-21swapper/221:38:052
3039562991612,2cyclictest0-21swapper/219:58:042
303956299161,11cyclictest3313064-21kthreadcore23:42:562
32583372152,9sleep30-21swapper/322:47:563
303956299155,7cyclictest3201486-21cut21:52:472
33165112145,5sleep30-21swapper/323:47:543
33042372142,8sleep30-21swapper/323:32:583
33655802132,7sleep30-21swapper/300:37:503
33648582132,6sleep30-21swapper/300:35:013
33441382132,8sleep30-21swapper/300:13:023
32901572132,6sleep30-21swapper/323:20:023
32506382132,6sleep30-21swapper/322:40:013
32447132132,7sleep30-21swapper/322:32:593
31957632132,6sleep30-21swapper/321:45:003
31957632132,6sleep30-21swapper/321:45:003
31709792132,6sleep30-21swapper/321:20:013
31611462132,6sleep30-21swapper/321:10:023
31606402132,7sleep30-21swapper/321:08:053
31251922132,7sleep30-21swapper/320:32:583
31062492132,6sleep30-21swapper/320:15:013
33503262122,6sleep30-21swapper/300:22:493
33492852122,6sleep30-21swapper/300:18:043
33349232121,7sleep30-21swapper/300:05:003
33247632120,6sleep30-21swapper/323:55:013
33212222122,6sleep30-21swapper/323:52:563
32891922122,6sleep30-21swapper/323:17:573
32809962122,6sleep30-21swapper/323:12:523
32755962122,6sleep30-21swapper/323:06:053
32752762122,5sleep30-21swapper/323:05:013
32702962122,6sleep30-21swapper/323:00:013
32465792122,6sleep30-21swapper/322:37:533
32401932122,6sleep30-21swapper/322:28:063
32258442122,6sleep30-21swapper/322:15:023
32202232122,6sleep30-21swapper/322:08:043
32108262122,5sleep30-21swapper/322:00:023
32011772122,6sleep30-21swapper/321:50:063
31536082122,6sleep30-21swapper/321:02:553
31436592122,6sleep30-21swapper/320:52:563
31276822122,6sleep30-21swapper/320:37:563
31068852122,6sleep30-21swapper/320:17:493
30961502122,5sleep30-21swapper/320:05:013
30903982122,7sleep30-21swapper/319:57:593
30853362122,6sleep30-21swapper/319:52:583
30803692122,6sleep30-21swapper/319:48:003
30721162122,6sleep30-21swapper/319:42:553
30669222123,5sleep30-21swapper/319:37:493
30622612122,6sleep30-21swapper/319:32:563
30570232122,6sleep30-21swapper/319:27:503
30435922122,6sleep30-21swapper/319:12:573
30435922122,6sleep30-21swapper/319:12:573
33552362112,6sleep30-21swapper/300:25:103
33351942112,6sleep30-21swapper/300:05:243
33141612113,5sleep30-21swapper/323:43:013
33056802111,6sleep30-21swapper/323:37:513
32614882112,5sleep30-21swapper/322:52:533
32614882112,5sleep30-21swapper/322:52:533
32312522112,6sleep30-21swapper/322:22:483
32215372112,5sleep30-21swapper/322:12:493
32112342112,6sleep30-21swapper/322:01:583
31762182112,5sleep30-21swapper/321:25:023
31717132112,6sleep30-21swapper/321:22:503
31466702112,6sleep30-21swapper/320:57:063
31360852112,5sleep30-21swapper/320:43:543
31114692112,5sleep30-21swapper/320:20:023
30914162112,5sleep30-21swapper/320:00:133
30516152112,6sleep30-21swapper/319:20:323
31164282102,5sleep30-21swapper/320:25:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional