You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 15:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri May 22, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316191121870,3sleep375-21kworker/3:1+events22:40:013
30298952720,1chrt3029900-21kthreadcore20:25:531
31014152710,3sleep2371rcuc/221:36:042
30812802640,1sleep13081281-21missed_timers21:15:561
31140602550,2sleep375-21kworker/3:1-events21:50:533
2951386995543,8cyclictest1704890-21systemd-journal20:55:411
2951386995341,9cyclictest3195636-21ntpq23:11:001
2951388995243,6cyclictest1704890-21systemd-journal21:30:012
30039002510,6sleep20-21swapper/220:00:542
2951383995140,9cyclictest2955370-21ntpq19:11:020
2951386995044,4cyclictest3056642-21kworker/u8:0+flush-8:022:05:471
2951383995044,4cyclictest3191850-21apt-get23:10:440
2951388994938,8cyclictest1704890-21systemd-journal00:09:592
2951386994837,8cyclictest1704890-21systemd-journal19:15:411
2951386994738,6cyclictest3241533-21kworker/u8:2+flush-8:000:35:501
2951386994736,8cyclictest1704890-21systemd-journal21:34:411
2951383994738,7cyclictest3170907-21ntpq22:45:570
2951386994640,4cyclictest3142169-21apt-get22:20:451
2951386994639,5cyclictest3112237-21/usr/sbin/munin21:50:561
2951386994535,8cyclictest3150917-21ntpq22:25:581
2951386994533,9cyclictest1704890-21systemd-journal23:46:391
2951383994538,5cyclictest3225694-21ntpq23:40:570
2951386994436,6cyclictest3082593-21/usr/sbin/munin21:21:021
2951383994438,4cyclictest3056642-21kworker/u8:0+events_unbound23:55:550
2951388994339,3cyclictest3056642-21kworker/u8:0+flush-8:023:25:012
2951388994339,3cyclictest2946128-21kworker/u8:2+events_unbound19:20:002
2951388994338,3cyclictest3056642-21kworker/u8:0+flush-8:000:25:592
2951388994336,4cyclictest3066562-21kworker/u8:1+flush-8:022:20:552
2951386994336,4cyclictest3056642-21kworker/u8:0+flush-8:000:15:501
2951386994333,8cyclictest3245568-21ntpq00:00:571
2951386994333,7cyclictest3067714-21/usr/sbin/munin21:06:001
2951383994335,6cyclictest3062482-21latency_hist21:00:020
2951388994238,3cyclictest2097876-21kworker/u8:1+flush-8:020:36:032
2951388994234,6cyclictest1704890-21systemd-journal23:11:402
2951386994236,4cyclictest2963437-21apt-get19:20:431
2951386994233,6cyclictest3172045-21/usr/sbin/munin22:50:591
2951383994235,5cyclictest3212079-21apt-get23:30:450
31595722410,3sleep20-21swapper/222:35:542
2951388994135,4cyclictest3156772-21kworker/u8:1+flush-8:023:26:022
2951388994133,6cyclictest3082302-21awk21:20:012
2951386994133,6cyclictest3231829-21/usr/sbin/munin23:50:591
2951383994134,5cyclictest1704890-21systemd-journal23:05:000
2951383994131,7cyclictest3111953-21latency_hist21:50:010
2951386994034,4cyclictest3196781-21apt-get23:15:421
2951386994024,11cyclictest1704890-21systemd-journal20:47:411
295138399402,36cyclictest1531336-21kworker/0:2+events20:20:010
30430452390,1sleep13043047-21basename20:40:451
2951383993930,7cyclictest2997730-21http19:55:010
2951383993929,8cyclictest3013043-21/usr/sbin/munin20:10:550
2951388993833,3cyclictest3056642-21kworker/u8:0+flush-8:023:40:532
2951386993833,4cyclictest3072637-21kworker/u8:2+flush-8:021:25:521
2951386993831,5cyclictest2997702-21cron19:54:591
2951386993831,4cyclictest3056642-21kworker/u8:0+events_unbound23:30:011
2951383993829,7cyclictest3008091-21/usr/sbin/munin20:05:560
2951388993728,7cyclictest3122269-21cp22:00:002
2951386993732,3cyclictest2946128-21kworker/u8:2+events_unbound20:06:011
2951383993730,5cyclictest3255951-21grep00:11:070
2951383993730,5cyclictest3255951-21grep00:11:060
2951383993726,9cyclictest2962233-21ntpq19:15:580
29510312374,10sleep10-21swapper/119:08:011
2951388993632,3cyclictest3066562-21kworker/u8:1+flush-8:021:00:592
2951388993631,4cyclictest3072637-21kworker/u8:2+flush-8:021:31:002
2951388993631,3cyclictest3225557-21kworker/u8:3+events_unbound23:45:042
2951388993630,4cyclictest3151759-21apt-get22:30:012
2951388993629,5cyclictest2946128-21kworker/u8:2+flush-8:019:35:532
2951386993631,3cyclictest2968393-21apt-get19:25:441
2951386993627,6cyclictest1704890-21systemd-journal19:46:421
2951386993530,3cyclictest3177027-21apt-get22:55:441
2951386993529,4cyclictest3156772-21kworker/u8:1+events_unbound23:00:491
2951386993526,7cyclictest3261580-21apt-get00:20:441
2951386993523,8cyclictest1704890-21systemd-journal20:01:411
295138399353,30cyclictest3082332-21kworker/0:0+events23:05:470
295138399352,27cyclictest3082332-21kworker/0:0+events21:55:460
295138399351,28cyclictest3082332-21kworker/0:0+events22:25:450
295138399351,28cyclictest1531336-21kworker/0:2+events19:25:010
295138399351,27cyclictest1531336-21kworker/0:2+events19:40:450
294718923525,6sleep20-21swapper/219:05:522
2951388993430,3cyclictest3032992-21kworker/u8:3+flush-8:020:40:502
2951388993427,5cyclictest3002891-21awk20:00:012
2951388993425,7cyclictest3241420-21awk00:00:002
2951386993427,5cyclictest3056642-21kworker/u8:0+flush-8:021:00:491
2951386993427,5cyclictest3056642-21kworker/u8:0+flush-8:000:25:501
2951386993427,5cyclictest2986933-21ntpq19:40:561
2951383993429,3cyclictest3056642-21kworker/u8:0+flush-8:000:15:550
2951383993427,5cyclictest3142418-21diskstats22:20:490
295138399342,30cyclictest3027616-21kworker/0:1+events20:25:470
295138399342,27cyclictest3027616-21kworker/0:1+events20:30:450
295138399341,31cyclictest3082332-21kworker/0:0+events22:30:470
295138399341,27cyclictest3221680-21kworker/0:1+events00:05:000
2951383993410,19cyclictest3082332-21kworker/0:0+events22:20:010
2951383993410,19cyclictest3082332-21kworker/0:0+events22:20:010
2951388993328,4cyclictest3170891-21kworker/u8:2+flush-8:022:45:582
2951386993328,4cyclictest3170891-21kworker/u8:2+flush-8:023:31:151
2951386993328,3cyclictest3056642-21kworker/u8:0+events_unbound00:05:531
2951386993326,5cyclictest2998250-21apt-get19:55:431
2951386993324,7cyclictest3157200-21/usr/sbin/munin22:35:571
2951386993323,8cyclictest3141051-21ntpq22:16:021
2951386993323,8cyclictest3141051-21ntpq22:16:011
2951388993228,3cyclictest2097876-21kworker/u8:1+events_unbound20:20:002
2951386993224,6cyclictest2097876-21kworker/u8:1+flush-8:020:15:581
295138399323,27cyclictest1531336-21kworker/0:2+events19:45:570
2951383993227,3cyclictest3207636-21irqrtprio23:25:520
295138399322,29cyclictest1531336-21kworker/0:2+events20:00:010
295138399322,28cyclictest3261313-21kworker/0:0+events00:30:570
295138399321,29cyclictest3082332-21kworker/0:0+events22:52:350
2951386993126,3cyclictest3121801-21cron22:00:001
2951386993124,5cyclictest3201739-21apt-get23:20:441
2951386993122,7cyclictest3275296-21ntpq00:31:011
2951386993121,8cyclictest3026674-21ntpq20:20:571
2951383993125,4cyclictest3265829-21unixbench_multi00:21:050
295138399311,29cyclictest3082332-21kworker/0:0+events22:01:090
295138399311,29cyclictest3027616-21kworker/0:1+events20:45:570
295138399311,28cyclictest3082332-21kworker/0:0+events23:15:470
2951386993025,4cyclictest3032992-21kworker/u8:3+flush-8:020:30:491
2951386993024,4cyclictest3056642-21kworker/u8:0+flush-8:022:45:571
2951386993024,4cyclictest3056642-21kworker/u8:0+flush-8:022:01:021
2951386993024,4cyclictest2946128-21kworker/u8:2+events_unbound19:35:471
2951386993023,5cyclictest3102397-21apt-get21:40:451
2951386993023,5cyclictest3066562-21kworker/u8:1+events_unbound21:36:011
295138399308,17cyclictest3082332-21kworker/0:0+events22:10:010
2951383993024,4cyclictest2946128-21kworker/u8:2+flush-8:019:26:120
295138399302,27cyclictest3082332-21kworker/0:0+events21:21:010
295138399302,27cyclictest3027616-21kworker/0:1+events21:11:030
295138399302,26cyclictest3082332-21kworker/0:0+events22:55:440
295138399302,26cyclictest3082332-21kworker/0:0+events22:10:440
295138399302,26cyclictest3082332-21kworker/0:0+events21:51:050
295138399301,28cyclictest3082332-21kworker/0:0+events21:40:460
295138399301,27cyclictest3027616-21kworker/0:1+events21:06:010
2951383993010,15cyclictest3261313-21kworker/0:0+events00:35:470
295138399300,29cyclictest3221680-21kworker/0:1+events23:46:430
295138399300,28cyclictest3082332-21kworker/0:0+events22:35:490
2951388992925,2cyclictest3052921-21aten2_r5power_c20:50:452
2951386992924,3cyclictest3191539-21turbostat.cron23:10:001
2951386992923,4cyclictest3056642-21kworker/u8:0+flush-8:023:35:551
2951386992923,4cyclictest3056642-21kworker/u8:0+events_unbound20:50:581
2951386992919,8cyclictest3255452-21ntpq00:11:001
2951386992919,8cyclictest3255452-21ntpq00:11:001
2951383992924,3cyclictest3236485-21systemd-run23:55:000
295138399291,26cyclictest3027616-21kworker/0:1+events20:35:440
2951383992912,16cyclictest3082332-21kworker/0:0+events21:25:530
2951383992910,18cyclictest3221680-21kworker/0:1+events00:08:590
2951388992824,2cyclictest3048044-21aten2_r5power_p20:45:462
2951388992824,2cyclictest2973644-21fschecks_time19:30:492
2951388992823,3cyclictest3056642-21kworker/u8:0+flush-8:021:10:322
2951386992823,3cyclictest3015215-21kthreadcore20:10:521
295138399282,21cyclictest3261313-21kworker/0:0+events00:25:080
2951383992820,6cyclictest3003207-21apt-get20:00:460
295138399281,26cyclictest3082332-21kworker/0:0+events21:37:190
295138399281,26cyclictest3027616-21kworker/0:1+events21:00:450
295138399281,11cyclictest589-21runrttasks23:35:460
2951388992724,2cyclictest3172183-21aten2_r5power_v22:50:462
2951388992721,4cyclictest3280623-21unixbench_multi00:36:062
2951386992723,3cyclictest3241429-21munin-run00:00:001
2951386992720,5cyclictest3077359-21turbostat.cron21:15:001
2951386992718,6cyclictest3136937-21latency_hist22:15:011
295138399277,15cyclictest3082332-21kworker/0:0+events21:30:450
2951383992723,2cyclictest3202053-21fschecks_time23:20:500
2951383992710,15cyclictest3027616-21kworker/0:1+events20:45:010
2951388992623,2cyclictest3242174-21fschecks_time00:00:502
2951388992622,3cyclictest2946128-21kworker/u8:2+events_unbound20:30:042
2951388992622,2cyclictest0-21swapper/219:55:012
2951386992619,5cyclictest3041800-21ntpq20:35:571
2951386992618,6cyclictest3066562-21kworker/u8:1+flush-8:021:45:571
295138399268,17cyclictest3082332-21kworker/0:0+events22:40:560
295138399268,13cyclictest1531336-21kworker/0:2+events19:35:250
2951383992611,14cyclictest1531336-21kworker/0:2+events19:30:520
2951388992521,3cyclictest3170891-21kworker/u8:2+flush-8:023:40:002
2951388992519,4cyclictest3185664-21needreboot23:00:562
2951386992521,3cyclictest3127036-21kworker/u8:3+flush-8:022:30:571
2951386992518,5cyclictest3056642-21kworker/u8:0+flush-8:022:41:011
295138399253,21cyclictest1531336-21kworker/0:2+events20:21:040
29510102253,3sleep00-21swapper/019:07:440
2951388992420,3cyclictest3162262-21aten2_r5power_e22:40:472
2951388992420,2cyclictest3107359-21aten2_r5power_c21:45:442
2951388992418,4cyclictest2097876-21kworker/u8:1+flush-8:020:10:062
2951386992418,4cyclictest2973579-21diskstats19:30:491
295138399248,15cyclictest3027616-21kworker/0:1+events20:50:020
295138399240,23cyclictest3027616-21kworker/0:1+events21:16:230
2951388992321,1cyclictest3216738-21awk23:35:002
2951388992320,2cyclictest3032156-21unixbench_singl20:26:022
2951388992320,2cyclictest2987428-21unixbench_multi19:41:032
2951388992319,2cyclictest3261798-21cpuspeed_turbos00:20:472
2951388992319,2cyclictest3008334-21cpuspeed_turbos20:05:472
2951386992316,5cyclictest3221965-21apt-get23:40:441
295138899229,4cyclictest0-21swapper/221:05:472
295138899225,3cyclictest39-21ksoftirqd/221:55:562
2951388992219,2cyclictest3271799-21fschecks_time00:30:502
2951388992218,2cyclictest3082677-21aten2_r5power_e21:20:492
2951388992117,3cyclictest2946128-21kworker/u8:2+flush-8:020:20:112
2951388992117,3cyclictest20977-21cron23:00:002
2951388992116,3cyclictest2597406-21kworker/u8:4+events_unbound19:11:072
2951388992112,7cyclictest3258582-21tr00:15:532
2951386992115,3cyclictest0-21swapper/119:10:541
2951388992016,2cyclictest0-21swapper/223:50:482
2951388992011,7cyclictest2992082-21grep19:46:022
2951388991914,3cyclictest2967675-21unixbench_multi19:21:032
29468792193,9sleep30-21swapper/319:05:503
295138899189,8cyclictest3156911-21cron22:35:012
2951388991814,2cyclictest3252040-21fschecks_time00:10:502
2951388991814,2cyclictest3252040-21fschecks_time00:10:502
2951388991814,2cyclictest3191138-21unixbench_multi23:06:052
2951388991814,2cyclictest0-21swapper/219:26:192
2951388991713,3cyclictest3056642-21kworker/u8:0+events_unbound22:05:022
2951388991713,2cyclictest3116326-21switchtime21:51:032
2951388991713,2cyclictest0-21swapper/222:10:562
2951388991712,3cyclictest0-21swapper/223:15:512
2951388991711,4cyclictest3141868-21sendmail22:20:002
2951388991711,4cyclictest3141868-21sendmail22:19:592
295138899162,9cyclictest3106210-21ntpq21:41:022
2951388991611,3cyclictest0-21swapper/220:55:512
29672262142,8sleep30-21swapper/319:20:593
32761022132,6sleep30-21swapper/300:35:013
31857442132,7sleep30-21swapper/323:01:003
31662812132,7sleep30-21swapper/322:41:063
31410322132,7sleep30-21swapper/322:16:023
31410322132,7sleep30-21swapper/322:16:013
31319582132,7sleep30-21swapper/322:10:003
31261302132,7sleep30-21swapper/322:01:013
30625242132,6sleep30-21swapper/321:00:013
30575072132,6sleep30-21swapper/320:55:013
30325132132,6sleep30-21swapper/320:30:003
32603842122,6sleep30-21swapper/300:16:003
32522162122,6sleep30-21swapper/300:10:543
32522162122,6sleep30-21swapper/300:10:543
32467302122,6sleep30-21swapper/300:05:453
32364862122,5sleep30-21swapper/323:55:013
32311802122,6sleep30-21swapper/323:46:063
32115572122,5sleep30-21swapper/323:30:013
32068492122,6sleep30-21swapper/323:25:203
32020552122,6sleep30-21swapper/323:20:503
32006262122,6sleep30-21swapper/323:16:013
31871642122,6sleep30-21swapper/323:05:503
31770312122,6sleep30-21swapper/322:55:473
31521002122,5sleep30-21swapper/322:30:023
31073312124,5sleep30-21swapper/321:45:453
30971242122,5sleep30-21swapper/321:35:013
30873442122,5sleep30-21swapper/321:25:023
30864712122,6sleep30-21swapper/321:21:053
30776632122,6sleep30-21swapper/321:15:463
30677112123,5sleep30-21swapper/321:05:443
30517122122,6sleep30-21swapper/320:45:573
30432532122,6sleep30-21swapper/320:40:483
30232162122,6sleep30-21swapper/320:20:503
30074862122,6sleep30-21swapper/320:01:083
29977892122,5sleep30-21swapper/319:55:013
29936072122,6sleep30-21swapper/319:50:533
29835532121,7sleep30-21swapper/319:40:483
29809942122,6sleep30-21swapper/319:35:563
29771752122,6sleep30-21swapper/319:31:023
29624892122,6sleep30-21swapper/319:16:063
32754422112,6sleep30-21swapper/300:31:053
32665192112,5sleep30-21swapper/300:25:473
32652682112,5sleep30-21swapper/300:20:573
32461362112,5sleep30-21swapper/300:01:073
32318282112,5sleep30-21swapper/323:50:433
32225882112,5sleep30-21swapper/323:40:533
32209242112,5sleep30-21swapper/323:36:023
31918192112,5sleep30-21swapper/323:10:433
31729562112,5sleep30-21swapper/322:50:533
31671092112,5sleep30-21swapper/322:45:433
31480512112,5sleep30-21swapper/322:25:533
31331592112,5sleep30-21swapper/322:10:533
31172012112,5sleep30-21swapper/321:55:483
31069832112,6sleep30-21swapper/321:44:403
30964452112,5sleep30-21swapper/321:31:033
30729462112,6sleep30-21swapper/321:10:503
30615682112,5sleep30-21swapper/320:55:573
30379442112,5sleep30-21swapper/320:35:023
30333152112,5sleep30-21swapper/320:30:493
30188662112,5sleep30-21swapper/320:15:523
30129902112,5sleep30-21swapper/320:10:023
30126232112,6sleep30-21swapper/320:08:183
29880692112,5sleep30-21swapper/319:45:033
29683602113,5sleep30-21swapper/319:25:403
29516342112,5sleep30-21swapper/319:10:523
31422012101,5sleep30-21swapper/322:20:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional