You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 02:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue May 19, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37010322660,6sleep20-21swapper/222:30:562
37010322660,6sleep20-21swapper/222:30:552
3498237995142,6cyclictest3624201-21latency_hist21:15:011
3498237994941,6cyclictest3594576-21latency_hist20:45:011
3498237994940,6cyclictest3753118-21latency_hist23:25:011
3498232994942,5cyclictest3514972-21base6419:25:000
3498232994941,5cyclictest3777786-21latency_hist23:50:000
3498237994839,6cyclictest3738276-21latency_hist23:10:011
3498232994837,9cyclictest3727458-21ntpq22:55:590
3498232994741,4cyclictest3599258-21kworker/u8:3+flush-8:021:46:000
3498237994539,4cyclictest3478725-21kworker/u8:1+flush-8:020:05:511
3498237994536,6cyclictest3520044-21latency_hist19:30:011
3498237994536,6cyclictest3520044-21latency_hist19:30:011
3498232994438,4cyclictest3498083-21kworker/u8:0+flush-8:021:16:040
3498232994437,5cyclictest3678457-21kworker/u8:2+flush-8:022:20:530
3498237994337,4cyclictest3599258-21kworker/u8:3+flush-8:023:51:041
3498237994334,6cyclictest3639054-21latency_hist21:30:011
3498232994336,5cyclictest2658328-21kworker/u8:3+flush-8:019:30:510
3498237994238,3cyclictest3498083-21kworker/u8:0+flush-8:020:31:031
3498237994236,4cyclictest3478725-21kworker/u8:1+flush-8:020:46:041
3498237994235,5cyclictest3740997-21kworker/u8:0+flush-8:023:16:051
3498237994234,6cyclictest3549071-21ntpq19:56:041
3498237994234,5cyclictest3589617-21latency_hist20:40:011
3498237994232,8cyclictest3573737-21ntpq20:21:001
3498232994132,6cyclictest3817457-21latency_hist00:30:010
3498232994131,8cyclictest3682757-21ntpq22:11:010
36827872400,3sleep20-21swapper/222:11:022
3498241994036,3cyclictest3812084-21kworker/u8:1+events_unbound00:31:222
3498241994032,6cyclictest1704890-21systemd-journal19:20:332
3498237994034,4cyclictest3740997-21kworker/u8:0+flush-8:000:21:081
3498237994031,6cyclictest3678628-21latency_hist22:10:011
3498232994034,4cyclictest3549896-21kworker/u8:2+flush-8:020:26:010
3498237993933,4cyclictest3644215-21kworker/u8:1+flush-8:021:45:501
3498237993929,8cyclictest3613487-21ntpq21:01:011
349823299391,34cyclictest3827398-21munin-run00:40:010
3498232993833,4cyclictest3498083-21kworker/u8:0+flush-8:020:10:510
34980402384,31sleep20-21swapper/219:09:572
3498237993732,4cyclictest3498083-21kworker/u8:0+flush-8:019:20:001
3498237993732,3cyclictest3740997-21kworker/u8:0+flush-8:000:05:001
3498237993730,5cyclictest3498083-21kworker/u8:0+flush-8:020:15:521
3498232993731,4cyclictest3644215-21kworker/u8:1+flush-8:022:06:080
3498232993728,7cyclictest3653081-21ntpq21:41:010
3498232993728,6cyclictest3498056-21latency_hist19:10:010
3498237993631,3cyclictest3739304-21irqrtprio23:10:541
3498237993630,4cyclictest1704890-21systemd-journal23:55:331
3498237993629,5cyclictest3664070-21apt-get21:55:451
3498232993630,4cyclictest3727684-21kworker/u8:2+events_unbound23:20:000
3498232993628,6cyclictest3782307-21grep23:51:110
3498232993628,6cyclictest3757212-21ntpq23:26:040
3498241993531,3cyclictest3498083-21kworker/u8:0+events_unbound20:16:072
3498237993529,4cyclictest3698746-21apt-get22:30:471
3498237993529,4cyclictest3698746-21apt-get22:30:461
3498232993531,3cyclictest3599258-21kworker/u8:3+flush-8:022:45:540
3498232993530,4cyclictest3478725-21kworker/u8:1+flush-8:020:45:520
3498232993529,4cyclictest3703407-21kworker/u8:0+flush-8:022:40:520
3498232993529,4cyclictest3498083-21kworker/u8:0+flush-8:021:31:030
3498232993525,8cyclictest3702490-21ntpq22:31:000
3498232993525,8cyclictest3702490-21ntpq22:30:590
3498237993428,4cyclictest3683920-21apt-get22:15:471
3498232993430,3cyclictest3727684-21kworker/u8:2+flush-8:023:31:060
3498232993429,4cyclictest3478725-21kworker/u8:1+flush-8:019:46:060
3498232993427,5cyclictest3498083-21kworker/u8:0+events_unbound19:15:010
3498232993425,6cyclictest3599258-21kworker/u8:3+flush-8:023:06:030
34980072344,9sleep10-21swapper/119:09:331
3498237993328,3cyclictest3644215-21kworker/u8:1+flush-8:023:01:081
3498237993322,3cyclictest3599258-21kworker/u8:3+flush-8:000:15:551
3498232993329,3cyclictest3599258-21kworker/u8:3+flush-8:021:56:030
3498232993328,4cyclictest3478725-21kworker/u8:1+flush-8:019:26:070
3498232993328,4cyclictest3478725-21kworker/u8:1+flush-8:019:26:060
3498232993327,4cyclictest3740997-21kworker/u8:0+flush-8:023:11:050
3498232993325,5cyclictest3740997-21kworker/u8:0+flush-8:000:11:010
3498237993226,4cyclictest3554630-21journal-offline20:02:331
3498237993224,6cyclictest3498083-21kworker/u8:0+flush-8:019:21:031
3498232993228,3cyclictest3498083-21kworker/u8:0+flush-8:021:25:500
3498232993227,4cyclictest3599258-21kworker/u8:3+flush-8:022:01:030
3498232993227,4cyclictest3498083-21kworker/u8:0+flush-8:021:11:040
3498232993227,4cyclictest3498083-21kworker/u8:0+flush-8:020:36:000
3498232993226,5cyclictest3599258-21kworker/u8:3+flush-8:023:36:070
3498232993221,9cyclictest3707658-21ntpq22:36:010
3498241993122,7cyclictest1704890-21systemd-journal22:55:012
3498237993127,3cyclictest3713517-21idleruntime-cro22:45:011
3498237993125,4cyclictest3614661-21apt-get21:05:491
3498237993125,4cyclictest3614661-21apt-get21:05:491
3498237993124,5cyclictest3579539-21apt-get20:30:011
3498232993126,4cyclictest3599258-21kworker/u8:3+flush-8:021:21:090
3498232993126,3cyclictest3478725-21kworker/u8:1+events_unbound19:50:560
3498232993124,5cyclictest3807539-21cron00:20:010
3498232993121,8cyclictest3528995-21ntpq19:36:000
3498241993021,6cyclictest1704890-21systemd-journal20:00:012
3498237993025,4cyclictest3644215-21kworker/u8:1+flush-8:021:36:091
3498237993025,3cyclictest3679659-21irqrtprio22:10:551
3498237993023,5cyclictest3812810-21apt-get00:25:481
3498232993025,4cyclictest3727684-21kworker/u8:2+flush-8:000:05:530
3498232993025,4cyclictest3727684-21kworker/u8:2+flush-8:000:05:530
3498232993025,3cyclictest3599258-21kworker/u8:3+events_unbound23:41:030
3498232993024,4cyclictest3599258-21kworker/u8:3+flush-8:021:00:480
3498232993023,5cyclictest3599258-21kworker/u8:3+flush-8:021:05:550
3498232993023,5cyclictest3599258-21kworker/u8:3+flush-8:021:05:550
3498237992924,4cyclictest3599258-21kworker/u8:3+flush-8:023:49:391
3498237992924,3cyclictest3522514-21kthreadcore19:30:561
3498237992921,6cyclictest1704890-21systemd-journal23:36:331
3498237992919,7cyclictest1704890-21systemd-journal19:46:331
3498232992922,5cyclictest3807878-21apt-get00:20:470
3498241992813,5cyclictest161rcu_preempt21:25:592
3498237992824,3cyclictest3740997-21kworker/u8:0+flush-8:000:13:051
3498237992822,4cyclictest3649269-21apt-get21:40:461
3498237992820,6cyclictest3544954-21latency_hist19:55:011
3498232992824,3cyclictest3498083-21kworker/u8:0+flush-8:020:51:060
349824199275,6cyclictest39-21ksoftirqd/220:30:002
3498241992724,2cyclictest3693921-21aten2_r5power_v22:25:492
3498241992724,2cyclictest3649355-21aten2_r5power_p21:40:482
3498241992721,4cyclictest3714175-21fschecks_time22:45:502
349824199270,17cyclictest3525382-21aten2_r5power_v19:35:502
3498237992722,4cyclictest3498083-21kworker/u8:0+flush-8:019:41:101
3498237992722,3cyclictest3823424-21irqrtprio00:35:541
3498237992721,5cyclictest3498083-21kworker/u8:0+flush-8:021:16:011
3498237992721,4cyclictest3498083-21kworker/u8:0+flush-8:020:11:061
3498237992718,6cyclictest3503087-21latency_hist19:15:011
349823799271,24cyclictest3763009-21munin-run23:35:011
3498232992724,2cyclictest3687606-21needreboot22:15:570
3498232992723,3cyclictest3740997-21kworker/u8:0+events_unbound23:56:060
3498232992722,3cyclictest3498083-21kworker/u8:0+flush-8:020:01:050
3498232992720,5cyclictest3569665-21latency_hist20:20:010
3498232992720,5cyclictest3498404-21/usr/sbin/munin19:11:030
3498232992718,7cyclictest3555117-21/usr/sbin/munin20:05:580
349824199266,4cyclictest3582588-21cut20:30:572
3498241992621,3cyclictest3727684-21kworker/u8:2+events_unbound23:54:152
3498241992618,6cyclictest1704890-21systemd-journal20:25:002
349824199260,8cyclictest3649117-21sort21:40:012
349824199260,10cyclictest3742824-21grep23:11:072
3498237992622,3cyclictest3498083-21kworker/u8:0+flush-8:021:23:151
3498237992620,5cyclictest3727684-21kworker/u8:2+flush-8:000:08:411
3498237992620,5cyclictest3727684-21kworker/u8:2+flush-8:000:08:401
3498237992620,4cyclictest3609042-21unixbench_multi20:56:071
3498232992622,2cyclictest3545518-21cut19:55:510
3498232992621,3cyclictest3678457-21kworker/u8:2+events_unbound22:25:520
3498232992620,4cyclictest3648547-21unixbench_multi21:36:060
3498232992619,5cyclictest3478725-21kworker/u8:1+events_unbound19:45:000
3498232992617,7cyclictest3732491-21ntpq23:01:030
3498232992617,7cyclictest3723410-21latency_hist22:55:010
349824199256,3cyclictest3606750-21grep20:55:562
349824199252,8cyclictest0-21swapper/219:41:532
3498241992522,2cyclictest3669289-21fschecks_count22:00:512
3498241992521,3cyclictest3732971-21unixbench_singl23:01:092
3498241992521,2cyclictest3762637-21unixbench_singl23:31:072
3498241992521,2cyclictest3733743-21aten2_r5power_v23:05:492
349824199251,8cyclictest39-21ksoftirqd/222:40:572
3498237992522,2cyclictest880-21mta-sts-daemon19:40:011
3498237992520,4cyclictest3678457-21kworker/u8:2+flush-8:022:24:381
3498237992519,5cyclictest3599258-21kworker/u8:3+flush-8:022:45:501
3498232992521,2cyclictest3753139-21systemd-run23:25:010
3498232992520,2cyclictest3570812-21irqrtprio20:20:540
3498232992519,4cyclictest3599258-21kworker/u8:3+flush-8:000:30:580
3498232992517,6cyclictest3663761-21latency_hist21:55:010
3498241992419,3cyclictest3505587-21fschecks_count19:15:512
3498241992415,7cyclictest3776836-21grep23:45:582
3498241992414,2cyclictest161rcu_preempt19:25:482
3498241992414,2cyclictest161rcu_preempt19:25:482
349824199240,8cyclictest3824921-21tr00:35:552
349824199240,6cyclictest3704366-21chrt22:35:542
3498237992418,4cyclictest3643576-21grep21:31:051
3498237992414,8cyclictest3718758-21/usr/sbin/munin22:50:591
3498237992411,4cyclictest3703377-21apt-get22:35:031
3498232992419,3cyclictest3727684-21kworker/u8:2+flush-8:000:00:580
3498232992419,3cyclictest0-21swapper/020:55:520
3498232992418,4cyclictest3584334-21unixbench_singl20:31:070
349824199237,6cyclictest161rcu_preempt21:50:372
349824199232,5cyclictest0-21swapper/221:46:042
349824199232,5cyclictest0-21swapper/219:45:582
349824199232,12cyclictest39-21ksoftirqd/200:10:512
3498241992320,2cyclictest3674288-21fschecks_time22:05:522
3498241992319,3cyclictest880-21mta-sts-daemon00:25:552
3498241992317,4cyclictest3668694-21awk22:00:002
3498241992312,9cyclictest3748169-21awk23:20:002
349824199230,9cyclictest3787669-21cmp00:00:002
349824199230,9cyclictest3594573-21apt20:45:002
349824199230,6cyclictest3802899-21apt-get00:15:492
349824199230,10cyclictest3764182-21grep23:35:542
3498237992318,3cyclictest0-21swapper/122:55:551
3498232992318,3cyclictest0-21swapper/020:41:000
349824199227,7cyclictest0-21swapper/221:11:062
349824199223,4cyclictest0-21swapper/220:50:492
349824199222,6cyclictest0-21swapper/219:32:052
349824199222,4cyclictest0-21swapper/221:02:382
349824199222,4cyclictest0-21swapper/220:46:452
3498241992218,3cyclictest3771964-21ntp_kernel_pll_23:40:592
3498241992218,3cyclictest3629152-21cron21:20:002
3498241992218,2cyclictest0-21swapper/220:15:002
349824199220,9cyclictest3758038-21munin-run23:30:002
349824199220,8cyclictest3693657-21ls22:25:002
349824199220,7cyclictest3616490-21cut21:05:592
349824199220,7cyclictest3616490-21cut21:05:582
349824199220,7cyclictest3499142-21ps19:10:532
349824199220,6cyclictest3639947-21sed21:30:522
349824199220,11cyclictest3753122-21munin-run23:24:592
349823799228,5cyclictest0-21swapper/122:02:071
3498237992219,2cyclictest882-21mta-sts-daemon20:51:031
3498237992219,2cyclictest3727684-21kworker/u8:2+flush-8:023:40:511
3498237992218,2cyclictest0-21swapper/123:26:001
3498237992217,3cyclictest0-21swapper/122:25:491
349824199215,2cyclictest0-21swapper/221:21:032
349824199212,4cyclictest0-21swapper/220:06:002
349824199212,4cyclictest0-21swapper/219:50:032
3498241992118,2cyclictest3589630-21idleruntime-cro20:40:002
349824199210,8cyclictest3687629-21awk22:15:592
349824199210,6cyclictest3797638-21munin-run00:10:002
349824199210,6cyclictest3797638-21munin-run00:10:002
349824199210,6cyclictest3792039-21sendmail_mailtr00:01:022
3498237992117,3cyclictest3663838-21latency_hist21:55:011
349824199202,4cyclictest0-21swapper/220:00:562
349824199200,6cyclictest3724006-21sort22:55:512
349824199192,7cyclictest0-21swapper/200:20:502
35165652189,5sleep30-21swapper/319:25:563
35165652189,5sleep30-21swapper/319:25:563
349823799189,7cyclictest3821166-21cut00:30:541
34978502184,8sleep30-21swapper/319:07:293
36977572167,6sleep30-21swapper/322:26:053
37667942132,7sleep30-21swapper/323:35:593
37471242132,7sleep30-21swapper/323:16:003
36926402132,7sleep30-21swapper/322:21:033
36836302132,6sleep30-21swapper/322:15:013
36579642132,7sleep30-21swapper/321:46:003
36498922132,7sleep30-21swapper/321:40:543
36430712132,7sleep30-21swapper/321:30:593
36184022132,7sleep30-21swapper/321:06:033
36184022132,7sleep30-21swapper/321:06:033
35871772131,8sleep30-21swapper/320:35:573
35597922132,6sleep30-21swapper/320:10:023
35468932132,7sleep30-21swapper/319:55:573
38223762122,5sleep30-21swapper/300:35:013
38128252122,6sleep30-21swapper/300:25:513
38124512122,6sleep30-21swapper/300:24:333
38022772122,6sleep30-21swapper/300:11:103
37965622122,6sleep30-21swapper/300:06:003
37965622122,6sleep30-21swapper/300:05:593
37823042122,6sleep30-21swapper/323:51:123
37736352122,6sleep30-21swapper/323:45:543
37562102122,6sleep30-21swapper/323:26:003
37482062122,6sleep30-21swapper/323:20:023
37291342122,6sleep30-21swapper/323:00:563
37234352122,6sleep30-21swapper/322:55:023
37226282122,6sleep30-21swapper/322:51:043
36831952122,6sleep30-21swapper/322:11:083
36686832123,6sleep30-21swapper/322:00:003
36588382122,5sleep30-21swapper/321:50:003
36468602122,6sleep30-21swapper/321:35:563
36383882122,6sleep30-21swapper/321:26:063
36320672122,6sleep30-21swapper/321:20:593
36244812122,6sleep30-21swapper/321:15:473
36101312122,6sleep30-21swapper/321:00:543
35963472122,6sleep30-21swapper/320:45:573
35555242122,6sleep30-21swapper/320:05:513
35404132122,6sleep30-21swapper/319:50:523
35356422122,6sleep30-21swapper/319:45:543
35304782122,6sleep30-21swapper/319:40:573
35111662122,6sleep30-21swapper/319:20:583
35053012122,6sleep30-21swapper/319:15:493
38177332112,6sleep30-21swapper/300:30:443
38069172112,5sleep30-21swapper/300:16:083
37879892112,6sleep30-21swapper/300:00:023
37868622112,5sleep30-21swapper/323:56:043
37686122112,6sleep30-21swapper/323:40:513
37587512112,5sleep30-21swapper/323:30:533
37385002112,5sleep30-21swapper/323:10:033
37377972112,5sleep30-21swapper/323:06:083
37151192111,6sleep30-21swapper/322:45:553
37086082112,5sleep30-21swapper/322:40:013
37038312112,5sleep30-21swapper/322:35:033
36986702113,5sleep30-21swapper/322:30:103
36986702113,5sleep30-21swapper/322:30:103
36738522112,5sleep30-21swapper/322:05:023
36690282112,5sleep30-21swapper/322:00:493
36204842112,5sleep30-21swapper/321:10:573
36050252112,6sleep30-21swapper/320:55:523
35997512112,5sleep30-21swapper/320:50:013
35899792112,5sleep30-21swapper/320:40:513
35803342112,6sleep30-21swapper/320:30:523
35748282112,5sleep30-21swapper/320:25:023
35725352112,5sleep30-21swapper/320:20:563
35655172111,6sleep30-21swapper/320:15:563
35501012112,5sleep30-21swapper/320:00:033
35200692112,5sleep30-21swapper/319:30:013
35021942112,5sleep30-21swapper/319:10:593
35252062102,5sleep30-21swapper/319:35:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional