You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 03:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 05, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22165021990,2sleep375-21kworker/3:1+events23:10:423
1399462800,3chrt75-21kworker/3:1+events21:50:403
2257192790,4sleep00-21swapper/023:15:400
2804972680,4sleep1281rcuc/100:10:441
4172635996759,6cyclictest154377-21kworker/u8:0+events_unbound22:55:500
4172635996560,3cyclictest4177168-21kworker/u8:2+events_unbound19:55:490
4172635996555,8cyclictest283461-21cp00:15:010
4172641996256,4cyclictest4177168-21kworker/u8:2+flush-8:020:40:502
4172635996155,4cyclictest3822996-21kworker/u8:0+events_unbound20:05:500
4172638995748,6cyclictest89341-21latency_hist21:00:011
4172635995752,4cyclictest4177168-21kworker/u8:2+flush-8:019:40:510
4172635995751,4cyclictest268728-21kworker/u8:3+flush-8:000:00:530
1658882570,4chrt0-21swapper/022:15:410
4172638995650,4cyclictest263247-21apt-get23:52:381
4172638995650,4cyclictest224069-21kworker/u8:2+flush-8:023:15:501
4172635995650,5cyclictest3822996-21kworker/u8:0+flush-8:019:25:520
4172635995650,4cyclictest257951-21kworker/u8:2+flush-8:000:15:510
4172635995550,4cyclictest154377-21kworker/u8:0+flush-8:023:25:510
4172635995550,4cyclictest154377-21kworker/u8:0+flush-8:023:25:510
4172635995549,5cyclictest154377-21kworker/u8:0+events_unbound23:10:490
4172635995548,5cyclictest99668-21kworker/u8:1+events_unbound21:25:510
4172635995448,4cyclictest278639-21kworker/u8:0+events_unbound00:30:540
4172635995447,5cyclictest139118-21kworker/u8:1+flush-8:022:00:510
4172635995346,5cyclictest154377-21kworker/u8:0+events_unbound22:10:490
4172635995248,3cyclictest238689-21kworker/u8:1+flush-8:023:35:510
4172635995245,5cyclictest174368-21kworker/u8:3+flush-8:023:40:470
4172635995236,4cyclictest54438-21kworker/u8:0+events_unbound20:50:480
4172638995140,8cyclictest153281-21ntpq22:00:471
4172635995147,3cyclictest3822996-21kworker/u8:0+events_unbound19:15:520
4172635995146,4cyclictest4177168-21kworker/u8:2+flush-8:021:10:360
4172635995047,2cyclictest133815-21kworker/u8:2+events_unbound22:35:360
4172635995045,3cyclictest4177168-21kworker/u8:2+flush-8:020:10:510
4172635995044,4cyclictest99668-21kworker/u8:1+flush-8:021:15:520
2976602500,3sleep375-21kworker/3:1+events00:25:503
4172635994943,4cyclictest3822996-21kworker/u8:0+flush-8:019:50:520
4172641994837,9cyclictest179102-21/usr/sbin/munin22:30:012
4172635994842,4cyclictest302946-21kworker/u8:2+events_unbound00:35:470
4172638994736,8cyclictest193057-21ntpq22:40:471
4172635994741,4cyclictest133815-21kworker/u8:2+events_unbound21:50:530
4172638994638,6cyclictest4189301-21latency_hist19:25:011
4172638994633,10cyclictest1704890-21systemd-journal21:30:001
4172635994640,4cyclictest3822996-21kworker/u8:0+events_unbound19:45:510
4172635994639,5cyclictest139118-21kworker/u8:1+flush-8:022:20:450
4172635994632,12cyclictest257951-21kworker/u8:2+flush-8:000:05:570
925792450,2chrt471rcuc/321:00:413
4172635994541,3cyclictest99668-21kworker/u8:1+flush-8:021:40:520
4172635994541,3cyclictest4177168-21kworker/u8:2+flush-8:020:00:510
4172635994541,3cyclictest4177168-21kworker/u8:2+flush-8:020:00:510
4172635994539,4cyclictest4184599-21kworker/u8:1+events_unbound20:15:340
4172635994538,5cyclictest278639-21kworker/u8:0+events_unbound00:25:490
4172641994434,7cyclictest1704890-21systemd-journal22:30:372
4172638994435,6cyclictest1704890-21systemd-journal20:35:501
4172635994438,4cyclictest4177168-21kworker/u8:2+flush-8:020:25:470
4172635994437,4cyclictest1-21systemd23:52:380
4172635994431,11cyclictest45047-21kworker/u8:3+events_unbound20:20:380
4172635994338,4cyclictest188676-21kworker/u8:1+flush-8:022:50:490
4172635994337,4cyclictest4184599-21kworker/u8:1+events_unbound19:20:500
4172635994337,4cyclictest154377-21kworker/u8:0+events_unbound23:55:510
4172635994336,4cyclictest45047-21kworker/u8:3+events_unbound21:30:410
4172641994233,7cyclictest198902-21apt-get22:50:002
4172638994236,4cyclictest229064-21/usr/sbin/munin23:20:501
4172638994234,6cyclictest188676-21kworker/u8:1+flush-8:022:45:361
4172635994236,5cyclictest154377-21kworker/u8:0+events_unbound22:05:500
4172638994132,7cyclictest19216-21ntpq19:45:461
4172635994137,3cyclictest133815-21kworker/u8:2+flush-8:021:55:500
4172635994134,5cyclictest224069-21kworker/u8:2+events_unbound23:20:480
4172635994134,4cyclictest154377-21kworker/u8:0+events_unbound23:00:500
4172638994030,6cyclictest45047-21kworker/u8:3+flush-8:020:15:321
4172635994034,4cyclictest45047-21kworker/u8:3+events_unbound20:35:490
4172635994016,15cyclictest278639-21kworker/u8:0+flush-8:000:22:560
4172638993932,5cyclictest154377-21kworker/u8:0+flush-8:022:10:511
4172635993935,3cyclictest45047-21kworker/u8:3+events_unbound21:35:510
4172635993934,3cyclictest154377-21kworker/u8:0+events_unbound22:25:410
4172635993933,4cyclictest174368-21kworker/u8:3+events_unbound23:30:460
4172635993932,6cyclictest54438-21kworker/u8:0+flush-8:021:05:520
4172638993832,4cyclictest4177168-21kworker/u8:2+flush-8:019:25:511
4172638993831,5cyclictest45047-21kworker/u8:3+flush-8:020:20:371
4172638993831,5cyclictest174368-21kworker/u8:3+events_unbound23:30:511
4172638993829,7cyclictest3822997-21kworker/u8:3+events_unbound19:15:031
4172638993828,7cyclictest1704890-21systemd-journal23:00:001
4172635993827,8cyclictest198014-21ntpq22:45:450
4172641993725,9cyclictest1704890-21systemd-journal20:55:002
4172638993731,4cyclictest4177168-21kworker/u8:2+flush-8:021:15:351
4172638993630,4cyclictest79729-21/usr/sbin/munin20:50:451
4172638993629,5cyclictest288758-21kworker/u8:1+events_unbound00:30:361
4172638993624,9cyclictest277518-21ntpq00:05:491
4172635993630,4cyclictest257951-21kworker/u8:2+events_unbound23:45:530
4172638993529,4cyclictest3822996-21kworker/u8:0+events_unbound19:50:501
4172638993529,4cyclictest154377-21kworker/u8:0+flush-8:022:25:511
4172635993532,1cyclictest54438-21kworker/u8:0+events_unbound21:04:510
4172635993530,3cyclictest135350-21kthreadcore21:45:410
4172635993530,3cyclictest135350-21kthreadcore21:45:400
4172641993429,3cyclictest50773-21irqrtprio20:20:392
4172641993429,3cyclictest188676-21kworker/u8:1+flush-8:022:40:532
4172641993427,5cyclictest116773-21sort21:25:442
4172638993428,5cyclictest4177168-21kworker/u8:2+events_unbound21:10:501
4172638993428,4cyclictest154377-21kworker/u8:0+flush-8:023:55:521
4172638993426,6cyclictest3822996-21kworker/u8:0+events_unbound19:35:511
4172638993426,6cyclictest154377-21kworker/u8:0+events_unbound23:05:481
4172638993426,6cyclictest139118-21kworker/u8:1+events_unbound22:20:481
4172635993429,3cyclictest54438-21kworker/u8:0+events_unbound20:55:340
4172635993427,5cyclictest74186-21grep20:40:530
152622340,3sleep3481ktimers/319:45:013
4172641993325,6cyclictest99300-21cp21:10:012
4172638993327,4cyclictest89640-21apt-get21:00:301
4172638993325,6cyclictest69863-21/usr/sbin/munin20:40:441
4172638993321,9cyclictest1704890-21systemd-journal21:21:501
4172641993223,7cyclictest35412-21tr20:05:362
4172638993226,4cyclictest74843-21apt-get20:45:321
4172638993224,6cyclictest4184599-21kworker/u8:1+events_unbound19:30:361
4172638993222,8cyclictest183283-21ntpq22:30:501
4172635993228,3cyclictest133815-21kworker/u8:2+flush-8:022:32:500
4172641993126,4cyclictest3822996-21kworker/u8:0+flush-8:019:10:482
4172641993126,3cyclictest154377-21kworker/u8:0+events_unbound23:45:502
4172641993125,5cyclictest54438-21kworker/u8:0+events_unbound21:00:482
4172638993127,3cyclictest3822997-21kworker/u8:3+flush-8:019:12:191
4172638993125,5cyclictest154377-21kworker/u8:0+flush-8:023:10:361
4172638993125,4cyclictest39861-21idleruntime-cro20:10:001
4172638993124,5cyclictest4177168-21kworker/u8:2+events_unbound20:10:361
4172638993124,5cyclictest174368-21kworker/u8:3+events_unbound23:40:361
4172638993124,5cyclictest144316-21apt-get21:55:331
4172638993118,10cyclictest1704890-21systemd-journal00:35:491
4172635993127,3cyclictest4177168-21kworker/u8:2+events_unbound20:45:540
4172635993125,4cyclictest188676-21kworker/u8:1+events_unbound23:05:350
4172641993025,4cyclictest4184599-21kworker/u8:1+flush-8:019:20:382
4172638993026,2cyclictest11239-21irqrtprio19:40:401
4172638993025,4cyclictest45047-21kworker/u8:3+events_unbound21:30:491
4172638993024,5cyclictest278639-21kworker/u8:0+events_unbound00:25:371
4172638993023,5cyclictest45047-21kworker/u8:3+events_unbound21:35:471
4172638993023,5cyclictest154377-21kworker/u8:0+events_unbound23:00:381
4172638993022,6cyclictest99314-21store21:10:011
4172638993022,6cyclictest168288-21ntpq22:15:451
4172638993021,7cyclictest257951-21kworker/u8:2+flush-8:000:15:471
4172635993025,4cyclictest54438-21kworker/u8:0+events_unbound20:30:540
4172641992923,4cyclictest278639-21kworker/u8:0+events_unbound00:20:362
4172638992924,4cyclictest133815-21kworker/u8:2+flush-8:021:45:521
4172638992924,4cyclictest133815-21kworker/u8:2+flush-8:021:45:521
4172638992923,4cyclictest288819-21apt-get00:20:331
4172638992918,8cyclictest1704890-21systemd-journal21:41:501
417263599293,17cyclictest583-21snmpd21:20:350
4172635992924,4cyclictest4177168-21kworker/u8:2+events_unbound19:30:520
4172635992924,4cyclictest3822996-21kworker/u8:0+flush-8:019:11:070
4172641992824,3cyclictest234374-21fschecks_time23:25:382
4172641992824,3cyclictest234374-21fschecks_time23:25:382
4172638992822,4cyclictest154497-21aten2_r5power_e22:05:371
4172635992824,3cyclictest188676-21kworker/u8:1+events_unbound22:40:500
4172641992722,3cyclictest30341-21aten2_r5power_p20:00:352
4172641992722,3cyclictest30341-21aten2_r5power_p20:00:342
4172641992722,3cyclictest244135-21cpuspeed_turbos23:35:352
4172641992722,3cyclictest219233-21aten2_r5power_e23:10:352
4172641992722,3cyclictest205304-21kthreadcore22:55:422
4172641992717,7cyclictest124512-21apt-get21:35:322
4172638992723,2cyclictest199947-21irqcore22:50:411
4172638992723,2cyclictest184479-21aten2_r5power_v22:35:361
4172638992722,4cyclictest54438-21kworker/u8:0+flush-8:020:27:191
4172638992722,4cyclictest154377-21kworker/u8:0+flush-8:023:25:481
4172638992722,4cyclictest154377-21kworker/u8:0+flush-8:023:25:481
417263899271,24cyclictest30783-21sed20:00:401
417263899271,24cyclictest30783-21sed20:00:391
4172635992723,3cyclictest3822996-21kworker/u8:0+events_unbound19:35:350
1580472270,7sleep3451irq_work/322:05:453
4172641992622,2cyclictest99991-21fschecks_count21:10:372
4172641992622,2cyclictest263990-21cpuspeed_turbos23:55:372
4172641992621,3cyclictest25676-21fschecks_time19:55:372
4172638992621,4cyclictest238689-21kworker/u8:1+events_unbound23:35:471
4172638992620,4cyclictest272574-21ntp_kernel_pll_00:00:491
41724382263,15sleep14172461-21munin-run19:10:011
4172638992519,4cyclictest255526-21kthreadcore23:45:411
4172638992518,5cyclictest139380-21apt-get21:50:331
4172641992420,3cyclictest277983-21unixbench_multi00:05:572
4172641992420,3cyclictest174368-21kworker/u8:3+flush-8:023:40:472
4172641992420,2cyclictest823-21cpuspeed_turbos19:30:352
4172641992420,2cyclictest139492-21aten2_r5power_v21:50:362
4172641992419,4cyclictest268728-21kworker/u8:3+flush-8:000:00:362
4172641992415,7cyclictest1704890-21systemd-journal00:10:502
41723032243,15sleep00-21swapper/019:08:140
4172641992319,3cyclictest199533-21aten2_r5power_v22:50:352
417264199230,7cyclictest10202-21cron19:40:002
417264199222,14cyclictest303663-21apt-get00:35:332
4172641992217,4cyclictest0-21swapper/223:20:002
4172641992213,7cyclictest1704890-21systemd-journal00:20:002
417264199220,20cyclictest164070-21munin-run22:15:012
4172641992118,2cyclictest259056-21fschecks_time23:50:382
4172641992117,2cyclictest134455-21aten2_r5power_c21:45:352
4172641992117,2cyclictest134455-21aten2_r5power_c21:45:342
4172641992117,2cyclictest0-21swapper/222:00:012
417264199208,4cyclictest0-21swapper/219:50:432
417264199202,13cyclictest113439-21ntpq21:20:492
4172638992015,4cyclictest54438-21kworker/u8:0+flush-8:020:30:471
4172638992013,5cyclictest0-21swapper/119:55:341
4172641991915,2cyclictest0-21swapper/221:15:402
4172641991915,2cyclictest0-21swapper/200:25:412
417264199191,13cyclictest40145-21apt-get20:10:342
417264199191,13cyclictest184371-21taskset22:35:342
4172641991910,7cyclictest76762-21tr20:45:412
4172641991910,7cyclictest61979-21tr20:30:422
4172641991910,7cyclictest49752-21cat20:20:012
1032062190,2sleep3471rcuc/321:10:443
417264199187,8cyclictest69596-21readlink20:40:012
417264199184,2cyclictest0-21swapper/223:00:372
417264199182,11cyclictest154438-21apt-get22:05:372
4172641991814,2cyclictest15805-21fschecks_time19:45:372
4172641991814,2cyclictest0-21swapper/223:05:342
4172641991814,2cyclictest0-21swapper/222:15:542
41724232183,8sleep30-21swapper/319:09:503
41677802184,9sleep20-21swapper/219:05:042
417264199177,7cyclictest4192414-21tr19:25:442
4172641991713,2cyclictest0-21swapper/222:20:492
4172641991710,5cyclictest4184134-21sshd19:17:242
417264199169,5cyclictest1-21systemd19:45:002
417264199167,7cyclictest55104-21cut20:25:352
4172641991612,2cyclictest85061-21fschecks_time20:55:372
4172641991612,2cyclictest0-21swapper/222:00:062
4172641991612,2cyclictest0-21swapper/200:30:392
417264199151,10cyclictest239879-21ps23:30:412
497382145,5sleep30-21swapper/320:20:003
41942712142,8sleep30-21swapper/319:30:013
417264199149,3cyclictest0-21swapper/221:40:412
417264199146,6cyclictest230218-21cut23:20:402
4172641991410,2cyclictest0-21swapper/221:30:392
2726502142,8sleep30-21swapper/300:00:523
2433672142,8sleep30-21swapper/323:31:513
2089852142,8sleep30-21swapper/323:00:003
1093422143,7sleep30-21swapper/321:20:003
646702132,6sleep30-21swapper/320:35:023
587922132,7sleep30-21swapper/320:25:473
44532132,7sleep30-21swapper/319:30:483
2635042132,6sleep30-21swapper/323:55:023
2141412132,6sleep30-21swapper/323:05:023
1999052132,7sleep30-21swapper/322:50:403
1988862131,6sleep30-21swapper/322:50:013
196402132,7sleep30-21swapper/319:45:543
1890352132,6sleep30-21swapper/322:40:023
1640682132,6sleep30-21swapper/322:15:023
1298582132,7sleep30-21swapper/321:40:393
1244862132,7sleep30-21swapper/321:35:323
1144352132,6sleep30-21swapper/321:25:023
966662122,6sleep30-21swapper/321:05:433
790632122,6sleep30-21swapper/320:45:523
634872122,6sleep30-21swapper/320:30:433
539502122,6sleep30-21swapper/320:20:493
41883892122,6sleep30-21swapper/319:20:463
41834982124,5sleep30-21swapper/319:15:473
41732112122,6sleep30-21swapper/319:10:393
3063752123,5sleep30-21swapper/300:35:433
3031012122,6sleep30-21swapper/300:31:383
2929452122,6sleep30-21swapper/300:20:543
2739862122,6sleep30-21swapper/300:05:373
2630942122,6sleep30-21swapper/323:50:563
253002122,7sleep30-21swapper/319:55:333
2380352123,6sleep30-21swapper/323:25:533
2380352123,6sleep30-21swapper/323:25:523
2096882122,6sleep30-21swapper/323:00:413
208602122,6sleep30-21swapper/319:50:403
1844652122,6sleep30-21swapper/322:35:363
1802732123,5sleep30-21swapper/322:30:433
1782862122,6sleep30-21swapper/322:25:493
1732722122,6sleep30-21swapper/322:20:473
1598282122,6sleep30-21swapper/322:10:413
1344792122,6sleep30-21swapper/321:45:373
1344792122,6sleep30-21swapper/321:45:373
1232732122,6sleep30-21swapper/321:30:483
1096812122,6sleep30-21swapper/321:20:353
846842112,5sleep30-21swapper/320:55:323
796902112,5sleep30-21swapper/320:50:033
702662112,5sleep30-21swapper/320:40:403
55032112,5sleep30-21swapper/319:35:033
409712112,6sleep30-21swapper/320:10:423
395202112,6sleep30-21swapper/320:05:563
301962112,6sleep30-21swapper/320:00:073
301962112,6sleep30-21swapper/320:00:063
2878782112,6sleep30-21swapper/300:15:533
2786692112,5sleep30-21swapper/300:10:343
2538322112,5sleep30-21swapper/323:45:353
2491162112,5sleep30-21swapper/323:40:373
2477992111,6sleep30-21swapper/323:35:513
2290932112,5sleep30-21swapper/323:20:353
2238602112,5sleep30-21swapper/323:15:013
1496112112,5sleep30-21swapper/322:00:373
1467612112,5sleep30-21swapper/321:55:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional