You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 00:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon May 11, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3628442212249,68sleep30-21swapper/33
362843628151,11sleep20-21swapper/22
362837728150,12sleep10-21swapper/11
362849827852,18sleep00-21swapper/00
39317242220,2sleep00-21swapper/00
362879899221,7cyclictest3854650-21taskset3
362879899211,14cyclictest0-21swapper/33
362879899210,19cyclictest0-21swapper/33
41062472200,3sleep10-21swapper/11
362879899209,7cyclictest3929990-21chrt3
3628798992011,7cyclictest0-21swapper/33
362879899201,16cyclictest3944681-21chrt3
362879899201,15cyclictest0-21swapper/33
36524602191,7sleep13652529-21date1
362879899192,13cyclictest0-21swapper/33
3628798991914,3cyclictest0-21swapper/33
362879899191,15cyclictest0-21swapper/33
362879899191,15cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899191,14cyclictest0-21swapper/33
362879899190,2cyclictest0-21swapper/33
39553182181,14sleep13955588-21rm1
362879899181,5cyclictest0-21swapper/33
3628798991811,4cyclictest4078454-21chrt3
362879899181,14cyclictest3893823-21chrt3
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,14cyclictest0-21swapper/33
362879899181,13cyclictest0-21swapper/33
362879899181,13cyclictest0-21swapper/33
362879899180,16cyclictest0-21swapper/33
362879899180,15cyclictest66950irq/132-enp1s0-TxRx-33
362879899180,14cyclictest0-21swapper/33
3628798991713,2cyclictest0-21swapper/33
3628798991713,2cyclictest0-21swapper/33
3628798991712,3cyclictest3700890-21turbostat3
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899171,13cyclictest0-21swapper/33
362879899170,14cyclictest0-21swapper/33
362879899170,14cyclictest0-21swapper/33
362879899170,14cyclictest0-21swapper/33
362879899170,13cyclictest0-21swapper/33
362879899170,13cyclictest0-21swapper/33
38273042161,4sleep23827319-21ssh2
3628798991612,3cyclictest0-21swapper/33
3628798991612,2cyclictest0-21swapper/33
40888662150,1sleep00-21swapper/00
40397402151,2sleep10-21swapper/11
40058382150,1sleep00-21swapper/00
38597782150,3sleep00-21swapper/00
38268722151,10sleep13826876-21ssh1
37670532151,2sleep00-21swapper/00
36729412151,10sleep13672959-21/usr/sbin/munin1
362879899151,3cyclictest0-21swapper/33
3628798991512,1cyclictest0-21swapper/33
3628798991511,2cyclictest0-21swapper/33
362879899150,13cyclictest0-21swapper/33
362879899150,12cyclictest3668858-21chrt3
362879899150,12cyclictest0-21swapper/33
362879899150,12cyclictest0-21swapper/33
40384702141,7sleep23760129-21diskmemload2
40235902141,5sleep24024047-21kthreadcore2
40207902141,6sleep13760129-21diskmemload1
40121872140,2sleep20-21swapper/22
39886772141,6sleep23988690-21ssh2
39272442140,1sleep20-21swapper/22
38699762141,8sleep03760129-21diskmemload0
38536132141,2sleep20-21swapper/22
38194632141,9sleep23819477-21ssh2
362879899148,3cyclictest36467322sleep33
362879899141,9cyclictest3727516-21taskset3
362879899140,12cyclictest0-21swapper/33
362879899140,11cyclictest0-21swapper/33
40885782131,2sleep20-21swapper/22
40464152131,8sleep04046429-21ssh0
40208562130,2sleep20-21swapper/22
38923972131,3sleep10-21swapper/11
38805932131,8sleep23882184-21kthreadcore2
38622292131,7sleep13760129-21diskmemload1
38524472131,2sleep10-21swapper/11
38413342131,8sleep23841482-21netstat2
37679552131,8sleep23767969-21ssh2
37381612130,1sleep10-21swapper/11
37118182131,8sleep23712074-21df2
362879899130,2cyclictest0-21swapper/33
362879899130,11cyclictest0-21swapper/33
362879899130,11cyclictest0-21swapper/33
41123322121,6sleep23760129-21diskmemload2
41055852121,3sleep04105595-21ssh0
40938492121,3sleep24093911-21ld2
40938492121,3sleep24093911-21ld2
40354092121,6sleep04035541-21ntp_192.168.1140
40294012120,3sleep00-21swapper/00
40282742122,6sleep1802-21snmpd1
40019432121,5sleep04002070-21/usr/sbin/munin0
39433512121,7sleep13943362-21ssh1
39143592121,7sleep13915971-21cut1
39130122121,5sleep23760129-21diskmemload2
39051102121,5sleep03905331-21hddtemp_smartct0
39019422120,2sleep23760129-21diskmemload2
38942572121,7sleep23894268-21ssh2
38709712121,7sleep03760129-21diskmemload0
38694292120,6sleep10-21swapper/11
38180382120,2sleep03818048-21ssh0
38088062121,3sleep23808818-21ssh2
37930772121,5sleep20-21swapper/22
37865972121,5sleep03786820-21smartctl0
37832492121,6sleep13760129-21diskmemload1
37772842121,7sleep03760129-21diskmemload0
37590572121,6sleep13759114-21ntpq1
36984432121,5sleep23699716-21memory2
36847242120,1sleep00-21swapper/00
36567642121,6sleep03656804-21ntpq0
40937252111,5sleep14093848-21ntpq1
40937252111,5sleep14093848-21ntpq1
40842192111,5sleep14085412-21memory1
40748872111,2sleep1171rcu_preempt1
40703592110,1sleep20-21swapper/22
40451512111,3sleep20-21swapper/22
40373182111,7sleep13760129-21diskmemload1
40025462111,5sleep13760129-21diskmemload1
39850072111,5sleep13985066-21ntpq1
39786322111,7sleep03978645-21sh0
39677922111,4sleep20-21swapper/22
39632112111,3sleep00-21swapper/00
39608042111,3sleep20-21swapper/22
39513042111,5sleep03760129-21diskmemload0
39468952111,5sleep13947108-21diskstats1
39425102110,2sleep20-21swapper/22
39288012111,6sleep03928812-21ssh0
39040272111,3sleep00-21swapper/00
38879052111,4sleep03887934-21apt-get0
38438492112,4sleep13760129-21diskmemload1
38294842111,6sleep13830616-21kthreadcore1
38210222111,6sleep03822466-21cut0
37997402111,6sleep03799750-21ssh0
37746502110,1sleep10-21swapper/11
37264802111,5sleep23726531-21ntpq2
36945272111,5sleep13694568-21ntpq1
36620072111,5sleep13662096-21ntpq1
41047492101,4sleep23760129-21diskmemload2
40964882100,2sleep00-21swapper/00
40964882100,2sleep00-21swapper/00
40772892100,3sleep20-21swapper/22
40646942100,1sleep00-21swapper/00
40531932100,6sleep04011176-21kworker/u16:2+rpciod0
40531592101,6sleep13760129-21diskmemload1
40516842101,4sleep24052104-21strings2
40112262101,4sleep13760129-21diskmemload1
40018282101,5sleep24001879-21ntpq2
39962482101,4sleep13760129-21diskmemload1
39934702101,4sleep03993531-21ssh0
39891172101,4sleep23989128-21ssh2
39884652101,4sleep03760129-21diskmemload0
39794332101,3sleep20-21swapper/22
39715022101,5sleep03971507-21ssh0
39540682101,2sleep20-21swapper/22
39342252101,4sleep13934283-21ntp_states1
39278082101,4sleep13760129-21diskmemload1
39207472101,4sleep03760129-21diskmemload0
39117902101,4sleep13760129-21diskmemload1
39038982101,4sleep13760129-21diskmemload1
38794432102,4sleep13879465-21apt-get1
38762502101,3sleep20-21swapper/22
38710322101,3sleep10-21swapper/11
38694952101,4sleep23760129-21diskmemload2
38612282102,4sleep23760129-21diskmemload2
38516392101,4sleep03760129-21diskmemload0
38356552101,3sleep20-21swapper/22
38329262101,4sleep03833024-21ntpq0
38175622101,5sleep13817570-21ssh1
38079132101,4sleep03760129-21diskmemload0
38073602101,2sleep10-21swapper/11
38011602100,2sleep20-21swapper/22
37993722101,5sleep13799453-21find1
37923772101,3sleep13760129-21diskmemload1
37776472103,3sleep0151ktimers/00
37772562100,1sleep20-21swapper/22
37658732101,3sleep10-21swapper/11
37556342101,4sleep23757132-21ps2
37280832101,4sleep23728102-21apt-get2
37008782101,5sleep03701071-21cat0
36854572101,4sleep03685670-21hddtemp_smartct0
36851662101,4sleep13685185-21apt-get1
36677392101,5sleep13667883-21mailstats1
36632372101,5sleep23663308-21unin-run2
36630312101,3sleep03662916-31sort0
36359142101,5sleep23636379-21munin-node2
36331192101,4sleep13633176-21ntp_states1
4112463290,1sleep10-21swapper/11
4106425291,3sleep03760129-21diskmemload0
4079267291,3sleep00-21swapper/00
4071402291,3sleep13760129-21diskmemload1
4061387291,3sleep13760129-21diskmemload1
4056666291,4sleep04056877-21head0
4056377291,4sleep24056506-21cut2
4020126290,2sleep00-21swapper/00
3969975290,2sleep10-21swapper/11
3944554291,2sleep00-21swapper/00
3935342290,4sleep23935345-21ssh2
3909733291,3sleep23760129-21diskmemload2
3885191291,4sleep03885201-21ssh0
3782899291,4sleep23782904-21ssh2
3750018291,4sleep23751546-21cut2
3745513291,4sleep13747246-21tr1
3744098291,4sleep03744161-21/usr/sbin/munin0
3739945291,5sleep03741672-21kthreadcore0
3721068291,3sleep03721185-21ntpq0
3718552291,4sleep23720293-21cut2
3717129291,3sleep13717147-21apt-get1
3712346291,4sleep13712906-21cut1
3673984291,4sleep13674469-21test1
3654408291,4sleep13656211-21kthreadcore1
3646864291,4sleep23647157-21sed2
3634117291,4sleep03634380-21diskstats0
3629538291,4sleep03630709-21cut0
3977542280,3sleep13760129-21diskmemload1
3838304282,3sleep00-21swapper/00
3749426281,2sleep10-21swapper/11
3711269280,2sleep272-21kcompactd02
3701135280,2sleep10-21swapper/11
3673074281,3sleep03673187-21ps0
3667917281,3sleep03668109-21sed0
3663520281,2sleep20-21swapper/22
3743492270,1sleep10-21swapper/11
3733443271,3sleep20-21swapper/22
3732907270,1sleep10-21swapper/11
3732472270,4sleep00-21swapper/00
3706491270,2sleep10-21swapper/11
3705956270,1sleep20-21swapper/22
3695833271,3sleep13696086-21/usr/sbin/munin1
3691178271,3sleep23692842-21kthreadcore2
3690472270,1sleep00-21swapper/00
3651764271,2sleep23651912-21timerwakeupswit2
3646627270,1sleep10-21swapper/11
3645894270,3sleep03645942-21ntpq0
3636691271,2sleep13636905-21smartctl1
3722748261,2sleep10-21swapper/11
3716709260,1sleep00-21swapper/00
3706167260,4sleep00-21swapper/00
3684192261,2sleep10-21swapper/11
3683659260,2sleep23683832-21strings2
3679346260,1sleep20-21swapper/22
3678562260,2sleep00-21swapper/00
3656214260,2sleep23656711-21strings2
3633777260,1sleep20-21swapper/22
3755018250,1sleep00-21swapper/00
3753270250,1sleep03753443-21strings0
3738745250,1sleep20-21swapper/22
3722633250,1sleep00-21swapper/00
3685740250,1sleep20-21swapper/22
3670042250,1sleep20-21swapper/22
3652354250,3sleep00-21swapper/00
3744365240,1sleep20-21swapper/22
3733415240,1sleep00-21swapper/00
3706340240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional