You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 15:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 23, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321654321290,3sleep13216542-21cron1
3096166212253,64sleep30-21swapper/33
309626828770,12sleep10-21swapper/11
309625428663,12sleep20-21swapper/22
309625727956,6sleep00-21swapper/00
33935182430,2sleep014-21ksoftirqd/00
309654899222,16cyclictest0-21swapper/33
309654899220,19cyclictest0-21swapper/33
309654899212,14cyclictest3552068-21taskset3
3096548992110,7cyclictest34734362chrt3
309654899201,15cyclictest66950irq/132-enp1s0-TxRx-33
309654899201,15cyclictest0-21swapper/33
309654899201,15cyclictest0-21swapper/33
309654899200,16cyclictest66950irq/132-enp1s0-TxRx-33
33295332191,9sleep13329545-21ssh1
33295332191,9sleep13329545-21ssh1
309654899198,1cyclictest0-21swapper/33
309654899192,13cyclictest3394087-21turbostat3
309654899191,3cyclictest0-21swapper/33
3096548991911,5cyclictest66950irq/132-enp1s0-TxRx-33
309654899191,15cyclictest0-21swapper/33
309654899191,14cyclictest3242510-21taskset3
309654899191,14cyclictest0-21swapper/33
309654899191,14cyclictest0-21swapper/33
309654899191,14cyclictest0-21swapper/33
309654899191,14cyclictest0-21swapper/33
309654899191,13cyclictest0-21swapper/33
309654899190,16cyclictest0-21swapper/33
32421472181,3sleep20-21swapper/22
309654899182,13cyclictest66950irq/132-enp1s0-TxRx-33
3096548991814,2cyclictest0-21swapper/33
309654899181,14cyclictest0-21swapper/33
309654899181,14cyclictest0-21swapper/33
309654899181,14cyclictest0-21swapper/33
309654899181,14cyclictest0-21swapper/33
309654899181,14cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899181,13cyclictest0-21swapper/33
309654899180,15cyclictest0-21swapper/33
34805782171,3sleep10-21swapper/11
34618822170,2sleep10-21swapper/11
309654899172,11cyclictest3526233-21taskset3
309654899171,13cyclictest0-21swapper/33
309654899171,13cyclictest0-21swapper/33
309654899171,13cyclictest0-21swapper/33
309654899171,13cyclictest0-21swapper/33
309654899171,12cyclictest0-21swapper/33
309654899170,15cyclictest0-21swapper/33
309654899170,14cyclictest0-21swapper/33
309654899170,14cyclictest0-21swapper/33
309654899170,14cyclictest0-21swapper/33
309654899170,13cyclictest0-21swapper/33
309654899170,13cyclictest0-21swapper/33
309654899170,13cyclictest0-21swapper/33
34553582161,4sleep03227218-21diskmemload0
34181332160,1sleep20-21swapper/22
33769292161,4sleep13227218-21diskmemload1
33110502161,11sleep03311107-21ntpq0
3096548991613,1cyclictest0-21swapper/33
3096548991611,3cyclictest0-21swapper/33
309654899161,12cyclictest0-21swapper/33
309654899160,12cyclictest0-21swapper/33
35921242151,4sleep23227218-21diskmemload2
35326582151,2sleep10-21swapper/11
34173492151,3sleep03227218-21diskmemload0
33741142151,9sleep13227218-21diskmemload1
33489622151,2sleep00-21swapper/00
33247422151,4sleep03324968-21ssh0
33247422151,4sleep03324968-21ssh0
32975252151,3sleep03227218-21diskmemload0
32688182151,2sleep10-21swapper/11
309654899158,4cyclictest3205517-21chrt3
3096548991512,2cyclictest0-21swapper/33
309654899151,11cyclictest3108528-21chrt3
3096548991511,1cyclictest0-21swapper/33
3096548991511,1cyclictest0-21swapper/33
309654899150,13cyclictest0-21swapper/33
35860622141,2sleep20-21swapper/22
35316602140,7sleep20-21swapper/22
33594202141,2sleep10-21swapper/11
33408252141,9sleep23340839-21sh2
33059252141,7sleep03227218-21diskmemload0
32981192141,9sleep23298227-21cpuspeed_turbos2
32493122140,8sleep03249365-21ntpq0
32420682140,1sleep00-21swapper/00
32209192140,2sleep00-21swapper/00
32165362141,9sleep03216537-21cron0
32064122141,9sleep03206604-21cut0
309654899143,1cyclictest0-21swapper/33
309654899140,2cyclictest0-21swapper/33
309654899140,2cyclictest0-21swapper/33
309654899140,2cyclictest0-21swapper/33
309654899140,12cyclictest0-21swapper/33
309654899140,11cyclictest0-21swapper/33
35669622131,5sleep00-21swapper/00
35387482131,6sleep03538806-21ntpq0
35008122131,2sleep20-21swapper/22
34526302131,1sleep10-21swapper/11
34446462131,8sleep13227218-21diskmemload1
33915712130,2sleep23227218-21diskmemload2
33585022131,2sleep00-21swapper/00
33580132131,8sleep13358027-21ssh1
32706732131,2sleep03227218-21diskmemload0
31472192131,7sleep23147477-21df_inode2
309654899131,10cyclictest0-21swapper/33
309654899130,1cyclictest0-21swapper/33
35868752122,5sleep13586879-21apt-get1
35766752120,3sleep03576689-21ssh0
35766362121,7sleep13576646-21ssh1
35474442121,8sleep13547504-21ld1
35147902121,5sleep20-21swapper/22
35073692121,2sleep03227218-21diskmemload0
34979272121,3sleep20-21swapper/22
33159492121,7sleep13315987-21grep1
33035882127,2sleep10-21swapper/11
32787452121,6sleep13227218-21diskmemload1
32722932121,7sleep03272390-21cut0
32705462121,7sleep23270560-21ssh2
32592522121,6sleep2802-21snmpd2
32332762121,7sleep23233287-21ssh2
32262612121,6sleep03226318-21ntp_states0
32005682121,5sleep03200616-21munin-run0
35725702111,5sleep23573475-21memory2
35591712110,1sleep00-21swapper/00
35402192111,6sleep13540233-21ssh1
35230782111,4sleep20-21swapper/22
35067752110,2sleep10-21swapper/11
34884732111,5sleep20-21swapper/22
34883642111,2sleep13488376-21ssh1
34559192111,5sleep23456182-21df2
34384712111,5sleep03438693-21diskstats0
34356972110,2sleep10-21swapper/11
34164402111,5sleep13416506-21ntp_states1
34104832111,3sleep20-21swapper/22
34013922111,6sleep13401403-21ssh1
33839902111,6sleep03384004-21ssh0
33833032110,1sleep20-21swapper/22
33688582111,3sleep00-21swapper/00
33661122112,4sleep23227218-21diskmemload2
33579742111,3sleep20-21swapper/22
33419472111,5sleep13342207-21df_inode1
33415132111,6sleep03341524-21ssh0
33122762111,5sleep23227218-21diskmemload2
33069762111,4sleep13307188-21diskstats1
32971332111,3sleep20-21swapper/22
32848352111,5sleep13284901-21ntpq1
32808932111,6sleep23281116-21ssh2
32609072111,6sleep13260919-21ssh1
32509532111,5sleep13227218-21diskmemload1
31750402111,6sleep13176764-21kthreadcore1
31477432111,6sleep13148262-21kthreadcore1
31469372111,5sleep13146985-21munin-run1
31257462111,5sleep13126001-21df1
31203982111,5sleep23120416-21apt-get2
31084302110,5sleep13108471-21ntpq1
35832412100,2sleep03583255-21ssh0
35666772101,3sleep10-21swapper/11
35483942101,5sleep03548405-21ssh0
35432942101,4sleep23543561-21df2
35404912101,3sleep20-21swapper/22
35232962101,4sleep03227218-21diskmemload0
35170342102,3sleep13517056-21apt-get1
35154662101,3sleep00-21swapper/00
34984082101,2sleep10-21swapper/11
34864642101,3sleep00-21swapper/00
34779692101,5sleep03478180-21/usr/sbin/munin0
34713362101,3sleep20-21swapper/22
34713092100,1sleep00-21swapper/00
34662552100,6sleep13467940-21ssh1
34512642101,4sleep23451312-21ntpq2
34351812101,2sleep00-21swapper/00
34212952101,5sleep03421493-21ssh0
34097502101,2sleep00-21swapper/00
34021752101,3sleep00-21swapper/00
33898432101,4sleep13389899-21ntpq1
33753362101,2sleep20-21swapper/22
33646772101,4sleep03227218-21diskmemload0
33471632100,2sleep20-21swapper/22
33243282101,3sleep20-21swapper/22
33243282101,3sleep20-21swapper/22
33238712101,4sleep23227218-21diskmemload2
33221222101,6sleep00-21swapper/00
32923212101,5sleep13293358-21memory1
32847722101,4sleep03227218-21diskmemload0
32768782101,3sleep20-21swapper/22
32618452101,4sleep03261856-21ssh0
32450052101,3sleep20-21swapper/22
32334502101,4sleep03227218-21diskmemload0
32328662101,2sleep10-21swapper/11
32011192101,4sleep23201329-21hddtemp_smartct2
31684572101,4sleep23168476-21apt-get2
31684572101,4sleep23168476-21apt-get2
31634452101,4sleep03163655-21hddtemp_smartct0
31628932101,5sleep23162895-21cron2
31007812101,4sleep03100814-21ntpq0
30969942101,5sleep23097022-21sort2
3591192291,4sleep03591321-21ssh0
3583497291,2sleep10-21swapper/11
3560728290,5sleep20-21swapper/22
3558779290,3sleep10-21swapper/11
3552032291,3sleep23552056-21apt-get2
3531280291,3sleep03227218-21diskmemload0
3516231291,2sleep10-21swapper/11
3497096291,3sleep03227218-21diskmemload0
3478381291,3sleep23227218-21diskmemload2
3456234291,4sleep03456439-21ssh0
3442416290,2sleep20-21swapper/22
3437573291,4sleep23437588-21ssh2
3427787291,2sleep20-21swapper/22
3424975291,4sleep13425077-21ntpq1
3407735290,2sleep10-21swapper/11
3394339291,4sleep23227218-21diskmemload2
3333231291,3sleep13333460-21df_inode1
3241776291,2sleep10-21swapper/11
3211205291,4sleep13211224-21munin-run1
3202710291,4sleep13204541-21cut1
3190395291,4sleep03191292-21cat0
3188874291,4sleep23188881-21sensors_temp2
3188470291,4sleep03188562-21collect20
3162805290,1sleep00-21swapper/00
3125724291,3sleep03125743-21apt-get0
3115056290,2sleep20-21swapper/22
3110017291,4sleep13110072-21grep1
3101806291,4sleep13101826-21munin-run1
3184087280,2sleep10-21swapper/11
3174078280,4sleep23174181-21perl2
3173805281,2sleep00-21swapper/00
3162885280,1sleep10-21swapper/11
3153106281,3sleep03154549-21cut0
3142171280,1sleep00-21swapper/00
3125314282,4sleep0151ktimers/00
3113826281,3sleep03113873-21ntpq0
3113646281,3sleep23113778-21netstat2
3104672281,4sleep00-21swapper/00
3227043270,1sleep20-21swapper/22
3216279270,1sleep20-21swapper/22
3200294270,1sleep10-21swapper/11
3195470270,1sleep20-21swapper/22
3194909270,1sleep20-21swapper/22
3194774270,1sleep10-21swapper/11
3183879272,3sleep2431ktimers/22
3156339270,2sleep23156512-21strings2
3152010270,1sleep00-21swapper/00
3142697271,3sleep23144381-21cut2
3136165270,1sleep10-21swapper/11
3134891270,4sleep20-21swapper/22
3130111270,1sleep20-21swapper/22
3109216270,1sleep20-21swapper/22
3226914260,1sleep10-21swapper/11
3221743260,4sleep10-21swapper/11
3206692261,2sleep20-21swapper/22
3201430260,3sleep0221rcuc/00
3185053261,2sleep10-21swapper/11
3183950260,4sleep00-21swapper/00
3173282260,1sleep00-21swapper/00
3173282260,1sleep00-21swapper/00
3167971260,1sleep10-21swapper/11
3157328260,4sleep10-21swapper/11
3137572261,2sleep10-21swapper/11
3136541260,2sleep00-21swapper/00
3131788261,2sleep00-21swapper/00
3119220260,2sleep03115067-21/usr/sbin/munin0
3172897250,1sleep10-21swapper/11
3172897250,1sleep10-21swapper/11
3167199250,2sleep20-21swapper/22
3124596250,2sleep10-21swapper/11
3119637250,1sleep10-21swapper/11
3217112240,1sleep20-21swapper/22
3139282240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional