You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 21:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sun May 17, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1013096212055,60sleep30-21swapper/33
12220322930,3sleep2431ktimers/22
101316628163,12sleep20-21swapper/22
101300227862,11sleep10-21swapper/11
101308527662,8sleep00-21swapper/00
1013386992624,1cyclictest0-21swapper/33
1013386992523,1cyclictest0-21swapper/33
1013386992522,1cyclictest0-21swapper/33
101338699251,20cyclictest0-21swapper/33
1013386992422,1cyclictest0-21swapper/33
1013386992421,2cyclictest0-21swapper/33
1013386992321,1cyclictest0-21swapper/33
1013386992320,2cyclictest0-21swapper/33
1013386992319,2cyclictest0-21swapper/33
1013386992318,2cyclictest0-21swapper/33
1013386992310,1cyclictest0-21swapper/33
101338699227,12cyclictest0-21swapper/33
1013386992220,1cyclictest0-21swapper/33
1013386992219,1cyclictest0-21swapper/33
1013386992219,1cyclictest0-21swapper/33
1013386992211,8cyclictest66950irq/132-enp1s0-TxRx-33
14158622210,12sleep20-21swapper/22
101338699217,9cyclictest0-21swapper/33
1013386992119,1cyclictest0-21swapper/33
1013386992119,1cyclictest0-21swapper/33
1013386992117,2cyclictest0-21swapper/33
1013386992117,2cyclictest0-21swapper/33
1013386992117,2cyclictest0-21swapper/33
1013386992117,2cyclictest0-21swapper/33
1013386992117,2cyclictest0-21swapper/33
1013386992113,5cyclictest66950irq/132-enp1s0-TxRx-33
1013386992112,6cyclictest1239681-21chrt3
101338699211,16cyclictest1122406-21taskset3
101338699205,12cyclictest0-21swapper/33
101338699202,15cyclictest66950irq/132-enp1s0-TxRx-33
1013386992017,2cyclictest0-21swapper/33
1013386992017,2cyclictest0-21swapper/33
1013386992017,1cyclictest0-21swapper/33
1013386992017,1cyclictest0-21swapper/33
1013386992016,2cyclictest0-21swapper/33
101338699201,15cyclictest1373372-21taskset3
101338699200,8cyclictest0-21swapper/33
11755642191,7sleep21143828-21diskmemload2
11598692192,4sleep21143828-21diskmemload2
101338699194,12cyclictest0-21swapper/33
101338699193,13cyclictest0-21swapper/33
1013386991917,1cyclictest0-21swapper/33
1013386991917,1cyclictest0-21swapper/33
1013386991916,1cyclictest0-21swapper/33
1013386991914,4cyclictest66950irq/132-enp1s0-TxRx-33
101338699191,15cyclictest0-21swapper/33
101338699191,14cyclictest0-21swapper/33
101338699191,14cyclictest0-21swapper/33
101338699191,14cyclictest0-21swapper/33
101338699191,14cyclictest0-21swapper/33
1013386991910,6cyclictest1035637-21taskset3
14825892181,11sleep00-21swapper/00
14406422181,8sleep01440654-21ssh0
101338699183,13cyclictest0-21swapper/33
1013386991816,1cyclictest0-21swapper/33
1013386991816,1cyclictest0-21swapper/33
1013386991816,1cyclictest0-21swapper/33
1013386991816,1cyclictest0-21swapper/33
1013386991815,1cyclictest0-21swapper/33
1013386991814,2cyclictest0-21swapper/33
13368162171,4sleep01336873-21ntpq0
12598652171,5sleep11143828-21diskmemload1
101338699171,4cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991713,2cyclictest0-21swapper/33
1013386991712,3cyclictest0-21swapper/33
14097062161,4sleep11143828-21diskmemload1
14003442161,2sleep10-21swapper/11
13662362161,4sleep01143828-21diskmemload0
13566712160,1sleep10-21swapper/11
13491762161,9sleep10-21swapper/11
12549552162,9sleep21143828-21diskmemload2
12536972161,2sleep20-21swapper/22
12284632161,3sleep00-21swapper/00
1013386991614,1cyclictest0-21swapper/33
1013386991614,1cyclictest0-21swapper/33
1013386991613,1cyclictest0-21swapper/33
101338699160,14cyclictest0-21swapper/33
101338699160,13cyclictest0-21swapper/33
149426921510,2sleep21458496-21kworker/2:1+events_freezable2
14828382151,4sleep11143828-21diskmemload1
14333432151,2sleep00-21swapper/00
13745632151,2sleep20-21swapper/22
13286592151,4sleep11143828-21diskmemload1
12089872151,3sleep11143828-21diskmemload1
10627692150,1sleep10-21swapper/11
10627692150,1sleep10-21swapper/11
101338699150,12cyclictest0-21swapper/33
14828082141,3sleep21482822-21sh2
14594082146,3sleep01143828-21diskmemload0
14232912141,8sleep01143828-21diskmemload0
14079112141,4sleep21143828-21diskmemload2
13978482142,8sleep0151ktimers/00
13916992141,9sleep01143828-21diskmemload0
13727192141,2sleep00-21swapper/00
13659672141,9sleep21365978-21ssh2
12899022141,6sleep11290039-21ssh1
12899022141,6sleep11290039-21ssh1
12803172141,8sleep11143828-21diskmemload1
12617222141,10sleep00-21swapper/00
11697172141,8sleep01143828-21diskmemload0
11582992143,2sleep0171rcu_preempt0
10356862141,8sleep01035733-21ntpq0
14654982131,7sleep01143828-21diskmemload0
14481412131,4sleep11448200-21cat1
13805452131,8sleep01380557-21ssh0
13573902131,3sleep01357392-21ssh0
13471342131,8sleep21143828-21diskmemload2
13308472131,5sleep20-21swapper/22
12368142131,8sleep01143828-21diskmemload0
12364752132,5sleep244-21ksoftirqd/22
11867692131,5sleep172-21kcompactd01
11375852131,8sleep11137704-21grep1
14856002121,5sleep01441989-21kworker/0:0+events0
14673202121,6sleep21143828-21diskmemload2
14609512121,6sleep11143828-21diskmemload1
14566802125,4sleep21456924-21unixbench_singl2
14563362121,6sleep11456401-21ntpq1
13896282124,2sleep1171rcu_preempt1
13462992121,7sleep01346312-21ssh0
13131602121,7sleep21313173-21rm2
13050512121,7sleep11143828-21diskmemload1
12526582121,7sleep11143828-21diskmemload1
12427092121,5sleep00-21swapper/00
12361742121,7sleep11236184-21ssh1
12183842121,7sleep11143828-21diskmemload1
12032152121,5sleep10-21swapper/11
11928762120,4sleep21192887-21sh2
11835992121,7sleep21143828-21diskmemload2
11384592121,7sleep0255-21systemd-journal0
11214682121,7sleep11121516-21ntpq1
11205532121,8sleep21121323-21sed2
10409792121,6sleep11041029-21ntpq1
14753932111,4sleep20-21swapper/22
14753932111,4sleep20-21swapper/22
14507102110,1sleep00-21swapper/00
14357732111,6sleep21436806-21grep2
14330622111,7sleep11433074-21rm1
14251132111,3sleep20-21swapper/22
14170172110,5sleep00-21swapper/00
13754362111,3sleep10-21swapper/11
13394962114,4sleep20-21swapper/22
13375202111,6sleep11337530-21ssh1
13209782110,6sleep21143828-21diskmemload2
13153452111,5sleep11315240-21/usr/sbin/munin1
13142792111,2sleep01314290-21ssh0
12969822111,6sleep01143828-21diskmemload0
12969822111,6sleep01143828-21diskmemload0
12793252112,4sleep21143828-21diskmemload2
12708852111,2sleep11143828-21diskmemload1
12693342110,1sleep00-21swapper/00
12531852111,6sleep01253196-21ssh0
12442242111,2sleep20-21swapper/22
12211732112,4sleep11221192-21apt-get1
12116082111,6sleep21211620-21ssh2
11654272111,5sleep01165487-21ntpq0
11429232111,6sleep21138720-21/usr/sbin/munin2
11019472111,6sleep21102958-21grep2
14943482101,3sleep10-21swapper/11
14743242101,2sleep00-21swapper/00
14743242101,2sleep00-21swapper/00
14740022101,3sleep10-21swapper/11
14740022101,3sleep10-21swapper/11
14499282101,3sleep20-21swapper/22
14392332101,4sleep11439347-21ntpq1
14309342101,5sleep21430994-21ntpq2
14181922101,3sleep10-21swapper/11
14076622101,3sleep10-21swapper/11
14064652101,4sleep01143828-21diskmemload0
13979602101,2sleep20-21swapper/22
13813382101,4sleep21143828-21diskmemload2
13731062101,4sleep11143828-21diskmemload1
13583442100,2sleep11358354-21ssh1
13549922100,2sleep20-21swapper/22
13311192101,4sleep01143828-21diskmemload0
13107242101,4sleep11143828-21diskmemload1
13023642101,5sleep01302414-21ntpq0
12868932101,4sleep01143828-21diskmemload0
12864432101,2sleep10-21swapper/11
12861262100,1sleep20-21swapper/22
12728322101,4sleep01272969-21diskstats0
12458522101,2sleep10-21swapper/11
12180562101,3sleep20-21swapper/22
12108462101,3sleep00-21swapper/00
12019252101,3sleep00-21swapper/00
12006462101,2sleep20-21swapper/22
11927992101,4sleep01143828-21diskmemload0
11847712100,1sleep10-21swapper/11
11828182101,3sleep00-21swapper/00
11753022101,3sleep10-21swapper/11
11652452101,4sleep21143828-21diskmemload2
11572542100,6sleep11152622-21/usr/sbin/munin1
11516872101,3sleep20-21swapper/22
11510262101,4sleep01143828-21diskmemload0
11441742101,5sleep11144202-21apt-get1
11267552101,5sleep21126803-21ntpq2
11072672101,5sleep11108722-21kthreadcore1
11001142101,5sleep01100156-21ntpq0
10422442101,4sleep01042262-21apt-get0
10307522101,4sleep21030969-21users2
1500151291,3sleep01143828-21diskmemload0
1490993291,2sleep20-21swapper/22
1486269291,4sleep11486481-21expr1
1389681291,2sleep20-21swapper/22
1320318291,3sleep01143828-21diskmemload0
1303217291,2sleep20-21swapper/22
1293635291,4sleep21293766-21ld2
1293635291,4sleep21293766-21ld2
1264041291,3sleep21263520-21apt-get2
1167808291,2sleep10-21swapper/11
1139292291,5sleep01140524-21kthreadcore0
1128301291,4sleep01128402-21grep0
1106685290,4sleep00-21swapper/00
1085411291,5sleep01085594-21cstates0
1047130291,4sleep11047056-31find1
1212686280,1sleep00-21swapper/00
1133372280,2sleep20-21swapper/22
1113207281,3sleep01114943-21kthreadcore0
1110802281,4sleep21110848-21ld2
1094789281,3sleep11094821-21ntpq1
1090722280,3sleep01090741-21apt-get0
1084509280,1sleep20-21swapper/22
1075306280,4sleep01076368-21cut0
1073501281,4sleep01073548-21ntpq0
1068430281,3sleep20-21swapper/22
1057612280,4sleep21057829-21users2
1042524281,3sleep21042627-21perl2
1031279280,1sleep00-21swapper/00
1143464270,1sleep10-21swapper/11
1132983270,1sleep10-21swapper/11
1128008270,1sleep20-21swapper/22
1122689271,2sleep11122708-21apt-get1
1117371271,2sleep00-21swapper/00
1116749270,1sleep20-21swapper/22
1097570271,2sleep10-21swapper/11
1085044270,1sleep10-21swapper/11
1084801270,1sleep00-21swapper/00
1074315270,1sleep20-21swapper/22
1059342271,2sleep20-21swapper/22
1059342271,2sleep20-21swapper/22
1058626271,2sleep01058212-21apt-get0
1058626271,2sleep01058212-21apt-get0
1053768271,3sleep01055438-21kthreadcore0
1052494270,1sleep00-21swapper/00
1047741270,2sleep20-21swapper/22
1041718270,1sleep00-21swapper/00
1041031270,3sleep21041090-21ld2
1036336270,1sleep20-21swapper/22
1028273271,3sleep10-21swapper/11
1025795271,3sleep11025796-21pool-udisksd1
1020922271,2sleep20-21swapper/22
1019095271,2sleep00-21swapper/00
1014469270,3sleep01016170-21cut0
1127132260,3sleep00-21swapper/00
1116416261,2sleep10-21swapper/11
1106339260,1sleep00-21swapper/00
1101081260,1sleep20-21swapper/22
1094824260,2sleep20-21swapper/22
1090311260,1sleep10-21swapper/11
1079664260,1sleep20-21swapper/22
1076369261,2sleep10-21swapper/11
1074376260,4sleep10-21swapper/11
1068077260,2sleep00-21swapper/00
1064629261,2sleep10-21swapper/11
1048042261,2sleep10-21swapper/11
1018314260,1sleep10-21swapper/11
1013556260,1sleep20-21swapper/22
1105325250,1sleep10-21swapper/11
1090141250,3sleep20-21swapper/22
1057509250,1sleep10-21swapper/11
1031384250,2sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional