You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 15:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Jun 25, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119919022700,2sleep21199189-2192
1170825212567,53sleep30-21swapper/33
117058228164,11sleep10-21swapper/11
117051428060,12sleep20-21swapper/22
117063527453,15sleep00-21swapper/00
16217442210,5sleep11621758-21ssh1
16055932211,9sleep21298786-21diskmemload2
117101499217,12cyclictest0-21swapper/33
1171014992118,1cyclictest0-21swapper/33
1171014992118,1cyclictest0-21swapper/33
1171014992118,1cyclictest0-21swapper/33
1171014992117,2cyclictest0-21swapper/33
117101499211,15cyclictest0-21swapper/33
15297372201,6sleep20-21swapper/22
1171014992016,2cyclictest0-21swapper/33
1171014992013,3cyclictest16020222sleep33
117101499201,15cyclictest66950irq/132-enp1s0-TxRx-33
117101499201,15cyclictest66950irq/132-enp1s0-TxRx-33
117101499201,15cyclictest66950irq/132-enp1s0-TxRx-33
117101499201,15cyclictest1399879-21chrt3
16132502191,3sleep00-21swapper/00
117101499194,12cyclictest0-21swapper/33
1171014991916,1cyclictest0-21swapper/33
117101499191,14cyclictest0-21swapper/33
117101499191,14cyclictest0-21swapper/33
117101499190,16cyclictest66950irq/132-enp1s0-TxRx-33
16388272181,3sleep20-21swapper/22
14400002181,3sleep10-21swapper/11
12361772181,3sleep10-21swapper/11
1171014991816,1cyclictest0-21swapper/33
1171014991816,1cyclictest0-21swapper/33
1171014991815,1cyclictest0-21swapper/33
1171014991814,2cyclictest0-21swapper/33
1171014991814,2cyclictest0-21swapper/33
1171014991814,2cyclictest0-21swapper/33
1171014991813,3cyclictest0-21swapper/33
1171014991813,2cyclictest0-21swapper/33
117101499181,14cyclictest0-21swapper/33
117101499181,14cyclictest0-21swapper/33
117101499181,14cyclictest0-21swapper/33
117101499181,13cyclictest0-21swapper/33
117101499180,16cyclictest0-21swapper/33
117101499180,14cyclictest0-21swapper/33
16066042171,2sleep00-21swapper/00
15712292171,1sleep00-21swapper/00
13802112171,2sleep00-21swapper/00
117101499173,12cyclictest0-21swapper/33
1171014991715,1cyclictest0-21swapper/33
1171014991714,1cyclictest0-21swapper/33
117101499171,3cyclictest0-21swapper/33
1171014991713,2cyclictest0-21swapper/33
1171014991713,2cyclictest0-21swapper/33
1171014991713,2cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,13cyclictest0-21swapper/33
117101499171,12cyclictest0-21swapper/33
117101499170,15cyclictest0-21swapper/33
117101499170,14cyclictest0-21swapper/33
117101499170,13cyclictest0-21swapper/33
15887762161,2sleep20-21swapper/22
15796222161,4sleep21298786-21diskmemload2
15476312161,2sleep10-21swapper/11
14971362161,2sleep10-21swapper/11
14723752161,4sleep11298786-21diskmemload1
14158502161,10sleep01415870-21ssh0
13661902161,4sleep01366323-21diskstats0
13143872161,2sleep20-21swapper/22
117101499161,3cyclictest0-21swapper/33
117101499161,3cyclictest0-21swapper/33
1171014991613,1cyclictest0-21swapper/33
1171014991613,1cyclictest0-21swapper/33
1171014991613,1cyclictest0-21swapper/33
1171014991613,1cyclictest0-21swapper/33
1171014991613,1cyclictest0-21swapper/33
1171014991611,3cyclictest0-21swapper/33
1171014991611,3cyclictest0-21swapper/33
117101499161,12cyclictest0-21swapper/33
117101499161,12cyclictest0-21swapper/33
117101499161,12cyclictest0-21swapper/33
117101499160,14cyclictest0-21swapper/33
16469582151,4sleep11646969-21ssh1
15468192151,3sleep01298786-21diskmemload0
15222642151,2sleep10-21swapper/11
14383932151,3sleep01298786-21diskmemload0
13888562151,4sleep01298786-21diskmemload0
13052232150,1sleep10-21swapper/11
12619902150,2sleep20-21swapper/22
1171014991513,1cyclictest0-21swapper/33
1171014991512,1cyclictest0-21swapper/33
1171014991512,1cyclictest0-21swapper/33
1171014991512,1cyclictest0-21swapper/33
117101499150,13cyclictest0-21swapper/33
117101499150,13cyclictest0-21swapper/33
117101499150,11cyclictest0-21swapper/33
16139272141,2sleep20-21swapper/22
117101499140,11cyclictest0-21swapper/33
15376952130,2sleep01298786-21diskmemload0
15291772131,7sleep11298786-21diskmemload1
15239092131,3sleep01523940-21apt-get0
15129052130,2sleep10-21swapper/11
14898582131,7sleep01489868-21ssh0
14624362135,3sleep2431ktimers/22
14464772131,8sleep11446489-21sh1
14315882131,3sleep01431600-21ssh0
14294532130,6sleep11429465-21rm1
13819062131,5sleep10-21swapper/11
13468232131,6sleep20-21swapper/22
13221322133,6sleep2431ktimers/22
12419792131,8sleep11242784-21cut1
16381672121,5sleep10-21swapper/11
15958362121,7sleep01595848-21ssh0
15832532122,5sleep11584779-21cut1
15740912121,6sleep11574114-21apt-get1
15650492121,5sleep20-21swapper/22
15645692121,3sleep10-21swapper/11
15544542121,7sleep11554466-21rm1
15203712121,7sleep01520383-21ssh0
14990242121,5sleep11499197-21diskstats1
14990242121,5sleep11499197-21diskstats1
14987882120,6sleep01298786-21diskmemload0
14987882120,6sleep01298786-21diskmemload0
14956362121,7sleep21495648-21rm2
14875062121,2sleep11487520-21ssh1
14872362122,6sleep21298786-21diskmemload2
14815662121,5sleep20-21swapper/22
14697942120,3sleep00-21swapper/00
13824732121,7sleep11382483-21ssh1
13300672121,3sleep00-21swapper/00
13158402121,7sleep01315617-21sendmail-msp0
13056102121,5sleep20-21swapper/22
12682302120,1sleep00-21swapper/00
12204542121,5sleep01220473-21apt-get0
16452172111,6sleep21645445-21rm2
16383412111,4sleep01298786-21diskmemload0
16059632111,3sleep10-21swapper/11
15972072111,3sleep10-21swapper/11
15561712111,4sleep00-21swapper/00
15203062111,3sleep20-21swapper/22
15071092111,4sleep01298786-21diskmemload0
15059542111,7sleep21505965-21ssh2
15059542111,7sleep21505965-21ssh2
14788342111,4sleep01298786-21diskmemload0
14718622111,3sleep20-21swapper/22
14562582111,2sleep20-21swapper/22
14495772111,5sleep11449800-21hddtemp_smartct1
14212452110,2sleep20-21swapper/22
13724732111,4sleep10-21swapper/11
13648642111,3sleep00-21swapper/00
13465162111,5sleep01346530-21ssh0
13395802111,4sleep01298786-21diskmemload0
13395802111,4sleep01298786-21diskmemload0
13335192111,6sleep11335020-21kthreadcore1
13335192111,6sleep11335020-21kthreadcore1
13301282111,4sleep11298786-21diskmemload1
13250542111,6sleep21325644-21tr2
13235732110,5sleep10-21swapper/11
13135212111,4sleep11298786-21diskmemload1
13132952110,1sleep00-21swapper/00
12732002110,1sleep00-21swapper/00
12519272111,4sleep21251946-21apt-get2
12309562112,4sleep21230958-21apt-get2
11944662110,3sleep01194680-21smartctl0
16466292101,2sleep00-21swapper/00
16315762101,3sleep20-21swapper/22
16309752101,2sleep10-21swapper/11
16227412101,5sleep21622753-21ssh2
16211292101,4sleep01298786-21diskmemload0
16075642102,3sleep11607588-21apt-get1
15719952101,3sleep10-21swapper/11
15693122101,5sleep21569793-21head2
15548822101,3sleep21298786-21diskmemload2
15453972101,4sleep21298786-21diskmemload2
15351232101,3sleep20-21swapper/22
15126412101,2sleep20-21swapper/22
14946752101,4sleep01494752-21ntp_states0
14740982101,3sleep10-21swapper/11
14629412100,2sleep11462953-21ssh1
14625992101,4sleep01298786-21diskmemload0
14472562101,4sleep01298786-21diskmemload0
14459242101,3sleep20-21swapper/22
14391102101,3sleep20-21swapper/22
14308072101,4sleep21298786-21diskmemload2
14140792101,4sleep01298786-21diskmemload0
14132132100,1sleep20-21swapper/22
14130702100,2sleep10-21swapper/11
14048562101,3sleep01298786-21diskmemload0
14045522101,2sleep20-21swapper/22
13985212101,4sleep21298786-21diskmemload2
13985082101,4sleep11298786-21diskmemload1
13956992101,4sleep01298786-21diskmemload0
13837422101,5sleep21385323-21cut2
13711362101,2sleep20-21swapper/22
13634672101,3sleep21298786-21diskmemload2
13569242101,3sleep01298786-21diskmemload0
13542472101,5sleep21354258-21ssh2
13472452100,1sleep10-21swapper/11
13371672101,4sleep21298786-21diskmemload2
13371672101,4sleep21298786-21diskmemload2
12997572101,5sleep01300275-21kthreadcore0
12972772101,6sleep01297767-21grep0
12522182101,4sleep11252427-21hddtemp_smartct1
12466692101,3sleep20-21swapper/22
12152052101,3sleep21214923-21apt-get2
12067482101,5sleep21206805-21kthreadcore2
12047032101,4sleep00-21swapper/00
12044032101,5sleep01-21systemd0
11890672101,4sleep01189269-21diskstats0
11890672101,4sleep01189269-21diskstats0
11784422101,4sleep21176155-21apt-get2
11784422101,4sleep21176155-21apt-get2
1629647292,3sleep0151ktimers/00
1596100290,1sleep20-21swapper/22
1589657290,1sleep00-21swapper/00
1581800291,2sleep00-21swapper/00
1532042291,2sleep10-21swapper/11
1455702291,2sleep00-21swapper/00
1420765291,2sleep10-21swapper/11
1405246291,2sleep10-21swapper/11
1379190290,3sleep20-21swapper/22
1364063291,2sleep10-21swapper/11
1349448291,2sleep10-21swapper/11
1298770291,4sleep11298998-21cat1
1288595290,3sleep11288614-21apt-get1
1281987291,4sleep01278112-21/usr/sbin/munin0
1272900291,2sleep10-21swapper/11
1262421291,4sleep01262603-21cat0
1257167291,3sleep01257179-21apt-get0
1251918291,4sleep00-21swapper/00
1215238291,3sleep11215241-21apt-get1
1209950291,2sleep10-21swapper/11
1184689291,4sleep01186315-21tr0
1184026291,4sleep11184053-21fschecks_count1
1182452290,1sleep00-21swapper/00
1182452290,1sleep00-21swapper/00
1176143291,4sleep11176169-21munin-run1
1171462290,4sleep21171672-21hddtemp_smartct2
1558980281,3sleep00-21swapper/00
1289168281,3sleep21289900-21kthreadcore2
1283367280,5sleep01283433-21cpuspeed_turbos0
1273503281,3sleep2421rcuc/22
1257186281,3sleep11257439-21df1
1230587280,1sleep00-21swapper/00
1225363280,2sleep10-21swapper/11
1221545281,3sleep20-21swapper/22
1205285281,3sleep11206747-21grep1
1203687281,3sleep11199401-21/usr/sbin/munin1
1199133280,4sleep11-21systemd1
1188976280,2sleep20-21swapper/22
1188976280,2sleep20-21swapper/22
1284880271,3sleep11286582-21kthreadcore1
1279027271,3sleep21280652-21kthreadcore2
1267303270,1sleep20-21swapper/22
1242785271,3sleep20-21swapper/22
1240215270,4sleep21240321-21processes2
1236475271,2sleep01236682-21smartctl0
1235688270,1sleep10-21swapper/11
1230514270,1sleep20-21swapper/22
1226685271,3sleep10-21swapper/11
1220098270,1sleep00-21swapper/00
1214731270,1sleep00-21swapper/00
1210527271,3sleep21211813-21tr2
1199400270,2sleep20-21swapper/22
1193794270,1sleep10-21swapper/11
1193794270,1sleep10-21swapper/11
1188462270,1sleep20-21swapper/22
1171773270,4sleep00-21swapper/00
1294381261,2sleep20-21swapper/22
1288020260,1sleep20-21swapper/22
1278133260,2sleep10-21swapper/11
1271330260,2sleep21271619-21strings2
1267850261,2sleep10-21swapper/11
1246455260,2sleep10-21swapper/11
1241412260,1sleep00-21swapper/00
1235822260,3sleep00-21swapper/00
1178476261,2sleep10-21swapper/11
1178476261,2sleep10-21swapper/11
1288520250,1sleep00-21swapper/00
1264620250,2sleep10-21swapper/11
1246947250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional