You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 22:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Fri Jun 05, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38137212255,63sleep30-21swapper/33
3792029364,10sleep10-21swapper/11
3795728162,11sleep20-21swapper/22
3318227748,17sleep00-21swapper/00
2993582330,3sleep30-21swapper/33
4893022260,2sleep20-21swapper/22
3828999251,20cyclictest533668-21taskset3
3828999222,15cyclictest519166-21chrt3
38289992215,4cyclictest515929-21taskset3
3828999212,15cyclictest0-21swapper/33
3828999211,16cyclictest0-21swapper/33
3828999211,16cyclictest0-21swapper/33
4979912201,2sleep20-21swapper/22
4979912201,2sleep20-21swapper/22
4844682201,4sleep0484604-21perl0
38289992017,2cyclictest0-21swapper/33
3828999201,16cyclictest0-21swapper/33
3828999200,16cyclictest289174-21taskset3
3828999200,16cyclictest0-21swapper/33
5078802190,1sleep10-21swapper/11
3828999192,12cyclictest173765-21taskset3
38289991915,2cyclictest0-21swapper/33
3828999191,15cyclictest0-21swapper/33
3828999191,14cyclictest411003-21taskset3
3828999191,14cyclictest0-21swapper/33
3828999191,14cyclictest0-21swapper/33
3828999191,14cyclictest0-21swapper/33
3828999191,14cyclictest0-21swapper/33
3828999190,16cyclictest0-21swapper/33
3828999187,8cyclictest94527-21turbostat3
3828999182,11cyclictest182622-21taskset3
38289991812,4cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,14cyclictest0-21swapper/33
3828999181,13cyclictest4801432sleep33
3828999181,13cyclictest0-21swapper/33
3828999181,13cyclictest0-21swapper/33
3828999180,15cyclictest0-21swapper/33
3828999180,14cyclictest0-21swapper/33
3828999180,14cyclictest0-21swapper/33
3828999180,14cyclictest0-21swapper/33
4458072171,3sleep10-21swapper/11
3828999178,6cyclictest110563-21turbostat3
38289991715,1cyclictest0-21swapper/33
38289991714,1cyclictest0-21swapper/33
3828999171,3cyclictest0-21swapper/33
3828999171,13cyclictest0-21swapper/33
3828999171,13cyclictest0-21swapper/33
3828999171,13cyclictest0-21swapper/33
3828999170,14cyclictest0-21swapper/33
3828999170,13cyclictest0-21swapper/33
2271292171,10sleep10-21swapper/11
2271292171,10sleep10-21swapper/11
3871152161,2sleep20-21swapper/22
3828999169,4cyclictest88922-21turbostat3
3828999162,10cyclictest300934-21taskset3
38289991613,1cyclictest0-21swapper/33
38289991611,3cyclictest0-21swapper/33
3828999161,12cyclictest88934-21turbostat3
3828999161,12cyclictest0-21swapper/33
3828999161,12cyclictest0-21swapper/33
3828999160,13cyclictest0-21swapper/33
3828999160,13cyclictest0-21swapper/33
3828999160,13cyclictest0-21swapper/33
3828999160,13cyclictest0-21swapper/33
3828999160,13cyclictest0-21swapper/33
3828999160,12cyclictest0-21swapper/33
3828999160,12cyclictest0-21swapper/33
3771182165,2sleep0171rcu_preempt0
3414312161,2sleep10-21swapper/11
3157442160,2sleep10-21swapper/11
4548072150,1sleep10-21swapper/11
4048222151,9sleep2169196-21diskmemload2
4028352151,3sleep0169196-21diskmemload0
3853772151,8sleep00-21swapper/00
3828999151,12cyclictest0-21swapper/33
3828999150,13cyclictest0-21swapper/33
3828999150,13cyclictest0-21swapper/33
3828999150,12cyclictest0-21swapper/33
3828999150,11cyclictest0-21swapper/33
3828999150,11cyclictest0-21swapper/33
3707372151,2sleep20-21swapper/22
3435612150,2sleep00-21swapper/00
3235482151,3sleep20-21swapper/22
3235482151,3sleep20-21swapper/22
1932222151,2sleep20-21swapper/22
1846512151,3sleep20-21swapper/22
5088142141,9sleep0508829-21ssh0
4642062140,2sleep10-21swapper/11
4564572141,9sleep0456471-21ssh0
4535492141,8sleep2453647-21/usr/sbin/munin2
4273422142,6sleep1427397-21ntpq1
4195552141,4sleep1419566-21ssh1
3828999140,11cyclictest121062-21chrt3
3773762140,2sleep10-21swapper/11
2901742141,8sleep0169196-21diskmemload0
1777212141,7sleep10-21swapper/11
785292131,8sleep078709-21head0
625832131,8sleep262661-21uname2
5344032131,2sleep20-21swapper/22
5324692131,8sleep0532678-21ssh0
5181522130,1sleep00-21swapper/00
4185822132,5sleep2169196-21diskmemload2
3828999131,9cyclictest1561982sleep33
3527732131,3sleep1352787-21ssh1
2974412131,6sleep20-21swapper/22
2705672131,8sleep1270583-21sensors_temp1
2347122131,4sleep0234773-21ssh0
2015282136,3sleep0169196-21diskmemload0
1869822130,8sleep1187001-21apt-get1
1855842133,2sleep00-21swapper/00
1633182131,7sleep2163503-21users2
1215122131,7sleep0121531-21apt-get0
1202252131,6sleep1120263-21ntpq1
989692121,7sleep099060-21ps0
724792120,1sleep10-21swapper/11
618202121,7sleep062003-21sed0
5260352125,1sleep10-21swapper/11
5011882121,8sleep0501199-21ssh0
5011882121,8sleep0501199-21ssh0
5001362121,8sleep1500147-21ssh1
5001362121,8sleep1500147-21ssh1
4921022121,6sleep1169196-21diskmemload1
4803442121,3sleep0480364-21ssh0
4745462121,2sleep20-21swapper/22
4358532120,8sleep0435978-21ld0
3958802121,6sleep0169196-21diskmemload0
3650942121,5sleep1366207-21memory1
3576512121,8sleep10-21swapper/11
3527612121,7sleep0169196-21diskmemload0
3429102121,5sleep20-21swapper/22
3356382121,3sleep1335652-21ssh1
3097302120,2sleep20-21swapper/22
2974262121,7sleep1297440-21ssh1
2724912121,7sleep0272498-21ssh0
2374302121,6sleep2169196-21diskmemload2
2200592121,2sleep20-21swapper/22
2106772122,4sleep2169196-21diskmemload2
1766482120,3sleep0115797-21kworker/u16:0+rpciod0
1380562121,7sleep2139470-21cut2
1162082121,7sleep2116416-21expr2
988602111,5sleep298910-21ntpq2
894192111,5sleep188918-21apt-get1
729142111,6sleep172932-21apt1
718872111,6sleep067401-21/usr/sbin/munin0
554932112,4sleep155533-21ntpq1
5250252111,4sleep0169196-21diskmemload0
5178752112,4sleep2169196-21diskmemload2
4836142111,5sleep2169196-21diskmemload2
4754732111,5sleep1475726-21df_inode1
4750342110,7sleep1475254-21wc1
4468882111,6sleep0446899-21ssh0
4386402111,4sleep2169196-21diskmemload2
4381852110,7sleep1438196-21ssh1
426112111,5sleep142665-21ntpq1
4122932111,1sleep10-21swapper/11
3504382111,4sleep2169196-21diskmemload2
3080662111,4sleep0169196-21diskmemload0
3058682111,7sleep2305882-21ssh2
2916052111,6sleep2291616-21ssh2
2810022111,6sleep1281016-21ssh1
2636912111,3sleep10-21swapper/11
2529602110,5sleep20-21swapper/22
2359512111,6sleep1169196-21diskmemload1
2259492111,5sleep0226006-21ntpq0
2259492111,5sleep0226006-21ntpq0
2134212111,5sleep1213641-21hddtemp_smartct1
1962982111,6sleep1197627-21cat1
1909692111,4sleep0191120-21ntpq0
1840882111,5sleep1169196-21diskmemload1
1467772111,5sleep0146866-21ntpq0
1415032111,5sleep1141551-21ntpq1
1152052111,6sleep0110808-21/usr/sbin/munin0
1113082111,5sleep2111379-21irqstats2
821872101,5sleep182275-21ntpq1
623722101,4sleep162582-21hddtemp_smartct1
5196922101,5sleep2519812-21kthreadcore2
5078412100,2sleep20-21swapper/22
501372101,5sleep250170-21ntpq2
4722492100,1sleep00-21swapper/00
4636872101,4sleep0169196-21diskmemload0
4630102101,3sleep2169196-21diskmemload2
4295012100,2sleep20-21swapper/22
4286222101,3sleep0169196-21diskmemload0
4206062101,4sleep0169196-21diskmemload0
4136202101,6sleep23674955-21ntpd2
3953102100,1sleep20-21swapper/22
3857942101,5sleep1169196-21diskmemload1
3689572101,2sleep00-21swapper/00
3325342101,2sleep20-21swapper/22
3267012102,4sleep1326715-21ssh1
3267012102,4sleep1326715-21ssh1
3243182101,3sleep00-21swapper/00
3243182101,3sleep00-21swapper/00
2964012101,4sleep0296461-21ntpq0
2883902100,4sleep10-21swapper/11
2747272101,5sleep0274917-21expr0
2703242101,2sleep20-21swapper/22
2645482101,4sleep0169196-21diskmemload0
2636072100,1sleep20-21swapper/22
2563222101,4sleep1256362-21apt-get1
2479142101,4sleep0169196-21diskmemload0
2449162101,3sleep20-21swapper/22
2270892101,4sleep2169196-21diskmemload2
2270892101,4sleep2169196-21diskmemload2
2042902100,6sleep00-21swapper/00
2031582101,4sleep2169196-21diskmemload2
1766752101,4sleep2169196-21diskmemload2
1349402101,4sleep2136041-21memory2
1095252101,5sleep2109565-21ntpq2
1042182101,4sleep2104265-21ntpq2
94818291,4sleep194961-21cstates1
84113290,1sleep00-21swapper/00
83823291,3sleep183842-21apt-get1
61463290,1sleep10-21swapper/11
533944291,2sleep10-21swapper/11
52812290,4sleep254538-21grep2
515611291,4sleep1515624-21rm1
446052291,4sleep2446063-21ssh2
406165291,4sleep0406304-21if_enp1s00
402749290,2sleep10-21swapper/11
394984291,3sleep1169196-21diskmemload1
357716290,4sleep2357774-21ntp_states2
357591291,4sleep0169196-21diskmemload0
335574291,4sleep0335585-21ssh0
315475291,3sleep0169196-21diskmemload0
300781291,2sleep10-21swapper/11
279646291,4sleep2169196-21diskmemload2
244404291,3sleep1169196-21diskmemload1
238885290,1sleep00-21swapper/00
212972291,2sleep00-21swapper/00
204350290,4sleep1204365-21apt-get1
158400290,4sleep20-21swapper/22
153135290,4sleep10-21swapper/11
152229291,3sleep0152277-21ntpq0
143377291,4sleep1144367-21cut1
122084291,5sleep1123428-21kthreadcore1
115011291,4sleep1115124-21ps1
100657291,4sleep1101014-21grep1
89964281,3sleep290317-21grep2
84395281,3sleep285685-21cut2
73483281,3sleep274632-21cut2
72631281,4sleep23671894-21systemd-journal2
44089281,3sleep144543-21users1
43563281,3sleep00-21swapper/00
43358280,1sleep00-21swapper/00
367247281,3sleep2169196-21diskmemload2
162889281,2sleep00-21swapper/00
157646281,3sleep0157771-21sendmail_mailqu0
154006281,3sleep1154531-21kthreadcore1
137172280,1sleep10-21swapper/11
121605280,4sleep2121800-21diskstats2
92006271,3sleep00-21swapper/00
58049271,3sleep258855-21kthreadcore2
42667271,2sleep242755-21ps2
165542271,3sleep10-21swapper/11
159079271,2sleep1158810-21/usr/sbin/munin1
132694271,3sleep0132750-21kthreadcore0
110414270,1sleep00-21swapper/00
110050270,3sleep1110176-21/usr/sbin/munin1
82281260,1sleep20-21swapper/22
76452261,2sleep00-21swapper/00
66978260,1sleep00-21swapper/00
51448261,2sleep00-21swapper/00
164699261,2sleep00-21swapper/00
164424260,2sleep20-21swapper/22
152333260,3sleep20-21swapper/22
142401260,4sleep00-21swapper/00
126839260,2sleep20-21swapper/22
121006260,1sleep00-21swapper/00
104986260,1sleep00-21swapper/00
142863250,1sleep20-21swapper/22
131882250,3sleep00-21swapper/00
130997250,2sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional