You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 07:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Jun 26, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36023421310,2sleep1301irq_work/11
250626212061,55sleep30-21swapper/33
25052928456,7sleep00-21swapper/00
25039728263,11sleep20-21swapper/22
25069827862,10sleep10-21swapper/11
6031102251,10sleep0378815-21diskmemload0
25100099221,17cyclictest698445-21taskset3
25100099221,17cyclictest394652-21taskset3
25100099215,13cyclictest66950irq/132-enp1s0-TxRx-33
251000992117,2cyclictest0-21swapper/33
25100099211,16cyclictest529525-21chrt3
4876272201,4sleep00-21swapper/00
251000992012,5cyclictest0-21swapper/33
25100099201,15cyclictest0-21swapper/33
25100099201,15cyclictest0-21swapper/33
25100099192,13cyclictest530572-21taskset3
25100099192,12cyclictest613876-21chrt3
251000991916,1cyclictest0-21swapper/33
25100099191,2cyclictest0-21swapper/33
25100099191,15cyclictest0-21swapper/33
25100099191,14cyclictest0-21swapper/33
25100099191,13cyclictest0-21swapper/33
6387982181,3sleep20-21swapper/22
5948682181,2sleep10-21swapper/11
3324172181,3sleep10-21swapper/11
25100099183,2cyclictest0-21swapper/33
25100099182,13cyclictest722382-21chrt3
25100099181,2cyclictest0-21swapper/33
25100099181,14cyclictest0-21swapper/33
25100099181,14cyclictest0-21swapper/33
25100099181,14cyclictest0-21swapper/33
25100099181,14cyclictest0-21swapper/33
25100099181,13cyclictest0-21swapper/33
6221212170,2sleep10-21swapper/11
6054752171,3sleep00-21swapper/00
5110352171,9sleep20-21swapper/22
4455762170,7sleep20-21swapper/22
4382112171,11sleep1438246-21ssh1
4378132170,13sleep10-21swapper/11
25100099174,1cyclictest0-21swapper/33
25100099172,10cyclictest547420-21taskset3
25100099172,10cyclictest395973-21taskset3
25100099172,10cyclictest269012-21taskset3
25100099171,7cyclictest677339-21taskset3
25100099171,4cyclictest66950irq/132-enp1s0-TxRx-33
251000991712,3cyclictest0-21swapper/33
25100099171,14cyclictest0-21swapper/33
25100099171,13cyclictest66950irq/132-enp1s0-TxRx-33
251000991711,3cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099171,13cyclictest0-21swapper/33
25100099170,1cyclictest0-21swapper/33
25100099170,14cyclictest0-21swapper/33
25100099170,14cyclictest0-21swapper/33
7136032161,5sleep2713614-21ssh2
6723272161,2sleep00-21swapper/00
6599062161,11sleep0660165-21grep0
6305212161,10sleep1630536-21ssh1
6204932160,3sleep10-21swapper/11
5937512161,3sleep0378815-21diskmemload0
5291842160,1sleep20-21swapper/22
5020532161,3sleep20-21swapper/22
4213972161,8sleep0421609-21diskstats0
25100099161,3cyclictest0-21swapper/33
25100099161,3cyclictest0-21swapper/33
25100099161,3cyclictest0-21swapper/33
251000991612,2cyclictest0-21swapper/33
251000991611,3cyclictest0-21swapper/33
251000991611,3cyclictest0-21swapper/33
25100099161,13cyclictest0-21swapper/33
25100099161,12cyclictest0-21swapper/33
7308722151,2sleep00-21swapper/00
6540652151,4sleep0654075-21ssh0
6444032151,3sleep0644413-21ssh0
6290832151,2sleep20-21swapper/22
5707792151,9sleep2570793-21ssh2
5623812151,4sleep2378815-21diskmemload2
5309052151,3sleep10-21swapper/11
3531522151,10sleep0353179-21cut0
25100099151,9cyclictest310961-21taskset3
25100099151,11cyclictest268748-21turbostat3
251000991510,3cyclictest0-21swapper/33
25100099150,3cyclictest0-21swapper/33
6880572141,9sleep1688067-21ssh1
6055352142,8sleep1605547-21apt-get1
6021982141,3sleep10-21swapper/11
5727252141,6sleep1572945-21hddtemp_smartct1
5710412141,8sleep0378815-21diskmemload0
5632832140,2sleep10-21swapper/11
5459542140,1sleep00-21swapper/00
5305572141,4sleep20-21swapper/22
5190512141,4sleep2519062-21ssh2
4694562141,2sleep20-21swapper/22
4099992141,9sleep0410012-21sh0
3254212141,9sleep0325479-21/usr/sbin/munin0
25100099149,3cyclictest0-21swapper/33
25100099148,3cyclictest3105592sleep33
251000991411,2cyclictest0-21swapper/33
251000991411,2cyclictest0-21swapper/33
25100099140,13cyclictest0-21swapper/33
25100099140,12cyclictest0-21swapper/33
25100099140,12cyclictest0-21swapper/33
25100099140,12cyclictest0-21swapper/33
25100099140,12cyclictest0-21swapper/33
7042362131,2sleep20-21swapper/22
6882942130,9sleep2378815-21diskmemload2
6354182132,6sleep2378815-21diskmemload2
5549232131,8sleep2554937-21ssh2
5222012131,7sleep1522218-21cpu1
4912812131,5sleep00-21swapper/00
4892182131,2sleep20-21swapper/22
4802792131,6sleep190-21kswapd01
4208312131,2sleep10-21swapper/11
7242012121,8sleep1724212-21sh1
6991742120,2sleep10-21swapper/11
6750822123,5sleep1675754-21grep1
6603432121,5sleep10-21swapper/11
6120232121,5sleep2378815-21diskmemload2
5863332121,7sleep1586344-21ssh1
5194052121,6sleep0378815-21diskmemload0
5036732121,2sleep1503685-21ssh1
4795442121,7sleep0479558-21ssh0
4767062122,4sleep2378815-21diskmemload2
4706942121,7sleep1470704-21ssh1
4474502121,7sleep0448986-21grep0
4360122121,7sleep2436023-21ssh2
4049422121,5sleep1405048-21ps1
3917172121,7sleep1391793-21ssh1
3858322121,7sleep2385843-21sh2
3738452121,5sleep0374104-21df_inode0
2681562121,6sleep2268341-21users2
25100099127,3cyclictest0-21swapper/33
25100099120,10cyclictest0-21swapper/33
7159132112,4sleep0151ktimers/00
7062442111,3sleep00-21swapper/00
6827922111,3sleep00-21swapper/00
6801592111,5sleep0378815-21diskmemload0
6452862111,3sleep10-21swapper/11
6359062111,3sleep00-21swapper/00
6278572111,5sleep0378815-21diskmemload0
6141482111,3sleep00-21swapper/00
5971952111,5sleep2378815-21diskmemload2
5947852111,6sleep2378815-21diskmemload2
5867272111,5sleep0378815-21diskmemload0
5053152111,5sleep0505335-21ssh0
4941632111,3sleep10-21swapper/11
4844292111,4sleep2484484-21ntp_states2
4764562111,5sleep1476655-21users1
4675852110,2sleep0467714-21ssh0
4625042112,4sleep0378815-21diskmemload0
4525112111,5sleep2378815-21diskmemload2
4266782111,5sleep2378815-21diskmemload2
4169832111,6sleep0417085-21head0
4101912111,4sleep2378815-21diskmemload2
4031962111,5sleep2403203-21ssh2
4008822110,2sleep10-21swapper/11
3881492113,5sleep0250994-21cyclictest0
3851402111,6sleep0385150-21ssh0
3732042110,1sleep10-21swapper/11
2875422111,5sleep1288602-21memory1
2742032111,4sleep0274222-21apt-get0
2690072111,3sleep20-21swapper/22
2631312111,3sleep172-21kcompactd01
7294692101,2sleep20-21swapper/22
7224102101,2sleep10-21swapper/11
7217492100,1sleep20-21swapper/22
7154292100,2sleep00-21swapper/00
7041252101,3sleep10-21swapper/11
6977412101,4sleep0378815-21diskmemload0
6963442100,2sleep20-21swapper/22
6806692101,4sleep2680681-21ssh2
6727182101,3sleep10-21swapper/11
6618832101,3sleep2378815-21diskmemload2
6138642101,3sleep20-21swapper/22
5786002100,3sleep00-21swapper/00
5775432101,2sleep20-21swapper/22
5692742101,4sleep1378815-21diskmemload1
5610432101,2sleep00-21swapper/00
5534212101,4sleep1378815-21diskmemload1
5465702100,3sleep20-21swapper/22
5369772101,4sleep0378815-21diskmemload0
5293512101,4sleep0529361-21ssh0
5202502101,4sleep1378815-21diskmemload1
5108312101,4sleep1510843-21ssh1
5027002100,1sleep00-21swapper/00
4550522101,5sleep2455048-21apt-get2
4465352101,3sleep1378815-21diskmemload1
4381982101,3sleep0378815-21diskmemload0
4292372101,5sleep1429251-21ssh1
4192902101,2sleep20-21swapper/22
4016842101,5sleep0401694-21ssh0
3903962101,2sleep20-21swapper/22
3870552101,2sleep10-21swapper/11
3583992103,3sleep2358609-21hddtemp_smartct2
3476322101,4sleep1347634-21apt-get1
3464722101,4sleep2346626-21sensors_temp2
3374442100,1sleep00-21swapper/00
3001552104,3sleep1300193-21dump-pmu-power1
2945952100,1sleep10-21swapper/11
2794412101,3sleep1279460-21apt-get1
2689892101,4sleep1269006-21apt1
713453291,3sleep1713463-21ssh1
670597291,4sleep2663695-40find2
653395290,2sleep10-21swapper/11
651934291,2sleep20-21swapper/22
587275291,2sleep20-21swapper/22
553368291,3sleep0378815-21diskmemload0
544122290,3sleep10-21swapper/11
460568290,1sleep10-21swapper/11
434731290,1sleep00-21swapper/00
337141290,1sleep10-21swapper/11
316724291,4sleep1317143-21cut1
315306290,1sleep10-21swapper/11
284720291,4sleep0284979-21sshd-auth0
273167290,2sleep0171rcu_preempt0
368593280,3sleep2368612-21apt-get2
363312280,3sleep2363331-21apt-get2
363312280,3sleep2363331-21apt-get2
363042281,3sleep0363100-21unin-run0
342381281,2sleep00-21swapper/00
337168281,3sleep2337330-21cstates2
332491280,4sleep2333920-21cut2
326675280,2sleep20-21swapper/22
321429280,3sleep1321667-21expr1
310940280,2sleep20-21swapper/22
310662280,1sleep20-21swapper/22
306568281,3sleep0308177-21cut0
290620281,3sleep2292208-21kthreadcore2
280018281,3sleep2281326-21kthreadcore2
278294281,3sleep2278442-21/usr/sbin/munin2
256167281,3sleep2256436-21munin-node2
255942280,2sleep00-21swapper/00
251209281,3sleep20-21swapper/22
251187280,2sleep10-21swapper/11
378596270,1sleep20-21swapper/22
378048271,3sleep1378248-21timerwakeupswit1
368222270,1sleep10-21swapper/11
368222270,1sleep10-21swapper/11
357688270,3sleep1357689-21sshd-session1
352878270,2sleep20-21swapper/22
352600271,3sleep2352621-21/usr/sbin/munin2
335684270,2sleep0335898-21strings0
326661270,1sleep00-21swapper/00
326081270,1sleep20-21swapper/22
320929270,1sleep00-21swapper/00
320787270,1sleep20-21swapper/22
315811270,1sleep00-21swapper/00
300443270,2sleep00-21swapper/00
283100271,2sleep0283430-21strings0
278843270,1sleep10-21swapper/11
365213261,2sleep00-21swapper/00
365213261,2sleep00-21swapper/00
352354260,1sleep00-21swapper/00
342955261,2sleep10-21swapper/11
331531260,1sleep10-21swapper/11
310354260,1sleep10-21swapper/11
305305260,1sleep10-21swapper/11
296109261,2sleep20-21swapper/22
294815260,4sleep00-21swapper/00
268494260,1sleep00-21swapper/00
263115260,1sleep00-21swapper/00
368380250,1sleep00-21swapper/00
303215250,1sleep20-21swapper/22
295499250,1sleep00-21swapper/00
284685250,1sleep20-21swapper/22
267956250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional