You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 00:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon Apr 20, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243024212552,68sleep30-21swapper/33
24304828856,12sleep20-21swapper/22
24314928555,11sleep10-21swapper/11
24291228363,14sleep00-21swapper/00
2905012290,2sleep30-21swapper/33
24333599221,14cyclictest0-21swapper/33
24333599198,8cyclictest597206-21turbostat3
24333599191,14cyclictest435141-21taskset3
24333599191,14cyclictest0-21swapper/33
4464242182,5sleep2446443-21apt-get2
24333599181,5cyclictest597132-21taskset3
24333599181,14cyclictest282390-21chrt3
24333599181,14cyclictest0-21swapper/33
24333599181,14cyclictest0-21swapper/33
24333599181,13cyclictest0-21swapper/33
24333599181,13cyclictest0-21swapper/33
24333599181,13cyclictest0-21swapper/33
4843412171,12sleep0484359-21idleruntime-cro0
3991102171,12sleep0400843-21grep0
3959552171,3sleep20-21swapper/22
243335991713,3cyclictest0-21swapper/33
243335991712,4cyclictest0-21swapper/33
243335991712,3cyclictest0-21swapper/33
24333599171,14cyclictest0-21swapper/33
24333599171,13cyclictest0-21swapper/33
24333599171,13cyclictest0-21swapper/33
24333599171,12cyclictest0-21swapper/33
24333599171,11cyclictest0-21swapper/33
24333599170,14cyclictest0-21swapper/33
24333599170,14cyclictest0-21swapper/33
24333599170,13cyclictest0-21swapper/33
24333599170,13cyclictest0-21swapper/33
4300292161,12sleep1430040-21turbostat1
24333599165,8cyclictest440819-21turbostat3
24333599162,12cyclictest0-21swapper/33
243335991613,1cyclictest0-21swapper/33
24333599160,14cyclictest0-21swapper/33
24333599160,13cyclictest0-21swapper/33
24333599160,13cyclictest0-21swapper/33
24333599160,13cyclictest0-21swapper/33
24333599160,13cyclictest0-21swapper/33
24333599160,13cyclictest0-21swapper/33
24333599160,12cyclictest0-21swapper/33
24333599160,12cyclictest0-21swapper/33
5372922152,9sleep0537537-21/usr/sbin/munin0
3514592157,4sleep2351579-21grep2
24333599151,3cyclictest0-21swapper/33
24333599151,2cyclictest0-21swapper/33
243335991511,3cyclictest0-21swapper/33
243335991511,2cyclictest0-21swapper/33
24333599151,12cyclictest0-21swapper/33
24333599151,11cyclictest309350-21chrt3
243335991510,3cyclictest0-21swapper/33
24333599150,9cyclictest4571442sleep33
24333599150,3cyclictest0-21swapper/33
24333599150,13cyclictest0-21swapper/33
24333599150,13cyclictest0-21swapper/33
24333599150,13cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,12cyclictest0-21swapper/33
24333599150,11cyclictest0-21swapper/33
4290842141,8sleep0429141-21ntpq0
3816152141,8sleep1373610-21diskmemload1
2771732141,9sleep1277104-31find1
24333599142,8cyclictest515513-21taskset3
24333599141,2cyclictest0-21swapper/33
24333599140,12cyclictest0-21swapper/33
24333599140,12cyclictest0-21swapper/33
24333599140,12cyclictest0-21swapper/33
24333599140,12cyclictest0-21swapper/33
24333599140,12cyclictest0-21swapper/33
24333599140,11cyclictest0-21swapper/33
24333599140,11cyclictest0-21swapper/33
24333599140,11cyclictest0-21swapper/33
5226552131,8sleep0522744-21irqstats0
3102242131,2sleep20-21swapper/22
2771232131,8sleep0277128-21tracker-miner-f0
243335991311,1cyclictest0-21swapper/33
5421132121,7sleep0542226-21ntpq0
5218892121,5sleep1521960-21munin-run1
4289402121,5sleep2429028-21ntpq2
3898182121,7sleep00-21swapper/00
3707222121,3sleep1372403-21latency1
3573232120,1sleep00-21swapper/00
6002052111,5sleep1601360-21memory1
5909232111,5sleep1590976-21ntp_states1
5208702111,5sleep2520916-21ntpq2
5061872111,5sleep1506334-21diskstats1
4571672116,2sleep00-21swapper/00
4559042111,5sleep2455961-21ntpq2
4343782111,5sleep1434429-21ntpq1
3976572112,4sleep0368278-21kworker/0:0+events0
3956092111,5sleep1395669-21ntpq1
3905432111,4sleep1373610-21diskmemload1
3748832111,2sleep0376456-21cut0
3673152111,5sleep2367364-21ntpq2
3189972111,5sleep2319046-21ntpq2
3031182111,5sleep2303171-21ntp_states2
2603082110,1sleep00-21swapper/00
5908712101,4sleep0590921-21ntpq0
5422842101,5sleep2542335-21ntpq2
5422322101,4sleep1542282-21ntpq1
5239902101,5sleep2525792-21tr2
5011692100,1sleep10-21swapper/11
4927152101,4sleep0493880-21memory0
4765092101,4sleep1477791-21sshd1
4731362100,1sleep20-21swapper/22
4558562101,4sleep1455897-21ntpq1
4452192101,4sleep2445275-21ntp_states2
4405622100,4sleep20-21swapper/22
4200202101,5sleep0420345-21grep0
4008442101,4sleep1401901-21memory1
3823322101,3sleep2373610-21diskmemload2
3576592101,5sleep1357664-21cron1
2990362101,4sleep1299291-21df1
2883362101,4sleep1288355-21apt-get1
2864692101,5sleep1287026-21cut1
2549172101,4sleep0254966-21ntpq0
607163291,4sleep1607407-21sed1
598498291,4sleep0600204-21grep0
586244291,4sleep1586314-21gpgv1
579845291,4sleep2579902-21ntpq2
579845291,4sleep2579902-21ntpq2
570207291,2sleep20-21swapper/22
570207291,2sleep20-21swapper/22
569946291,4sleep0570085-21sort0
554206291,2sleep20-21swapper/22
551487291,4sleep1552784-21memory1
537604291,4sleep2537607-21sshd2
532850291,4sleep1532869-21apt-get1
515557291,4sleep0515606-21ntpq0
501241291,4sleep2502548-21cut2
490499291,4sleep2491000-21kthreadcore2
484331291,2sleep20-21swapper/22
462672291,4sleep1462492-21/usr/sbin/munin1
457433291,4sleep2457644-21hddtemp_smartct2
442338291,4sleep1444065-21grep1
440128291,4sleep1440326-21grep1
434861291,4sleep0435045-21users0
434431291,4sleep2434477-21ntpq2
419761290,1sleep20-21swapper/22
418266291,4sleep1418328-21ntpq1
408480291,4sleep2408584-21cut2
408182290,1sleep10-21swapper/11
379423291,3sleep2373610-21diskmemload2
358487291,4sleep1359447-21tr1
347898291,4sleep0349553-21cut0
342460291,4sleep0342531-21irqstats0
336610291,3sleep2336629-21apt-get2
336346291,4sleep2336438-21wc2
335458291,5sleep0335550-21processes0
310151291,4sleep1310223-21irqstats1
309943291,4sleep0310149-21gltestperf0
308701291,4sleep1308725-21sed1
293686291,4sleep2293941-21df2
273657290,2sleep20-21swapper/22
254968291,4sleep1255013-21ntpq1
601361280,3sleep2601501-21ntp_192.168.1142
592705281,3sleep0594162-21cut0
581154280,2sleep20-21swapper/22
579666280,3sleep1579839-21strings1
579666280,3sleep1579839-21strings1
570482281,3sleep0570517-21fschecks_count0
570482281,3sleep0570517-21fschecks_count0
566801281,3sleep2568638-21cut2
563731280,1sleep10-21swapper/11
559533280,2sleep20-21swapper/22
549790281,3sleep00-21swapper/00
500045280,2sleep10-21swapper/11
490278280,1sleep10-21swapper/11
485110281,3sleep2485256-21cat2
469095281,4sleep10-21swapper/11
468698281,3sleep0469092-21kthreadcore0
413749280,1sleep10-21swapper/11
412790281,3sleep2412848-21modprobe2
369183281,3sleep00-21swapper/00
367270280,1sleep10-21swapper/11
362842280,1sleep00-21swapper/00
357910280,1sleep20-21swapper/22
352025280,1sleep10-21swapper/11
343756281,3sleep2345569-21kthreadcore2
330991280,2sleep00-21swapper/00
324355280,5sleep00-21swapper/00
320002280,1sleep10-21swapper/11
319844280,1sleep10-21swapper/11
309222280,1sleep20-21swapper/22
308387282,3sleep0243330-21cyclictest0
293664281,2sleep10-21swapper/11
293321280,1sleep20-21swapper/22
284673281,3sleep0286468-21kthreadcore0
277673280,2sleep10-21swapper/11
266873280,3sleep2266892-21apt-get2
264611281,4sleep1265474-21cat1
261281280,1sleep00-21swapper/00
260962280,1sleep10-21swapper/11
243504280,3sleep1243523-21apt-get1
602770271,2sleep2602771-21sshd2
597008270,1sleep10-21swapper/11
595963270,2sleep2596136-21strings2
591852270,1sleep20-21swapper/22
586084270,1sleep00-21swapper/00
575044270,1sleep10-21swapper/11
575044270,1sleep10-21swapper/11
562714271,2sleep0563438-21memory0
559182270,1sleep10-21swapper/11
544638271,2sleep20-21swapper/22
544078271,2sleep10-21swapper/11
532468270,1sleep10-21swapper/11
530129270,3sleep0531425-21memory0
527542271,1sleep2527561-21apt-get2
522745271,3sleep10-21swapper/11
521820270,1sleep00-21swapper/00
516428270,1sleep10-21swapper/11
516175270,1sleep20-21swapper/22
506068271,3sleep0506130-21cpuspeed_turbos0
500087270,1sleep00-21swapper/00
499435270,3sleep20-21swapper/22
484026270,1sleep10-21swapper/11
478792270,1sleep00-21swapper/00
462490270,1sleep20-21swapper/22
462115270,1sleep10-21swapper/11
441070270,1sleep00-21swapper/00
440598270,1sleep00-21swapper/00
420346271,3sleep10-21swapper/11
414694271,2sleep00-21swapper/00
402900270,1sleep20-21swapper/22
356503271,2sleep20-21swapper/22
346696270,1sleep10-21swapper/11
341510270,1sleep10-21swapper/11
336199270,1sleep10-21swapper/11
325889270,2sleep2325908-21apt-get2
325145270,1sleep20-21swapper/22
299014270,2sleep00-21swapper/00
282602270,1sleep00-21swapper/00
271031271,3sleep1271154-21sendmail_mailqu1
255640270,2sleep2171rcu_preempt2
248357270,1sleep20-21swapper/22
248320270,1sleep00-21swapper/00
554482260,3sleep00-21swapper/00
553773260,1sleep20-21swapper/22
548124260,3sleep00-21swapper/00
505765260,1sleep00-21swapper/00
478083261,1sleep20-21swapper/22
467321260,1sleep00-21swapper/00
456589260,4sleep00-21swapper/00
446423260,4sleep10-21swapper/11
414106260,1sleep20-21swapper/22
413609260,4sleep00-21swapper/00
363539261,2sleep00-21swapper/00
336888261,2sleep00-21swapper/00
319716260,1sleep00-21swapper/00
298381260,1sleep00-21swapper/00
271604260,4sleep00-21swapper/00
607693250,3sleep00-21swapper/00
575422250,1sleep00-21swapper/00
575422250,1sleep00-21swapper/00
569678250,3sleep10-21swapper/11
506335250,1sleep20-21swapper/22
488797250,1sleep10-21swapper/11
488741250,1sleep00-21swapper/00
451273250,3sleep00-21swapper/00
407506250,1sleep00-21swapper/00
368872250,1sleep20-21swapper/22
325745250,1sleep10-21swapper/11
292784251,1sleep00-21swapper/00
283460250,1sleep20-21swapper/22
278635250,2sleep20-21swapper/22
266600250,1sleep20-21swapper/22
256540240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional