You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 12:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Jul 18, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275179021420,2sleep10-21swapper/11
2427304213564,66sleep30-21swapper/33
242721228564,12sleep10-21swapper/11
242719728354,10sleep20-21swapper/22
242713627851,6sleep00-21swapper/00
28675002290,2sleep20-21swapper/22
242762999211,16cyclictest0-21swapper/33
289578022011,5sleep02895794-21ssh0
2427629992018,1cyclictest0-21swapper/33
2427629992017,1cyclictest0-21swapper/33
2427629992017,1cyclictest0-21swapper/33
2427629992017,1cyclictest0-21swapper/33
2427629992012,4cyclictest0-21swapper/33
242762999201,16cyclictest0-21swapper/33
242762999201,16cyclictest0-21swapper/33
242762999201,15cyclictest2795840-21chrt3
242762999201,15cyclictest0-21swapper/33
242762999201,15cyclictest0-21swapper/33
27979522192,4sleep02555428-21diskmemload0
26315852191,4sleep02555428-21diskmemload0
25875532190,2sleep00-21swapper/00
242762999196,10cyclictest2677365-21turbostat3
2427629991916,1cyclictest0-21swapper/33
2427629991916,1cyclictest0-21swapper/33
2427629991911,5cyclictest0-21swapper/33
242762999191,15cyclictest0-21swapper/33
242762999191,15cyclictest0-21swapper/33
242762999191,15cyclictest0-21swapper/33
242762999191,15cyclictest0-21swapper/33
242762999191,14cyclictest0-21swapper/33
242762999191,14cyclictest0-21swapper/33
242762999191,14cyclictest0-21swapper/33
242762999191,14cyclictest0-21swapper/33
242762999191,13cyclictest0-21swapper/33
27712462180,9sleep02771260-21ssh0
26667082181,4sleep02555428-21diskmemload0
26667082181,4sleep02555428-21diskmemload0
2427629991815,1cyclictest0-21swapper/33
2427629991813,3cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,14cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
242762999181,13cyclictest0-21swapper/33
2427629991810,5cyclictest0-21swapper/33
242762999180,14cyclictest0-21swapper/33
242762999180,14cyclictest0-21swapper/33
29046402171,7sleep22904653-21ssh2
28620612171,11sleep22555428-21diskmemload2
27628482171,12sleep02555428-21diskmemload0
26239492171,3sleep20-21swapper/22
26148762171,2sleep20-21swapper/22
242762999179,5cyclictest0-21swapper/33
242762999171,14cyclictest0-21swapper/33
242762999171,13cyclictest0-21swapper/33
242762999171,13cyclictest0-21swapper/33
242762999171,13cyclictest0-21swapper/33
242762999171,13cyclictest0-21swapper/33
242762999170,14cyclictest0-21swapper/33
27104402161,2sleep20-21swapper/22
25958862161,3sleep20-21swapper/22
25803822161,4sleep02580392-21ssh0
242762999164,8cyclictest0-21swapper/33
2427629991612,2cyclictest0-21swapper/33
242762999161,12cyclictest0-21swapper/33
242762999161,12cyclictest0-21swapper/33
242762999160,13cyclictest0-21swapper/33
242762999160,13cyclictest0-21swapper/33
28777312151,2sleep20-21swapper/22
28686482151,2sleep00-21swapper/00
28481662153,2sleep0171rcu_preempt0
27416712151,7sleep02742741-21memory0
26951732151,3sleep12695186-21apt-get1
26741312151,4sleep02674145-21ssh0
26423392151,2sleep20-21swapper/22
25891632151,2sleep10-21swapper/11
25797352151,4sleep12555428-21diskmemload1
25627722151,2sleep00-21swapper/00
242762999151,11cyclictest2440122-21sleep3
242762999150,13cyclictest0-21swapper/33
242762999150,12cyclictest0-21swapper/33
29202982141,8sleep02555428-21diskmemload0
28403392141,7sleep10-21swapper/11
28085772141,9sleep12808788-21head1
28064842141,3sleep02806496-21ssh0
27997742140,2sleep1321rcuc/11
27725012141,3sleep22555428-21diskmemload2
27125832141,4sleep12712597-21ssh1
26947692141,9sleep22694830-21ssh2
26829152141,9sleep22555428-21diskmemload2
25705112141,8sleep02555428-21diskmemload0
24560832141,7sleep02456095-21apt-get0
242762999141,8cyclictest2529506-21taskset3
242762999140,12cyclictest0-21swapper/33
28854382131,8sleep02555428-21diskmemload0
28220272131,4sleep22822030-21ssh2
27874372131,1sleep20-21swapper/22
27873152131,3sleep02787326-21ssh0
27810932131,4sleep12781108-21ssh1
27740942131,7sleep22774996-21cut2
27551412130,3sleep20-21swapper/22
27474052131,4sleep02622483-21kworker/u16:2+ext4-rsv-conversion0
27468862131,8sleep12746897-21ssh1
27106782130,4sleep02555428-21diskmemload0
26856832131,8sleep12685694-21ssh1
26516152131,2sleep22651619-21apt-get2
26150542131,3sleep02615065-21ssh0
25654382131,3sleep12555428-21diskmemload1
25615552131,7sleep12555428-21diskmemload1
24928082131,6sleep12493061-21df1
24878362131,8sleep02487900-21tune2fs0
242762999130,11cyclictest0-21swapper/33
29210442121,6sleep22555428-21diskmemload2
29025622121,2sleep12902576-21ssh1
28538102121,7sleep12851547-40find1
28227212121,3sleep02822732-21ssh0
28221132120,6sleep10-21swapper/11
27611692120,2sleep22555428-21diskmemload2
27435622121,7sleep22743569-21ssh2
27268082121,8sleep10-21swapper/11
27096002121,6sleep12709611-21ssh1
26400052121,6sleep12640015-21ssh1
26213742121,7sleep02621561-21ssh0
26152202121,7sleep12615231-21ssh1
25907362122,5sleep02590755-21apt-get0
29120502111,5sleep12555428-21diskmemload1
29061472112,4sleep02555428-21diskmemload0
28889102111,5sleep12889124-21diskstats1
28790652110,6sleep12555428-21diskmemload1
28702742111,6sleep12555428-21diskmemload1
28502372111,5sleep12555428-21diskmemload1
28424962110,1sleep20-21swapper/22
28415102112,4sleep02555428-21diskmemload0
28257392111,5sleep02555428-21diskmemload0
27987832110,1sleep10-21swapper/11
27792342111,3sleep00-21swapper/00
27362402111,5sleep22555428-21diskmemload2
27348832111,6sleep02734902-21ssh0
27299432110,7sleep12729957-21ssh1
27273112111,5sleep02555428-21diskmemload0
27186882111,5sleep22555428-21diskmemload2
26930542111,3sleep00-21swapper/00
26837672111,4sleep02555428-21diskmemload0
26742682114,1sleep20-21swapper/22
26491342111,4sleep22555428-21diskmemload2
26434592111,5sleep12643589-21irqstats1
26055202110,2sleep22605533-21ssh2
25964352111,4sleep12555428-21diskmemload1
25724952114,3sleep22572506-21ssh2
25638202111,5sleep22555428-21diskmemload2
25505852111,5sleep12550732-21diskstats1
24980202111,5sleep22498273-21df2
24717992111,5sleep12471818-21apt-get1
24715282111,5sleep22471584-21munin-run2
24500002111,5sleep12450184-21users1
29214922104,2sleep12921507-21ssh1
29116432101,4sleep22555428-21diskmemload2
29049702101,4sleep02555428-21diskmemload0
28887322101,4sleep22888457-21sendmail-msp2
28873722101,2sleep20-21swapper/22
28734062101,5sleep02875091-21kthreadcore0
28599242101,2sleep00-21swapper/00
28326512100,5sleep22555428-21diskmemload2
28256172101,3sleep10-21swapper/11
28082302101,4sleep02555428-21diskmemload0
28048152102,3sleep22555428-21diskmemload2
27969012101,3sleep22555428-21diskmemload2
27894892101,3sleep10-21swapper/11
27710072101,4sleep12555428-21diskmemload1
27277592101,4sleep22555428-21diskmemload2
27206642101,2sleep00-21swapper/00
27018372101,2sleep20-21swapper/22
26916272101,3sleep10-21swapper/11
26759452101,2sleep10-21swapper/11
26673332101,2sleep10-21swapper/11
26673332101,2sleep10-21swapper/11
26589622100,1sleep00-21swapper/00
26584122102,5sleep12555428-21diskmemload1
26506002101,3sleep00-21swapper/00
26331312101,4sleep12555428-21diskmemload1
26307812101,4sleep22555428-21diskmemload2
26071922101,3sleep00-21swapper/00
26052542100,2sleep10-21swapper/11
25885132101,4sleep22555428-21diskmemload2
25404852101,5sleep12540840-21cut1
25245482101,4sleep22524758-21hddtemp_smartct2
25134892101,5sleep22513623-21latency_hist2
24985322101,5sleep12498933-21grep1
24820282101,4sleep02482107-21munin-run0
24820282101,4sleep02482107-21munin-run0
24451882103,2sleep1171rcu_preempt1
24391852101,5sleep02439298-21awk0
24354152100,1sleep20-21swapper/22
2884884290,1sleep10-21swapper/11
2848857291,4sleep22555428-21diskmemload2
2763580291,3sleep12763594-21ssh1
2701715290,1sleep00-21swapper/00
2640203291,2sleep00-21swapper/00
2622450291,2sleep10-21swapper/11
2573312291,4sleep239542-21systemd-journal2
2549504291,4sleep22549743-21grep2
2540842291,4sleep22542468-21cut2
2514785291,4sleep12516419-21cut1
2514040291,4sleep22513761-21/usr/sbin/munin2
2512762291,4sleep12512986-21sed1
2503287290,3sleep22502979-21apt-get2
2482837291,4sleep22483130-21cut2
2482837291,4sleep22483130-21cut2
2481763290,2sleep10-21swapper/11
2481763290,2sleep10-21swapper/11
2477073291,3sleep22477075-21apt-get2
2477073291,3sleep22477075-21apt-get2
2476708290,1sleep00-21swapper/00
2470750291,3sleep12470896-21find1
2465208291,4sleep22461332-21/usr/sbin/munin2
2454720291,4sleep12454853-21netstat1
2450863291,2sleep20-21swapper/22
2816239281,3sleep22816253-21ssh2
2660264281,3sleep22555428-21diskmemload2
2660264281,3sleep22555428-21diskmemload2
2549903280,1sleep00-21swapper/00
2539572280,1sleep00-21swapper/00
2534735281,2sleep22534737-21apt-get2
2528307281,3sleep02524255-21/usr/sbin/munin0
2520623281,3sleep22522346-21kthreadcore2
2518997280,2sleep00-21swapper/00
2513778280,3sleep02513781-21apt-get0
2492793281,2sleep00-21swapper/00
2491887280,1sleep10-21swapper/11
2487572280,2sleep20-21swapper/22
2482108281,3sleep12482094-21sendmail-msp1
2482108281,3sleep12482094-21sendmail-msp1
2472372281,3sleep22473659-21grep2
2466589281,3sleep02466839-21cstates0
2461355281,3sleep02461511-21cstates0
2451125281,3sleep02451164-21tune2fs0
2446174281,3sleep22447176-21kthreadcore2
2555364270,1sleep00-21swapper/00
2555327270,1sleep20-21swapper/22
2547214271,3sleep12547307-21kthreadcore1
2544757270,1sleep00-21swapper/00
2534077270,1sleep10-21swapper/11
2531031271,2sleep02532738-21kthreadcore0
2529484270,2sleep20-21swapper/22
2524116272,1sleep10-21swapper/11
2509972271,2sleep00-21swapper/00
2503280271,2sleep10-21swapper/11
2503279270,4sleep00-21swapper/00
2497534270,1sleep20-21swapper/22
2466028270,1sleep10-21swapper/11
2445162270,1sleep00-21swapper/00
2445065270,1sleep20-21swapper/22
2432816270,1sleep20-21swapper/22
2432512270,1sleep10-21swapper/11
2519567261,2sleep10-21swapper/11
2502965260,2sleep00-21swapper/00
2487129260,1sleep00-21swapper/00
2487129260,1sleep00-21swapper/00
2460691260,1sleep10-21swapper/11
2440081261,2sleep1555-21dbus-daemon1
2431652260,2sleep02431859-21strings0
2538558250,1sleep10-21swapper/11
2460681250,3sleep20-21swapper/22
2445393240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional