You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 09:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Fri Jan 02, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1653029912800,1276cyclictest4124372sleep33
1653029911640,1160cyclictest586406-21sleep3
165302993340,331cyclictest238503-21chrt3
4512222460,3sleep134-21ksoftirqd/11
165302992517,5cyclictest438393-21sleep3
16530299181,13cyclictest171664-21turbostat3
16530299177,6cyclictest263981-21turbostat3
165302991714,1cyclictest0-21swapper/33
165302991714,1cyclictest0-21swapper/33
5793962161,7sleep1579541-21grep1
16530299166,7cyclictest4200902sleep33
165302991613,1cyclictest0-21swapper/33
165302991611,2cyclictest431951-21sleep3
16530299161,11cyclictest438674-21taskset3
16530299161,11cyclictest199489-21turbostat3
3821072151,12sleep0382142-21kthreadcore0
165302991513,1cyclictest0-21swapper/33
165302991512,1cyclictest0-21swapper/33
165302991512,1cyclictest0-21swapper/33
16530299151,11cyclictest488867-21taskset3
16530299151,11cyclictest309963-21taskset3
16530299151,11cyclictest270418-21turbostat3
16530299151,11cyclictest179382-21taskset3
16530299151,10cyclictest477155-21taskset3
16530299151,10cyclictest361448-21taskset3
16530299147,4cyclictest592441-21taskset3
16530299141,9cyclictest2773392sleep33
165302991412,1cyclictest0-21swapper/33
165302991412,1cyclictest0-21swapper/33
165302991412,1cyclictest0-21swapper/33
165302991412,1cyclictest0-21swapper/33
165302991412,1cyclictest0-21swapper/33
165302991412,1cyclictest0-21swapper/33
165302991412,0cyclictest0-21swapper/33
16530299141,11cyclictest354959-21chrt3
165302991411,1cyclictest0-21swapper/33
165302991411,1cyclictest0-21swapper/33
165302991411,1cyclictest0-21swapper/33
165302991411,1cyclictest0-21swapper/33
16530299141,10cyclictest451526-21taskset3
16530299141,10cyclictest218950-21taskset3
16530299140,11cyclictest528333-21taskset3
4516852130,1sleep1451840-21grep1
2642232131,2sleep00-21swapper/00
16530299131,9cyclictest476907-21taskset3
16530299131,9cyclictest445111-21taskset3
16530299131,9cyclictest418546-21taskset3
16530299131,9cyclictest328472-21taskset3
16530299131,9cyclictest296550-21taskset3
16530299131,9cyclictest270907-21taskset3
16530299131,9cyclictest212246-21chrt3
165302991312,0cyclictest0-21swapper/33
165302991312,0cyclictest0-21swapper/33
165302991311,1cyclictest0-21swapper/33
165302991311,1cyclictest0-21swapper/33
16530299131,10cyclictest493076-21taskset3
165302991310,1cyclictest0-21swapper/33
165302991310,1cyclictest0-21swapper/33
165302991310,1cyclictest0-21swapper/33
16530299130,11cyclictest367614-21turbostat3
16530299130,10cyclictest541419-21taskset3
16530299130,10cyclictest303069-21chrt3
3226122127,3sleep2322613-21/usr/sbin/munin2
301798120,8rtkit-daemon171814-21munin-node2
301798120,7rtkit-daemon199852-21cat0
301798120,4rtkit-daemon667-21lldpd0
16530299123,7cyclictest579624-21taskset3
16530299121,9cyclictest521735-21taskset3
16530299121,9cyclictest302700-21taskset3
16530299121,9cyclictest222754-21taskset3
16530299121,8cyclictest288889-21taskset3
16530299120,9cyclictest553182-21chrt3
16530299120,9cyclictest533828-21taskset3
16530299120,9cyclictest399860-21taskset3
4986362110,8sleep1500721-21grep1
4578792112,5sleep1457912-21apt-get1
3355042111,7sleep0335647-21df0
3351912111,7sleep0335256-21/usr/sbin/munin0
301798110,4rtkit-daemon3205-21sendmail-mta0
301798110,3rtkit-daemon3205-21sendmail-mta2
16530299110,9cyclictest560814-21taskset3
16530299110,9cyclictest392363-21taskset3
1648462110,3sleep30-21swapper/33
4725022102,5sleep20-21swapper/22
3183362100,1sleep2320405-21kthreadcore2
301798100,5rtkit-daemon514605-21ntp_states2
301798100,5rtkit-daemon389401-21kthreadcore2
301798100,5rtkit-daemon335268-21ls2
301798100,3rtkit-daemon430-21avahi-daemon0
301798100,1rtkit-daemon0-21swapper/22
1985002101,2sleep20-21swapper/22
580733290,1sleep1581707-21uname1
342146291,4sleep0342178-21apt-get0
304161291,5sleep2305183-21grep2
301921291,4sleep2301977-21ntp_states2
30179890,6rtkit-daemon386427-21vmstat2
30179890,6rtkit-daemon317-21systemd-udevd2
30179890,5rtkit-daemon636-21snmpd2
30179890,5rtkit-daemon636-21snmpd2
30179890,5rtkit-daemon636-21snmpd2
30179890,5rtkit-daemon534553-21sshd2
30179890,5rtkit-daemon448-21wpa_supplicant0
30179890,5rtkit-daemon393967-21irqcore2
30179890,5rtkit-daemon317-21systemd-udevd2
30179890,4rtkit-daemon180495-21apt-get0
30179890,3rtkit-daemon492-21gmain2
30179890,3rtkit-daemon492-21gmain1
30179890,1rtkit-daemon0-21swapper/22
30179890,1rtkit-daemon0-21swapper/22
30179890,1rtkit-daemon0-21swapper/00
276190291,4sleep2276246-21ntp_states2
270936291,4sleep0270958-21apt-get0
188329290,3sleep0189430-21tr0
586636281,3sleep0586669-21apt-get0
561111280,1sleep10-21swapper/11
558097281,4sleep2559428-21memory2
522216281,4sleep1522362-21df1
515442281,4sleep0453-21rs:main0
496620280,5sleep0496624-21df_inode0
451027280,2sleep0297-21systemd-journal0
445474283,2sleep2445840-21irqcore2
444024280,2sleep1444131-21smartctl1
423113281,4sleep1424210-21memory1
393514280,5sleep0393594-21tr0
387061281,4sleep1387093-21apt1
383762281,4sleep1385683-21/usr/sbin/munin1
30179880,5rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon667-21lldpd2
30179880,4rtkit-daemon667-21lldpd1
30179880,4rtkit-daemon638-21ntpd1
30179880,4rtkit-daemon638-21ntpd1
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon492-21gmain2
30179880,4rtkit-daemon430-21avahi-daemon2
30179880,4rtkit-daemon3205-21sendmail-mta2
30179880,4rtkit-daemon3200908-21packagekitd2
30179880,4rtkit-daemon2904-21cron2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node2
30179880,4rtkit-daemon171814-21munin-node1
272378280,5sleep1273439-21cut1
206428281,3sleep0206461-21apt-get0
581709270,5sleep2583469-21kthreadcore2
555273271,4sleep00-21swapper/00
541142271,3sleep1541203-40mandb1
440097270,4sleep0441776-21kthreadcore0
437289270,5sleep1437444-21netstat1
432378270,4sleep0432575-21hddtemp_smartct0
411406270,4sleep00-21swapper/00
399902271,3sleep0400045-21df0
376095270,4sleep1378129-21kthreadcore1
364280271,3sleep0366447-21grep0
361442271,2sleep20-21swapper/22
356433270,4sleep1358070-21kthreadcore1
342181270,4sleep1342333-21df_inode1
322651270,3sleep0322806-21diskstats0
309219271,3sleep0309252-21munin-plugin-st0
30179870,3rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon636-21snmpd0
30179870,3rtkit-daemon492-21gmain0
30179870,3rtkit-daemon492-21gmain0
30179870,3rtkit-daemon430-21avahi-daemon2
30179870,3rtkit-daemon3205-21sendmail-mta2
30179870,3rtkit-daemon297-21systemd-journal0
30179870,3rtkit-daemon171814-21munin-node2
30179870,3rtkit-daemon126474-21munin-node0
30179870,3rtkit-daemon126474-21munin-node0
265620270,4sleep1266661-21cut1
251345270,3sleep0251378-21apt-get0
239969270,4sleep2241015-21grep2
224569271,4sleep2224614-21grep2
207178271,4sleep1208019-21grep1
165149270,3sleep20-21swapper/22
522618260,3sleep0523275-21sed0
469604260,4sleep1469643-21/usr/sbin/munin1
469527262,2sleep0151ktimers/00
425960260,4sleep0426144-21gltestperf0
421074260,3sleep0423112-21cut0
412717261,2sleep1412750-21apt-get1
401661260,3sleep1403710-21kthreadcore1
367858261,2sleep10-21swapper/11
330257261,2sleep10-21swapper/11
328772261,2sleep1321rcuc/11
311272261,2sleep10-21swapper/11
292192260,4sleep0294233-21grep0
244970260,3sleep1245124-21diskstats1
238261260,3sleep1238282-21munin-run1
238261260,3sleep1238282-21munin-run1
231827260,1sleep10-21swapper/11
218875260,1sleep10-21swapper/11
212844261,2sleep20-21swapper/22
206151260,3sleep1206153-21cron1
198746260,3sleep1198853-21threads1
171626260,1sleep20-21swapper/22
164568260,2sleep10-21swapper/11
591801250,3sleep2591908-21ntp_kernel_pll_2
580241251,2sleep00-21swapper/00
579884250,1sleep00-21swapper/00
553711250,1sleep20-21swapper/22
546676250,3sleep00-21swapper/00
540832250,1sleep00-21swapper/00
530760250,3sleep0221rcuc/00
517178251,2sleep10-21swapper/11
515297250,1sleep10-21swapper/11
508733250,1sleep00-21swapper/00
483749250,2sleep00-21swapper/00
478723251,1sleep00-21swapper/00
470706251,1sleep00-21swapper/00
457878250,1sleep00-21swapper/00
430823250,3sleep1431005-21grep1
394932251,2sleep10-21swapper/11
393164250,1sleep00-21swapper/00
375241250,2sleep00-21swapper/00
354499250,1sleep00-21swapper/00
341368251,2sleep1667-21lldpd1
322016251,2sleep0151ktimers/00
303529251,2sleep10-21swapper/11
302464250,1sleep10-21swapper/11
290547250,2sleep10-21swapper/11
289373250,2sleep00-21swapper/00
283271250,1sleep00-21swapper/00
278808251,2sleep10-21swapper/11
260671250,2sleep00-21swapper/00
244588250,1sleep10-21swapper/11
238116250,1sleep20-21swapper/22
238116250,1sleep20-21swapper/22
208020250,2sleep20-21swapper/22
205806250,1sleep20-21swapper/22
192679250,1sleep20-21swapper/22
181955250,3sleep1183868-21grep1
179885250,1sleep20-21swapper/22
165457250,1sleep10-21swapper/11
575263240,2sleep20-21swapper/22
573126240,3sleep20-21swapper/22
567195240,2sleep00-21swapper/00
565951240,2sleep2566017-21awk2
547846240,1sleep00-21swapper/00
521612240,3sleep00-21swapper/00
496014240,3sleep00-21swapper/00
476189240,2sleep10-21swapper/11
452949241,1sleep00-21swapper/00
367425240,1sleep10-21swapper/11
353999240,1sleep10-21swapper/11
317626240,2sleep1318335-21cut1
310558240,2sleep0221rcuc/00
296658240,1sleep00-21swapper/00
256465240,2sleep1256599-21netstat1
251003240,2sleep20-21swapper/22
219860240,2sleep10-21swapper/11
189431240,2sleep10-21swapper/11
174792240,2sleep10-21swapper/11
560705230,1sleep00-21swapper/00
528591230,1sleep10-21swapper/11
503050230,1sleep10-21swapper/11
490030230,1sleep10-21swapper/11
483554230,1sleep10-21swapper/11
418038230,1sleep00-21swapper/00
407738230,1sleep10-21swapper/11
360610230,1sleep00-21swapper/00
285267230,1sleep10-21swapper/11
262819230,1sleep10-21swapper/11
231723230,1sleep20-21swapper/22
180657230,1sleep20-21swapper/22
477108220,1sleep10-21swapper/11
367836220,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional