You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 11:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Wed Dec 10, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13509319911610,1158cyclictest18041482sleep33
13509319911151,1109cyclictest1441279-21sleep3
13509319910981,1093cyclictest1409842-21sleep3
13509319910971,1091cyclictest1747091-21sleep3
13509319910721,1067cyclictest1504135-21sleep3
1350931999471,942cyclictest1378194-21sleep3
1350931994973,490cyclictest1472728-21turbostat3
17797582990,94sleep11714125-21kworker/u16:4+efi_rts_wq1
1350931992725,1cyclictest0-21swapper/33
1350931992421,1cyclictest0-21swapper/33
18301062211,8sleep01832077-21tr0
18301062211,8sleep01832077-21tr0
1350931991917,1cyclictest0-21swapper/33
1350931991916,1cyclictest0-21swapper/33
1350931991816,1cyclictest0-21swapper/33
1350931991816,1cyclictest0-21swapper/33
1350931991816,1cyclictest0-21swapper/33
1350931991816,1cyclictest0-21swapper/33
1350931991816,1cyclictest0-21swapper/33
1350931991815,1cyclictest0-21swapper/33
1350931991815,1cyclictest0-21swapper/33
1350931991715,1cyclictest0-21swapper/33
1350931991715,1cyclictest0-21swapper/33
1350931991715,1cyclictest0-21swapper/33
1350931991715,1cyclictest0-21swapper/33
1350931991715,0cyclictest0-21swapper/33
1350931991714,1cyclictest0-21swapper/33
1350931991714,1cyclictest0-21swapper/33
1350931991714,1cyclictest0-21swapper/33
1350931991711,3cyclictest1422417-21sleep3
1350931991615,0cyclictest0-21swapper/33
1350931991614,1cyclictest0-21swapper/33
1350931991614,1cyclictest0-21swapper/33
1350931991614,1cyclictest0-21swapper/33
1350931991614,1cyclictest0-21swapper/33
1350931991614,1cyclictest0-21swapper/33
1350931991613,1cyclictest0-21swapper/33
1350931991613,1cyclictest0-21swapper/33
1350931991613,1cyclictest0-21swapper/33
1350931991613,1cyclictest0-21swapper/33
1350931991613,1cyclictest0-21swapper/33
16029582150,4sleep01604071-21grep0
16011882150,7sleep01601196-21ssh0
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,1cyclictest0-21swapper/33
1350931991513,0cyclictest0-21swapper/33
1350931991512,1cyclictest0-21swapper/33
1350931991512,1cyclictest0-21swapper/33
1350931991512,1cyclictest0-21swapper/33
1350931991512,1cyclictest0-21swapper/33
1350931991512,1cyclictest0-21swapper/33
1350931991413,0cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991412,1cyclictest0-21swapper/33
1350931991411,1cyclictest0-21swapper/33
1350931991411,1cyclictest0-21swapper/33
1350931991411,1cyclictest0-21swapper/33
135093199141,10cyclictest1704665-21taskset3
135093199141,10cyclictest1610052-21taskset3
135093199139,1cyclictest0-21swapper/33
135093199131,9cyclictest1477340-21taskset3
1350931991311,1cyclictest0-21swapper/33
1350931991311,1cyclictest0-21swapper/33
1350931991310,1cyclictest0-21swapper/33
1350931991310,1cyclictest0-21swapper/33
190898120,8rtkit-daemon423-21dbus-daemon2
190898120,6rtkit-daemon1736439-21ntp_states2
190898120,6rtkit-daemon1535522-21ssh0
190898120,5rtkit-daemon1705919-21ssh1
1350931991210,1cyclictest0-21swapper/33
190898110,7rtkit-daemon1681341-21chrt1
190898110,5rtkit-daemon1422842-21diskstats2
190898110,4rtkit-daemon1357306-21munin-node2
16572552110,8sleep01657263-21ssh0
16395862110,3sleep11639696-21ssh1
190898100,6rtkit-daemon1689726-21ssh1
190898100,5rtkit-daemon1569346-21ssh0
190898100,5rtkit-daemon1345054-21diskstats2
190898100,3rtkit-daemon1827488-21ssh0
17939452101,7sleep21793952-21sh2
17797162101,6sleep00-21swapper/00
17786842100,7sleep01778691-21sh0
17149902100,7sleep01715032-21apt-get0
16973492101,7sleep01697356-21sh0
15991282101,5sleep21599186-21ntp_states2
15776352101,5sleep21577839-21hddtemp_smartct2
15354692100,2sleep21535477-21ssh2
14978492100,3sleep01497892-21munin-run0
14690252100,7sleep21471154-21cut2
14289572101,6sleep00-21swapper/00
13976922103,4sleep11398574-21irqrtprio1
13655422100,1sleep10-21swapper/11
13501142101,6sleep11350371-21grep1
19089890,5rtkit-daemon299-21systemd-journal2
19089890,5rtkit-daemon1672387-21ssh0
19089890,5rtkit-daemon1391987-21irqrtprio2
19089890,4rtkit-daemon1844319-21ssh0
19089890,4rtkit-daemon1844319-21ssh0
19089890,4rtkit-daemon1674486-21ssh0
19089890,4rtkit-daemon1609247-21ssh2
19089890,4rtkit-daemon1528220-21ssh0
19089890,4rtkit-daemon1491869-21grep2
1828802290,6sleep21829225-21sed2
1828802290,6sleep21829225-21sed2
1803070290,1sleep00-21swapper/00
1778976290,2sleep21778984-21ssh2
1768538291,5sleep11768685-21/usr/sbin/munin1
1697794290,1sleep11697800-21ssh1
1640543292,1sleep0171rcu_preempt0
1634640291,5sleep21635032-21cut2
1545772290,6sleep01546670-21cut0
19089880,5rtkit-daemon1928-21sendmail-mta2
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,4rtkit-daemon671-21ntpd2
19089880,4rtkit-daemon671-21ntpd2
19089880,4rtkit-daemon667-21snmpd2
19089880,4rtkit-daemon667-21snmpd2
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon438-21wpa_supplicant2
19089880,4rtkit-daemon438-21wpa_supplicant2
19089880,4rtkit-daemon432-21rsyslogd2
19089880,4rtkit-daemon421-21avahi-daemon0
19089880,4rtkit-daemon1928-21sendmail-mta1
19089880,4rtkit-daemon1616147-21ssh2
19089880,4rtkit-daemon1586539-21ps2
19089880,4rtkit-daemon1543630-21ssh0
19089880,4rtkit-daemon1386007-21cut2
19089880,4rtkit-daemon1357306-21munin-node2
19089880,4rtkit-daemon1357306-21munin-node2
19089880,4rtkit-daemon1357306-21munin-node1
1836809281,4sleep21836850-21ssh2
1836809281,4sleep21836850-21ssh2
1828595280,4sleep11828801-21hddtemp_smartct1
1828595280,4sleep11828801-21hddtemp_smartct1
1820388281,3sleep11820423-21apt-get1
1623351280,6sleep01623484-21/usr/sbin/munin0
1623351280,6sleep01623484-21/usr/sbin/munin0
1618042280,5sleep21504119-21diskmemload2
1618042280,5sleep21504119-21diskmemload2
1585747281,4sleep11585946-21hddtemp_smartct1
1583988280,1sleep00-21swapper/00
1579058282,4sleep11581003-21cut1
1568357281,5sleep21504119-21diskmemload2
1560571281,5sleep1331ktimers/11
1553080281,3sleep01553117-21apt-get0
1551696280,2sleep21551704-21ssh2
1506531281,5sleep20-21swapper/22
1504008281,4sleep072-21kcompactd00
1467882280,5sleep11469024-21tr1
1460122280,5sleep11460129-21latency_hist1
1365199281,4sleep21365200-21sshd2
19089870,4rtkit-daemon671-21ntpd2
19089870,4rtkit-daemon671-21ntpd2
19089870,4rtkit-daemon671-21ntpd1
19089870,4rtkit-daemon671-21ntpd1
19089870,4rtkit-daemon671-21ntpd1
19089870,4rtkit-daemon671-21ntpd1
19089870,4rtkit-daemon671-21ntpd0
19089870,4rtkit-daemon667-21snmpd2
19089870,4rtkit-daemon667-21snmpd2
19089870,4rtkit-daemon667-21snmpd0
19089870,4rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon674-21lldpd2
19089870,3rtkit-daemon667-21snmpd2
19089870,3rtkit-daemon438-21wpa_supplicant2
19089870,3rtkit-daemon1747343-21ssh2
19089870,3rtkit-daemon1721004-21ssh2
19089870,3rtkit-daemon1657242-21ssh1
19089870,3rtkit-daemon1489299-21kthreadcore2
19089870,3rtkit-daemon1357306-21munin-node2
19089870,3rtkit-daemon1357306-21munin-node0
1752646270,4sleep11752709-21awk1
1705992271,4sleep01706000-21ssh0
1699040270,1sleep20-21swapper/22
1688494270,1sleep20-21swapper/22
1682679270,4sleep01682831-21df0
1674564271,3sleep21674599-21apt-get2
1649958270,2sleep21649967-21ssh2
1626350270,5sleep11626418-21ssh1
1626194271,4sleep01626349-21df_inode0
1617641270,1sleep00-21swapper/00
1599364270,4sleep11599599-21awk1
1527683270,4sleep11527691-21ssh1
1518005270,4sleep01518089-21ssh0
1511593270,4sleep11511601-21ssh1
1510028270,4sleep01510219-21users0
1466423271,4sleep01466488-21munin-run0
1461884270,4sleep11463910-21grep1
1452951270,4sleep11453022-21ntp_states1
1435236270,4sleep11435380-21/usr/sbin/munin1
1403249271,4sleep01-21systemd0
1384862270,5sleep11384933-21cut1
1372143271,3sleep00-21swapper/00
19089860,2rtkit-daemon431ktimers/22
1818799260,3sleep21818807-21ssh2
1803891260,3sleep11803918-21munin-run1
1794553260,1sleep10-21swapper/11
1771086260,1sleep00-21swapper/00
1757242260,3sleep01714125-21kworker/u16:4+kvfree_rcu_reclaim0
1755907260,4sleep21756313-21irqcore2
1754807260,3sleep01754809-21ssh0
1745631260,4sleep10-21swapper/11
1739470260,4sleep01739652-21sed0
1734336260,3sleep01736204-21sed0
1714593260,1sleep10-21swapper/11
1712359260,4sleep01712626-21/usr/sbin/munin0
1673469260,1sleep10-21swapper/11
1576002260,1sleep10-21swapper/11
1560518261,3sleep22344348-21kworker/u16:2+rpciod2
1551790260,1sleep10-21swapper/11
1542235260,1sleep10-21swapper/11
1531530260,3sleep11533618-21kthreadcore1
1519027260,1sleep10-21swapper/11
1503256260,4sleep11503326-21processes1
1491829261,2sleep11491862-21apt-get1
1474065261,3sleep10-21swapper/11
1473367260,4sleep01474064-21sed0
1448220260,3sleep01448476-21sed0
1440978260,3sleep00-21swapper/00
1428667261,2sleep10-21swapper/11
1428451260,1sleep00-21swapper/00
1416396261,2sleep11416428-21apt-get1
1411604261,2sleep00-21swapper/00
1404182260,3sleep01404844-21sed0
1386020261,2sleep00-21swapper/00
1379858260,4sleep01380898-21grep0
1365831261,2sleep11365853-21apt-get1
19089850,1rtkit-daemon0-21swapper/22
1818790250,3sleep11818798-21ssh1
1811441250,3sleep21811449-21ssh2
1804236250,2sleep10-21swapper/11
1786788251,2sleep20-21swapper/22
1770330250,1sleep20-21swapper/22
1737528250,3sleep11737536-21ssh1
1725773251,2sleep11727869-21kthreadcore1
1715779251,2sleep10-21swapper/11
1691136250,3sleep21691778-21sed2
1668521251,2sleep20-21swapper/22
1658727251,2sleep00-21swapper/00
1632119250,3sleep20-21swapper/22
1604072251,2sleep10-21swapper/11
1575105250,2sleep21575113-21ssh2
1561100250,3sleep10-21swapper/11
1544437250,3sleep21544445-21ssh2
1487024250,2sleep10-21swapper/11
1479235250,2sleep10-21swapper/11
1466696250,1sleep00-21swapper/00
1460073250,1sleep00-21swapper/00
1443303251,2sleep11445354-21kthreadcore1
1442386251,2sleep00-21swapper/00
1430428250,2sleep10-21swapper/11
1415827250,1sleep10-21swapper/11
1403805250,3sleep11403952-21df1
1396770250,1sleep00-21swapper/00
1392450251,2sleep10-21swapper/11
1373125250,2sleep10-21swapper/11
1371887250,3sleep01371930-21munin-run0
1360293251,2sleep00-21swapper/00
1356848250,1sleep10-21swapper/11
1351094250,1sleep00-21swapper/00
1826807240,2sleep21826809-21ssh2
1803016240,2sleep21803024-21ssh2
1723061240,2sleep00-21swapper/00
1664997240,2sleep21665005-21ssh2
1485563240,2sleep00-21swapper/00
1485265240,1sleep00-21swapper/00
1416394240,2sleep00-21swapper/00
1350562240,2sleep00-21swapper/00
1378608230,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional