You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 02:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Fri Jan 09, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10879059912530,1249cyclictest14072082sleep33
10879059912090,1205cyclictest11681592sleep33
10879059911521,1147cyclictest1271165-21sleep3
1087905992701,265cyclictest1471801-21turbostat3
108790599181,13cyclictest1193826-21turbostat3
108790599177,8cyclictest1174371-21turbostat3
108790599175,8cyclictest1284049-21turbostat3
1087905991714,1cyclictest0-21swapper/33
108790599171,13cyclictest1510473-21turbostat3
108790599166,7cyclictest1459831-21taskset3
1087905991613,1cyclictest0-21swapper/33
108790599161,11cyclictest1497848-21taskset3
108790599161,11cyclictest1484970-21taskset3
108790599161,11cyclictest1471092-21taskset3
13203362151,4sleep01321642-21memory0
1087905991513,1cyclictest0-21swapper/33
1087905991512,1cyclictest0-21swapper/33
1087905991512,1cyclictest0-21swapper/33
1087905991512,1cyclictest0-21swapper/33
1087905991512,1cyclictest0-21swapper/33
108790599151,11cyclictest1322685-21turbostat3
108790599151,11cyclictest1290526-21turbostat3
108790599151,11cyclictest1215726-21taskset3
14138832141,11sleep21414082-21/usr/sbin/munin2
108790599144,7cyclictest1277469-21taskset3
108790599144,7cyclictest1181107-21taskset3
108790599141,9cyclictest14201432sleep33
1087905991412,1cyclictest0-21swapper/33
1087905991412,1cyclictest0-21swapper/33
1087905991412,1cyclictest0-21swapper/33
1087905991412,1cyclictest0-21swapper/33
1087905991412,0cyclictest0-21swapper/33
1087905991411,1cyclictest0-21swapper/33
1087905991411,1cyclictest0-21swapper/33
1087905991411,1cyclictest0-21swapper/33
1087905991411,1cyclictest0-21swapper/33
108790599141,10cyclictest1393215-21chrt3
108790599141,10cyclictest1355470-21taskset3
108790599141,10cyclictest1335409-21taskset3
108790599141,10cyclictest1264461-21taskset3
108790599141,10cyclictest1251483-21chrt3
108790599141,10cyclictest1230420-21taskset3
11835832131,2sleep00-21swapper/00
108790599131,9cyclictest1452388-21taskset3
108790599131,9cyclictest1257984-21taskset3
108790599131,9cyclictest1148494-21chrt3
108790599131,9cyclictest1135591-21taskset3
108790599131,9cyclictest1108359-21taskset3
108790599131,8cyclictest14459142sleep33
1087905991312,0cyclictest0-21swapper/33
1087905991311,1cyclictest0-21swapper/33
1087905991311,1cyclictest0-21swapper/33
1087905991311,1cyclictest0-21swapper/33
108790599131,10cyclictest1432803-21turbostat3
108790599131,10cyclictest1161253-21taskset3
1087905991310,1cyclictest0-21swapper/33
108790599130,10cyclictest1387117-21taskset3
108790599130,10cyclictest1373705-21taskset3
108790599130,10cyclictest1206952-21chrt3
108790599130,10cyclictest1093960-21chrt3
108790599130,10cyclictest1093960-21chrt3
301798120,7rtkit-daemon1435807-21grep1
11501762120,2sleep2421rcuc/22
108790599129,1cyclictest0-21swapper/33
108790599128,1cyclictest0-21swapper/33
108790599121,9cyclictest1238665-21taskset3
108790599121,9cyclictest1224996-21taskset3
108790599121,8cyclictest1348963-21taskset3
1087905991210,1cyclictest0-21swapper/33
108790599120,9cyclictest1497337-21taskset3
108790599120,9cyclictest1439488-21taskset3
108790599120,9cyclictest1310040-21taskset3
10877522124,4sleep30-21swapper/33
301798110,4rtkit-daemon636-21snmpd1
301798110,3rtkit-daemon1094451-21munin-node1
11670632112,5sleep11167213-21unattended-upgr1
301798100,6rtkit-daemon1354928-21seq1
301798100,6rtkit-daemon1194533-21/usr/sbin/munin1
301798100,3rtkit-daemon636-21snmpd1
301798100,3rtkit-daemon3200908-21packagekitd1
301798100,3rtkit-daemon1094451-21munin-node1
14650182101,6sleep21465206-21date2
12652582100,1sleep01265421-21/usr/sbin/munin0
30179890,6rtkit-daemon636-21snmpd1
30179890,6rtkit-daemon492-21gmain1
30179890,5rtkit-daemon448-21wpa_supplicant1
30179890,5rtkit-daemon430-21avahi-daemon1
30179890,5rtkit-daemon3205-21sendmail-mta1
30179890,5rtkit-daemon3205-21sendmail-mta1
30179890,5rtkit-daemon3205-21sendmail-mta1
30179890,5rtkit-daemon317-21systemd-udevd1
30179890,5rtkit-daemon1094451-21munin-node1
30179890,4rtkit-daemon638-21ntpd1
30179890,4rtkit-daemon1511421-21cut1
30179890,4rtkit-daemon1319727-21kthreadcore1
30179890,1rtkit-daemon0-21swapper/11
30179890,1rtkit-daemon0-21swapper/11
1503328291,5sleep11503526-21grep1
1474827290,6sleep21476979-21cut2
1407221291,4sleep11407254-21apt-get1
1357554291,5sleep01359630-21kthreadcore0
1324645290,6sleep11326487-21cut1
1284300291,4sleep11284333-21apt-get1
1277850291,4sleep11277883-21apt-get1
1264953291,4sleep11264986-21apt-get1
30179880,5rtkit-daemon667-21lldpd1
30179880,5rtkit-daemon492-21gmain1
30179880,4rtkit-daemon667-21lldpd1
30179880,4rtkit-daemon638-21ntpd1
30179880,4rtkit-daemon638-21ntpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon448-21wpa_supplicant1
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon1477987-21chrt1
30179880,4rtkit-daemon1393845-21apt-get1
30179880,4rtkit-daemon1237147-21kthreadcore1
30179880,4rtkit-daemon1094451-21munin-node1
30179880,4rtkit-daemon1094451-21munin-node1
30179880,4rtkit-daemon1094451-21munin-node1
30179880,4rtkit-daemon1094451-21munin-node1
30179880,4rtkit-daemon1094451-21munin-node1
30179880,3rtkit-daemon1379531-21kthreadcore1
1490791281,4sleep0636-21snmpd0
1484332286,1sleep01426393-21kworker/0:0+kacpid0
1458961280,1sleep00-21swapper/00
1387756281,4sleep01387864-21diskstats0
1360911281,4sleep11361020-21find1
1336066281,4sleep21336212-21df2
1310078281,4sleep11310230-21df_inode1
1273120280,5sleep11275141-21grep1
1272202280,5sleep01273117-21kthreadcore0
1251184281,4sleep11251428-21users1
1214541280,6sleep21215724-21cut2
1174644280,5sleep01174713-21tr0
1167216281,4sleep21167457-21awk2
1154972281,1sleep20-21swapper/22
1142100281,4sleep01142249-21df_inode0
1129100281,3sleep01129133-21apt-get0
1093260281,4sleep21093414-21sed2
1093260281,4sleep21093414-21sed2
1083541281,4sleep01085627-21cut0
30179870,4rtkit-daemon667-21lldpd1
30179870,4rtkit-daemon3200908-21packagekitd1
30179870,3rtkit-daemon638-21ntpd1
30179870,3rtkit-daemon636-21snmpd1
30179870,3rtkit-daemon3205-21sendmail-mta1
30179870,3rtkit-daemon3205-21sendmail-mta1
30179870,3rtkit-daemon3205-21sendmail-mta1
30179870,3rtkit-daemon1489739-21kthreadcore1
30179870,3rtkit-daemon1450467-21grep1
1500602270,4sleep01502725-21cut0
1497554270,1sleep00-21swapper/00
1444624270,5sleep01444762-21ntp_kernel_err0
1426616270,4sleep20-21swapper/22
1400808270,3sleep11400841-21apt-get1
1363526270,4sleep01365555-21tr0
1329775271,3sleep01329868-21/usr/sbin/munin0
1239384270,4sleep01239450-21grep0
1239201271,2sleep20-21swapper/22
1153760270,4sleep11153819-21ntp_states1
1116549270,4sleep21117540-21irqstats2
1096705270,3sleep01096738-21apt-get0
1510178260,1sleep00-21swapper/00
1497403261,4sleep2636-21snmpd2
1478673260,1sleep20-21swapper/22
1439111260,1sleep00-21swapper/00
1413720261,3sleep00-21swapper/00
1413153260,1sleep00-21swapper/00
1371591260,3sleep01373497-21sed0
1348975260,3sleep01349008-21apt-get0
1348539260,1sleep00-21swapper/00
1323185260,3sleep01323212-21apt-get0
1315455260,3sleep244-21ksoftirqd/22
1290946260,1sleep00-21swapper/00
1285757260,3sleep21284301-21/usr/sbin/munin2
1283332260,3sleep01283551-21sed0
1258493260,3sleep01258526-21apt-get0
1252052260,2sleep00-21swapper/00
1251442260,1sleep00-21swapper/00
1233116261,2sleep20-21swapper/22
1226691261,3sleep01226288-21/usr/sbin/munin0
1226408261,2sleep20-21swapper/22
1220396261,2sleep00-21swapper/00
1212299260,3sleep01212388-21systemctl0
1200819261,2sleep00-21swapper/00
1200265260,3sleep01200279-21munin-run0
1173657260,4sleep21173815-21timerwakeupswit2
1168206261,2sleep00-21swapper/00
1141592261,2sleep2636-21snmpd2
1122719260,3sleep01122919-21hddtemp_smartct0
1122556261,2sleep20-21swapper/22
1118956261,2sleep00-21swapper/00
1109833261,2sleep20-21swapper/22
1109650261,2sleep00-21swapper/00
1102297261,3sleep21102541-21users2
1086712260,2sleep20-21swapper/22
1505765250,2sleep20-21swapper/22
1484934250,2sleep20-21swapper/22
1478041250,1sleep00-21swapper/00
1470966251,2sleep20-21swapper/22
1465556251,1sleep00-21swapper/00
1453034251,2sleep20-21swapper/22
1452030250,1sleep20-21swapper/22
1420140250,1sleep00-21swapper/00
1408676250,3sleep20-21swapper/22
1406129250,3sleep00-21swapper/00
1401877250,2sleep20-21swapper/22
1394110250,2sleep00-21swapper/00
1380672250,1sleep00-21swapper/00
1374803250,2sleep20-21swapper/22
1374239250,1sleep20-21swapper/22
1362313251,2sleep20-21swapper/22
1355434251,2sleep20-21swapper/22
1354847250,2sleep21354848-21sshd2
1341961250,1sleep00-21swapper/00
1329589250,2sleep20-21swapper/22
1323059250,2sleep21322683-21apt-get2
1317352250,3sleep21318309-21kthreadcore2
1310042250,2sleep00-21swapper/00
1309415250,1sleep20-21swapper/22
1298609250,2sleep00-21swapper/00
1296796250,1sleep20-21swapper/22
1258085250,1sleep20-21swapper/22
1251671250,1sleep20-21swapper/22
1226029250,1sleep20-21swapper/22
1219524250,3sleep00-21swapper/00
1193779250,3sleep00-21swapper/00
1193647250,1sleep20-21swapper/22
1180779250,1sleep20-21swapper/22
1163109251,2sleep01164416-21kthreadcore0
1160784250,1sleep00-21swapper/00
1136778251,2sleep00-21swapper/00
1135052250,1sleep20-21swapper/22
1109119250,1sleep20-21swapper/22
1104170251,2sleep00-21swapper/00
1090279250,3sleep01092355-21grep0
1090279250,3sleep01092355-21grep0
1510708240,1sleep20-21swapper/22
1497812240,2sleep20-21swapper/22
1447271240,2sleep00-21swapper/00
1441279240,2sleep21442645-21kthreadcore2
1432019240,2sleep00-21swapper/00
1426272240,3sleep20-21swapper/22
1393102240,2sleep21393214-21grep2
1342481240,3sleep20-21swapper/22
1303249240,3sleep20-21swapper/22
1290273240,3sleep00-21swapper/00
1279159240,2sleep20-21swapper/22
1266410240,2sleep21264954-21/usr/sbin/munin2
1258490240,3sleep20-21swapper/22
1212969240,3sleep20-21swapper/22
1181116240,1sleep20-21swapper/22
1513480230,1sleep00-21swapper/00
1455962230,1sleep00-21swapper/00
1433233230,1sleep20-21swapper/22
1399264230,1sleep20-21swapper/22
1383193230,1sleep20-21swapper/22
1381214230,1sleep00-21swapper/00
1303810230,1sleep00-21swapper/00
1271391230,1sleep20-21swapper/22
1232806230,1sleep00-21swapper/00
1200553230,1sleep20-21swapper/22
1200140230,1sleep20-21swapper/22
1154560230,1sleep00-21swapper/00
1146874230,1sleep21147315-21strings2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional