You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 04:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Apr 20, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1136935212160,54sleep30-21swapper/33
113704328064,10sleep10-21swapper/11
113708427858,14sleep00-21swapper/00
113699627849,9sleep20-21swapper/22
113741299251,11cyclictest1602143-21chrt3
113741299251,11cyclictest1602143-21chrt3
13958692221,15sleep01396081-21users0
113741299222,16cyclictest1337097-21taskset3
1137412992215,4cyclictest1572902-21taskset3
1137412992213,5cyclictest66950irq/132-enp1s0-TxRx-33
113741299221,17cyclictest1293663-21taskset3
113741299220,18cyclictest1203759-21taskset3
113741299211,16cyclictest1527775-21taskset3
113741299211,16cyclictest1407294-21taskset3
113741299210,18cyclictest0-21swapper/33
113741299210,17cyclictest1282608-21taskset3
15128282201,9sleep11268380-21diskmemload1
14939532201,4sleep11493966-21sh1
1137412992012,5cyclictest66950irq/132-enp1s0-TxRx-33
1137412992012,5cyclictest0-21swapper/33
113741299201,15cyclictest66950irq/132-enp1s0-TxRx-33
113741299201,15cyclictest0-21swapper/33
113741299201,15cyclictest0-21swapper/33
113741299201,14cyclictest0-21swapper/33
113741299200,12cyclictest0-21swapper/33
12778442191,4sleep01277969-21perl0
11419832191,7sleep01142145-21sed0
1137412991916,1cyclictest0-21swapper/33
113741299191,15cyclictest0-21swapper/33
113741299191,15cyclictest0-21swapper/33
113741299191,14cyclictest66950irq/132-enp1s0-TxRx-33
113741299191,14cyclictest0-21swapper/33
113741299191,14cyclictest0-21swapper/33
113741299191,14cyclictest0-21swapper/33
13873332181,3sleep20-21swapper/22
113741299184,12cyclictest0-21swapper/33
1137412991811,5cyclictest66950irq/132-enp1s0-TxRx-33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,14cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
113741299181,13cyclictest0-21swapper/33
15647282171,4sleep11-21systemd1
14620032171,11sleep01462428-21cut0
14151972171,12sleep21268380-21diskmemload2
12341772171,5sleep11235268-21memory1
1137412991713,2cyclictest0-21swapper/33
1137412991713,2cyclictest0-21swapper/33
1137412991711,4cyclictest0-21swapper/33
113741299171,14cyclictest0-21swapper/33
113741299170,14cyclictest0-21swapper/33
113741299170,14cyclictest0-21swapper/33
113741299170,13cyclictest0-21swapper/33
113741299170,13cyclictest0-21swapper/33
113741299170,13cyclictest0-21swapper/33
16269212160,1sleep20-21swapper/22
16012692161,2sleep00-21swapper/00
13627792161,9sleep20-21swapper/22
13302072162,10sleep21330341-21/usr/sbin/munin2
13020372161,3sleep20-21swapper/22
113741299161,11cyclictest1149917-21taskset3
1137412991610,3cyclictest0-21swapper/33
113741299160,13cyclictest0-21swapper/33
113741299160,13cyclictest0-21swapper/33
113741299160,13cyclictest0-21swapper/33
113741299160,13cyclictest0-21swapper/33
113741299160,13cyclictest0-21swapper/33
113741299160,12cyclictest0-21swapper/33
15997582150,1sleep10-21swapper/11
15988072151,2sleep20-21swapper/22
15839252151,8sleep01583983-21munin-run0
15482372151,10sleep21548251-21ssh2
13894382151,4sleep11268380-21diskmemload1
13100412150,1sleep10-21swapper/11
13093582150,1sleep00-21swapper/00
12703642158,4sleep10-21swapper/11
113741299150,13cyclictest0-21swapper/33
113741299150,13cyclictest0-21swapper/33
113741299150,12cyclictest0-21swapper/33
113741299150,12cyclictest0-21swapper/33
15571022141,9sleep11268380-21diskmemload1
15197092141,8sleep11268380-21diskmemload1
15032392141,2sleep20-21swapper/22
14253792141,4sleep11425390-21ssh1
12950052141,7sleep11295030-21ssh1
12837062140,1sleep10-21swapper/11
12763452141,8sleep01268380-21diskmemload0
12742132140,3sleep20-21swapper/22
113741299148,3cyclictest0-21swapper/33
1137412991411,2cyclictest0-21swapper/33
113741299140,2cyclictest0-21swapper/33
113741299140,12cyclictest0-21swapper/33
15728902131,8sleep21572901-21ssh2
15367852131,8sleep21536798-21rm2
15123282131,2sleep20-21swapper/22
14680932131,8sleep21468105-21sh2
14607072131,8sleep11460719-21sh1
14588542131,8sleep21458865-21ssh2
14329332131,7sleep00-21swapper/00
13439082131,8sleep11343911-21ssh1
13295012131,6sleep01329560-21munin-run0
13182212132,6sleep11268380-21diskmemload1
13182212132,6sleep11268380-21diskmemload1
11931912130,2sleep10-21swapper/11
11766862130,1sleep10-21swapper/11
11375872130,5sleep21137580-21/usr/sbin/munin2
113741299130,1cyclictest0-21swapper/33
113741299130,11cyclictest0-21swapper/33
113741299130,10cyclictest0-21swapper/33
113741299130,10cyclictest0-21swapper/33
16285942122,5sleep01628617-21apt-get0
16240962121,7sleep11624155-21ssh1
16239422121,5sleep01624095-21ntpq0
15846152121,7sleep21584672-21grep2
15843172121,6sleep01584350-21ssh0
15738862121,7sleep11573897-21ssh1
14838602121,5sleep20-21swapper/22
14332632120,1sleep10-21swapper/11
14139082121,2sleep0171rcu_preempt0
14000802121,7sleep11268380-21diskmemload1
13786762121,7sleep11268380-21diskmemload1
13350302120,3sleep01335044-21ssh0
13341532120,2sleep10-21swapper/11
13287282121,3sleep20-21swapper/22
12408262121,5sleep21240863-21ntpq2
12408262121,5sleep21240863-21ntpq2
12217032121,7sleep21223424-21cut2
11993252122,6sleep01199669-21cut0
11503782121,5sleep21150550-21diskstats2
11499812120,8sleep11149995-21latency_hist1
16292952111,6sleep11630859-21grep1
16172812110,1sleep20-21swapper/22
16151192111,5sleep01615177-21ntpq0
15843512111,5sleep11584614-21df1
15587302111,5sleep01560302-21cut0
15492242111,5sleep01549250-21apt-get0
15287622111,6sleep11268380-21diskmemload1
15193142111,2sleep20-21swapper/22
15024242111,4sleep11268380-21diskmemload1
14972382111,6sleep01498838-21tr0
14930242111,7sleep01493037-21rm0
14774572111,5sleep11268380-21diskmemload1
14765892111,6sleep01476596-21ssh0
14683902111,5sleep11268380-21diskmemload1
14517622110,3sleep20-21swapper/22
14334632111,3sleep20-21swapper/22
14176382112,4sleep01417662-21apt-get0
13964992111,2sleep20-21swapper/22
13716172111,4sleep21268380-21diskmemload2
13550242111,3sleep10-21swapper/11
13444252110,2sleep20-21swapper/22
12862532114,2sleep20-21swapper/22
12683692111,5sleep01268423-21munin-run0
12474412111,5sleep11247630-21diskstats1
12137362111,5sleep21213784-21ntpq2
12067742111,5sleep11208005-21memory1
11772922111,5sleep01177495-21diskstats0
11769502112,6sleep01176968-21dump-pmu-power0
11490022111,5sleep21149051-21ntpq2
16356732100,2sleep21635684-21ssh2
16170632100,1sleep10-21swapper/11
16071592101,3sleep20-21swapper/22
16071592101,3sleep20-21swapper/22
16057092101,4sleep11268380-21diskmemload1
16057092101,4sleep11268380-21diskmemload1
15796212101,4sleep11579775-21ntpq1
15460432101,4sleep01268380-21diskmemload0
15281442101,4sleep01268380-21diskmemload0
14943692100,2sleep20-21swapper/22
14860452101,2sleep10-21swapper/11
14839832101,3sleep00-21swapper/00
14783792101,3sleep20-21swapper/22
14586162101,6sleep01268380-21diskmemload0
14501272101,3sleep00-21swapper/00
14438762101,3sleep11443909-21apt-get1
14418782101,3sleep20-21swapper/22
14397612101,6sleep01440011-21unixbench_multi0
14218882101,5sleep21421954-21ntp_states2
14051062100,1sleep20-21swapper/22
14001962101,5sleep01400431-21ssh0
13990542101,3sleep11268380-21diskmemload1
13827732100,7sleep01382946-21ssh0
13764572101,4sleep01377694-21memory0
13708422101,3sleep10-21swapper/11
13691992101,5sleep01369263-21ntp_states0
13628472101,3sleep00-21swapper/00
13547772100,3sleep20-21swapper/22
13540912100,2sleep00-21swapper/00
13388242101,4sleep01338957-21diskstats0
13280602101,2sleep10-21swapper/11
13104052100,5sleep20-21swapper/22
13003132101,5sleep01300327-21ssh0
12913602101,3sleep00-21swapper/00
12835632101,3sleep20-21swapper/22
12425712100,6sleep01242884-21grep0
12262972101,4sleep21226421-21perl2
11670402101,5sleep01167111-21irqstats0
11561842101,5sleep11157626-21kthreadcore1
1608443291,4sleep01608454-21ssh0
1608443291,4sleep01608454-21ssh0
1580717291,2sleep20-21swapper/22
1572161291,4sleep01572175-21ssh0
1564648291,2sleep20-21swapper/22
1555849290,1sleep20-21swapper/22
1546113291,3sleep11268380-21diskmemload1
1537671291,3sleep01537681-21ssh0
1536920291,2sleep10-21swapper/11
1527013291,4sleep21527071-21/usr/sbin/munin2
1520603291,4sleep01520614-21ssh0
1510384291,4sleep01510399-21ssh0
1441104291,3sleep11268380-21diskmemload1
1379442290,3sleep20-21swapper/22
1319163291,5sleep01319174-21sh0
1319163291,5sleep01319174-21sh0
1319097291,4sleep21319109-21ssh2
1319097291,4sleep21319109-21ssh2
1291225291,3sleep11268380-21diskmemload1
1221069292,3sleep00-21swapper/00
1211587291,4sleep01213413-21grep0
1208576291,4sleep21208793-21users2
1203820291,4sleep1802-21snmpd1
1197372291,4sleep01197490-21grep0
1181204293,2sleep20-21swapper/22
1163738291,4sleep11164847-21memory1
1150263291,3sleep01150282-21apt-get0
1414629281,3sleep11268380-21diskmemload1
1362614280,1sleep10-21swapper/11
1267363281,3sleep11267412-21ntpq1
1251789281,4sleep21252034-21users2
1237279281,3sleep11238246-21kthreadcore1
1237279281,3sleep11238246-21kthreadcore1
1215566280,2sleep00-21swapper/00
1215343281,2sleep20-21swapper/22
1214781280,1sleep10-21swapper/11
1198703281,2sleep21198266-21apt-get2
1182538281,4sleep01182750-21expr0
1173638281,3sleep21173988-21kthreadcore2
1164848281,3sleep21160941-21/usr/sbin/munin2
1159631281,3sleep01159688-21ntp_kernel_err0
1257432270,1sleep10-21swapper/11
1253334270,3sleep01255018-21grep0
1247365271,3sleep01247437-21grep0
1246965270,1sleep10-21swapper/11
1241462270,1sleep00-21swapper/00
1241462270,1sleep00-21swapper/00
1231066270,1sleep00-21swapper/00
1208179271,2sleep01208225-21ntpq0
1192695270,1sleep20-21swapper/22
1188413271,2sleep01187843-21/usr/sbin/munin0
1187545270,3sleep10-21swapper/11
1150285271,3sleep10-21swapper/11
1142940270,1sleep00-21swapper/00
1268147260,4sleep20-21swapper/22
1263040261,2sleep10-21swapper/11
1261910260,2sleep20-21swapper/22
1259318261,2sleep00-21swapper/00
1257399260,1sleep20-21swapper/22
1246730260,4sleep20-21swapper/22
1235460260,2sleep00-21swapper/00
1227393261,2sleep10-21swapper/11
1225527260,1sleep10-21swapper/11
1220353260,1sleep10-21swapper/11
1193213261,2sleep20-21swapper/22
1191964260,2sleep10-21swapper/11
1186696260,2sleep21186813-21gzip2
1181917260,4sleep10-21swapper/11
1168359261,2sleep20-21swapper/22
1167112261,2sleep11168357-21kthreadcore1
1162020261,2sleep00-21swapper/00
1160420260,1sleep20-21swapper/22
1142360260,1sleep10-21swapper/11
1235269250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional