You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 06:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Wed Dec 03, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
179192699445,38cyclictest0-21swapper/021:48:110
1791926994012,2cyclictest1977874-21ssh23:51:310
179192699391,38cyclictest0-21swapper/022:43:090
179192699372,34cyclictest0-21swapper/020:28:130
179192699352,8cyclictest1996658-21ssh00:12:320
179192699351,3cyclictest1960833-21irqstats23:33:090
179192699341,31cyclictest0-21swapper/019:26:100
179192699331,32cyclictest0-21swapper/000:08:100
179192699322,6cyclictest1908803-21/usr/sbin/munin22:38:080
179192699301,27cyclictest1836785-21munin-plugin-st21:21:070
179192699301,21cyclictest1972930-21latency_hist23:46:080
179192699295,6cyclictest1901296-21ssh22:28:420
1791926992912,5cyclictest0-21swapper/021:33:050
179192699284,14cyclictest0-21swapper/022:18:120
179192699284,14cyclictest0-21swapper/022:18:120
1791926992826,2cyclictest1832173-21diskmemload23:23:090
179192699280,12cyclictest0-21swapper/023:47:130
179192699272,19cyclictest1956838-21grep23:28:170
1791928992619,5cyclictest0-21swapper/221:01:102
179192799264,16cyclictest1909691-21ld22:38:111
179192699262,22cyclictest0-21swapper/020:08:110
179192699262,19cyclictest111788-21systemd-journal19:33:420
1791926992617,3cyclictest1879397-21sendmail-msp22:08:090
179192699261,3cyclictest1923393-21/usr/sbin/munin22:53:080
179192699261,23cyclictest0-21swapper/023:03:100
179192699261,15cyclictest1894828-21/usr/sbin/munin22:23:140
179192799251,10cyclictest11050irq/107-eth%d00:26:241
1791926992510,2cyclictest11050irq/107-eth%d21:53:150
179192799242,6cyclictest1934660-21ssh23:05:081
179192799242,18cyclictest1815028-21sendmail-msp20:28:131
1791926992414,4cyclictest1928707-21timerwakeupswit22:58:150
179192699241,21cyclictest1871539-21cut21:58:050
179192799236,13cyclictest1917057-21ssh22:46:081
1791926992318,4cyclictest1791925-21cyclictest22:13:350
179192699231,21cyclictest0-21swapper/022:33:100
179192999224,10cyclictest0-21swapper/322:15:443
179192899225,16cyclictest1999186-21ssh00:14:382
1791928992218,2cyclictest1898151-21sendmail-msp22:28:422
179192699222,16cyclictest2008771-21sendmail-msp00:28:120
179192699221,12cyclictest0-21swapper/000:38:250
1791926992210,8cyclictest1935283-21sendmail-msp23:11:080
179192899212,5cyclictest0-21swapper/221:38:172
179192799218,4cyclictest11050irq/107-eth%d22:07:111
179192799217,11cyclictest111788-21systemd-journal22:44:131
179192799215,12cyclictest1850256-21ssh21:35:141
179192799213,16cyclictest111788-21systemd-journal21:29:391
179192799211,16cyclictest111788-21systemd-journal00:08:101
1791926992116,3cyclictest0-21swapper/023:13:030
1791926992116,1cyclictest0-21swapper/020:23:090
179192899202,13cyclictest111788-21systemd-journal00:28:012
179192899201,17cyclictest2006596-21ntpq00:23:112
179192799207,10cyclictest1900398-21sed22:28:101
179192799203,13cyclictest1956341-21ntpq23:28:111
179192799202,2cyclictest11050irq/107-eth%d23:18:091
1791927992014,4cyclictest1989700-21threads00:03:161
179192699206,12cyclictest1007-21mta-sts-daemon23:36:250
179192699205,11cyclictest1007-21mta-sts-daemon20:41:070
179192699204,16cyclictest0-21swapper/021:29:390
179192699202,17cyclictest1839082-21ntpq21:23:100
179192699202,17cyclictest1839082-21ntpq21:23:100
179192899196,7cyclictest111788-21systemd-journal00:01:112
179192899195,12cyclictest1904734-21/usr/sbin/munin22:33:072
179192899193,2cyclictest1946005-21/usr/sbin/munin23:18:092
179192899193,14cyclictest259-21jbd2/mmcblk0p2-822:15:442
179192899193,13cyclictest1995291-21ssh00:10:312
179192899193,12cyclictest1955269-21ssh23:27:482
179192899192,15cyclictest1895549-21load22:23:072
1791928991910,6cyclictest1860282-21sendmail-msp21:48:132
179192799198,7cyclictest0-21swapper/100:13:091
179192799195,10cyclictest11050irq/107-eth%d22:23:071
179192799191,4cyclictest1819984-21dpkg20:41:071
1791927991911,5cyclictest0-21swapper/119:33:161
179192699192,16cyclictest2026276-21cat00:46:080
179192699191,6cyclictest1874340-21apt-get22:01:100
1791926991915,3cyclictest0-21swapper/023:18:130
179192699190,6cyclictest1916837-21sendmail-msp22:48:160
179192899185,9cyclictest1881817-21ps22:08:122
179192899182,8cyclictest1871536-21gltestperf21:58:052
1791928991813,3cyclictest1935283-21sendmail-msp23:07:172
1791928991813,3cyclictest1007-21mta-sts-daemon00:43:002
179192899181,13cyclictest1832025-21sed21:13:162
179192899180,17cyclictest1797906-21ld19:33:102
179192799185,11cyclictest1916837-21sendmail-msp22:54:211
1791927991815,2cyclictest1969955-21gltestperf23:43:051
179192699189,7cyclictest0-21swapper/000:32:450
179192699182,2cyclictest0-21swapper/000:18:150
179192699182,13cyclictest1793578-21grep19:21:070
112699180,0rtkit-daemon0-21swapper/221:52:132
179192899179,3cyclictest0-21swapper/219:38:112
179192899179,3cyclictest0-21swapper/219:38:112
179192899176,9cyclictest1007-21mta-sts-daemon22:01:102
179192899175,8cyclictest1928276-21awk22:58:092
179192899174,9cyclictest1991577-21sendmail-msp00:16:082
179192899173,12cyclictest1808401-21idleruntime-cro20:06:072
179192899173,11cyclictest1857834-21ntpq21:43:102
179192899173,10cyclictest1836905-21ssh21:21:082
179192899172,6cyclictest1909684-21ntpq22:38:112
1791928991713,3cyclictest1843687-21ssh21:28:102
179192899171,13cyclictest967-21snmpd19:43:152
179192899171,12cyclictest1794084-21fschecks_count19:23:072
179192899171,10cyclictest1839172-21ntpq21:23:122
179192899171,10cyclictest1839172-21ntpq21:23:122
179192799179,6cyclictest111788-21systemd-journal00:35:281
179192799175,6cyclictest1928037-21ssh22:58:071
179192799175,11cyclictest1935539-21ssh23:06:131
179192799172,3cyclictest11050irq/107-eth%d23:31:241
179192799172,13cyclictest1874962-21ssh22:01:111
179192799172,12cyclictest1825235-21munin-plugin-st20:56:071
179192799171,5cyclictest1979922-21/usr/sbin/munin23:53:151
179192699172,12cyclictest1984298-21/usr/sbin/munin23:58:090
1791926991712,3cyclictest0-21swapper/019:43:110
179192899168,5cyclictest0-21swapper/220:28:102
179192899166,8cyclictest259-21jbd2/mmcblk0p2-820:53:122
179192899165,6cyclictest1817067-21aten_r2power_vo20:33:032
179192899164,7cyclictest2015344-21ssh00:33:122
179192899163,9cyclictest1918538-21fschecks_count22:48:052
179192899163,7cyclictest1979453-21ssh23:53:102
179192899163,6cyclictest111788-21systemd-journal23:46:092
179192899163,10cyclictest1914386-21/usr/sbin/munin22:43:092
1791928991613,2cyclictest0-21swapper/219:48:152
1791928991612,3cyclictest1932385-21fschecks_count23:03:062
179192899161,11cyclictest1813284-21sed20:18:162
179192799164,6cyclictest1822542-21fschecks_time20:48:081
179192799163,10cyclictest111788-21systemd-journal21:08:091
179192799162,9cyclictest1841445-21idleruntime-cro21:26:071
179192799162,9cyclictest1841445-21idleruntime-cro21:26:071
179192799162,13cyclictest1874524-21cat22:01:081
179192799162,11cyclictest1984925-21head23:58:161
179192799161,8cyclictest11050irq/107-eth%d20:08:111
1791927991613,2cyclictest0-21swapper/121:01:071
179192699165,6cyclictest1828338-21/usr/sbin/munin21:03:110
179192699163,10cyclictest1829927-21ld21:08:090
179192699162,11cyclictest762-21in:imuxsock20:33:030
179192699161,11cyclictest1857899-21sshd21:43:110
112699160,2rtkit-daemon1125-21rtkit-daemon21:45:371
179192999155,5cyclictest0-21swapper/323:33:123
179192999154,6cyclictest0-21swapper/322:33:093
179192999153,7cyclictest0-21swapper/321:31:073
179192999152,9cyclictest0-21swapper/322:58:063
179192899157,7cyclictest351ktimers/222:52:442
179192899153,9cyclictest1944818-21latency_hist23:16:082
179192899153,10cyclictest1847580-21/usr/sbin/munin21:33:032
179192899153,10cyclictest1820514-21apt-get20:41:092
179192899152,10cyclictest1890539-21fschecks_time22:18:072
179192899152,10cyclictest1890539-21fschecks_time22:18:072
179192899151,13cyclictest1962673-21sh23:34:492
179192899151,10cyclictest1965468-21ssh23:38:072
1791928991510,3cyclictest0-21swapper/219:53:082
179192799153,9cyclictest2023594-21ssh00:43:071
179192799153,9cyclictest2018997-21ssh00:38:061
179192799153,9cyclictest1801266-21/usr/sbin/munin19:43:101
179192799152,8cyclictest11050irq/107-eth%d21:36:081
1791927991510,4cyclictest1974548-21fschecks_time23:48:081
1791927991510,2cyclictest0-21swapper/121:18:091
179192699154,10cyclictest0-21swapper/021:13:110
179192699153,10cyclictest1805347-21/usr/sbin/munin19:58:020
179192699152,8cyclictest1853390-21/usr/sbin/munin21:38:140
179192699152,11cyclictest1812270-21fschecks_time20:18:060
179192699152,11cyclictest111788-21systemd-journal20:46:080
179192699152,10cyclictest1805119-21apt19:56:070
1791926991512,2cyclictest1822607-21gltestperf20:48:080
1791926991511,3cyclictest1005-21mta-sts-daemon00:22:100
179192699150,12cyclictest0-21swapper/019:38:110
179192699150,12cyclictest0-21swapper/019:38:110
179192999145,6cyclictest0-21swapper/321:01:093
179192999145,5cyclictest0-21swapper/321:48:033
179192999144,5cyclictest0-21swapper/320:03:113
179192999144,4cyclictest0-21swapper/319:39:113
179192999144,4cyclictest0-21swapper/319:39:113
179192999144,4cyclictest0-21swapper/300:30:103
179192999143,5cyclictest0-21swapper/323:13:143
179192999142,8cyclictest0-21swapper/300:11:313
179192999142,6cyclictest0-21swapper/323:18:013
179192999141,7cyclictest0-21swapper/323:03:153
179192899144,8cyclictest0-21swapper/220:23:102
179192899143,9cyclictest1795227-21sendmail-msp19:26:102
179192899142,10cyclictest1811782-21latency_hist20:16:082
179192799147,5cyclictest2006006-21fschecks_time00:23:051
179192799147,5cyclictest0-21swapper/121:13:081
179192799145,4cyclictest0-21swapper/123:11:411
179192799143,9cyclictest1803140-21/usr/sbin/munin19:48:141
179192799143,5cyclictest1814446-21ntpq20:23:101
179192799142,8cyclictest1890146-21/usr/sbin/munin22:18:071
179192799142,8cyclictest1890146-21/usr/sbin/munin22:18:071
179192799142,10cyclictest1820873-21fschecks_time20:43:041
179192799141,9cyclictest1965198-21cut23:38:061
179192799141,9cyclictest1861780-21aten_r2power_fr21:48:031
179192799141,8cyclictest1866364-21/usr/sbin/munin21:53:061
1791927991412,1cyclictest0-21swapper/120:13:071
1791927991411,2cyclictest271ktimers/120:36:081
179192799141,12cyclictest2001516-21/usr/sbin/munin00:18:041
179192799141,12cyclictest1799086-21grep19:38:061
179192799141,12cyclictest1799086-21grep19:38:061
179192799141,10cyclictest1886081-21ssh22:13:071
179192699141,9cyclictest0-21swapper/000:01:110
179192699141,12cyclictest1826880-21cut21:01:070
179192999134,4cyclictest0-21swapper/322:23:073
179192999133,6cyclictest0-21swapper/323:43:133
179192999133,6cyclictest0-21swapper/322:43:153
179192999133,5cyclictest0-21swapper/319:23:173
179192999133,5cyclictest0-21swapper/300:08:103
179192999132,7cyclictest0-21swapper/322:01:083
179192999132,6cyclictest0-21swapper/321:21:033
179192999132,6cyclictest0-21swapper/321:08:043
179192999132,6cyclictest0-21swapper/319:33:103
179192999132,6cyclictest0-21swapper/300:23:433
179192999132,5cyclictest0-21swapper/320:08:113
179192999131,7cyclictest0-21swapper/323:46:093
179192999131,7cyclictest0-21swapper/322:28:103
179192999130,7cyclictest0-21swapper/320:38:043
179192899133,6cyclictest2019145-21gltestperf00:38:062
179192899133,5cyclictest1984253-21strings23:58:082
179192899131,9cyclictest1822915-21/usr/sbin/munin20:48:112
179192899131,9cyclictest1818834-21fschecks_count20:38:062
179192899131,9cyclictest11050irq/107-eth%d23:22:582
179192799133,8cyclictest1904996-21ntpq22:33:091
179192799132,8cyclictest1805452-21head19:58:031
179192799131,9cyclictest1792271-21aten_r2power_po19:18:041
179192799131,8cyclictest111788-21systemd-journal19:31:071
1791927991310,1cyclictest0-21swapper/123:23:041
179192699132,8cyclictest1810380-21/usr/sbin/munin20:13:040
179192699132,10cyclictest1823823-21/usr/sbin/munin20:53:140
1791926991310,0cyclictest0-21swapper/019:23:050
112699130,5rtkit-daemon1006-21mta-sts-daemon19:14:081
179192999124,5cyclictest0-21swapper/323:28:113
179192999124,4cyclictest0-21swapper/319:18:093
179192999123,5cyclictest0-21swapper/319:43:153
179192999123,5cyclictest0-21swapper/300:33:553
179192999123,4cyclictest0-21swapper/323:23:023
179192999123,4cyclictest0-21swapper/319:48:063
179192999122,7cyclictest0-21swapper/323:51:313
179192999122,6cyclictest0-21swapper/323:07:053
179192999122,6cyclictest0-21swapper/320:41:093
179192999122,6cyclictest0-21swapper/300:16:403
179192999122,5cyclictest0-21swapper/321:53:093
179192999122,5cyclictest0-21swapper/320:48:123
179192999122,4cyclictest0-21swapper/321:31:403
179192999122,4cyclictest0-21swapper/320:33:033
179192999121,7cyclictest0-21swapper/322:08:063
179192999120,5cyclictest0-21swapper/300:38:043
179192899129,2cyclictest0-21swapper/219:58:062
179192899123,7cyclictest1829389-21/usr/sbin/munin21:08:042
179192899123,6cyclictest1808432-21sendmail-msp20:08:152
179192899123,6cyclictest1792609-21grep19:18:062
179192899121,9cyclictest1825831-21cut20:58:042
179192899121,4cyclictest0-21swapper/223:43:082
179192799127,4cyclictest0-21swapper/120:18:051
179192799122,8cyclictest1805043-21/usr/sbin/munin19:53:181
179192799121,9cyclictest1807904-21sshd20:03:111
179192799120,5cyclictest58-21kcompactd021:01:101
179192699121,9cyclictest1801854-21sendmail-msp19:48:090
179192699121,4cyclictest0-21swapper/020:03:110
179192999114,5cyclictest0-21swapper/320:28:103
179192999114,4cyclictest0-21swapper/322:46:083
179192999114,4cyclictest0-21swapper/320:13:073
179192999114,4cyclictest0-21swapper/300:43:043
179192999114,3cyclictest0-21swapper/323:58:053
179192999113,6cyclictest0-21swapper/322:01:103
179192999113,4cyclictest0-21swapper/322:18:073
179192999113,4cyclictest0-21swapper/322:18:073
179192999112,6cyclictest0-21swapper/300:01:113
179192999112,5cyclictest0-21swapper/319:28:103
179192999112,4cyclictest0-21swapper/322:38:053
179192999111,6cyclictest0-21swapper/321:13:103
179192999111,5cyclictest0-21swapper/319:58:113
179192999110,6cyclictest0-21swapper/323:38:123
179192999110,6cyclictest0-21swapper/321:38:153
179192899112,6cyclictest1791976-21grep19:16:072
179192799116,3cyclictest0-21swapper/119:23:121
179192999104,4cyclictest0-21swapper/320:23:113
179192999103,4cyclictest0-21swapper/320:53:043
179192999102,4cyclictest0-21swapper/319:53:093
179192999101,6cyclictest0-21swapper/320:58:083
179192999101,5cyclictest0-21swapper/321:23:043
179192999101,5cyclictest0-21swapper/321:23:043
17919299992,3cyclictest0-21swapper/321:41:523
17919299991,3cyclictest0-21swapper/322:54:213
17919299990,4cyclictest0-21swapper/320:18:073
11269990,3rtkit-daemon1007-21mta-sts-daemon19:11:140
17919299961,4cyclictest0-21swapper/319:16:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional