You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 03:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Tue Nov 25, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1663007992825,1cyclictest0-21swapper/300:00:003
166300799252,16cyclictest2103108-21taskset00:10:013
1663007992513,1cyclictest0-21swapper/322:30:113
1663007992320,1cyclictest0-21swapper/320:40:013
1663007992118,1cyclictest0-21swapper/300:10:193
1663007992016,1cyclictest0-21swapper/319:17:223
1663007991916,1cyclictest0-21swapper/323:13:433
1663007991916,1cyclictest0-21swapper/321:55:013
1663007991916,1cyclictest0-21swapper/321:25:403
1663007991916,1cyclictest0-21swapper/321:10:013
1663007991915,1cyclictest0-21swapper/322:00:003
166300799191,14cyclictest1794937-21taskset20:50:223
166300799191,13cyclictest1990975-21turbostat23:00:013
1663007991814,1cyclictest0-21swapper/319:15:003
166300799181,14cyclictest1702751-21taskset19:40:143
166300799181,13cyclictest2143112-21sleep00:35:003
166300799181,13cyclictest2063220-21taskset23:45:113
166300799181,13cyclictest1965177-21chrt22:40:353
166300799181,12cyclictest1870625-21taskset21:45:003
166300799180,13cyclictest1801708-21taskset20:59:573
1663007991714,1cyclictest0-21swapper/323:29:593
1663007991714,1cyclictest0-21swapper/321:20:003
1663007991714,1cyclictest0-21swapper/319:30:143
1663007991714,1cyclictest0-21swapper/300:15:173
166300799171,13cyclictest2126077-21taskset00:22:463
166300799171,13cyclictest2045874-21chrt23:32:383
166300799171,13cyclictest2016645-21taskset23:15:173
166300799171,13cyclictest1958415-21chrt22:38:273
166300799171,13cyclictest1942731-21chrt22:29:423
166300799171,12cyclictest2055539-21chrt23:40:153
166300799171,12cyclictest1983017-21turbostat22:55:003
166300799171,12cyclictest1869585-21taskset21:43:053
166300799171,12cyclictest1830753-21taskset21:20:133
166300799171,12cyclictest1814458-21chrt21:10:103
166300799171,12cyclictest1770735-21taskset20:34:553
166300799171,12cyclictest1677873-21taskset19:20:143
20699132160,1sleep02069921-21ssh23:47:580
166300799167,6cyclictest19173202sleep322:11:183
1663007991613,1cyclictest0-21swapper/322:45:193
1663007991613,1cyclictest0-21swapper/322:05:203
166300799161,12cyclictest2149340-21chrt00:36:063
166300799161,12cyclictest2134380-21taskset00:28:243
166300799161,12cyclictest2090946-21taskset00:00:183
166300799161,12cyclictest2052951-21taskset23:35:293
166300799161,12cyclictest1996534-21taskset23:00:243
166300799161,12cyclictest1932965-21chrt22:20:233
166300799161,12cyclictest1925609-21taskset22:17:033
166300799161,12cyclictest1902109-21chrt22:03:493
166300799161,12cyclictest1861895-21chrt21:38:553
166300799161,12cyclictest1853343-21chrt21:32:433
166300799161,12cyclictest1783476-21taskset20:45:143
166300799161,12cyclictest1777264-21chrt20:40:123
166300799161,12cyclictest1764228-21taskset20:25:503
166300799161,12cyclictest1751906-21taskset20:16:483
166300799161,12cyclictest1739615-21taskset20:07:303
166300799161,12cyclictest1702272-21taskset19:37:533
166300799161,11cyclictest2023731-21taskset23:20:153
166300799160,8cyclictest1752422-21taskset20:20:023
166300799160,13cyclictest1727234-21chrt19:57:403
166300799160,13cyclictest1689503-21chrt19:26:483
18522192151,10sleep11852391-21awk21:30:261
1663007991512,1cyclictest0-21swapper/320:14:263
166300799151,11cyclictest2077196-21taskset23:50:413
166300799151,11cyclictest1807574-21taskset21:00:323
166300799151,11cyclictest1733345-21taskset20:01:463
166300799151,11cyclictest1719962-21chrt19:50:203
166300799150,12cyclictest1999277-21chrt23:05:073
166300799150,12cyclictest1714729-21chrt19:45:383
147598150,10rtkit-daemon720-21snmpd22:10:170
18886102140,3sleep1331ktimers/121:55:171
16691972141,9sleep21670615-21grep19:15:022
20739262135,5sleep02075941-21kthreadcore23:50:180
16769352130,1sleep10-21swapper/119:15:231
19807912120,5sleep01981039-21users22:50:240
17086422120,9sleep01709063-21cat19:45:010
147598120,8rtkit-daemon2125597-21chrt00:21:372
21367362110,8sleep12138107-21grep00:30:191
20228952110,8sleep12022903-21ssh23:19:571
18690232111,4sleep21845523-21kworker/u16:3+nfsiod21:41:492
18295902110,8sleep11829597-21sh21:18:461
18035562110,1sleep20-21swapper/221:00:152
17831812111,3sleep1474-21systemd-logind20:45:001
17090672110,7sleep11708662-21apt-get19:45:011
147598110,7rtkit-daemon1807622-21kworker/u16:0+nfsiod21:20:052
147598110,7rtkit-daemon1687079-21grep19:25:182
147598110,3rtkit-daemon214-21plymouthd00:37:031
21113912102,5sleep22111424-21apt-get00:15:142
19906932101,6sleep01990703-21sshd22:59:200
18870052101,5sleep01887027-21sh21:55:130
18627242101,6sleep01845523-21kworker/u16:3+rpciod21:40:130
18446782100,7sleep21844686-21ssh21:26:052
18070212100,7sleep11807048-21/usr/sbin/munin21:00:201
147598100,6rtkit-daemon1983139-21cut22:55:011
147598100,6rtkit-daemon1540-21sendmail-mta00:17:380
147598100,5rtkit-daemon1737600-21cut20:05:172
147598100,2rtkit-daemon214-21plymouthd00:25:452
2140609290,6sleep22140660-21/usr/sbin/munin00:30:232
2101906291,6sleep21814154-21diskmemload00:07:202
1957682291,6sleep11957690-21sh22:36:461
1945207290,6sleep11947167-21kthreadcore22:30:161
1944106291,5sleep01944583-21kthreadcore22:30:160
1911264291,4sleep11911299-21apt-get22:10:121
1830957290,6sleep11831109-21awk21:20:161
1802310290,6sleep01802771-21cut21:00:150
1798048290,6sleep11800087-21kthreadcore20:55:181
1766360290,6sleep11768340-21cut20:30:171
1690015290,2sleep00-21swapper/019:30:140
14759890,5rtkit-daemon1926600-21kworker/u16:1+nfsiod23:11:552
14759890,5rtkit-daemon1749986-21cut20:15:212
14759890,5rtkit-daemon1702748-21apt-get19:40:142
14759890,5rtkit-daemon1540-21sendmail-mta23:28:581
14759890,4rtkit-daemon2076308-21ssh23:50:182
14759890,4rtkit-daemon1861554-21ssh21:38:140
14759890,4rtkit-daemon1846684-21ssh21:30:110
14759890,4rtkit-daemon1754884-21cut20:20:192
14759890,1rtkit-daemon0-21swapper/223:16:482
14759890,1rtkit-daemon0-21swapper/022:00:500
2110115280,2sleep1214-21plymouthd00:12:551
2079411280,4sleep12079450-21apt-get23:55:131
2079073281,4sleep10-21swapper/123:55:001
2006271282,4sleep11974368-21kworker/u16:5+nfsiod23:08:311
1991309281,3sleep11991344-21apt-get23:00:151
1968732280,6sleep01970614-21cut22:45:180
1958059280,2sleep20-21swapper/222:37:352
1949848280,2sleep2171rcu_preempt22:32:412
1935260281,3sleep21935297-21apt-get22:25:132
1910185280,1sleep20-21swapper/222:08:542
1844929280,6sleep11844934-21sh21:26:441
1830089281,4sleep21830116-21latency_hist21:20:002
1829581280,1sleep00-21swapper/021:18:450
1791314281,5sleep11792579-21kthreadcore20:50:171
1765581280,6sleep01766359-21kthreadcore20:30:160
1746253281,3sleep01746286-21apt-get20:15:150
1736072280,5sleep11738110-21kthreadcore20:05:181
1733388281,5sleep10-21swapper/120:02:211
1729517280,6sleep01731509-21cut20:00:190
1677763281,4sleep21677872-21/usr/sbin/munin19:20:142
14759880,5rtkit-daemon1669315-21munin-node22:17:380
14759880,4rtkit-daemon729-21lldpd22:28:051
14759880,4rtkit-daemon720-21snmpd21:27:250
14759880,4rtkit-daemon720-21snmpd21:09:392
14759880,4rtkit-daemon476-21wpa_supplicant19:21:170
14759880,4rtkit-daemon214-21plymouthd22:59:321
14759880,4rtkit-daemon214-21plymouthd20:50:182
14759880,4rtkit-daemon214-21plymouthd20:10:032
14759880,4rtkit-daemon2093809-21ssh00:01:562
14759880,4rtkit-daemon1964538-21ntpq22:40:211
14759880,4rtkit-daemon1788531-21grep20:45:222
14759880,4rtkit-daemon1669315-21munin-node21:50:550
14759880,4rtkit-daemon1669315-21munin-node21:10:511
14759880,4rtkit-daemon1669315-21munin-node19:17:550
14759880,4rtkit-daemon1-21systemd23:07:352
14759880,4rtkit-daemon1-21systemd21:48:020
14759880,4rtkit-daemon1-21systemd00:29:281
14759880,4rtkit-daemon1-21systemd00:14:530
14759880,1rtkit-daemon0-21swapper/223:47:442
14759880,1rtkit-daemon0-21swapper/223:03:302
2135383271,3sleep02135418-21apt-get00:30:140
2118604270,5sleep12118610-21ssh00:19:011
2056911271,3sleep10-21swapper/123:40:171
2047449270,4sleep12047578-21hddtemp_smartct23:35:171
2044946271,4sleep22044953-21sh23:30:332
2028344270,4sleep02028427-21ntp_states23:20:200
2005713270,4sleep00-21swapper/023:07:140
1990676271,3sleep21990684-21ssh22:59:182
1917409270,5sleep20-21swapper/222:11:292
1871123271,4sleep21872063-21sh21:45:162
1864084272,3sleep134-21ksoftirqd/121:40:191
1862349271,3sleep21862409-21idleruntime-cro21:39:592
1846743271,3sleep21846895-21df21:30:152
1815833270,4sleep21817133-21grep21:10:192
1779507270,5sleep01781550-21kthreadcore20:40:190
1777228271,3sleep21777261-21apt-get20:40:122
1764406273,2sleep01662998-21cyclictest20:28:090
1695906270,1sleep10-21swapper/119:34:161
1656971270,2sleep10-21swapper/119:05:151
14759870,4rtkit-daemon720-21snmpd20:31:442
14759870,4rtkit-daemon515-21gmain20:39:062
14759870,4rtkit-daemon1669315-21munin-node22:45:101
14759870,4rtkit-daemon1540-21sendmail-mta19:05:080
14759870,4rtkit-daemon1-21systemd20:28:332
14759870,3rtkit-daemon899-21cron19:37:002
14759870,3rtkit-daemon729-21lldpd19:58:022
14759870,3rtkit-daemon729-21lldpd19:31:482
14759870,3rtkit-daemon214-21plymouthd23:55:042
14759870,3rtkit-daemon214-21plymouthd23:20:172
14759870,3rtkit-daemon214-21plymouthd22:05:390
14759870,3rtkit-daemon2055231-21apt-get23:40:122
14759870,3rtkit-daemon1800967-21systemctl20:55:232
14759870,3rtkit-daemon1669315-21munin-node23:24:041
14759870,3rtkit-daemon1625474-21munin-node19:14:410
14759870,3rtkit-daemon1540-21sendmail-mta22:20:441
14759870,3rtkit-daemon1-21systemd23:29:532
14759870,3rtkit-daemon1-21systemd21:22:430
14759870,3rtkit-daemon1-21systemd20:02:012
14759870,3rtkit-daemon1-21systemd19:54:002
14759870,2rtkit-daemon214-21plymouthd23:36:002
14759870,1rtkit-daemon0-21swapper/200:12:502
2126242260,5sleep00-21swapper/000:23:090
2102178260,1sleep10-21swapper/100:07:551
2094504260,4sleep02094512-21ssh00:03:320
2086391260,1sleep00-21swapper/023:58:200
2069093260,1sleep10-21swapper/123:46:071
2056020260,4sleep02056910-21cut23:40:160
2046248260,3sleep12046256-21ssh23:33:331
2037964262,2sleep01814154-21diskmemload23:27:510
2013408260,1sleep00-21swapper/023:11:320
1974473260,1sleep20-21swapper/222:48:492
1965807260,1sleep00-21swapper/022:42:140
1958303260,1sleep00-21swapper/022:38:120
1942741260,1sleep00-21swapper/022:29:430
1933660260,4sleep21845523-21kworker/u16:3+xprtiod22:21:592
1921853261,2sleep20-21swapper/222:15:192
1902886260,3sleep11902894-21ssh22:05:041
1900420260,1sleep10-21swapper/122:00:221
1895918261,2sleep20-21swapper/222:00:152
1884698260,4sleep10-21swapper/121:51:051
1854702260,1sleep10-21swapper/121:35:141
1813225260,3sleep11808180-21/usr/sbin/munin21:05:201
1801587260,1sleep00-21swapper/020:58:220
1789655261,3sleep01789677-21apt-get20:50:130
1789072260,1sleep00-21swapper/020:45:550
1773172262,2sleep00-21swapper/020:35:180
1758286260,1sleep00-21swapper/020:23:590
1745692260,1sleep10-21swapper/120:11:101
1739574260,1sleep00-21swapper/020:07:010
1721509260,3sleep10-21swapper/119:55:111
1714785260,1sleep20-21swapper/219:46:222
1707963260,3sleep11708214-21tail19:40:251
1702134260,1sleep10-21swapper/119:36:071
1696489260,3sleep01696522-21apt-get19:35:140
1683863260,3sleep11684017-21df19:25:131
1678562260,3sleep10-21swapper/119:20:181
1668968260,1sleep20-21swapper/219:12:402
1662859260,3sleep2421rcuc/219:10:012
14759860,3rtkit-daemon761-21gmain23:14:221
2148370250,2sleep00-21swapper/000:35:180
2145247250,2sleep22147199-21kthreadcore00:35:162
2095480250,2sleep02095513-21apt-get00:05:140
2094824251,2sleep1214-21plymouthd00:04:181
2054140250,3sleep00-21swapper/023:38:170
2039313251,2sleep02039468-21df_inode23:30:140
2021609250,3sleep00-21swapper/023:17:000
1997854250,1sleep00-21swapper/023:02:260
1981889250,3sleep20-21swapper/222:52:262
1966986250,3sleep20-21swapper/222:45:002
1933749250,3sleep00-21swapper/022:22:170
1925342250,3sleep10-21swapper/122:16:301
1893013250,3sleep20-21swapper/221:56:072
1885110250,3sleep20-21swapper/221:52:072
1820228252,1sleep00-21swapper/021:10:290
1813480250,3sleep01813731-21unixbench_singl21:05:230
1776775252,1sleep10-21swapper/120:37:481
1758626250,2sleep10-21swapper/120:25:141
1754880250,2sleep10-21swapper/120:20:201
1747128250,3sleep11748126-21cut20:15:201
1745897250,3sleep00-21swapper/020:13:450
1721157250,3sleep00-21swapper/019:53:470
1709198250,3sleep01709341-21df19:45:120
1683827250,2sleep00-21swapper/019:25:120
1656968250,2sleep30-21swapper/319:05:133
2128294240,2sleep00-21swapper/000:25:170
2119599240,2sleep12119732-21ssh00:20:181
1876429240,2sleep10-21swapper/121:45:281
1727330240,2sleep00-21swapper/019:58:560
1720989240,2sleep1214-21plymouthd19:51:391
1668850240,3sleep10-21swapper/119:11:121
1783429230,1sleep10-21swapper/120:45:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional