You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 14:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Thu Nov 20, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18886242250,1sleep30-21swapper/300:05:173
150623299250,21cyclictest1616277-21sleep21:15:013
1506232992118,1cyclictest0-21swapper/321:20:003
150623299201,14cyclictest1546111-21turbostat20:20:003
1506232991916,1cyclictest0-21swapper/322:55:153
1506232991916,1cyclictest0-21swapper/322:35:023
1506232991916,1cyclictest0-21swapper/319:30:003
1506232991916,1cyclictest0-21swapper/300:25:173
150623299191,14cyclictest1608186-21chrt21:08:563
1506232991815,1cyclictest0-21swapper/323:45:173
1506232991815,1cyclictest0-21swapper/323:10:123
1506232991815,1cyclictest0-21swapper/322:50:013
1506232991815,1cyclictest0-21swapper/322:30:133
1506232991815,1cyclictest0-21swapper/321:00:163
150623299181,13cyclictest1847358-21taskset23:40:003
150623299181,13cyclictest1702855-21chrt22:07:023
150623299181,13cyclictest1678897-21chrt21:52:213
150623299178,6cyclictest16868512sleep321:57:143
150623299177,6cyclictest19337122sleep300:30:503
150623299176,7cyclictest18219372sleep323:22:433
1506232991715,1cyclictest0-21swapper/321:20:113
1506232991714,1cyclictest0-21swapper/323:40:123
1506232991714,1cyclictest0-21swapper/322:50:173
1506232991714,1cyclictest0-21swapper/322:25:003
1506232991714,1cyclictest0-21swapper/321:40:173
150623299171,13cyclictest1869971-21taskset23:51:583
150623299171,13cyclictest1694225-21taskset22:00:333
150623299171,13cyclictest1632472-21chrt21:25:153
150623299171,13cyclictest1577638-21taskset20:45:113
150623299171,12cyclictest1797007-21taskset23:05:493
150623299171,12cyclictest1751042-21taskset22:40:173
150623299171,12cyclictest1709784-21taskset22:14:563
150623299171,12cyclictest1640587-21taskset21:30:123
150623299171,12cyclictest1565250-21taskset20:35:093
150623299171,12cyclictest1533984-21taskset20:10:023
150623299166,7cyclictest19021962sleep300:12:153
1506232991613,1cyclictest0-21swapper/323:00:213
1506232991613,1cyclictest0-21swapper/320:58:213
150623299161,12cyclictest1942506-21taskset00:37:433
150623299161,12cyclictest1913116-21chrt00:20:153
150623299161,12cyclictest1913116-21chrt00:20:153
150623299161,12cyclictest1877619-21chrt23:56:073
150623299161,12cyclictest1835024-21taskset23:30:193
150623299161,12cyclictest1670845-21taskset21:47:113
150623299161,12cyclictest1654242-21taskset21:35:413
150623299161,12cyclictest1564754-21taskset20:31:573
150623299161,12cyclictest1558799-21turbostat20:30:003
150623299161,12cyclictest1547949-21taskset20:20:193
150623299161,12cyclictest1513530-21taskset19:50:213
150623299161,12cyclictest1511831-21chrt19:38:193
150623299161,12cyclictest1509773-21taskset19:20:523
150623299161,12cyclictest1509152-21chrt19:16:123
150623299161,11cyclictest1512229-21chrt19:40:073
150623299160,13cyclictest1879659-21taskset00:00:083
150623299160,12cyclictest1506387-21chrt19:10:103
1506232991512,1cyclictest0-21swapper/323:25:183
1506232991512,1cyclictest0-21swapper/323:15:163
1506232991512,1cyclictest0-21swapper/320:05:173
1506232991512,1cyclictest0-21swapper/300:15:253
150623299151,11cyclictest1732287-21taskset22:25:423
150623299151,11cyclictest1577236-21taskset20:43:353
150623299151,11cyclictest1527233-21taskset20:00:513
150623299151,11cyclictest1512865-21taskset19:45:163
150623299151,11cyclictest1510981-21taskset19:30:223
150623299151,10cyclictest1583754-21taskset20:50:043
150623299150,12cyclictest1715277-21taskset22:15:203
150623299150,12cyclictest1515433-21taskset19:55:063
19266752130,7sleep244-21ksoftirqd/200:28:052
17502042131,9sleep21750450-21cat22:40:012
16557572131,9sleep01655765-21ssh21:39:150
19364552120,1sleep10-21swapper/100:35:171
19278502121,7sleep11927883-21apt-get00:30:161
18718522121,8sleep21871982-21/usr/sbin/munin23:55:162
18472842121,3sleep21847355-21munin-run23:40:002
18131132120,9sleep01813122-21sshd23:15:490
17508882121,8sleep21751040-21df_inode22:40:172
15401662121,8sleep21540199-21apt-get20:15:142
15002222121,5sleep01500254-21apt-get19:05:150
147598120,8rtkit-daemon1678129-21ssh21:50:282
147598120,8rtkit-daemon1506927-21munin-node22:30:180
147598120,4rtkit-daemon171rcu_preempt23:37:150
19258052110,1sleep00-21swapper/000:26:070
18620862110,8sleep01862094-21ssh23:47:080
18376062110,8sleep11837612-21ssh23:31:531
17424442110,8sleep11742452-21ssh22:35:071
17236172110,8sleep01723866-21/usr/sbin/munin22:20:230
16497542110,1sleep2421rcuc/221:35:162
16407882110,8sleep11641690-21cut21:30:161
15970162110,8sleep11598090-21grep21:00:171
147598110,9rtkit-daemon1474-21rtkit-daemon23:21:322
147598110,7rtkit-daemon1829677-21ssh23:27:001
147598110,7rtkit-daemon1790463-21ssh23:04:102
147598110,7rtkit-daemon1748247-21ssh22:35:260
147598110,7rtkit-daemon1540-21sendmail-mta23:14:512
19016402100,7sleep11901646-21ssh00:10:571
18880692103,4sleep21888622-21sed00:05:172
18316272101,6sleep01832048-21irqcore23:30:160
18053332100,1sleep00-21swapper/023:11:240
17754892101,5sleep11776399-21cat22:55:181
17588262101,4sleep01758865-21apt-get22:45:120
16898712100,8sleep01691801-21kthreadcore22:00:190
16304252101,6sleep21630427-21ssh21:21:062
16238682100,7sleep21623876-21ssh21:19:182
16228712100,7sleep11622877-21ssh21:17:041
16165132102,4sleep01616546-21apt-get21:15:110
147598100,6rtkit-daemon515-21gmain20:59:021
147598100,6rtkit-daemon1919871-21apt-get00:25:121
147598100,6rtkit-daemon1540-21sendmail-mta22:57:202
147598100,6rtkit-daemon1540-21sendmail-mta21:23:211
147598100,5rtkit-daemon1798879-21munin-run23:10:012
147598100,5rtkit-daemon1527584-21munin-run20:05:012
147598100,4rtkit-daemon476-21wpa_supplicant22:45:572
1798508291,5sleep01798518-21ssh23:09:200
1662492290,2sleep01662499-21sh21:41:200
1591490290,6sleep01593492-21kthreadcore20:55:150
1534003291,4sleep01534036-21apt-get20:10:150
14759890,5rtkit-daemon1540-21sendmail-mta19:18:102
14759890,4rtkit-daemon214-21plymouthd22:50:422
14759890,4rtkit-daemon1756532-21ssh22:40:291
14759890,4rtkit-daemon1614669-21ssh21:11:232
14759890,4rtkit-daemon1589690-21munin-run20:55:001
1903742281,3sleep01903777-21apt-get00:15:120
1903049281,4sleep01903057-21ssh00:14:080
1783421281,4sleep11783528-21/usr/sbin/munin23:00:161
1719724281,3sleep20-21swapper/222:20:172
1716432281,4sleep21716440-21ssh22:16:452
1701531281,4sleep01701616-21ntp_states22:05:210
1695869282,4sleep21577316-21kworker/u16:0+nfsiod22:04:262
1680352281,3sleep2214-21plymouthd21:55:122
1602321281,3sleep01602354-21apt-get21:05:130
1589642280,1sleep00-21swapper/020:54:390
1571476281,4sleep21571625-21df_inode20:40:142
1545965280,1sleep10-21swapper/120:18:291
14759880,5rtkit-daemon515-21gmain20:08:062
14759880,4rtkit-daemon214-21plymouthd23:53:020
14759880,4rtkit-daemon214-21plymouthd00:21:071
14759880,4rtkit-daemon214-21plymouthd00:21:071
14759880,4rtkit-daemon1710191-21apt-get22:15:130
14759880,4rtkit-daemon1696446-21apt-get22:05:122
14759880,4rtkit-daemon1638715-21ssh21:26:501
14759880,4rtkit-daemon1559900-21sed20:30:192
14759880,4rtkit-daemon1506927-21munin-node00:10:592
14759880,4rtkit-daemon1-21systemd23:50:021
14759880,3rtkit-daemon214-21plymouthd20:20:162
14759880,1rtkit-daemon0-21swapper/219:46:462
1936190271,3sleep00-21swapper/000:35:160
1934545270,1sleep00-21swapper/000:32:440
1911772270,3sleep21911809-21apt-get00:20:112
1911772270,3sleep21911809-21apt-get00:20:112
1837043270,5sleep21837050-21diskmemload23:30:382
1829210270,1sleep20-21swapper/223:25:572
1809911270,4sleep11811971-21tr23:15:181
1801975271,3sleep11803837-21ssh23:10:171
1798674270,4sleep11798682-21ssh23:09:411
1741299270,1sleep10-21swapper/122:32:581
1731414270,1sleep20-21swapper/222:25:192
1726523271,3sleep01726685-21diskstats22:25:120
1704042271,3sleep01704984-21irqstats22:10:130
1694242270,1sleep10-21swapper/122:00:361
1669688271,4sleep01669896-21grep21:45:200
1662506270,5sleep21608277-21diskmemload21:41:232
1662373271,3sleep11577316-21kworker/u16:0+xprtiod21:41:051
1638159270,1sleep00-21swapper/021:25:330
1632430271,3sleep21632469-21apt-get21:25:152
1616163270,1sleep00-21swapper/021:14:520
1577602270,3sleep21577635-21apt-get20:45:122
1571440270,3sleep11571473-21apt-get20:40:131
1570264271,3sleep11570323-21ntp_states20:35:211
1506073270,1sleep30-21swapper/319:09:553
1505789270,1sleep10-21swapper/119:06:121
14759870,4rtkit-daemon720-21snmpd22:23:061
14759870,4rtkit-daemon720-21snmpd21:05:011
14759870,4rtkit-daemon214-21plymouthd20:26:512
14759870,4rtkit-daemon214-21plymouthd00:15:372
14759870,4rtkit-daemon1506927-21munin-node23:17:132
14759870,3rtkit-daemon899-21cron19:26:002
14759870,3rtkit-daemon730-21ntpd20:11:052
14759870,3rtkit-daemon729-21lldpd20:35:400
14759870,3rtkit-daemon456-21avahi-daemon22:10:162
14759870,3rtkit-daemon214-21plymouthd21:59:151
14759870,3rtkit-daemon214-21plymouthd21:45:102
14759870,3rtkit-daemon214-21plymouthd19:30:552
14759870,3rtkit-daemon214-21plymouthd00:00:162
14759870,3rtkit-daemon1726511-21apt-get22:25:111
14759870,3rtkit-daemon1506927-21munin-node21:34:492
14759870,3rtkit-daemon1506927-21munin-node19:20:472
14759870,3rtkit-daemon1468493-21munin-node19:11:060
14759870,3rtkit-daemon1-21systemd23:49:551
14759870,3rtkit-daemon1-21systemd20:46:191
14759870,3rtkit-daemon1-21systemd19:45:002
14759870,3rtkit-daemon1-21systemd19:35:552
14759870,3rtkit-daemon1-21systemd00:19:081
14759870,2rtkit-daemon214-21plymouthd23:55:030
14759870,2rtkit-daemon214-21plymouthd23:41:130
14759870,1rtkit-daemon0-21swapper/219:56:162
1943260260,1sleep20-21swapper/200:39:272
1887685260,1sleep10-21swapper/100:05:071
1887203260,1sleep00-21swapper/000:04:340
1883830260,3sleep11884695-21ls00:00:191
1855662260,3sleep21855701-21apt-get23:45:172
1853384260,1sleep10-21swapper/123:40:351
1830559260,3sleep01830567-21ssh23:29:080
1782320260,1sleep00-21swapper/022:59:380
1767051260,3sleep11767183-21hddtemp_smartct22:50:131
1757264260,1sleep00-21swapper/022:42:110
1741992261,3sleep21742000-21ssh22:34:402
1709491260,1sleep10-21swapper/122:13:071
1702415260,1sleep10-21swapper/122:06:021
1679549260,1sleep00-21swapper/021:53:500
1671921260,1sleep10-21swapper/121:49:421
1655460260,1sleep10-21swapper/121:38:321
1646274260,5sleep00-21swapper/021:30:460
1616233260,1sleep10-21swapper/121:15:001
1608040260,1sleep20-21swapper/221:07:032
1601925260,1sleep00-21swapper/021:03:170
1590231261,3sleep21590422-21cut20:55:132
1559046260,1sleep00-21swapper/020:30:150
1558729260,1sleep00-21swapper/020:29:190
1558429260,1sleep10-21swapper/120:25:271
1552356260,1sleep00-21swapper/020:22:130
1546492260,3sleep11546104-21apt-get20:20:021
1540356261,3sleep00-21swapper/020:15:160
1526928260,4sleep00-21swapper/020:00:410
1521633260,1sleep10-21swapper/120:00:061
1520413260,1sleep00-21swapper/019:57:000
1515113260,1sleep00-21swapper/019:54:160
1513524260,3sleep21513527-21apt-get19:50:212
1512502260,1sleep10-21swapper/119:43:441
1512409260,1sleep00-21swapper/019:42:310
1511798260,1sleep00-21swapper/019:37:530
1511026260,1sleep10-21swapper/119:30:571
1511010260,1sleep00-21swapper/019:30:450
1510365260,1sleep10-21swapper/119:25:281
1509887260,1sleep10-21swapper/119:22:231
1509850260,1sleep00-21swapper/019:21:540
1509189260,1sleep00-21swapper/019:16:410
1507219261,2sleep10-21swapper/119:15:021
14759860,3rtkit-daemon1-21systemd19:14:262
14759860,2rtkit-daemon214-21plymouthd20:35:022
1929184251,2sleep21930861-21kthreadcore00:30:212
1914522250,2sleep00-21swapper/000:20:170
1914522250,2sleep00-21swapper/000:20:170
1873454250,2sleep11875426-21grep23:55:191
1843823250,3sleep11844638-21cat23:35:181
1815598250,3sleep01815976-21irqcore23:20:140
1815278250,1sleep10-21swapper/123:20:111
1764698251,2sleep1214-21plymouthd22:45:491
1680557250,3sleep01680683-21gltestperf21:55:150
1624530250,3sleep01624694-21diskstats21:20:120
1585857251,2sleep21587942-21kthreadcore20:50:202
1577782251,2sleep00-21swapper/020:45:130
1539561250,3sleep10-21swapper/120:10:361
1533513250,1sleep10-21swapper/120:07:031
1528000250,3sleep01528093-21fschecks_time20:05:140
1889495240,2sleep00-21swapper/000:05:190
1869727240,2sleep21869735-21ssh23:51:222
1853323240,2sleep21853331-21ssh23:40:282
1788992240,2sleep0214-21plymouthd23:00:500
1772824240,2sleep01487621-21kworker/0:0+kacpid22:51:100
1716823241,1sleep10-21swapper/122:17:401
1678853240,2sleep10-21swapper/121:52:151
1598091240,2sleep20-21swapper/221:00:182
1577158240,2sleep0720-21snmpd20:42:370
1513071240,3sleep00-21swapper/019:47:590
1511929240,2sleep10-21swapper/119:39:381
1500413240,1sleep20-21swapper/219:05:182
1559035230,1sleep10-21swapper/120:30:081
1515210230,1sleep10-21swapper/119:55:011
1513476230,1sleep10-21swapper/119:50:091
1512863230,1sleep10-21swapper/119:45:151
1510339230,1sleep00-21swapper/019:25:070
1506412230,1sleep10-21swapper/119:10:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional