You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 04:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 15, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14263572330,1sleep10-21swapper/120:25:011
1330915992813,11cyclictest1401284-21sleep20:04:593
1330915992410,10cyclictest1778890-21turbostat00:15:003
1330915992320,1cyclictest0-21swapper/323:50:003
1330915992219,1cyclictest0-21swapper/321:59:593
1330915992219,1cyclictest0-21swapper/321:35:023
133091599211,15cyclictest1364096-21turbostat19:35:003
1330915992017,1cyclictest0-21swapper/323:00:003
133091599201,15cyclictest1498522-21taskset21:20:173
1330915991916,1cyclictest0-21swapper/323:05:203
1330915991916,1cyclictest0-21swapper/322:25:013
1330915991915,2cyclictest0-21swapper/300:05:003
1330915991914,2cyclictest1413911-21turbostat20:14:593
133091599191,14cyclictest1586323-21turbostat22:15:003
133091599191,13cyclictest1802861-21taskset00:29:553
133091599191,13cyclictest1463662-21sleep20:55:003
133091599191,13cyclictest1438875-21turbostat20:35:013
133091599191,13cyclictest1337047-21turbostat19:15:013
133091599182,12cyclictest1794886-21turbostat00:25:003
1330915991815,1cyclictest0-21swapper/321:15:413
133091599181,13cyclictest1728492-21taskset23:40:223
133091599181,13cyclictest1659295-21taskset23:00:153
133091599181,13cyclictest1550943-21chrt21:50:183
133091599181,12cyclictest1506415-21taskset21:25:023
1330915991714,1cyclictest0-21swapper/323:10:193
1330915991714,1cyclictest0-21swapper/321:49:593
1330915991714,1cyclictest0-21swapper/321:10:183
1330915991714,1cyclictest0-21swapper/320:20:163
133091599171,13cyclictest1779241-21taskset00:15:123
133091599171,13cyclictest1770181-21chrt00:08:233
133091599171,13cyclictest1714245-21chrt23:33:163
133091599171,13cyclictest1364323-21chrt19:35:013
133091599171,12cyclictest1811265-21chrt00:35:123
133091599171,12cyclictest1562732-21taskset22:00:123
133091599171,12cyclictest1407445-21sleep20:10:003
133091599171,12cyclictest1381764-21taskset19:45:243
133091599170,9cyclictest1445328-21taskset20:40:013
133091599170,13cyclictest1570694-21chrt22:05:123
1330915991613,1cyclictest0-21swapper/323:35:213
1330915991613,1cyclictest0-21swapper/323:25:203
1330915991613,1cyclictest0-21swapper/321:08:323
1330915991613,1cyclictest0-21swapper/319:25:153
133091599161,12cyclictest1803609-21chrt00:30:163
133091599161,12cyclictest1697323-21taskset23:21:143
133091599161,12cyclictest1683187-21taskset23:15:103
133091599161,12cyclictest1649678-21chrt22:52:423
133091599161,12cyclictest1632755-21taskset22:40:443
133091599161,12cyclictest1632755-21taskset22:40:433
133091599161,12cyclictest1624778-21chrt22:35:353
133091599161,12cyclictest1592399-21taskset22:15:313
133091599161,12cyclictest1530565-21chrt21:40:053
133091599161,12cyclictest1526443-21taskset21:35:193
133091599161,12cyclictest1475676-21chrt21:01:043
133091599161,12cyclictest1444380-21taskset20:35:253
133091599161,12cyclictest1432114-21taskset20:25:433
133091599161,12cyclictest1432114-21taskset20:25:423
133091599161,12cyclictest1419846-21chrt20:17:013
133091599161,12cyclictest1389221-21taskset19:55:133
133091599161,12cyclictest1376219-21taskset19:41:113
133091599161,12cyclictest1351321-21taskset19:22:563
133091599161,12cyclictest1344983-21taskset19:15:573
133091599160,9cyclictest1746805-21sleep23:59:553
133091599160,13cyclictest1388526-21chrt19:50:283
133091599160,12cyclictest1739088-21taskset23:50:003
133091599160,12cyclictest1641052-21chrt22:46:203
13517802151,4sleep01351936-21diskstats19:25:140
133091599151,11cyclictest1616700-21taskset22:30:333
133091599151,11cyclictest1469467-21taskset20:55:443
133091599151,11cyclictest1457079-21taskset20:45:353
133091599150,12cyclictest1608829-21chrt22:25:453
15758942141,9sleep01576028-21/usr/sbin/munin22:05:230
147598140,9rtkit-daemon1439312-21/usr/sbin/munin20:35:160
147598140,10rtkit-daemon1336189-21ntp_states19:10:220
17886612131,9sleep21790472-21cut00:20:182
15308122130,4sleep01530887-21fschecks_count21:40:150
14976982138,2sleep11497704-21ssh21:19:031
147598130,6rtkit-daemon1540-21sendmail-mta19:31:110
13584162130,10sleep21358171-21/usr/sbin/munin19:30:172
17138842120,9sleep11713892-21ssh23:32:281
16617872122,7sleep21663898-21tr23:00:182
16505722120,8sleep11650579-21sh22:54:521
14988932120,9sleep21498481-21/usr/sbin/munin21:20:212
14262862120,8sleep01426356-21sed20:25:010
13643722121,3sleep21364519-21df19:35:142
17632492110,8sleep11763253-21apt00:05:131
17153502116,3sleep01715430-21cpuspeed_turbos23:35:150
15858832110,4sleep11585891-21ssh22:13:571
15301342110,8sleep21530137-21sshd21:39:432
147598110,7rtkit-daemon1689038-21sh23:15:452
147598110,7rtkit-daemon1345582-21/usr/sbin/munin19:20:160
147598110,5rtkit-daemon1787628-21hddtemp_smartct00:20:140
147598110,4rtkit-daemon1737506-21ssh23:46:540
13940352110,8sleep11394177-21sed19:55:201
17853222100,7sleep11785329-21sh00:16:231
17714112106,2sleep10-21swapper/100:10:151
17471082102,4sleep11747147-21apt-get23:55:121
17059502100,7sleep21705948-21ssh23:27:402
16996132100,7sleep01700047-21cut23:25:180
16993032100,7sleep11699320-21cpu23:25:151
16241312100,2sleep10-21swapper/122:35:221
15781222100,7sleep21578130-21ssh22:09:302
15489262100,7sleep21550942-21cut21:50:182
15285632100,7sleep01528571-21ssh21:36:020
15140342100,7sleep11514042-21ssh21:29:491
14879222100,7sleep01488174-21/usr/sbin/munin21:10:250
14840842100,7sleep21486011-21cut21:10:192
147598100,6rtkit-daemon1618970-21sh22:35:110
147598100,6rtkit-daemon1540-21sendmail-mta21:00:310
147598100,6rtkit-daemon1540-21sendmail-mta00:11:362
147598100,6rtkit-daemon1482165-21diskmemload23:39:272
147598100,6rtkit-daemon1383017-21apt-get19:50:110
147598100,5rtkit-daemon1675037-21apt-get23:10:130
147598100,3rtkit-daemon214-21plymouthd21:21:340
14141772100,1sleep21414180-21apt-get20:15:132
13953472101,5sleep21395380-21apt-get20:00:132
13691532100,1sleep01369360-21grep19:35:200
13252532101,5sleep01326193-21irqstats19:05:180
1795216291,4sleep11795255-21apt-get00:25:141
1730116290,7sleep21730122-21ssh23:43:062
1672340290,6sleep01672544-21unixbench-2d23:05:260
1569043290,6sleep11569049-21ssh22:02:071
1477856290,6sleep21479826-21kthreadcore21:05:222
14759890,6rtkit-daemon720-21snmpd20:30:040
14759890,6rtkit-daemon214-21plymouthd23:51:590
14759890,6rtkit-daemon1540-21sendmail-mta20:52:070
14759890,5rtkit-daemon1611128-21diskstats22:30:160
14759890,4rtkit-daemon1640174-21ntpq22:45:211
14759890,4rtkit-daemon1511647-21ntp_states21:25:210
14759890,4rtkit-daemon1450397-21ntp_states20:40:210
1427501290,6sleep11428640-21cat20:25:181
1427501290,6sleep11428640-21cat20:25:171
1803449281,4sleep21803608-21basename00:30:162
1556990280,5sleep11559019-21kthreadcore21:55:181
1554077280,5sleep01482165-21diskmemload21:54:240
1544025281,4sleep21544288-21head21:45:252
14759880,4rtkit-daemon730-21ntpd21:16:420
14759880,4rtkit-daemon720-21snmpd20:57:030
14759880,4rtkit-daemon214-21plymouthd22:25:280
14759880,4rtkit-daemon214-21plymouthd22:17:360
14759880,4rtkit-daemon214-21plymouthd00:14:060
14759880,4rtkit-daemon1779522-21ssh00:15:150
14759880,4rtkit-daemon1746784-21cron23:55:001
14759880,4rtkit-daemon1382016-21systemctl19:45:260
14759880,4rtkit-daemon1337210-21munin-node22:52:470
14759880,4rtkit-daemon1-21systemd22:10:400
14759880,3rtkit-daemon214-21plymouthd21:07:440
14759880,2rtkit-daemon0-21swapper/020:45:090
14759880,1rtkit-daemon0-21swapper/122:41:311
14759880,1rtkit-daemon0-21swapper/122:41:301
14759880,1rtkit-daemon0-21swapper/022:22:350
1444919280,1sleep20-21swapper/220:38:092
1438855281,4sleep21438878-21munin-run20:35:002
1426545281,3sleep01426578-21apt-get20:25:130
1426545281,3sleep01426578-21apt-get20:25:120
1376226280,1sleep00-21swapper/019:41:160
1345097280,1sleep00-21swapper/019:17:250
1811826270,5sleep21812648-21kthreadcore00:35:172
1785364270,5sleep20-21swapper/200:16:282
1770069273,2sleep00-21swapper/000:08:090
1738771271,4sleep21738779-21ssh23:49:532
1729510270,1sleep10-21swapper/123:41:421
1714211270,1sleep20-21swapper/223:33:082
1665041270,1sleep10-21swapper/123:01:181
1626641270,4sleep21618978-21kworker/u16:1+rpciod22:40:002
1547805270,4sleep11548924-21cut21:50:171
1512873270,5sleep21512879-21ssh21:27:052
14759870,4rtkit-daemon720-21snmpd22:00:500
14759870,4rtkit-daemon720-21snmpd21:56:410
14759870,4rtkit-daemon515-21gmain20:05:180
14759870,3rtkit-daemon720-21snmpd00:00:121
14759870,3rtkit-daemon515-21gmain23:43:340
14759870,3rtkit-daemon295-21systemd-journal20:10:010
14759870,3rtkit-daemon214-21plymouthd20:15:170
14759870,3rtkit-daemon214-21plymouthd00:02:062
14759870,3rtkit-daemon1691238-21ssh23:20:082
14759870,3rtkit-daemon1-21systemd22:48:380
14759870,3rtkit-daemon1-21systemd21:45:210
14759870,3rtkit-daemon1-21systemd19:56:140
14759870,3rtkit-daemon1-21systemd00:33:161
14759870,3rtkit-daemon1-21systemd00:08:542
14759870,2rtkit-daemon214-21plymouthd21:31:030
14759870,1rtkit-daemon0-21swapper/023:03:100
1453263270,4sleep21455259-21cut20:45:232
1398284270,4sleep00-21swapper/020:00:200
1345581271,3sleep21345614-21apt-get19:20:152
1326194270,4sleep11327588-21grep19:05:181
1818255260,1sleep00-21swapper/000:38:360
1817084260,1sleep10-21swapper/100:35:561
1804368261,2sleep00-21swapper/000:30:170
1787291260,3sleep11787325-21apt-get00:20:131
1752487260,3sleep01752691-21/usr/sbin/munin23:55:230
1737873260,3sleep11737881-21ssh23:47:421
1708648260,3sleep01709730-21kthreadcore23:30:190
1698435260,1sleep00-21swapper/023:23:540
1692163260,3sleep11693211-21cut23:20:171
1690449260,4sleep01690457-21ssh23:19:050
1683545260,3sleep11683666-21cut23:15:171
1682423260,4sleep11674068-21kworker/u16:1+rpciod23:14:281
1681280260,2sleep20-21swapper/223:11:572
1673676260,1sleep10-21swapper/123:07:481
1657196260,1sleep00-21swapper/022:56:450
1651380260,3sleep11652322-21cut22:55:171
1640379260,4sleep20-21swapper/222:45:242
1634387260,3sleep21634389-21ssh22:44:282
1634387260,3sleep21634389-21ssh22:44:272
1617098260,4sleep21617099-21sh22:31:252
1609916260,1sleep20-21swapper/222:28:212
1602923260,4sleep10-21swapper/122:25:081
1601056260,1sleep20-21swapper/222:21:592
1594647260,3sleep10-21swapper/122:20:101
1593257260,1sleep20-21swapper/222:17:362
1583836260,4sleep21578700-21/usr/sbin/munin22:10:212
1577502260,1sleep10-21swapper/122:08:051
1559023260,4sleep21559699-21cat21:55:182
1521328260,1sleep10-21swapper/121:33:141
1521116260,1sleep20-21swapper/221:32:472
1495570260,3sleep21490502-21/usr/sbin/munin21:15:242
1489777260,4sleep10-21swapper/121:14:151
1481254260,3sleep11481313-21ntp_states21:05:241
14759860,3rtkit-daemon515-21gmain23:52:302
14759860,3rtkit-daemon214-21plymouthd22:40:050
14759860,3rtkit-daemon214-21plymouthd22:40:040
14759860,2rtkit-daemon214-21plymouthd22:15:231
1475983260,3sleep11476046-21sed21:05:011
1463381260,1sleep20-21swapper/220:51:472
1457674260,1sleep10-21swapper/120:50:051
1451029260,1sleep20-21swapper/220:42:212
1419967260,1sleep10-21swapper/120:18:371
1413884260,1sleep20-21swapper/220:14:562
1413652260,1sleep10-21swapper/120:11:591
1407065260,1sleep10-21swapper/120:05:301
1406835260,3sleep21407052-21users20:05:272
1394767260,1sleep20-21swapper/219:56:102
1371923261,2sleep20-21swapper/219:40:182
1370152260,1sleep10-21swapper/119:38:171
1363719260,1sleep10-21swapper/119:30:271
1357546260,1sleep20-21swapper/219:28:442
1355204260,3sleep11356612-21memory19:25:191
1341290261,2sleep20-21swapper/219:15:172
1324867260,2sleep30-21swapper/319:05:083
1796323251,2sleep20-21swapper/200:25:182
1795444251,2sleep00-21swapper/000:25:170
1761439250,3sleep00-21swapper/000:01:370
1717401250,3sleep11719394-21cut23:35:211
1668322251,2sleep20-21swapper/223:05:202
1657367250,3sleep20-21swapper/222:57:072
1649890250,3sleep20-21swapper/222:53:182
1611131250,3sleep11611263-21hddtemp_smartct22:30:161
1563041250,3sleep21563532-21cut22:00:162
1544595250,3sleep10-21swapper/121:46:001
1537402250,3sleep11537410-21ssh21:42:561
1522597250,2sleep10-21swapper/121:35:021
1469564250,3sleep10-21swapper/120:57:001
1452372250,3sleep11453261-21grep20:45:221
1440438251,2sleep10-21swapper/120:35:201
1421679250,3sleep21423138-21tr20:20:182
1400975250,1sleep10-21swapper/120:01:291
1388881250,3sleep11388905-21munin-run19:54:591
1345136250,1sleep10-21swapper/119:17:541
1748458240,2sleep2421rcuc/223:55:172
1504663240,2sleep11504671-21ssh21:21:361
1470077240,2sleep2431ktimers/221:00:122
1426537240,3sleep20-21swapper/220:25:072
1426537240,3sleep20-21swapper/220:25:072
1382984240,1sleep20-21swapper/219:50:112
1382047240,2sleep20-21swapper/219:45:282
1379280240,2sleep10-21swapper/119:45:231
1336376240,2sleep11336613-21unixbench_singl19:10:241
1331071240,1sleep20-21swapper/219:10:132
1325059240,1sleep20-21swapper/219:05:152
1530556230,1sleep20-21swapper/221:40:052
1463888230,1sleep20-21swapper/220:55:082
1445336230,1sleep10-21swapper/120:40:081
1433161230,1sleep10-21swapper/120:30:141
1370568230,1sleep10-21swapper/119:40:131
1345887230,1sleep10-21swapper/119:20:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional