You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 00:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Mon Jun 30, 2025 12:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164753999129,1cyclictest0-21swapper/312:30:153
1647539991210,2cyclictest1699445-21taskset09:20:223
1647539991210,1cyclictest0-21swapper/310:50:163
164753999120,1cyclictest0-21swapper/308:15:143
164753999120,11cyclictest0-21swapper/311:30:143
164753999120,11cyclictest0-21swapper/310:00:233
164753999120,11cyclictest0-21swapper/308:05:003
164753999120,11cyclictest0-21swapper/307:58:443
164753999120,11cyclictest0-21swapper/307:35:123
164753999120,10cyclictest0-21swapper/309:55:133
164753999119,1cyclictest0-21swapper/311:10:163
164753999119,1cyclictest0-21swapper/309:00:163
1647539991110,0cyclictest0-21swapper/309:15:243
1647539991110,0cyclictest0-21swapper/308:20:223
164753999110,1cyclictest0-21swapper/309:30:203
164753999110,11cyclictest0-21swapper/310:40:273
164753999110,11cyclictest0-21swapper/309:10:163
164753999110,10cyclictest0-21swapper/311:25:223
164753999110,10cyclictest0-21swapper/308:29:593
164753999110,0cyclictest0-21swapper/312:30:003
164753999109,0cyclictest0-21swapper/311:05:133
164753999108,0cyclictest0-21swapper/308:10:173
1647539991010,0cyclictest0-21swapper/312:20:183
1647539991010,0cyclictest0-21swapper/312:15:183
1647539991010,0cyclictest0-21swapper/310:45:163
1647539991010,0cyclictest0-21swapper/310:20:233
1647539991010,0cyclictest0-21swapper/309:45:223
1647539991010,0cyclictest0-21swapper/308:30:173
164753999100,9cyclictest0-21swapper/308:35:233
164753999100,10cyclictest0-21swapper/312:10:233
164753999100,0cyclictest0-21swapper/312:40:013
164753999100,0cyclictest0-21swapper/309:35:273
164753999100,0cyclictest0-21swapper/308:50:013
16475399999,0cyclictest0-21swapper/311:35:233
16475399999,0cyclictest0-21swapper/310:55:153
16475399999,0cyclictest0-21swapper/307:50:273
16475399998,0cyclictest0-21swapper/311:40:203
16475399990,8cyclictest0-21swapper/311:25:013
16475399990,8cyclictest0-21swapper/307:25:123
16475399990,8cyclictest0-21swapper/307:20:183
16475399988,0cyclictest0-21swapper/311:50:243
16475399988,0cyclictest0-21swapper/311:01:313
16475399988,0cyclictest0-21swapper/310:25:173
16475399980,7cyclictest0-21swapper/307:10:173
16475399980,0cyclictest0-21swapper/310:35:233
16475399980,0cyclictest0-21swapper/310:30:223
16475399980,0cyclictest0-21swapper/310:15:013
16475399977,0cyclictest0-21swapper/308:50:193
16475399970,0cyclictest0-21swapper/310:15:233
16475399970,0cyclictest0-21swapper/307:35:003
1646445271,4sleep30-21swapper/307:05:193
16475399966,0cyclictest0-21swapper/311:15:133
16475399966,0cyclictest0-21swapper/308:55:183
16475399966,0cyclictest0-21swapper/307:45:153
16475399960,6cyclictest0-21swapper/311:55:193
16475399955,0cyclictest0-21swapper/310:05:193
16475399955,0cyclictest0-21swapper/309:50:263
16475399955,0cyclictest0-21swapper/309:06:503
16475399955,0cyclictest0-21swapper/307:40:173
13989850,2rtkit-daemon331-21plymouthd07:05:172
13989850,2rtkit-daemon1692765-21apt-get09:05:162
13989850,0rtkit-daemon0-21swapper/207:45:322
16475399944,0cyclictest0-21swapper/312:04:093
16475399944,0cyclictest0-21swapper/308:07:493
16475399943,0cyclictest0-21swapper/312:05:133
16475399941,2cyclictest0-21swapper/309:25:153
16475399940,3cyclictest1760992-21chrt11:45:233
16475399940,3cyclictest1684074-21chrt08:40:243
16475399940,3cyclictest1650073-21chrt07:15:073
16475399940,2cyclictest0-21swapper/309:40:183
1647028242,1sleep10-21swapper/107:05:331
13989840,3rtkit-daemon760-21snmpd10:33:242
13989840,2rtkit-daemon760-21snmpd12:16:401
13989840,2rtkit-daemon760-21snmpd11:43:292
13989840,2rtkit-daemon1-21systemd09:23:012
13989840,2rtkit-daemon1-21systemd07:16:472
13989840,1rtkit-daemon1649571-21munin-node11:22:492
13989840,0rtkit-daemon0-21swapper/207:27:082
1781216230,1sleep11781242-21apt-get12:35:141
1779862230,2sleep01779970-21head12:30:210
1756506230,2sleep01756577-21pmu-power11:35:210
1715815230,2sleep11716042-21grep10:00:191
1713727231,1sleep11714000-21/usr/sbin/munin09:55:161
1647266231,1sleep00-21swapper/007:08:360
13989830,2rtkit-daemon613-21systemd-logind08:03:502
13989830,2rtkit-daemon1399-21sendmail-mta12:22:331
13989830,2rtkit-daemon1399-21sendmail-mta07:35:382
13989830,2rtkit-daemon1-21systemd11:15:442
13989830,1rtkit-daemon802-21gmain09:29:562
13989830,1rtkit-daemon762-21ntpd08:28:512
13989830,1rtkit-daemon762-21ntpd07:44:162
13989830,1rtkit-daemon760-21snmpd11:30:522
13989830,1rtkit-daemon760-21snmpd11:07:442
13989830,1rtkit-daemon760-21snmpd10:36:232
13989830,1rtkit-daemon760-21snmpd09:45:342
13989830,1rtkit-daemon600-21avahi-daemon09:55:032
13989830,1rtkit-daemon331-21plymouthd12:07:461
13989830,1rtkit-daemon331-21plymouthd12:00:552
13989830,1rtkit-daemon331-21plymouthd11:10:042
13989830,1rtkit-daemon331-21plymouthd10:47:152
13989830,1rtkit-daemon331-21plymouthd10:05:122
13989830,1rtkit-daemon331-21plymouthd10:00:232
13989830,1rtkit-daemon331-21plymouthd09:50:232
13989830,1rtkit-daemon331-21plymouthd09:39:322
13989830,1rtkit-daemon331-21plymouthd07:20:222
13989830,1rtkit-daemon1780104-21smartctl12:30:211
13989830,1rtkit-daemon1777590-21sort12:25:181
13989830,1rtkit-daemon1649571-21munin-node11:01:302
13989830,1rtkit-daemon1399-21sendmail-mta11:56:332
13989830,1rtkit-daemon1399-21sendmail-mta07:30:332
13989830,1rtkit-daemon1-21systemd12:12:151
13989830,1rtkit-daemon1-21systemd11:35:482
13989830,1rtkit-daemon1-21systemd11:29:412
13989830,1rtkit-daemon1-21systemd10:40:402
13989830,1rtkit-daemon1-21systemd10:10:082
13989830,1rtkit-daemon1-21systemd08:54:592
13989830,1rtkit-daemon1-21systemd08:20:472
13989830,1rtkit-daemon1-21systemd08:10:502
13989830,0rtkit-daemon0-21swapper/209:10:482
1781841220,1sleep01782000-21ntp_states12:35:210
1773065220,1sleep20-21swapper/212:15:182
1769020220,1sleep20-21swapper/212:05:252
1761393220,1sleep00-21swapper/011:46:220
1758894220,0sleep00-21swapper/011:40:210
1755383220,0sleep00-21swapper/011:33:570
1745921220,1sleep00-21swapper/011:10:230
1727985220,0sleep10-21swapper/110:30:021
1721946220,1sleep11721988-21basename10:15:171
1706081220,1sleep01706228-21/usr/sbin/munin09:35:250
1699569220,1sleep01699724-21ntp_states09:20:240
1694929220,1sleep00-21swapper/009:10:160
1694404220,1sleep11694418-21munin-run09:10:011
1675308220,1sleep11675564-21ls08:20:181
1667222220,1sleep11-21systemd08:00:001
1663288220,1sleep10-21swapper/107:48:441
1661724220,1sleep01661749-21apt07:45:140
13989820,1rtkit-daemon762-21ntpd08:55:182
13989820,1rtkit-daemon762-21ntpd07:10:532
13989820,1rtkit-daemon760-21snmpd07:55:122
13989820,1rtkit-daemon684-21gmain08:30:152
13989820,1rtkit-daemon436-21systemd-udevd10:55:512
13989820,1rtkit-daemon1649571-21munin-node10:50:042
13989820,1rtkit-daemon1399-21sendmail-mta08:15:332
13989820,1rtkit-daemon1-21systemd10:20:042
13989820,1rtkit-daemon1-21systemd09:00:222
13989820,1rtkit-daemon0-21swapper/209:40:082
13989820,0rtkit-daemon600-21avahi-daemon10:25:152
13989820,0rtkit-daemon331-21plymouthd11:50:132
13989820,0rtkit-daemon331-21plymouthd11:45:062
13989820,0rtkit-daemon0-21swapper/210:15:502
13989820,0rtkit-daemon0-21swapper/209:30:012
13989820,0rtkit-daemon0-21swapper/209:15:092
13989820,0rtkit-daemon0-21swapper/208:45:162
13989820,0rtkit-daemon0-21swapper/208:40:242
13989820,0rtkit-daemon0-21swapper/208:35:182
13989820,0rtkit-daemon0-21swapper/208:05:032
13989820,0rtkit-daemon0-21swapper/207:50:342
1781245210,0sleep20-21swapper/212:35:152
1779106210,0sleep20-21swapper/212:30:072
1778421210,0sleep00-21swapper/012:26:080
1777004210,0sleep20-21swapper/212:25:022
1775728210,0sleep20-21swapper/212:20:262
1772723210,0sleep00-21swapper/012:15:160
1771854210,0sleep20-21swapper/212:11:052
1770493210,0sleep01770611-21aten_r1power_po12:10:150
1770009210,0sleep00-21swapper/012:08:150
1767988210,0sleep10-21swapper/112:03:561
1767815210,0sleep00-21swapper/012:02:230
1765210210,0sleep00-21swapper/011:55:220
1764146210,0sleep10-21swapper/111:55:071
1762873210,0sleep10-21swapper/111:50:231
1762135210,0sleep00-21swapper/011:50:180
1760743210,0sleep10-21swapper/111:45:231
1759256210,0sleep10-21swapper/111:40:581
1755510210,0sleep10-21swapper/111:35:021
1752925210,0sleep10-21swapper/111:25:451
1751580210,0sleep00-21swapper/011:25:160
1750549210,0sleep10-21swapper/111:20:291
1749211210,1sleep00-21swapper/011:20:040
1747107210,0sleep10-21swapper/111:15:131
1747097210,0sleep00-21swapper/011:15:080
1746033210,0sleep10-21swapper/111:10:241
1744067210,0sleep00-21swapper/011:05:230
1743047210,0sleep10-21swapper/111:05:161
1742130210,0sleep10-21swapper/111:00:241
1740831210,0sleep00-21swapper/011:00:150
1738725210,1sleep00-21swapper/010:55:140
1738712210,0sleep10-21swapper/110:55:071
1738046210,0sleep00-21swapper/010:51:180
1737996210,0sleep10-21swapper/110:50:511
1735345210,0sleep10-21swapper/110:45:231
1735267210,0sleep00-21swapper/010:45:220
1732835210,0sleep10-21swapper/110:40:221
1732594210,0sleep00-21swapper/010:40:210
1730958210,0sleep00-21swapper/010:35:210
1730102210,0sleep10-21swapper/110:35:021
1728240210,0sleep00-21swapper/010:30:130
1726580210,0sleep00-21swapper/010:25:210
1725891210,0sleep10-21swapper/110:25:011
1724867210,0sleep00-21swapper/010:20:240
1724510210,0sleep10-21swapper/110:20:211
1722744210,1sleep00-21swapper/010:15:230
1721335210,0sleep10-21swapper/110:11:571
1720751210,0sleep00-21swapper/010:10:240
1719191210,0sleep00-21swapper/010:06:230
1717747210,0sleep10-21swapper/110:05:041
1714191210,0sleep00-21swapper/009:55:190
1712864210,0sleep00-21swapper/009:51:020
1710103210,0sleep00-21swapper/009:45:220
1709575210,0sleep10-21swapper/109:45:191
1708901210,0sleep00-21swapper/009:43:020
1707290210,0sleep10-21swapper/109:40:111
1706805210,0sleep10-21swapper/109:37:461
1703346210,0sleep00-21swapper/009:30:210
1702954210,0sleep10-21swapper/109:30:021
1702481210,0sleep10-21swapper/109:27:381
1701560210,0sleep00-21swapper/009:25:210
1698673210,0sleep10-21swapper/109:20:011
1697365210,0sleep00-21swapper/009:15:200
1696669210,0sleep10-21swapper/109:15:011
1694958210,0sleep10-21swapper/109:10:171
1692996210,0sleep00-21swapper/009:05:190
1690823210,0sleep10-21swapper/109:00:161
1689409210,0sleep00-21swapper/008:55:220
1688345210,0sleep00-21swapper/008:51:190
1686182210,1sleep00-21swapper/008:46:300
1684189210,0sleep00-21swapper/008:40:300
1681457210,0sleep10-21swapper/108:35:191
1681376210,0sleep00-21swapper/008:35:180
1679077210,0sleep10-21swapper/108:30:141
1676848210,0sleep00-21swapper/008:25:010
1676477210,0sleep00-21swapper/008:20:250
1673669210,0sleep10-21swapper/108:15:171
1673395210,0sleep00-21swapper/008:15:160
1671324210,0sleep00-21swapper/008:10:120
1669159210,0sleep10-21swapper/108:05:011
1667588210,0sleep10-21swapper/108:00:161
1666963210,0sleep00-21swapper/007:56:430
1665048210,0sleep10-21swapper/107:51:441
1665047210,1sleep00-21swapper/007:51:430
1660421210,0sleep10-21swapper/107:40:191
1660291210,0sleep00-21swapper/007:40:180
1657860210,0sleep00-21swapper/007:35:130
1657767210,0sleep1191rcu_preempt07:35:111
1656593210,0sleep00-21swapper/007:30:220
1655593210,0sleep00-21swapper/007:29:540
1652049210,0sleep00-21swapper/007:20:130
1648936210,0sleep00-21swapper/007:10:200
1774655200,0sleep00-21swapper/012:20:040
1753410200,0sleep10-21swapper/111:30:021
1715666200,0sleep00-21swapper/010:00:030
1711461200,0sleep10-21swapper/109:50:031
1690807200,0sleep00-21swapper/009:00:030
1688869200,0sleep10-21swapper/108:55:041
1686954200,0sleep10-21swapper/108:50:031
1684776200,0sleep10-21swapper/108:45:031
1682860200,0sleep10-21swapper/108:40:031
1678768200,0sleep00-21swapper/008:30:010
1677084200,0sleep10-21swapper/108:25:021
1671075200,0sleep10-21swapper/108:10:011
1669394200,0sleep00-21swapper/008:05:040
1667480200,0sleep00-21swapper/008:00:030
1655841200,0sleep10-21swapper/107:30:031
1653923200,0sleep10-21swapper/107:25:021
1652007200,0sleep10-21swapper/107:20:011
1650065200,0sleep10-21swapper/107:15:021
1649368200,0sleep00-21swapper/007:15:010
1647681200,0sleep10-21swapper/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional