You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 22:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Sat Dec 20, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1664033998071,7cyclictest1738012-21latency_hist11:00:010
1664035997968,8cyclictest266-21systemd-journal11:30:011
1664033997867,8cyclictest1729821-21kworker/u8:2+flush-179:011:05:000
1664035997768,6cyclictest1718645-21latency_hist10:00:001
1664033997772,4cyclictest1755749-21kworker/u8:1+events_unbound11:55:250
1664035997568,4cyclictest1734829-21latency_hist10:50:021
1664033997567,6cyclictest1750742-21latency_hist11:40:000
1664033997463,7cyclictest1722892-21kworker/u8:1+flush-179:010:15:260
1664035997364,7cyclictest1696617-21/usr/sbin/munin08:50:251
1664035997349,21cyclictest1726617-21latency_hist10:25:001
1664033996964,4cyclictest1699537-21kworker/u8:0+flush-179:009:05:170
1664033996962,4cyclictest1663634-21kworker/u8:1+events_unbound07:30:230
1664035996846,20cyclictest1667379-21apt-get07:20:131
1664035996840,16cyclictest1710730-21kworker/u8:3+flush-179:010:30:011
1664033996862,4cyclictest1678883-21kworker/u8:0+flush-179:007:55:180
1664033996859,6cyclictest1707556-21kworker/u8:1+flush-179:010:00:010
1664033996760,5cyclictest1688205-21kworker/u8:2+flush-179:008:30:180
1664033996760,5cyclictest1688205-21kworker/u8:2+flush-179:008:30:180
1664033996755,7cyclictest1699537-21kworker/u8:0+flush-179:009:20:200
1664035996656,7cyclictest510-21rs:main1
1664033996657,7cyclictest1721837-21latency_hist10:10:010
1664033996561,3cyclictest1673609-21kworker/u8:0+flush-179:007:40:170
1664035996451,12cyclictest1699537-21kworker/u8:0+flush-179:009:20:221
1664033996357,5cyclictest1676748-21kworker/u8:1+flush-179:008:00:260
1664033996357,5cyclictest1676748-21kworker/u8:1+flush-179:008:00:250
1664033996357,4cyclictest1691379-21kworker/u8:3+flush-179:008:35:190
1664033996356,5cyclictest1699829-21apt-get09:00:110
1664033996356,5cyclictest1685212-21kworker/u8:1+flush-179:008:30:010
1664033996354,6cyclictest1732623-21kworker/u8:0+flush-179:010:50:240
1664033996256,4cyclictest1736449-21kworker/u8:1+flush-179:011:20:000
1664033996154,5cyclictest1699537-21kworker/u8:0+flush-179:009:15:270
1664033996054,4cyclictest1678883-21kworker/u8:0+flush-179:008:15:210
1664033995954,4cyclictest1685212-21kworker/u8:1+flush-179:008:50:180
1664033995853,3cyclictest1667137-21kworker/u8:2+events_unbound07:25:200
1664033995850,6cyclictest1739590-21kworker/u8:3+flush-179:011:10:210
1664033995850,6cyclictest1736449-21kworker/u8:1+flush-179:011:30:210
1664033995850,6cyclictest1688170-21latency_hist08:25:010
1664040995750,5cyclictest1691357-21turbostat08:35:003
1664040995750,5cyclictest1691357-21turbostat08:34:593
1664033995751,4cyclictest1761911-21kworker/u8:3+flush-179:012:15:180
1664033995749,6cyclictest1744930-21kworker/u8:2+flush-179:011:20:170
1664035995647,7cyclictest1726854-21kworker/u8:0+flush-179:010:35:001
1664033995649,5cyclictest1755749-21kworker/u8:1+flush-179:012:35:140
1664033995551,3cyclictest1722892-21kworker/u8:1+flush-179:010:10:220
1664033995549,4cyclictest1707556-21kworker/u8:1+flush-179:009:45:220
1664033995548,5cyclictest1731384-21latency_hist10:40:010
1664033995548,4cyclictest1691379-21kworker/u8:3+flush-179:009:10:180
1664035995447,5cyclictest1744930-21kworker/u8:2+flush-179:011:25:001
1664035995439,13cyclictest1688205-21kworker/u8:2+flush-179:008:30:271
1664035995439,13cyclictest1688205-21kworker/u8:2+flush-179:008:30:261
1664033995447,5cyclictest1766655-21latency_hist12:30:000
1664035995346,5cyclictest1755749-21kworker/u8:1+flush-179:012:40:001
1664035995342,9cyclictest1736672-21apt-get10:55:141
1664035995247,3cyclictest1691379-21kworker/u8:3+flush-179:009:15:101
1664035995144,5cyclictest266-21systemd-journal11:15:091
1664035995142,8cyclictest266-21systemd-journal11:52:091
1664033995146,4cyclictest1733121-21kworker/u8:3+flush-179:010:45:220
1664033995146,3cyclictest1710730-21kworker/u8:3+flush-179:010:20:240
1664033995146,3cyclictest1676748-21kworker/u8:1+flush-179:007:50:250
1664033995143,6cyclictest1729821-21kworker/u8:2+flush-179:010:40:200
1664035995040,8cyclictest1735085-21apt-get10:50:131
1664033995045,4cyclictest1736449-21kworker/u8:1+events_unbound11:25:240
1664033995042,6cyclictest1663634-21kworker/u8:1+flush-179:007:25:000
4577091490,13ptp4l441ktimers/307:10:013
1664035994942,5cyclictest1761876-21latency_hist12:15:011
1664035994938,10cyclictest0-21swapper/111:04:551
1664035994931,17cyclictest1732623-21kworker/u8:0+events_unbound10:40:271
1664033994944,4cyclictest1726854-21kworker/u8:0+flush-179:010:25:170
1664033994944,4cyclictest1671863-21kworker/u8:3+events_unbound07:45:260
1664035994827,19cyclictest714-21Xorg09:06:001
1664035994739,6cyclictest1753933-21latency_hist11:50:011
1664035994738,7cyclictest1717058-21latency_hist09:55:011
166403599470,36cyclictest0-21swapper/112:24:551
166403599470,28cyclictest0-21swapper/109:40:161
1664033994745,1cyclictest1760528-21kworker/u8:2+events_unbound12:20:230
1664033994741,5cyclictest1750993-21kworker/u8:0+events_unbound11:40:260
1664033994741,4cyclictest1752329-21kworker/u8:3+flush-179:011:50:000
1664033994736,9cyclictest1715728-21apt-get09:50:160
1664040994643,2cyclictest0-21swapper/309:41:583
1664033994637,7cyclictest1707556-21kworker/u8:1+flush-179:009:35:200
1664035994536,7cyclictest1679954-21latency_hist08:00:011
1664035994438,4cyclictest1736449-21kworker/u8:1+flush-179:011:35:001
1664035994434,8cyclictest1749405-21apt-get11:35:131
1664035994431,11cyclictest0-21swapper/108:20:011
1664035994424,18cyclictest0-21swapper/109:50:001
1664033994439,4cyclictest1705339-21kworker/u8:2+flush-179:009:25:230
1664033994438,5cyclictest1691379-21kworker/u8:3+flush-179:008:55:160
1664033994436,6cyclictest1683647-21apt-get08:10:130
1664035994338,3cyclictest1701197-21systemd-run09:05:001
1664035994324,17cyclictest714-21Xorg08:28:581
1664035994324,17cyclictest714-21Xorg07:46:591
1664033994338,4cyclictest1663634-21kworker/u8:1+flush-179:007:15:140
1664033994336,5cyclictest1694535-21latency_hist08:45:010
1664033994336,5cyclictest1683163-21http08:10:000
1664033994334,6cyclictest1754161-21kworker/u8:0+flush-179:012:10:240
1664035994236,5cyclictest1683153-21kworker/u8:3+flush-179:008:10:001
1664035994222,18cyclictest0-21swapper/111:10:001
1664035994221,19cyclictest0-21swapper/107:15:001
1664033994237,4cyclictest1710730-21kworker/u8:3+flush-179:010:00:220
1664038994138,2cyclictest0-21swapper/209:27:002
1664035994132,6cyclictest0-21swapper/112:28:591
1664035994120,19cyclictest0-21swapper/111:10:231
1664035994115,4cyclictest1692786-21unixbench-2d08:35:281
166403599411,38cyclictest714-21Xorg07:41:001
1664033994136,4cyclictest1765551-21kworker/u8:0+flush-179:012:30:190
1664033994135,5cyclictest1754161-21kworker/u8:0+flush-179:012:00:220
1664033994135,5cyclictest1667137-21kworker/u8:2+flush-179:007:35:230
1664033994135,5cyclictest1667137-21kworker/u8:2+flush-179:007:35:230
1664033994134,5cyclictest1736449-21kworker/u8:1+events_unbound11:05:210
166404099400,5cyclictest1667136-21turbostat07:20:003
166404099400,39cyclictest1749159-21turbostat11:35:003
1664038994038,1cyclictest0-21swapper/212:15:002
1664035994036,2cyclictest714-21Xorg12:34:591
1664033994037,2cyclictest0-21swapper/007:12:590
166404099390,4cyclictest1750749-21turbostat11:40:003
166404099390,4cyclictest1725025-21turbostat10:19:593
166403899390,36cyclictest0-21swapper/209:25:002
1664035993935,3cyclictest0-21swapper/109:26:001
1664035993918,2cyclictest1696130-21ls08:50:011
1664033993932,5cyclictest1705339-21kworker/u8:2+events_unbound09:30:220
166403399391,10cyclictest1728461-21apt-get10:30:150
1664035993835,2cyclictest714-21Xorg07:39:591
1664035993835,2cyclictest714-21Xorg07:39:581
1664035993830,6cyclictest1693190-21/usr/sbin/munin08:40:231
1664035993816,3cyclictest0-21swapper/110:35:201
1664035993816,3cyclictest0-21swapper/108:15:001
1664033993832,5cyclictest1710730-21kworker/u8:3+events_unbound09:40:140
1664040993734,2cyclictest0-21swapper/311:53:593
166404099370,36cyclictest0-21swapper/310:27:583
166404099370,35cyclictest0-21swapper/307:51:593
1664038993734,2cyclictest0-21swapper/210:16:002
166403899370,35cyclictest0-21swapper/209:35:592
166403899370,35cyclictest0-21swapper/208:11:002
166403899370,35cyclictest0-21swapper/208:02:592
166403899370,35cyclictest0-21swapper/208:02:592
166403899370,35cyclictest0-21swapper/207:58:592
166403899370,30cyclictest0-21swapper/212:32:592
1664035993733,3cyclictest1704342-21munin-run09:15:011
1664035993730,4cyclictest1698222-21apt-get08:55:151
1664035993716,3cyclictest0-21swapper/107:25:281
1664035993715,18cyclictest0-21swapper/112:19:591
4577091360,28ptp4l441ktimers/311:10:143
1664040993634,1cyclictest0-21swapper/309:56:003
1664040993634,1cyclictest0-21swapper/308:59:563
166404099360,35cyclictest0-21swapper/307:33:583
166404099360,2cyclictest0-21swapper/309:15:593
1664038993634,1cyclictest0-21swapper/212:29:592
1664038993634,1cyclictest0-21swapper/212:25:012
1664038993634,1cyclictest0-21swapper/210:35:002
1664038993633,2cyclictest0-21swapper/211:18:002
1664038993633,2cyclictest0-21swapper/210:01:002
166403899360,1cyclictest0-21swapper/209:13:582
166403899360,1cyclictest0-21swapper/209:09:002
166403899360,1cyclictest0-21swapper/207:15:592
1664035993631,4cyclictest271rcuc/112:03:591
1664035993617,2cyclictest0-21swapper/107:15:241
166403599361,33cyclictest1757158-21munin-run12:00:011
1664033993631,4cyclictest1754161-21kworker/u8:0+flush-179:012:09:540
1664040993533,1cyclictest0-21swapper/311:55:593
166404099350,1cyclictest0-21swapper/308:14:553
166404099350,1cyclictest0-21swapper/307:43:003
166403899350,1cyclictest0-21swapper/211:40:592
166403899350,1cyclictest0-21swapper/210:11:582
166403899350,1cyclictest0-21swapper/209:00:592
166403899350,1cyclictest0-21swapper/208:55:002
1664035993530,3cyclictest1671911-21systemd-run07:35:011
1664035993527,6cyclictest1722892-21kworker/u8:1+events_unbound10:15:251
1664035993524,9cyclictest266-21systemd-journal09:35:011
1664035993524,9cyclictest1718903-21/usr/sbin/munin10:00:231
1664033993530,3cyclictest1748553-21kworker/u8:2+flush-179:011:50:260
231999340,11rtkit-daemon685-21snmpd09:35:221
1664038993432,1cyclictest0-21swapper/208:25:002
1664038993431,2cyclictest0-21swapper/207:49:592
166403599342,9cyclictest2304-21lightdm-gtk-gre10:09:001
1664035993429,3cyclictest0-21swapper/111:40:141
1664035993425,7cyclictest1686841-21apt-get08:20:131
166403599342,29cyclictest1680214-21apt-get08:00:151
166403599342,29cyclictest1680214-21apt-get08:00:151
166403599342,28cyclictest1677021-21apt-get07:50:151
1664033993429,4cyclictest1685212-21kworker/u8:1+flush-179:008:45:150
1664040993331,1cyclictest0-21swapper/312:06:593
1664035993321,11cyclictest0-21swapper/112:09:551
1664040993230,1cyclictest0-21swapper/308:45:583
1664038993228,2cyclictest0-21swapper/208:20:002
166404099313,27cyclictest0-21swapper/308:50:153
1664040993129,1cyclictest0-21swapper/308:24:003
166404099302,26cyclictest0-21swapper/309:50:173
166404099301,26cyclictest0-21swapper/310:40:143
166404099300,29cyclictest0-21swapper/309:00:133
1664038993028,1cyclictest0-21swapper/211:55:002
1664038993028,1cyclictest0-21swapper/207:29:592
1664038993027,2cyclictest0-21swapper/210:05:142
1664038993027,2cyclictest0-21swapper/208:36:592
1664038993027,2cyclictest0-21swapper/207:42:002
1664038993026,2cyclictest0-21swapper/210:40:002
4577091290,7ptp4l441ktimers/310:50:003
4577091290,6ptp4l441ktimers/311:30:013
4577091290,6ptp4l441ktimers/308:30:013
166404099290,27cyclictest0-21swapper/312:25:143
166404099290,27cyclictest0-21swapper/308:35:163
166404099290,27cyclictest0-21swapper/308:15:123
1664038992927,1cyclictest0-21swapper/209:49:552
1664038992926,2cyclictest0-21swapper/212:00:132
1664038992926,2cyclictest0-21swapper/210:29:552
166403899290,27cyclictest0-21swapper/212:15:142
166403899290,27cyclictest0-21swapper/210:20:162
166403899290,27cyclictest0-21swapper/209:55:132
4577091280,7ptp4l61490irq/134-eno1-TxRx-007:25:003
4577091280,7ptp4l441ktimers/309:40:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-012:05:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-011:50:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-011:45:003
4577091280,6ptp4l441ktimers/312:40:013
4577091280,6ptp4l441ktimers/311:09:553
4577091280,6ptp4l441ktimers/310:55:013
4577091280,6ptp4l441ktimers/309:49:563
4577091280,6ptp4l441ktimers/309:35:003
4577091280,6ptp4l441ktimers/309:09:553
1664040992826,1cyclictest0-21swapper/310:38:593
1664040992826,1cyclictest0-21swapper/308:00:153
1664040992826,1cyclictest0-21swapper/308:00:143
1664040992826,1cyclictest0-21swapper/307:25:173
166404099280,27cyclictest0-21swapper/310:00:133
166404099280,26cyclictest0-21swapper/309:25:143
1664038992826,1cyclictest0-21swapper/211:50:002
1664038992825,2cyclictest0-21swapper/211:05:132
1664038992825,2cyclictest0-21swapper/210:41:582
1664038992825,2cyclictest0-21swapper/209:40:172
166403899280,2cyclictest0-21swapper/210:55:152
166403899280,26cyclictest0-21swapper/210:45:022
166403899280,26cyclictest0-21swapper/208:28:592
166403899280,26cyclictest0-21swapper/207:30:162
166403899280,26cyclictest0-21swapper/207:20:152
4577091270,6ptp4l441ktimers/312:14:553
4577091270,6ptp4l441ktimers/308:45:003
4577091270,6ptp4l441ktimers/307:59:563
4577091270,5ptp4l441ktimers/310:14:573
4577091270,5ptp4l441ktimers/307:39:563
4577091270,5ptp4l441ktimers/307:39:563
1664040992725,1cyclictest0-21swapper/312:30:153
1664040992725,1cyclictest0-21swapper/311:20:133
1664040992725,1cyclictest0-21swapper/311:18:593
1664040992725,1cyclictest0-21swapper/310:22:593
1664040992725,1cyclictest0-21swapper/310:05:593
1664040992725,1cyclictest0-21swapper/309:11:593
166404099270,26cyclictest0-21swapper/308:06:593
1664038992724,2cyclictest0-21swapper/207:37:592
1664038992724,2cyclictest0-21swapper/207:37:582
166403899270,2cyclictest0-21swapper/209:17:582
166403899270,25cyclictest0-21swapper/208:34:592
166403899270,25cyclictest0-21swapper/208:34:592
166403899270,1cyclictest0-21swapper/208:07:582
166404099260,25cyclictest0-21swapper/312:18:593
166404099260,24cyclictest0-21swapper/307:10:173
166404099260,1cyclictest0-21swapper/309:21:003
1664038992623,2cyclictest0-21swapper/207:10:242
166403899260,2cyclictest0-21swapper/212:38:002
166403899260,2cyclictest0-21swapper/210:50:592
166403899260,24cyclictest0-21swapper/211:28:592
4577091250,4ptp4l441ktimers/310:34:563
1664040992523,1cyclictest0-21swapper/310:55:163
1664038992422,1cyclictest0-21swapper/211:00:152
1664038992421,2cyclictest0-21swapper/211:23:592
4577091230,4ptp4l61490irq/134-eno1-TxRx-011:04:553
231999230,14rtkit-daemon3203871-21ntpd07:07:241
1664040992321,1cyclictest0-21swapper/312:21:593
1664038992320,2cyclictest0-21swapper/211:33:592
1664038992319,2cyclictest0-21swapper/207:54:542
1664038992220,1cyclictest0-21swapper/212:00:012
1664038992220,1cyclictest0-21swapper/211:14:552
1664038992220,1cyclictest0-21swapper/208:59:592
1664038992119,1cyclictest0-21swapper/209:31:582
1664038992018,1cyclictest0-21swapper/212:09:552
1664038992018,1cyclictest0-21swapper/208:50:012
1664038991714,2cyclictest0-21swapper/209:51:592
4577091160,3ptp4l441ktimers/307:45:263
1664038991411,2cyclictest0-21swapper/208:43:002
166403399121,9cyclictest1664036-21cat07:10:020
16640389996,2cyclictest0-21swapper/211:35:442
16640389941,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional