You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 18:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 23, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1728299998979,7cyclictest1828419-21latency_hist12:20:000
1728299998073,5cyclictest1778827-21kworker/u8:0+flush-179:010:25:240
1728299997973,5cyclictest1775432-21kworker/u8:2+flush-179:009:40:010
1728299997973,5cyclictest1775432-21kworker/u8:2+flush-179:009:40:000
1728299997971,6cyclictest1818621-21latency_hist11:50:010
1728299997971,6cyclictest1818621-21latency_hist11:50:000
1728299997872,5cyclictest1749448-21kworker/u8:0+flush-179:009:15:220
1728299997568,5cyclictest1737823-21kworker/u8:2+flush-179:008:20:170
1728303997463,5cyclictest1770686-21kworker/u8:3+events_unbound09:35:251
1728303997463,5cyclictest1770686-21kworker/u8:3+events_unbound09:35:251
1728303997264,5cyclictest1764051-21kworker/u8:1+events_unbound09:35:001
1728303997262,7cyclictest1760574-21apt-get08:50:011
1728299997265,4cyclictest1732956-21kworker/u8:0+events_unbound07:50:010
1728303997157,12cyclictest1817582-21kworker/u8:2+flush-179:012:30:261
1728299997159,7cyclictest1818656-21kworker/u8:3+flush-179:012:20:150
1728299997064,4cyclictest1732956-21kworker/u8:0+flush-179:007:45:000
1728299996962,6cyclictest1810706-21kworker/u8:2+flush-179:011:35:220
1728299996958,8cyclictest1760562-21latency_hist08:50:010
1728299996761,4cyclictest1770686-21kworker/u8:3+flush-179:009:30:000
1728299996757,7cyclictest266-21systemd-journal11:21:170
1728303996659,5cyclictest1790037-21kworker/u8:2+flush-179:010:30:221
1728303996455,6cyclictest1732976-21latency_hist07:25:011
1728299996456,5cyclictest1810706-21kworker/u8:2+flush-179:011:35:010
1728299996455,7cyclictest1832186-21gpgv12:30:010
1728303996257,3cyclictest1778827-21kworker/u8:0+events_unbound10:00:011
1728303996255,5cyclictest1784956-21latency_hist10:05:001
1728303996154,6cyclictest1801348-21/usr/sbin/munin10:55:251
1728303996153,6cyclictest266-21systemd-journal10:30:011
1728303996149,10cyclictest1758731-21apt-get08:45:001
1728299996153,7cyclictest1815687-21kworker/u8:1+flush-179:011:50:170
1728303996053,5cyclictest1804353-21kworker/u8:3+flush-179:011:20:261
1728299996055,3cyclictest1778827-21kworker/u8:0+flush-179:010:20:180
1728299996053,5cyclictest1818656-21kworker/u8:3+events_unbound12:15:010
1728299996053,5cyclictest1818656-21kworker/u8:3+events_unbound12:15:010
1728299996051,5cyclictest1753713-21kworker/u8:3+flush-179:008:55:210
1728299996050,8cyclictest1730018-21/usr/sbin/munin07:15:210
1728303995949,7cyclictest1770620-21latency_hist09:20:011
1728303995948,9cyclictest1822069-21apt-get12:00:131
1728305995855,2cyclictest0-21swapper/210:35:582
1728299995852,4cyclictest1753713-21kworker/u8:3+flush-179:008:40:000
1728299995752,4cyclictest1784990-21kworker/u8:3+events_unbound10:10:130
1728299995750,5cyclictest1749448-21kworker/u8:0+flush-179:009:05:250
1728299995749,5cyclictest1778827-21kworker/u8:0+flush-179:010:50:220
172830399561,11cyclictest1830538-21apt-get12:25:131
1728299995649,4cyclictest1760574-21apt-get08:50:030
1728303995540,13cyclictest1817582-21kworker/u8:2+flush-179:012:00:011
1728299995550,4cyclictest1817582-21kworker/u8:2+flush-179:012:00:200
1728299995547,6cyclictest1789380-21kworker/u8:1+events_unbound10:15:250
172830399540,1cyclictest0-21swapper/107:52:591
1728299995348,4cyclictest1722367-21kworker/u8:2+events_unbound07:20:250
1728303995246,4cyclictest1770686-21kworker/u8:3+flush-179:009:40:161
1728303995244,6cyclictest266-21systemd-journal07:37:161
1728303995243,6cyclictest510-21rs:main1
1728303995243,6cyclictest510-21rs:main1
172830399520,51cyclictest0-21swapper/110:10:591
1728299995246,4cyclictest1778827-21kworker/u8:0+flush-179:011:40:170
1728299995242,7cyclictest1744124-21latency_hist08:00:000
1728299995242,7cyclictest1744124-21latency_hist08:00:000
1728299995147,3cyclictest1817582-21kworker/u8:2+flush-179:011:55:220
1728303995040,7cyclictest1737823-21kworker/u8:2+flush-179:007:40:211
1728303995033,16cyclictest0-21swapper/108:03:581
1728303994941,6cyclictest1818656-21kworker/u8:3+flush-179:012:05:241
1728299994943,5cyclictest1762385-21kworker/u8:2+events_unbound09:00:250
1728299994942,5cyclictest1780212-21kworker/u8:1+flush-179:009:50:140
1728299994942,5cyclictest1733010-21kworker/u8:1+flush-179:007:30:260
1728299994940,8cyclictest1741203-21apt-get07:50:100
1728299994838,8cyclictest1767196-21apt-get09:10:030
4577091470,13ptp4l441ktimers/307:10:003
1728303994743,3cyclictest1737823-21kworker/u8:2+flush-179:007:45:261
1728303994728,18cyclictest1812950-21hwlatdetect11:30:171
1728303994726,19cyclictest0-21swapper/108:50:031
1728299994742,4cyclictest484-21dbus-daemon12:10:010
1728299994741,5cyclictest1744109-21kworker/u8:1+events_unbound08:05:240
1728308994639,5cyclictest1789988-21turbostat10:20:013
1728303994639,5cyclictest1789979-21latency_hist10:20:011
1728303994617,11cyclictest1764271-21apt-get09:00:141
172830399461,43cyclictest1-21systemd09:25:001
1728303994532,11cyclictest0-21swapper/108:40:001
1728303994527,16cyclictest714-21Xorg09:11:591
1728303994525,18cyclictest0-21swapper/107:30:141
172830399450,28cyclictest714-21Xorg12:22:591
1728303994425,18cyclictest1805923-21systemd-run11:10:011
1728303994424,19cyclictest1752096-21munin-run08:25:011
1728303994423,3cyclictest1734559-21cron07:30:001
1728299994440,3cyclictest1807492-21grep11:15:010
172830599430,41cyclictest0-21swapper/207:51:592
172830599430,35cyclictest0-21swapper/211:45:582
172830599430,35cyclictest0-21swapper/211:45:582
1728303994336,5cyclictest1817056-21turbostat11:49:561
1728303994336,5cyclictest1817056-21turbostat11:49:551
1728303994336,5cyclictest1764004-21latency_hist09:00:011
1728303994335,6cyclictest1729306-21journal-offline07:10:251
1728303994332,8cyclictest1749448-21kworker/u8:0+flush-179:008:30:211
1728303994323,2cyclictest0-21swapper/108:25:141
172830399430,41cyclictest1-21systemd11:15:011
1728299994338,4cyclictest1794785-21kworker/u8:3+events_unbound10:40:230
1728299994237,3cyclictest1802698-21sendmail11:00:000
1728299994233,7cyclictest1785211-21apt-get10:05:120
172830899410,5cyclictest1780186-21turbostat09:50:003
172830899410,39cyclictest1786550-21turbostat10:10:003
1728303994138,2cyclictest714-21Xorg11:42:591
1728303994136,4cyclictest1778827-21kworker/u8:0+flush-179:009:55:001
1728303994134,5cyclictest1747322-21turbostat08:14:551
1728299994136,3cyclictest714-21Xorg11:09:590
1728299994135,4cyclictest1789380-21kworker/u8:1+events_unbound11:00:150
1728299994134,6cyclictest1833726-21turbostat12:39:550
1728299994134,5cyclictest1810706-21kworker/u8:2+events_unbound11:25:210
1728299994134,5cyclictest1780212-21kworker/u8:1+flush-179:010:00:210
1728299994131,8cyclictest1756876-21apt-get08:40:030
1728299994129,10cyclictest0-21swapper/008:20:000
1728308994034,5cyclictest1812271-21turbostat11:29:593
172830899400,5cyclictest1783361-21turbostat10:00:013
172830899400,39cyclictest1828433-21turbostat12:19:593
172830899400,39cyclictest1770627-21turbostat09:20:003
1728303994035,3cyclictest1835358-21systemd-run12:40:001
172830399400,1cyclictest0-21swapper/109:06:591
1728299994036,3cyclictest1796344-21munin-run10:40:000
1728299994031,6cyclictest1778827-21kworker/u8:0+flush-179:009:55:200
1728299994029,9cyclictest1793419-21apt-get10:30:110
172829999401,3cyclictest714-21Xorg09:46:590
1728308993936,2cyclictest0-21swapper/310:35:593
172830899390,4cyclictest1809071-21turbostat11:20:013
172830899390,4cyclictest1755277-21turbostat08:35:003
172830899390,4cyclictest1748905-21turbostat08:15:003
172830899390,38cyclictest1821807-21turbostat12:00:003
172830899390,38cyclictest1750497-21turbostat08:20:003
172830899390,37cyclictest1799534-21turbostat10:50:003
1728305993933,5cyclictest0-21swapper/212:37:592
1728303993934,3cyclictest714-21Xorg10:51:591
1728303993932,5cyclictest1750514-21perf08:20:001
1728303993930,7cyclictest1784990-21kworker/u8:3+flush-179:010:10:001
1728299993933,5cyclictest1778827-21kworker/u8:0+flush-179:011:15:210
172830899380,4cyclictest1737770-21turbostat07:40:003
1728305993835,2cyclictest0-21swapper/211:25:002
172830599380,35cyclictest0-21swapper/208:53:592
1728303993819,3cyclictest0-21swapper/112:15:241
172830399381,36cyclictest1826597-21basename12:15:011
172830399381,36cyclictest1826597-21basename12:15:001
172830399380,37cyclictest0-21swapper/111:04:581
1728299993835,2cyclictest0-21swapper/008:13:590
1728299993833,4cyclictest1752627-21kworker/u8:1+flush-179:008:25:250
172829999380,37cyclictest0-21swapper/008:30:590
1728305993734,2cyclictest0-21swapper/211:44:002
172830599370,35cyclictest0-21swapper/212:28:592
172830599370,35cyclictest0-21swapper/211:28:592
172830599370,35cyclictest0-21swapper/210:13:002
172830599370,35cyclictest0-21swapper/209:54:592
172830599370,35cyclictest0-21swapper/209:01:002
1728303993733,2cyclictest714-21Xorg10:35:581
1728299993732,4cyclictest1732956-21kworker/u8:0+flush-179:007:25:150
1728305993633,2cyclictest0-21swapper/209:33:592
1728305993633,2cyclictest0-21swapper/209:17:002
1728305993628,6cyclictest0-21swapper/212:17:582
172830599360,1cyclictest0-21swapper/211:05:592
1728303993629,5cyclictest1804353-21kworker/u8:3+flush-179:011:20:001
1728299993629,5cyclictest1749448-21kworker/u8:0+events_unbound09:25:000
1728299993629,5cyclictest1728208-21kworker/u8:1+events_unbound07:10:020
1728308993532,2cyclictest0-21swapper/310:28:593
1728305993532,2cyclictest0-21swapper/212:00:582
172830599350,1cyclictest0-21swapper/212:34:552
1728303993532,2cyclictest0-21swapper/110:49:561
1728303993530,4cyclictest1764051-21kworker/u8:1+flush-179:009:25:181
1728308993432,1cyclictest0-21swapper/307:44:553
1728305993431,2cyclictest0-21swapper/209:44:562
1728305993431,2cyclictest0-21swapper/208:24:552
1728303993431,2cyclictest714-21Xorg10:23:581
1728299993428,4cyclictest1778827-21kworker/u8:0+flush-179:010:50:000
1728308993331,1cyclictest0-21swapper/307:59:553
1728308993331,1cyclictest0-21swapper/307:59:553
172830599330,31cyclictest0-21swapper/207:42:592
1728299993329,3cyclictest1732956-21kworker/u8:0+flush-179:007:35:210
1728308993230,1cyclictest0-21swapper/312:14:553
1728308993230,1cyclictest0-21swapper/312:14:553
1728308993230,1cyclictest0-21swapper/308:42:593
1728305993229,2cyclictest0-21swapper/210:44:002
1728303993227,4cyclictest1820254-21latency_hist11:55:001
1728303993226,5cyclictest1770686-21kworker/u8:3+events_unbound09:49:591
1728303993225,6cyclictest1722367-21kworker/u8:2+flush-179:007:15:201
1728303993224,5cyclictest0-21swapper/111:26:001
1728299993228,3cyclictest1833752-21systemd-run12:35:000
1728299993227,3cyclictest1729405-21mailstats07:10:260
172829999320,1cyclictest0-21swapper/009:40:120
1728308993129,1cyclictest0-21swapper/312:27:593
1728308993129,1cyclictest0-21swapper/312:24:553
1728308993129,1cyclictest0-21swapper/311:39:563
1728308993129,1cyclictest0-21swapper/309:02:583
172830599310,2cyclictest0-21swapper/211:14:542
172830599310,2cyclictest0-21swapper/208:11:592
172830599310,27cyclictest0-21swapper/212:05:132
1728303993125,4cyclictest1815433-21latency_hist11:40:011
1728299993124,5cyclictest1770686-21kworker/u8:3+events_unbound09:30:270
1728308993028,1cyclictest0-21swapper/308:09:553
1728308993027,2cyclictest0-21swapper/308:50:143
1728305993027,2cyclictest0-21swapper/211:04:552
1728305993027,2cyclictest0-21swapper/210:24:562
172830399300,28cyclictest714-21Xorg08:06:591
1728308992927,1cyclictest0-21swapper/312:30:023
1728308992927,1cyclictest0-21swapper/312:05:143
1728308992923,4cyclictest1740961-21turbostat07:50:003
1728305992926,2cyclictest0-21swapper/212:20:012
1728305992926,2cyclictest0-21swapper/208:45:022
1728305992926,2cyclictest0-21swapper/208:00:592
1728305992926,2cyclictest0-21swapper/207:20:142
1728305992925,2cyclictest0-21swapper/207:55:142
1728305992925,2cyclictest0-21swapper/207:55:132
172830599290,2cyclictest0-21swapper/212:13:592
172830599290,2cyclictest0-21swapper/212:13:582
172830599290,27cyclictest0-21swapper/211:55:132
172830599290,27cyclictest0-21swapper/209:20:122
172830599290,27cyclictest0-21swapper/209:05:152
172830599290,27cyclictest0-21swapper/207:15:122
1728308992826,1cyclictest0-21swapper/309:24:553
1728308992825,2cyclictest0-21swapper/311:45:593
1728308992825,2cyclictest0-21swapper/311:45:583
172830899280,27cyclictest0-21swapper/310:24:593
172830899280,27cyclictest0-21swapper/307:15:113
172830899280,26cyclictest0-21swapper/312:35:143
172830899280,26cyclictest0-21swapper/311:40:133
172830899280,26cyclictest0-21swapper/307:25:113
172830899280,21cyclictest0-21swapper/311:00:133
172830899280,1cyclictest0-21swapper/309:05:153
1728305992825,2cyclictest0-21swapper/211:30:582
172830599280,2cyclictest0-21swapper/207:25:122
172830599280,26cyclictest0-21swapper/208:35:132
1728299992824,3cyclictest1737823-21kworker/u8:2+flush-179:008:01:380
1728308992725,1cyclictest0-21swapper/309:40:593
172830899270,26cyclictest0-21swapper/311:08:593
172830899270,26cyclictest0-21swapper/310:44:003
172830899270,26cyclictest0-21swapper/307:20:143
172830899270,1cyclictest0-21swapper/311:10:133
172830899270,1cyclictest0-21swapper/307:50:123
1728305992724,2cyclictest0-21swapper/210:51:582
172830599270,25cyclictest0-21swapper/211:16:582
172830599270,24cyclictest0-21swapper/209:56:582
172830599270,1cyclictest0-21swapper/211:35:182
1728305992623,2cyclictest0-21swapper/208:40:592
1728308992523,1cyclictest0-21swapper/308:55:593
1728308992523,1cyclictest0-21swapper/308:04:553
1728308992522,2cyclictest0-21swapper/309:33:593
172830899250,2cyclictest0-21swapper/311:51:593
172830899250,24cyclictest0-21swapper/309:52:583
172830899250,24cyclictest0-21swapper/307:31:373
1728305992523,1cyclictest0-21swapper/209:15:002
172830599250,2cyclictest0-21swapper/210:30:122
172830599250,24cyclictest0-21swapper/207:30:062
172830599250,23cyclictest0-21swapper/209:30:002
1728303992520,4cyclictest1728400-21latency_hist07:10:031
1728303992520,4cyclictest0-21swapper/110:40:221
4577091240,3ptp4l61490irq/134-eno1-TxRx-010:35:003
4577091240,3ptp4l61490irq/134-eno1-TxRx-009:30:013
4577091240,3ptp4l441ktimers/310:05:003
1728308992422,1cyclictest0-21swapper/308:35:593
1728308992422,1cyclictest0-21swapper/307:10:183
1728305992421,2cyclictest0-21swapper/207:10:152
172830599240,1cyclictest0-21swapper/207:35:122
4577091230,3ptp4l61490irq/134-eno1-TxRx-012:04:553
4577091230,3ptp4l61490irq/134-eno1-TxRx-010:54:563
4577091230,3ptp4l441ktimers/310:59:573
4577091230,3ptp4l441ktimers/310:14:593
4577091230,3ptp4l441ktimers/309:14:563
1728308992321,1cyclictest0-21swapper/308:49:553
1728305992320,2cyclictest0-21swapper/210:09:552
1728305992320,2cyclictest0-21swapper/209:35:592
1728305992320,2cyclictest0-21swapper/209:35:592
4577091220,3ptp4l61490irq/134-eno1-TxRx-011:35:013
4577091220,3ptp4l61490irq/134-eno1-TxRx-011:24:563
4577091220,3ptp4l441ktimers/309:39:563
4577091220,3ptp4l441ktimers/309:39:553
4577091220,3ptp4l441ktimers/308:29:563
4577091220,3ptp4l441ktimers/308:24:563
1728305992219,2cyclictest0-21swapper/210:16:582
1728305992119,1cyclictest0-21swapper/208:09:592
1728305992018,1cyclictest0-21swapper/210:59:592
1728305992017,2cyclictest0-21swapper/210:04:562
1728305991915,2cyclictest0-21swapper/208:25:142
1728305991913,2cyclictest0-21swapper/207:49:552
1728305991815,2cyclictest0-21swapper/210:29:002
1728305991814,2cyclictest0-21swapper/209:48:592
1728305991813,3cyclictest1820223-21turbostat11:55:002
1728305991713,2cyclictest0-21swapper/210:49:562
172830599129,2cyclictest0-21swapper/208:16:592
172830599119,1cyclictest0-21swapper/209:00:002
17283059972,3cyclictest1753697-21turbostat08:34:552
17283059940,1cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional