You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 07:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 16, 2025 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1507284998878,7cyclictest1520172-21kworker/u8:3+flush-179:020:00:011
1507284997162,7cyclictest1533430-21/usr/sbin/munin20:30:251
1507283997164,5cyclictest1544813-21kworker/u8:0+flush-179:021:05:000
1507283996862,4cyclictest1507209-21kworker/u8:3+flush-179:019:20:010
1507283996862,4cyclictest1507209-21kworker/u8:3+flush-179:019:20:000
1507283996857,9cyclictest1581978-21apt-get22:57:370
1507283996761,4cyclictest1520172-21kworker/u8:3+flush-179:019:50:000
1507284996657,6cyclictest1533189-21latency_hist20:30:021
1507283996660,4cyclictest1601885-21kworker/u8:1+flush-179:000:25:160
1507283996659,5cyclictest1562402-21kworker/u8:2+flush-179:023:30:250
1507283996559,4cyclictest1537896-21kworker/u8:3+flush-179:020:50:010
1507283996458,4cyclictest1537896-21kworker/u8:3+events_unbound20:40:240
1507283996456,6cyclictest1609946-21latency_hist00:25:010
1507283996356,5cyclictest1576642-21kworker/u8:1+flush-179:022:50:000
1507284996253,7cyclictest1557596-21latency_hist21:45:011
1507283996252,8cyclictest266-21systemd-journal19:33:090
1507284996149,10cyclictest1513822-21apt-get19:30:131
1507283996155,4cyclictest1562402-21kworker/u8:2+events_unbound22:20:000
1507283996154,5cyclictest1613126-21latency_hist00:35:010
1507283996154,5cyclictest1613126-21latency_hist00:35:000
1507283996154,5cyclictest1562402-21kworker/u8:2+flush-179:022:10:270
1507283996152,7cyclictest1585482-21latency_hist23:10:010
1507283996054,4cyclictest1562402-21kworker/u8:2+events_unbound23:45:150
1507284995951,6cyclictest1562402-21kworker/u8:2+events_unbound23:50:011
1507283995953,4cyclictest1562615-21/usr/sbin/munin22:00:250
1507283995953,4cyclictest1562402-21kworker/u8:2+events_unbound23:50:250
1507283995952,4cyclictest1523535-21kworker/u8:0+flush-179:020:00:150
1507284995848,7cyclictest1601909-21latency_hist00:00:011
1507283995849,7cyclictest1507209-21kworker/u8:3+flush-179:019:35:260
1507284995647,6cyclictest1561006-21/usr/sbin/munin21:55:231
1507284995551,3cyclictest0-21swapper/123:05:591
1507284995546,7cyclictest266-21systemd-journal21:35:001
1507284995530,23cyclictest1511979-21latency_hist19:25:001
150728399551,51cyclictest1-21systemd21:35:000
1507283995448,4cyclictest1601885-21kworker/u8:1+flush-179:000:00:250
1507283995445,7cyclictest1540112-21kworker/u8:1+events_unbound21:00:000
1507284995341,9cyclictest1521778-21latency_hist19:55:011
1507283995349,3cyclictest1540112-21kworker/u8:1+flush-179:021:40:270
1507283995347,4cyclictest1525107-21kworker/u8:1+events_unbound20:10:010
1507283995347,4cyclictest1525107-21kworker/u8:1+events_unbound20:10:000
1507286995249,2cyclictest0-21swapper/221:31:002
1507284995245,5cyclictest1601975-21kworker/u8:3+flush-179:000:04:001
1507283995247,3cyclictest1562402-21kworker/u8:2+flush-179:023:00:170
1507284995142,7cyclictest1564204-21/usr/sbin/munin22:05:241
1507283995145,4cyclictest1601975-21kworker/u8:3+events_unbound00:05:240
1507284995045,3cyclictest1594710-21kworker/u8:0+flush-179:023:39:101
1507284995042,6cyclictest1576642-21kworker/u8:1+flush-179:022:45:161
1507284995031,18cyclictest1510367-21cron19:20:011
1507284995031,18cyclictest1510367-21cron19:20:011
1507283995045,4cyclictest1544813-21kworker/u8:0+flush-179:021:50:250
1507283995045,3cyclictest1544813-21kworker/u8:0+flush-179:021:40:000
1507283995043,5cyclictest1537896-21kworker/u8:3+flush-179:020:50:230
1507284994946,2cyclictest714-21Xorg21:38:001
1507284994935,11cyclictest1525107-21kworker/u8:1+events_unbound20:05:201
1507284994935,11cyclictest1525107-21kworker/u8:1+events_unbound20:05:201
1507283994943,4cyclictest1527260-21kworker/u8:0+flush-179:020:35:190
1507283994941,6cyclictest1545099-21/usr/sbin/munin21:05:220
1507284994841,5cyclictest1559180-21latency_hist21:50:001
1507284994840,6cyclictest1578844-21kworker/u8:0+flush-179:023:20:001
1507284994825,3cyclictest0-21swapper/119:15:011
1507283994839,7cyclictest1528646-21/usr/sbin/munin20:15:240
1507283994741,5cyclictest1594710-21kworker/u8:0+flush-179:023:40:180
1507283994741,4cyclictest1507209-21kworker/u8:3+flush-179:019:30:000
1507283994740,5cyclictest1587072-21latency_hist23:15:010
1507283994740,5cyclictest1557832-21kworker/u8:2+events_unbound21:45:160
1507283994739,6cyclictest1574263-21/usr/sbin/munin22:35:220
1507283994739,5cyclictest1562402-21kworker/u8:2+flush-179:022:30:250
4577091460,13ptp4l61490irq/134-eno1-TxRx-019:10:003
1507284994625,5cyclictest1598489-21apt-get23:50:031
1507284994625,3cyclictest1541670-21munin-run20:55:001
1507283994638,6cyclictest1578844-21kworker/u8:0+flush-179:022:55:000
1507284994526,3cyclictest714-21Xorg23:40:591
1507283994538,5cyclictest1613162-21kworker/u8:0+flush-179:000:35:150
150728399450,43cyclictest1548040-21munin-run21:15:010
1507284994437,5cyclictest1559229-21kworker/u8:3+events_unbound21:55:001
1507283994440,3cyclictest1544813-21kworker/u8:0+flush-179:021:26:100
1507284994341,1cyclictest0-21swapper/100:22:591
1507284994333,8cyclictest1585738-21apt-get23:10:131
1507283994338,4cyclictest1601975-21kworker/u8:3+flush-179:000:15:220
1507283994334,6cyclictest1510426-21kworker/u8:2+flush-179:019:50:260
150728499420,41cyclictest714-21Xorg20:48:591
150728499420,27cyclictest714-21Xorg00:14:591
1507283994234,5cyclictest1591886-21kworker/u8:1+flush-179:023:35:200
1507283994233,7cyclictest266-21systemd-journal00:13:090
1507286994139,1cyclictest0-21swapper/223:15:002
1507284994139,1cyclictest0-21swapper/100:25:591
1507283994136,4cyclictest1502437-21kworker/u8:0+flush-179:019:10:240
1507283994127,10cyclictest1601943-40mandb00:00:010
150728399411,38cyclictest714-21Xorg21:59:590
1507290994033,5cyclictest1595047-21turbostat23:40:003
1507290994033,5cyclictest1523630-21turbostat20:00:003
1507284994035,4cyclictest1536633-21apt-get20:40:031
1507284994031,6cyclictest1518349-21latency_hist19:45:011
150728499401,37cyclictest714-21Xorg22:40:591
150728499400,38cyclictest714-21Xorg22:12:591
1507283994034,4cyclictest1-21systemd20:15:010
150728399400,39cyclictest1533195-21turbostat20:34:560
1507286993935,2cyclictest0-21swapper/222:08:592
150728699390,36cyclictest0-21swapper/221:29:542
1507284993934,3cyclictest1605185-21idleruntime-cro00:10:011
1507284993933,4cyclictest1528444-21systemd-run20:15:011
1507283993934,3cyclictest714-21Xorg22:09:590
1507286993835,2cyclictest0-21swapper/223:25:592
150728699380,36cyclictest0-21swapper/222:54:552
150728699380,36cyclictest0-21swapper/221:07:582
150728699380,36cyclictest0-21swapper/219:53:592
150728699380,35cyclictest0-21swapper/219:48:002
1507284993834,3cyclictest714-21Xorg20:55:591
1507284993834,2cyclictest1546482-21systemd-run21:10:011
1507284993832,4cyclictest1534784-21apt-get20:35:021
1507284993829,7cyclictest266-21systemd-journal23:00:081
1507290993734,2cyclictest0-21swapper/323:11:593
1507286993734,2cyclictest0-21swapper/221:46:592
150728699370,35cyclictest0-21swapper/221:23:592
1507284993734,2cyclictest0-21swapper/123:34:001
150728499370,1cyclictest0-21swapper/119:28:591
1507283993732,4cyclictest1489226-21kworker/u8:1+flush-179:019:20:210
1507283993728,7cyclictest1515183-21kworker/u8:1+events_unbound19:40:200
1507290993634,1cyclictest0-21swapper/321:44:003
1507290993634,1cyclictest0-21swapper/321:18:583
1507290993634,1cyclictest0-21swapper/321:18:583
1507290993634,1cyclictest0-21swapper/320:40:583
1507290993634,1cyclictest0-21swapper/300:16:593
150729099360,35cyclictest0-21swapper/320:08:593
150729099360,35cyclictest0-21swapper/320:08:583
150729099360,35cyclictest0-21swapper/300:29:553
150729099360,35cyclictest0-21swapper/300:22:593
1507286993633,2cyclictest0-21swapper/222:55:592
1507286993633,2cyclictest0-21swapper/200:01:592
1507286993632,2cyclictest0-21swapper/200:31:592
1507286993632,2cyclictest0-21swapper/200:31:592
150728699360,1cyclictest0-21swapper/200:19:552
1507284993632,3cyclictest1548063-21systemd-run21:15:001
1507284993625,9cyclictest1613385-21apt-get00:35:131
1507283993631,4cyclictest1570836-21kworker/u8:0+flush-179:022:40:230
1507283993631,4cyclictest1527260-21kworker/u8:0+flush-179:020:29:560
1507283993625,9cyclictest685-21snmpd19:55:020
1507290993533,1cyclictest0-21swapper/322:14:553
1507290993532,2cyclictest0-21swapper/321:59:553
150729099350,1cyclictest0-21swapper/323:08:593
150729099350,1cyclictest0-21swapper/321:37:593
1507284993530,4cyclictest1576642-21kworker/u8:1+flush-179:022:53:091
1507284993530,4cyclictest1523535-21kworker/u8:0+flush-179:020:00:161
1507284993528,5cyclictest1568989-21latency_hist22:20:011
1507283993532,2cyclictest714-21Xorg22:29:590
1507283993529,5cyclictest1590350-21latency_hist23:25:010
1507290993432,1cyclictest0-21swapper/319:45:003
1507290993431,2cyclictest0-21swapper/300:14:003
150729099340,5cyclictest1583647-21turbostat23:04:593
1507286993430,2cyclictest0-21swapper/219:55:582
1507284993430,3cyclictest714-21Xorg21:16:001
1507284993430,3cyclictest714-21Xorg21:15:591
1507284993430,3cyclictest1-21systemd22:35:011
1507284993428,4cyclictest1530273-21apt-get20:20:151
1507283993431,2cyclictest0-21swapper/023:16:590
150728399342,4cyclictest1568991-21apt-get22:20:030
1507290993331,1cyclictest0-21swapper/322:29:553
1507290993331,1cyclictest0-21swapper/321:33:583
1507290993331,1cyclictest0-21swapper/320:20:583
1507290993331,1cyclictest0-21swapper/319:29:553
1507284993328,3cyclictest1518865-21apt-get19:45:141
1507284993328,3cyclictest0-21swapper/119:40:011
1507284993327,3cyclictest57850irq/129-enp2s0-TxRx-000:30:121
1507284993327,3cyclictest57850irq/129-enp2s0-TxRx-000:30:111
1507284993326,5cyclictest1540112-21kworker/u8:1+flush-179:021:00:181
1507283993329,3cyclictest1588703-21kworker/u8:3+flush-179:023:27:400
1507283993328,3cyclictest714-21Xorg21:24:000
4577091320,2ptp4l441ktimers/320:00:533
1507290993230,1cyclictest0-21swapper/322:47:583
1507290993230,1cyclictest0-21swapper/322:15:593
1507290993225,6cyclictest1548039-21turbostat21:15:013
1507286993229,2cyclictest0-21swapper/223:03:592
1507286993229,2cyclictest0-21swapper/221:13:592
1507286993228,2cyclictest0-21swapper/222:37:592
1507284993215,15cyclictest1575632-21grep22:40:001
1507283993229,2cyclictest0-21swapper/020:23:580
1507283993227,4cyclictest1546426-21kworker/u8:2+events_unbound21:15:270
1507283993227,4cyclictest1546426-21kworker/u8:2+events_unbound21:15:270
1507290993129,1cyclictest0-21swapper/321:02:583
150728699310,29cyclictest0-21swapper/220:17:592
1507284993127,1cyclictest0-21swapper/122:20:021
150728499310,29cyclictest714-21Xorg22:56:591
1507290993028,1cyclictest0-21swapper/322:54:593
150729099300,2cyclictest0-21swapper/321:25:153
1507286993027,2cyclictest0-21swapper/223:59:002
1507286993027,2cyclictest0-21swapper/223:53:592
1507286993027,2cyclictest0-21swapper/223:30:142
1507286993027,2cyclictest0-21swapper/222:44:552
150728699300,2cyclictest0-21swapper/222:04:582
150728699300,2cyclictest0-21swapper/219:37:582
1507284993027,2cyclictest0-21swapper/120:15:131
150728499300,2cyclictest1588936-21apt-get23:20:131
150728499300,2cyclictest0-21swapper/122:25:131
4577091290,6ptp4l61490irq/134-eno1-TxRx-019:35:003
1507290992926,2cyclictest0-21swapper/320:45:133
150729099290,27cyclictest0-21swapper/322:55:153
150729099290,27cyclictest0-21swapper/319:45:023
1507286992926,2cyclictest0-21swapper/220:26:582
150728699290,28cyclictest0-21swapper/220:50:132
150728699290,27cyclictest0-21swapper/223:40:012
150728699290,27cyclictest0-21swapper/220:45:132
150728699290,27cyclictest0-21swapper/220:40:032
150728699290,27cyclictest0-21swapper/200:10:152
150728699290,27cyclictest0-21swapper/200:05:152
1507284992927,1cyclictest0-21swapper/122:01:581
150728499290,28cyclictest1552853-21munin-run21:30:001
4577091280,7ptp4l441ktimers/300:05:003
4577091280,6ptp4l441ktimers/320:20:013
4577091280,6ptp4l441ktimers/300:35:013
4577091280,6ptp4l441ktimers/300:35:013
1507290992826,1cyclictest0-21swapper/319:54:543
1507290992825,2cyclictest0-21swapper/323:59:593
1507290992825,2cyclictest0-21swapper/323:20:133
1507290992825,2cyclictest0-21swapper/322:45:003
1507290992823,3cyclictest1510399-21turbostat19:20:013
1507290992823,3cyclictest1510399-21turbostat19:20:003
150729099280,27cyclictest0-21swapper/320:57:003
150729099280,26cyclictest0-21swapper/323:40:013
150729099280,26cyclictest0-21swapper/322:20:033
150729099280,26cyclictest0-21swapper/320:35:033
150729099280,26cyclictest0-21swapper/319:20:123
150729099280,26cyclictest0-21swapper/300:05:153
1507286992825,2cyclictest0-21swapper/223:05:162
1507286992825,2cyclictest0-21swapper/200:28:592
1507286992825,2cyclictest0-21swapper/200:21:592
150728699280,2cyclictest0-21swapper/220:35:152
150728699280,26cyclictest0-21swapper/222:45:592
150728699280,26cyclictest0-21swapper/222:10:162
150728699280,26cyclictest0-21swapper/219:22:592
1507284992824,3cyclictest1591301-21/usr/sbin/munin23:25:221
4577091270,6ptp4l61490irq/134-eno1-TxRx-023:50:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-020:15:013
4577091270,6ptp4l441ktimers/322:10:023
4577091270,6ptp4l441ktimers/321:24:563
4577091270,6ptp4l441ktimers/319:39:563
4577091270,6ptp4l441ktimers/319:15:013
1507290992725,1cyclictest0-21swapper/320:54:593
1507290992725,1cyclictest0-21swapper/320:30:153
1507290992724,2cyclictest0-21swapper/321:10:003
150729099270,26cyclictest0-21swapper/322:39:593
150729099270,26cyclictest0-21swapper/320:25:143
1507286992724,2cyclictest0-21swapper/221:18:592
1507286992724,2cyclictest0-21swapper/221:18:582
1507286992724,2cyclictest0-21swapper/219:41:592
1507286992723,2cyclictest0-21swapper/220:34:582
150728699270,25cyclictest0-21swapper/221:54:552
150728699270,25cyclictest0-21swapper/219:27:112
1507284992722,3cyclictest0-21swapper/100:15:241
4577091260,6ptp4l61490irq/134-eno1-TxRx-023:35:003
4577091260,5ptp4l441ktimers/323:55:003
1507290992624,1cyclictest0-21swapper/323:19:593
1507290992624,1cyclictest0-21swapper/322:30:583
1507286992623,2cyclictest0-21swapper/223:15:582
1507286992623,2cyclictest0-21swapper/222:26:002
1507286992623,2cyclictest0-21swapper/220:20:592
1507286992623,2cyclictest0-21swapper/219:32:282
150728699260,24cyclictest0-21swapper/220:56:002
4577091250,5ptp4l441ktimers/323:29:563
4577091250,5ptp4l441ktimers/321:49:563
1507290992523,1cyclictest0-21swapper/321:53:593
150729099250,24cyclictest0-21swapper/322:04:593
1507286992522,2cyclictest0-21swapper/222:19:542
1507286992521,2cyclictest0-21swapper/219:15:022
1507286992521,2cyclictest0-21swapper/219:15:012
150728699250,2cyclictest0-21swapper/221:58:592
150728699250,24cyclictest0-21swapper/219:10:172
1507284992521,2cyclictest0-21swapper/121:25:011
1507290992321,1cyclictest0-21swapper/300:39:553
1507286992321,1cyclictest0-21swapper/221:39:592
1507286992320,2cyclictest0-21swapper/222:32:582
1507286992219,2cyclictest0-21swapper/220:00:542
150728499210,4cyclictest1507332-21latency_hist19:10:021
1507286992017,2cyclictest0-21swapper/221:02:002
1507286992017,2cyclictest0-21swapper/220:14:592
1507286992016,2cyclictest0-21swapper/223:45:592
1507283991712,3cyclictest0-21swapper/019:10:020
1507286991614,1cyclictest0-21swapper/220:09:592
1507286991614,1cyclictest0-21swapper/220:09:592
1507286991612,2cyclictest0-21swapper/222:21:592
1507286991310,2cyclictest0-21swapper/223:24:592
1507286991210,1cyclictest0-21swapper/221:44:592
150728699118,2cyclictest0-21swapper/200:37:592
15072869985,2cyclictest0-21swapper/223:36:402
15072869930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional