You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-17 - 00:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6.osadl.org (updated Mon Jun 16, 2025 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
410965499121107,11cyclictest4170084-21apt-get10:15:140
410965499115105,8cyclictest22864-21latency_hist12:40:010
410965699114101,10cyclictest4144953-21dpkg08:56:041
410965499113101,9cyclictest502-21rs:main0
410965699112101,9cyclictest4177785-21apt-get10:40:001
41096549911298,10cyclictest4174865-21apt-get10:30:150
41096549910190,8cyclictest4132120-21latency_hist08:20:000
41096549910086,10cyclictest3500-21apt-get11:40:160
4109654999986,10cyclictest16750-21apt-get12:20:130
4109656999785,8cyclictest4109506-21kworker/u8:1+events_unbound07:15:011
4109656999383,7cyclictest4160290-21apt-get09:45:111
4109656999380,10cyclictest4158703-21apt-get09:40:131
4109656999082,6cyclictest8268-21apt-get11:54:591
4109656998877,9cyclictest4171694-21apt-get10:20:151
4109656998674,8cyclictest4138740-21kworker/u8:2+events_unbound09:05:011
4109656998674,8cyclictest4138740-21kworker/u8:2+events_unbound09:05:011
4109654998676,7cyclictest4177800-21latency_hist10:40:000
4109656998575,7cyclictest3105085-21systemd-journal10:15:001
4109656998575,7cyclictest3105085-21systemd-journal10:15:001
4109654998575,7cyclictest4109576-21kworker/u8:3+events_unbound07:15:030
4109656998474,7cyclictest3105085-21systemd-journal11:40:001
4109656998469,12cyclictest4166916-21apt-get10:05:131
4109654998474,6cyclictest4153704-21kworker/u8:2+flush-179:009:40:150
4109654998473,8cyclictest4133958-21/usr/sbin/munin08:25:240
4109656998277,4cyclictest4109576-21kworker/u8:3+events_unbound07:40:141
4109656998274,5cyclictest4135563-21apt-get08:30:131
4109656998271,8cyclictest3255707-21kworker/u8:0+events_unbound07:20:171
4109656998172,6cyclictest4171450-21kworker/u8:1+flush-179:010:25:191
4109656998163,15cyclictest3105085-21systemd-journal08:21:341
4109654998169,9cyclictest4186267-21apt-get11:05:130
4109656998067,10cyclictest4164800-21latency_hist10:00:011
4109654998067,10cyclictest4127607-21apt-get08:05:130
4109656997969,8cyclictest6546-21store11:50:021
4109656997969,7cyclictest4129194-21apt-get08:10:141
4109654997867,8cyclictest10141-21latency_hist12:00:010
410965499781,73cyclictest3276-21true11:40:000
4109654997768,6cyclictest4116214-21kworker/u8:1+flush-179:007:30:150
4109656997667,7cyclictest4153669-21latency_hist09:25:011
4109656997662,11cyclictest3105085-21systemd-journal11:58:351
4109654997669,5cyclictest8392-21kworker/u8:2+events_unbound12:00:180
4109656997567,6cyclictest8392-21kworker/u8:2+flush-179:012:10:251
4109656997566,7cyclictest4143263-21latency_hist08:55:011
4109656997466,6cyclictest4122605-21kworker/u8:2+events_unbound08:00:151
4109654997466,5cyclictest4148663-21kworker/u8:3+flush-179:009:20:010
4109654997267,3cyclictest4176191-21kworker/u8:4+flush-179:010:55:230
4109656997163,6cyclictest3105085-21systemd-journal07:59:341
4109656997161,8cyclictest4166659-21latency_hist10:05:011
4109654997145,23cyclictest4168243-21latency_hist10:10:010
4109654997057,10cyclictest4181486-21apt-get10:50:150
4109660996941,26cyclictest0-21swapper/309:11:593
4109656996961,6cyclictest4187629-21kworker/u8:1+flush-179:011:35:001
4109654996961,5cyclictest4138509-21latency_hist08:40:010
4109654996961,5cyclictest4138509-21latency_hist08:40:010
4109654996956,10cyclictest4148884-21apt-get09:10:150
4109656996859,6cyclictest4179904-21apt-get10:45:141
4109654996861,4cyclictest4193999-21kworker/u8:3+events_unbound11:45:200
4109654996858,8cyclictest4187645-21kworker/u8:2+flush-179:011:15:190
4109654996762,4cyclictest4133699-21kworker/u8:0+flush-179:008:40:180
4109654996744,21cyclictest4165141-21store10:00:010
4109654996659,5cyclictest4120976-21kworker/u8:1+flush-179:007:55:250
4109656996556,7cyclictest4122605-21kworker/u8:2+flush-179:008:05:181
4109654996554,9cyclictest4191048-21apt-get11:20:160
4109654996554,9cyclictest4191048-21apt-get11:20:150
4109654996455,7cyclictest3105085-21systemd-journal09:39:590
4109656996357,5cyclictest4138740-21kworker/u8:2+flush-179:009:15:001
4109656996355,5cyclictest4187645-21kworker/u8:2+flush-179:011:25:251
4109654996358,4cyclictest4148663-21kworker/u8:3+flush-179:009:20:270
4109654996355,5cyclictest4148663-21kworker/u8:3+events_unbound09:30:210
4109654996355,5cyclictest4133699-21kworker/u8:0+flush-179:008:30:150
4109654996351,8cyclictest4176191-21kworker/u8:4+flush-179:011:10:250
4109659996157,2cyclictest0-21swapper/208:55:592
4109656996156,4cyclictest4176191-21kworker/u8:4+flush-179:011:05:271
4109656996152,6cyclictest4109576-21kworker/u8:3+events_unbound07:35:141
4109656996152,6cyclictest18338-21apt-get12:25:141
4109654996157,3cyclictest4109576-21kworker/u8:3+events_unbound07:45:250
4109654996153,5cyclictest4169351-21kworker/u8:2+flush-179:010:50:010
4109654996152,6cyclictest3255707-21kworker/u8:0+flush-179:007:25:220
4109656996053,5cyclictest4153704-21kworker/u8:2+flush-179:009:50:201
4109656996052,5cyclictest502-21rs:main1
4109654996055,4cyclictest4168231-21kworker/u8:1+flush-179:010:10:240
4109654996055,4cyclictest4168231-21kworker/u8:1+flush-179:010:10:230
4109654996053,5cyclictest4109576-21kworker/u8:3+flush-179:007:38:290
4109654996052,6cyclictest4147588-21diskstats09:05:200
4109654996051,6cyclictest4187645-21kworker/u8:2+events_unbound11:25:170
4109656995950,6cyclictest4109576-21kworker/u8:3+events_unbound07:45:221
4109656995940,17cyclictest4155290-21kworker/u8:4+flush-179:010:19:591
4109654995953,5cyclictest4128954-21kworker/u8:3+flush-179:008:20:190
4109654995951,5cyclictest4187629-21kworker/u8:1+events_unbound11:30:290
4109656995848,8cyclictest3105085-21systemd-journal09:30:011
4109654995848,7cyclictest8261-21latency_hist11:55:010
4109656995747,7cyclictest4147301-21apt-get09:05:161
4109654995748,7cyclictest502-21rs:main0
4109654995746,9cyclictest4146796-21apt-get09:05:010
4109654995746,9cyclictest4146796-21apt-get09:05:010
4109656995648,6cyclictest8392-21kworker/u8:2+events_unbound12:05:011
4109656995647,6cyclictest4187645-21kworker/u8:2+flush-179:011:15:161
4109656995646,7cyclictest4135307-21latency_hist08:30:011
4109654995650,4cyclictest4153704-21kworker/u8:2+flush-179:009:55:270
4109656995548,5cyclictest4133699-21kworker/u8:0+flush-179:008:45:231
4109654995547,6cyclictest4120976-21kworker/u8:1+flush-179:008:05:000
4109654995544,8cyclictest4109520-21latency_hist07:10:020
4109654995544,8cyclictest4109520-21latency_hist07:10:010
4109654995540,12cyclictest3105085-21systemd-journal09:52:340
4109660995450,2cyclictest0-21swapper/307:59:593
4109656995446,6cyclictest4155290-21kworker/u8:4+flush-179:009:35:271
4109654995447,5cyclictest8392-21kworker/u8:2+flush-179:012:15:270
4109656995346,5cyclictest4138740-21kworker/u8:2+flush-179:009:15:201
4109660995249,2cyclictest0-21swapper/309:08:593
4109656995144,5cyclictest8392-21kworker/u8:2+flush-179:012:15:201
4109654995145,5cyclictest4109576-21kworker/u8:3+flush-179:007:40:210
4109656995044,4cyclictest4137151-21apt-get08:35:151
4109656995044,4cyclictest4137151-21apt-get08:35:151
4109656994944,4cyclictest4193999-21kworker/u8:3+flush-179:011:40:301
4109656994943,5cyclictest3255707-21kworker/u8:0+flush-179:007:25:151
4109656994940,7cyclictest19712-21kworker/u8:2+flush-179:012:35:021
4109656994940,6cyclictest502-21rs:main1
4109654994943,4cyclictest14921-21kworker/u8:0+flush-179:012:30:240
4505291480,14ptp4l61790irq/134-eno1-TxRx-007:10:013
4505291480,14ptp4l61790irq/134-eno1-TxRx-007:10:003
4109656994841,5cyclictest4148663-21kworker/u8:3+flush-179:009:34:591
4109654994841,5cyclictest3255707-21kworker/u8:0+flush-179:007:20:180
4109656994741,4cyclictest4166635-21kworker/u8:0+flush-179:010:30:171
4109654994740,5cyclictest8392-21kworker/u8:2+events_unbound12:05:230
4109656994638,6cyclictest4187629-21kworker/u8:1+flush-179:011:20:191
4109656994638,6cyclictest4187629-21kworker/u8:1+flush-179:011:20:191
4109656994537,6cyclictest3105085-21systemd-journal07:30:211
4109654994538,6cyclictest4176191-21kworker/u8:4+events_unbound10:40:020
4109656994438,5cyclictest4187629-21kworker/u8:1+flush-179:011:15:011
4109656994436,6cyclictest4179647-21latency_hist10:45:011
4109659994340,2cyclictest0-21swapper/210:05:592
410965699432,39cyclictest4184422-21turbostat11:04:561
4109654994333,7cyclictest19669-21latency_hist12:30:010
4109660994239,2cyclictest0-21swapper/310:57:593
410966099420,1cyclictest0-21swapper/307:38:593
410965499421,38cyclictest4141694-21dump-pmu-power08:50:000
410965499420,40cyclictest4122579-21turbostat07:54:560
410965999410,36cyclictest0-21swapper/212:14:562
410965699411,37cyclictest722-21Xorg10:53:591
410965699410,38cyclictest722-21Xorg12:20:591
4109654994138,2cyclictest4141721-21kworker/u8:3+events_unbound08:50:260
4109654994135,4cyclictest4122605-21kworker/u8:2+events_unbound08:10:230
4109654994133,6cyclictest3105085-21systemd-journal10:20:340
410965499410,4cyclictest13315-21turbostat12:14:550
4109660994037,2cyclictest0-21swapper/307:19:003
410965999400,36cyclictest0-21swapper/211:04:552
410965999400,31cyclictest0-21swapper/209:18:592
4109656994034,5cyclictest4176191-21kworker/u8:4+events_unbound10:55:161
4109660993937,1cyclictest0-21swapper/309:45:003
410966099390,3cyclictest4153680-21turbostat09:25:003
4109659993935,2cyclictest0-21swapper/209:47:592
4109656993934,3cyclictest722-21Xorg08:16:591
4109656993933,5cyclictest8392-21kworker/u8:2+flush-179:012:05:241
410965499390,2cyclictest0-21swapper/009:47:590
410966099380,35cyclictest0-21swapper/308:01:593
4109659993834,2cyclictest0-21swapper/208:54:552
410965999380,36cyclictest0-21swapper/209:43:592
410965999380,35cyclictest0-21swapper/211:14:592
4109654993832,5cyclictest4153645-21kworker/u8:1+flush-179:009:25:260
4109654993829,6cyclictest4171450-21kworker/u8:1+events_unbound10:25:240
4109660993733,2cyclictest0-21swapper/310:36:583
4109660993732,4cyclictest4161630-21turbostat09:50:013
4109659993734,2cyclictest0-21swapper/211:29:552
4109659993734,2cyclictest0-21swapper/210:54:002
410965999370,35cyclictest0-21swapper/208:30:592
4109654993727,6cyclictest0-21swapper/007:10:130
4109660993634,1cyclictest0-21swapper/308:38:593
4109660993634,1cyclictest0-21swapper/308:38:593
410966099360,1cyclictest0-21swapper/311:19:553
410966099360,1cyclictest0-21swapper/310:41:593
4109659993632,2cyclictest0-21swapper/207:20:002
4505291350,13ptp4l441ktimers/308:50:003
4109660993532,2cyclictest0-21swapper/310:51:593
4109660993532,2cyclictest0-21swapper/307:25:593
4109659993533,1cyclictest0-21swapper/208:50:002
4109656993526,7cyclictest4138759-21apt-get08:40:141
4505291340,7ptp4l61790irq/134-eno1-TxRx-010:20:003
4109660993432,1cyclictest0-21swapper/308:44:593
4109660993431,2cyclictest0-21swapper/307:20:593
4109659993431,2cyclictest0-21swapper/209:35:592
4109659993428,2cyclictest0-21swapper/207:50:582
4109659993330,2cyclictest0-21swapper/212:18:592
4109659993330,2cyclictest0-21swapper/209:35:002
4109659993329,2cyclictest0-21swapper/212:34:552
4505291320,5ptp4l61790irq/134-eno1-TxRx-009:55:003
4109660993230,1cyclictest0-21swapper/310:27:003
4109660993230,1cyclictest0-21swapper/309:38:583
410965999320,29cyclictest0-21swapper/210:35:012
4505291310,10ptp4l61790irq/134-eno1-TxRx-010:25:003
4109660993129,1cyclictest0-21swapper/312:35:593
4109660993128,2cyclictest0-21swapper/309:58:003
4109659993129,1cyclictest0-21swapper/210:24:592
4109659993127,2cyclictest0-21swapper/210:00:002
410965999310,28cyclictest0-21swapper/207:40:142
410965699310,30cyclictest0-21swapper/112:35:161
4109660993028,1cyclictest0-21swapper/307:49:553
4109660993027,2cyclictest0-21swapper/311:10:183
4109660993027,2cyclictest0-21swapper/310:48:593
4109660993027,2cyclictest0-21swapper/308:55:593
410966099300,28cyclictest0-21swapper/310:00:033
4109659993027,2cyclictest0-21swapper/209:09:552
4109659993027,2cyclictest0-21swapper/208:16:592
4109659993027,2cyclictest0-21swapper/207:30:132
410965999300,29cyclictest0-21swapper/210:00:012
410965999300,28cyclictest0-21swapper/212:00:162
410965999300,28cyclictest0-21swapper/210:55:152
410965999300,28cyclictest0-21swapper/209:25:152
4109660992927,1cyclictest0-21swapper/308:51:593
4109660992927,1cyclictest0-21swapper/307:13:593
4109660992926,2cyclictest0-21swapper/308:29:593
410966099290,28cyclictest0-21swapper/309:30:183
410966099290,1cyclictest0-21swapper/311:40:183
4109659992926,2cyclictest0-21swapper/211:35:152
4109659992926,2cyclictest0-21swapper/211:20:172
4109659992926,2cyclictest0-21swapper/211:20:162
4109659992926,2cyclictest0-21swapper/211:15:142
4109659992926,2cyclictest0-21swapper/210:10:162
4109659992926,2cyclictest0-21swapper/210:10:152
4109659992926,2cyclictest0-21swapper/207:10:132
410965999290,2cyclictest0-21swapper/210:40:132
410965999290,2cyclictest0-21swapper/208:20:152
410965999290,27cyclictest0-21swapper/211:45:182
410965999290,27cyclictest0-21swapper/210:45:152
4505291280,7ptp4l441ktimers/307:55:013
4109660992826,1cyclictest0-21swapper/312:05:173
4109660992826,1cyclictest0-21swapper/307:41:593
4109660992825,2cyclictest0-21swapper/312:34:593
410966099280,27cyclictest0-21swapper/310:30:163
410966099280,26cyclictest0-21swapper/312:25:163
410966099280,26cyclictest0-21swapper/312:10:173
410966099280,26cyclictest0-21swapper/311:25:163
410966099280,21cyclictest0-21swapper/312:02:583
4109659992825,2cyclictest0-21swapper/212:35:162
4109659992825,2cyclictest0-21swapper/211:55:032
4109659992825,2cyclictest0-21swapper/210:35:202
4109659992825,2cyclictest0-21swapper/209:50:592
410965999280,2cyclictest0-21swapper/209:20:012
410965999280,26cyclictest0-21swapper/211:08:002
4505291270,7ptp4l61790irq/134-eno1-TxRx-010:10:013
4505291270,6ptp4l61790irq/134-eno1-TxRx-009:30:013
4505291270,6ptp4l441ktimers/312:00:003
4505291270,6ptp4l441ktimers/311:35:003
4505291270,6ptp4l441ktimers/311:25:013
4505291270,6ptp4l441ktimers/311:25:003
4505291270,5ptp4l441ktimers/311:10:013
4109660992725,1cyclictest0-21swapper/308:12:593
4109660992724,2cyclictest0-21swapper/311:50:003
410966099270,26cyclictest0-21swapper/312:23:003
410966099270,26cyclictest0-21swapper/311:00:163
410966099270,1cyclictest0-21swapper/311:50:033
410965999270,24cyclictest0-21swapper/211:50:592
4505291260,6ptp4l441ktimers/310:15:003
4505291260,6ptp4l441ktimers/310:14:593
4505291260,5ptp4l441ktimers/309:20:013
4505291260,5ptp4l441ktimers/308:10:013
4109660992624,1cyclictest0-21swapper/308:18:593
4109659992623,2cyclictest0-21swapper/211:41:002
4109659992623,2cyclictest0-21swapper/208:14:552
410965999260,24cyclictest0-21swapper/208:05:592
4505291250,5ptp4l441ktimers/312:19:553
4505291250,5ptp4l441ktimers/309:04:553
4505291250,5ptp4l441ktimers/309:04:553
4505291250,4ptp4l61790irq/134-eno1-TxRx-011:40:013
4109659992523,1cyclictest0-21swapper/207:25:002
4109659992522,2cyclictest0-21swapper/210:27:592
4109659992522,2cyclictest0-21swapper/209:00:592
4109659992522,2cyclictest0-21swapper/209:00:592
4109659992522,2cyclictest0-21swapper/208:29:552
4505291240,4ptp4l61790irq/134-eno1-TxRx-008:24:553
4505291240,4ptp4l61790irq/134-eno1-TxRx-007:34:553
4505291230,4ptp4l61790irq/134-eno1-TxRx-008:34:553
4109659992321,1cyclictest0-21swapper/212:24:592
4109659992320,2cyclictest0-21swapper/208:39:552
4109659992320,2cyclictest0-21swapper/208:39:552
4109659992220,1cyclictest0-21swapper/212:29:592
4109659992219,2cyclictest0-21swapper/212:05:592
4109659992118,2cyclictest0-21swapper/208:02:592
4109659992017,2cyclictest0-21swapper/211:32:582
4109659992016,2cyclictest0-21swapper/207:48:592
4109659991917,1cyclictest0-21swapper/209:14:592
4109659991816,1cyclictest0-21swapper/210:20:002
4109659991816,1cyclictest0-21swapper/207:39:592
4109656991814,3cyclictest0-21swapper/107:10:011
4109656991814,3cyclictest0-21swapper/107:10:011
410965999129,2cyclictest0-21swapper/207:56:002
41096599963,2cyclictest0-21swapper/208:44:562
41096599960,5cyclictest0-21swapper/207:29:202
41096599940,3cyclictest0-21swapper/207:10:022
41096599940,3cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional