You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 15:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Mon May 25, 2026 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416489099119108,8cyclictest43650-21latency_hist10:55:011
416489099115105,7cyclictest50025-21latency_hist11:15:011
416489099114102,8cyclictest54811-21latency_hist11:30:011
416488999114106,5cyclictest4192490-21kworker/u8:0+events_unbound08:40:000
41648909911096,11cyclictest1213033-21systemd-journal11:45:001
41648909911096,11cyclictest1213033-21systemd-journal11:44:591
41648899910797,7cyclictest4169691-21kworker/u8:2+events_unbound07:25:010
41648899910594,8cyclictest69393-21latency_hist12:15:010
41648899910493,8cyclictest51671-21kworker/u8:3+events_unbound11:50:010
41648909910289,5cyclictest38054-21kworker/u8:0+events_unbound11:00:261
4164889999990,6cyclictest4176525-21kworker/u8:0+flush-179:008:10:010
4164889999987,9cyclictest61179-21latency_hist11:50:010
4164889999891,5cyclictest19551-21kworker/u8:3+flush-179:009:50:260
4164890999786,8cyclictest32247-21latency_hist10:20:021
4164890999783,5cyclictest4164860-21kworker/u8:2+events_unbound07:15:211
4164889999586,6cyclictest51590-21kworker/u8:0+flush-179:011:20:150
4164889999286,4cyclictest4168006-21kworker/u8:0+flush-179:007:35:230
4164890999088,1cyclictest0-21swapper/108:14:581
4164890998982,5cyclictest4192490-21kworker/u8:0+events_unbound09:15:211
4164890998980,3cyclictest14742-21kworker/u8:0+events_unbound09:35:231
4164889998980,7cyclictest70994-21latency_hist12:20:000
4164890998884,3cyclictest14742-21kworker/u8:0+events_unbound10:10:241
4164890998681,4cyclictest13107-21kworker/u8:1+events_unbound09:30:221
4164889998478,4cyclictest51590-21kworker/u8:0+flush-179:011:40:250
4164889998478,4cyclictest51590-21kworker/u8:0+flush-179:011:40:240
4164889998476,5cyclictest4174739-21kworker/u8:1+flush-179:007:40:230
4164889998471,10cyclictest56940-21diskstats11:35:140
4164889998375,5cyclictest43683-21kworker/u8:1+flush-179:011:10:130
4164889998375,5cyclictest4192490-21kworker/u8:0+flush-179:008:55:200
4164889998276,4cyclictest4164860-21kworker/u8:2+events_unbound07:10:010
4164889998271,9cyclictest14742-21kworker/u8:0+flush-179:009:45:000
4164890998177,3cyclictest4178402-21kworker/u8:2+events_unbound07:50:251
4164890998075,4cyclictest29103-21kworker/u8:3+events_unbound10:30:251
4164890998071,6cyclictest4181063-21latency_hist08:00:011
4164890998069,4cyclictest27506-21kworker/u8:2+events_unbound10:20:201
4164890997974,4cyclictest4187651-21kworker/u8:1+events_unbound08:20:161
4164890997967,10cyclictest1213033-21systemd-journal09:10:001
4164889997972,4cyclictest14742-21kworker/u8:0+flush-179:010:10:200
4164889997768,6cyclictest43683-21kworker/u8:1+events_unbound11:05:200
4164889997756,12cyclictest9983-21kworker/u8:3+flush-179:009:20:250
4164890997672,3cyclictest4178402-21kworker/u8:2+flush-179:008:00:251
4164890997670,4cyclictest74160-21kworker/u8:3+events_unbound12:30:151
4164889997670,4cyclictest59627-21kworker/u8:1+flush-179:012:05:200
4164889997569,4cyclictest4187651-21kworker/u8:1+events_unbound09:05:140
4164889997567,5cyclictest43683-21kworker/u8:1+events_unbound11:15:230
4164889997566,6cyclictest14742-21kworker/u8:0+flush-179:009:35:220
4164889997561,4cyclictest4178402-21kworker/u8:2+events_unbound07:55:020
4164890997470,3cyclictest14742-21kworker/u8:0+flush-179:010:00:261
4164890997470,3cyclictest14742-21kworker/u8:0+flush-179:010:00:261
4164890997465,6cyclictest11535-21latency_hist09:15:011
4164889997467,5cyclictest38054-21kworker/u8:0+flush-179:011:00:150
4164889997465,6cyclictest4192457-21latency_hist08:35:010
4164889997464,4cyclictest51590-21kworker/u8:0+flush-179:011:25:220
4164889997462,9cyclictest4174739-21kworker/u8:1+events_unbound07:45:150
4164890997368,4cyclictest29103-21kworker/u8:3+flush-179:010:40:211
4164889997363,4cyclictest51671-21kworker/u8:3+events_unbound11:30:240
4164890997267,4cyclictest66266-21kworker/u8:2+flush-179:012:25:261
4164890997267,4cyclictest66266-21kworker/u8:2+flush-179:012:25:251
4164890997267,4cyclictest51590-21kworker/u8:0+events_unbound11:45:251
4164890997262,4cyclictest74160-21kworker/u8:3+events_unbound12:35:231
4164889997262,7cyclictest29103-21kworker/u8:3+flush-179:010:35:140
4164890997167,3cyclictest59627-21kworker/u8:1+events_unbound12:05:251
4164889997161,7cyclictest4187739-21kworker/u8:2+events_unbound08:45:190
4164890997064,4cyclictest4176525-21kworker/u8:0+events_unbound08:05:141
4164890997063,3cyclictest4187651-21kworker/u8:1+events_unbound08:45:251
4164890997060,7cyclictest22689-21latency_hist09:50:021
4164889997065,4cyclictest51671-21kworker/u8:3+flush-179:011:59:560
4164890996963,4cyclictest29103-21kworker/u8:3+flush-179:010:35:201
4164890996959,7cyclictest5165-21latency_hist08:55:011
4164889996962,5cyclictest4161846-21kworker/u8:3+events_unbound07:25:230
4164889996959,8cyclictest74435-21apt-get12:30:100
4164890996864,3cyclictest4187651-21kworker/u8:1+flush-179:008:35:291
4164890996864,3cyclictest14742-21kworker/u8:0+events_unbound09:40:211
4164890996863,4cyclictest51590-21kworker/u8:0+flush-179:011:20:201
4164890996863,4cyclictest4174739-21kworker/u8:1+flush-179:007:40:261
4164890996863,4cyclictest4164860-21kworker/u8:2+flush-179:007:10:261
4164889996862,4cyclictest4187651-21kworker/u8:1+flush-179:009:04:560
4164889996860,6cyclictest25891-21latency_hist10:00:010
4164889996851,8cyclictest4192490-21kworker/u8:0+flush-179:009:10:210
4164890996763,3cyclictest14742-21kworker/u8:0+flush-179:009:55:261
4164890996654,9cyclictest1213033-21systemd-journal07:25:021
4164889996661,3cyclictest4176525-21kworker/u8:0+flush-179:007:55:140
4164889996660,4cyclictest14742-21kworker/u8:0+events_unbound09:30:180
4164889996659,5cyclictest8348-21kworker/u8:2+flush-179:009:45:210
4164890996561,3cyclictest29103-21kworker/u8:3+flush-179:010:45:261
4164890996561,3cyclictest29103-21kworker/u8:3+flush-179:010:45:261
4164890996560,4cyclictest4187651-21kworker/u8:1+events_unbound08:25:271
4164890996558,5cyclictest43683-21kworker/u8:1+flush-179:011:05:231
4164889996559,5cyclictest4186340-21apt-get08:15:120
4164889996558,5cyclictest4176525-21kworker/u8:0+flush-179:008:10:250
4164889996558,4cyclictest38054-21kworker/u8:0+events_unbound10:55:190
4164889996550,8cyclictest4187651-21kworker/u8:1+events_unbound08:50:210
4164890996459,4cyclictest4187651-21kworker/u8:1+flush-179:008:55:261
4164890996454,8cyclictest1213033-21systemd-journal11:40:011
4164889996458,4cyclictest8348-21kworker/u8:2+flush-179:009:15:160
4164889996457,5cyclictest74160-21kworker/u8:3+flush-179:012:35:220
4164899996360,1cyclictest0-21swapper/308:22:593
4164890996358,4cyclictest43683-21kworker/u8:1+events_unbound11:15:251
4164889996358,4cyclictest27506-21kworker/u8:2+flush-179:010:24:550
4164889996356,4cyclictest66266-21kworker/u8:2+events_unbound12:25:140
4164889996356,4cyclictest66266-21kworker/u8:2+events_unbound12:25:140
4164899996260,1cyclictest0-21swapper/309:41:593
4164890996257,4cyclictest66266-21kworker/u8:2+flush-179:012:15:261
4164890996157,3cyclictest4192490-21kworker/u8:0+events_unbound08:40:221
4164890996153,7cyclictest4187651-21kworker/u8:1+events_unbound09:00:181
4164890996152,7cyclictest59627-21kworker/u8:1+flush-179:011:54:591
4164890996150,8cyclictest45241-21latency_hist11:00:011
4164889996156,3cyclictest35409-21kworker/u8:1+flush-179:010:30:230
4164889996155,4cyclictest4164860-21kworker/u8:2+flush-179:007:10:200
4164889996155,4cyclictest14742-21kworker/u8:0+events_unbound10:00:250
4164889996155,4cyclictest14742-21kworker/u8:0+events_unbound10:00:250
4164890995954,4cyclictest4168006-21kworker/u8:0+events_unbound07:35:231
4164889995953,4cyclictest4161846-21kworker/u8:3+flush-179:007:30:160
4164889995953,4cyclictest4161846-21kworker/u8:3+flush-179:007:30:160
4164889995851,4cyclictest4178402-21kworker/u8:2+flush-179:008:00:140
4164889995847,4cyclictest38054-21kworker/u8:0+flush-179:010:50:160
4164889995751,4cyclictest29103-21kworker/u8:3+flush-179:010:45:160
4164889995751,4cyclictest29103-21kworker/u8:3+flush-179:010:45:160
4164890995550,4cyclictest4168006-21kworker/u8:0+events_unbound07:33:291
4164890995550,4cyclictest4168006-21kworker/u8:0+events_unbound07:33:281
4164890995546,7cyclictest1213033-21systemd-journal09:55:001
4164889995549,4cyclictest29103-21kworker/u8:3+flush-179:010:15:190
4164889995546,7cyclictest1213033-21systemd-journal08:40:180
4164889995546,3cyclictest14742-21kworker/u8:0+events_unbound09:25:140
4164890995449,4cyclictest59627-21kworker/u8:1+events_unbound12:10:161
4164890995449,4cyclictest59627-21kworker/u8:1+events_unbound12:00:181
4164890995449,4cyclictest4174739-21kworker/u8:1+events_unbound07:47:301
4164889995248,3cyclictest29103-21kworker/u8:3+flush-179:010:25:210
4164890995146,4cyclictest14742-21kworker/u8:0+flush-179:009:25:271
4164890995142,7cyclictest27710-21/usr/sbin/munin10:05:171
4164889995144,5cyclictest4168039-21latency_hist07:20:010
4577091500,13ptp4l61490irq/134-eno1-TxRx-007:10:013
4164889995046,3cyclictest4187651-21kworker/u8:1+flush-179:008:25:260
4164889995045,4cyclictest66266-21kworker/u8:2+flush-179:012:20:250
4164889995045,4cyclictest59627-21kworker/u8:1+events_unbound12:00:210
4164890994945,3cyclictest4181102-21kworker/u8:3+flush-179:008:30:251
4164899994644,1cyclictest0-21swapper/308:11:583
4164890994537,6cyclictest51671-21kworker/u8:3+flush-179:011:30:211
416489999440,42cyclictest50033-21turbostat11:15:003
4164894994441,2cyclictest0-21swapper/208:22:592
4164890994439,4cyclictest59627-21kworker/u8:1+flush-179:011:55:271
4164890994439,4cyclictest59627-21kworker/u8:1+events_unbound12:20:221
4164889994434,3cyclictest4187651-21kworker/u8:1+events_unbound08:20:180
4164894994340,2cyclictest0-21swapper/209:42:002
4164894994340,2cyclictest0-21swapper/208:18:002
416489499430,41cyclictest0-21swapper/209:16:592
416489499430,35cyclictest0-21swapper/207:57:592
4164899994238,2cyclictest0-21swapper/309:10:593
4164889994230,4cyclictest14742-21kworker/u8:0+events_unbound10:05:150
4164899994137,2cyclictest0-21swapper/307:56:583
416489999400,38cyclictest16335-21turbostat09:30:003
416489099400,4cyclictest4168062-21turbostat07:24:551
4164899993936,2cyclictest0-21swapper/312:22:583
416489499380,36cyclictest0-21swapper/211:47:592
416489499380,35cyclictest0-21swapper/211:54:552
416489499380,35cyclictest0-21swapper/211:39:542
4164899993735,1cyclictest0-21swapper/310:31:593
4164899993734,2cyclictest0-21swapper/311:59:593
4164899993734,2cyclictest0-21swapper/311:53:593
4164899993734,2cyclictest0-21swapper/310:19:553
4164894993734,2cyclictest0-21swapper/212:21:582
4164894993734,2cyclictest0-21swapper/210:06:592
4164894993734,2cyclictest0-21swapper/209:31:592
4164894993734,2cyclictest0-21swapper/209:20:592
4164894993734,2cyclictest0-21swapper/208:03:592
416489499370,35cyclictest0-21swapper/212:28:592
416489499370,35cyclictest0-21swapper/212:28:582
416489499370,35cyclictest0-21swapper/211:43:592
416489499370,35cyclictest0-21swapper/211:43:592
4164890993733,3cyclictest9983-21kworker/u8:3+flush-179:009:20:291
4164899993634,1cyclictest0-21swapper/311:01:003
4164899993634,1cyclictest0-21swapper/310:44:543
4164899993634,1cyclictest0-21swapper/309:55:593
4164899993633,2cyclictest0-21swapper/311:33:003
416489999360,35cyclictest0-21swapper/310:51:593
416489999360,35cyclictest0-21swapper/309:53:593
416489999360,35cyclictest0-21swapper/307:35:003
416489999360,35cyclictest0-21swapper/307:34:593
416489999360,1cyclictest0-21swapper/311:39:593
416489999360,1cyclictest0-21swapper/310:58:593
4164894993633,2cyclictest0-21swapper/209:04:552
4164894993632,2cyclictest0-21swapper/211:08:592
416489499360,2cyclictest0-21swapper/212:34:002
416489499360,1cyclictest0-21swapper/208:48:002
4164899993533,1cyclictest0-21swapper/312:17:593
4164894993532,2cyclictest0-21swapper/207:40:582
416489499350,1cyclictest0-21swapper/211:29:552
416489499350,1cyclictest0-21swapper/210:01:592
416489499350,1cyclictest0-21swapper/210:01:592
4164890993531,3cyclictest14742-21kworker/u8:0+flush-179:010:27:591
4164890993530,4cyclictest4181102-21kworker/u8:3+events_unbound08:15:131
4164899993431,1cyclictest0-21swapper/310:35:593
4164899993427,5cyclictest30660-21turbostat10:15:003
4164894993431,2cyclictest0-21swapper/207:46:592
4164899993331,1cyclictest0-21swapper/310:48:593
4164899993331,1cyclictest0-21swapper/310:48:593
4164899993331,1cyclictest0-21swapper/308:04:553
416489499330,2cyclictest0-21swapper/208:53:592
416489499330,26cyclictest0-21swapper/210:40:132
4164889993328,4cyclictest29103-21kworker/u8:3+flush-179:010:40:300
4164899993230,1cyclictest0-21swapper/309:09:593
4164899993229,2cyclictest0-21swapper/308:41:003
4164894993229,2cyclictest0-21swapper/210:54:562
4164894993229,2cyclictest0-21swapper/209:09:002
4164894993229,2cyclictest0-21swapper/208:09:542
4164894993229,2cyclictest0-21swapper/207:27:592
4164899993129,1cyclictest0-21swapper/310:26:593
4164894993129,1cyclictest0-21swapper/208:35:012
4164894993128,2cyclictest0-21swapper/212:07:582
4164894993125,5cyclictest0-21swapper/211:10:132
4164894993125,5cyclictest0-21swapper/208:35:132
416489499310,1cyclictest0-21swapper/209:55:132
4164899993027,2cyclictest0-21swapper/310:00:133
4164899993027,2cyclictest0-21swapper/310:00:133
4164899993025,4cyclictest59605-21turbostat11:45:003
4164899993025,4cyclictest59605-21turbostat11:44:593
416489499300,2cyclictest0-21swapper/207:30:122
416489499300,2cyclictest0-21swapper/207:30:122
416489499300,29cyclictest0-21swapper/210:30:132
416489499300,28cyclictest0-21swapper/207:16:592
4577091290,7ptp4l441ktimers/307:15:003
4577091290,6ptp4l441ktimers/308:49:553
4164899992927,1cyclictest0-21swapper/309:34:553
4164899992927,1cyclictest0-21swapper/308:30:583
416489999290,27cyclictest0-21swapper/309:35:133
416489999290,27cyclictest0-21swapper/308:15:133
416489999290,1cyclictest0-21swapper/309:20:143
4164894992927,1cyclictest0-21swapper/212:14:592
4164894992926,2cyclictest0-21swapper/211:15:122
4164894992926,2cyclictest0-21swapper/210:45:122
4164894992926,2cyclictest0-21swapper/210:45:122
416489499290,28cyclictest0-21swapper/209:45:142
416489499290,27cyclictest0-21swapper/210:20:142
416489499290,27cyclictest0-21swapper/207:35:132
4577091280,7ptp4l61490irq/134-eno1-TxRx-008:30:013
4577091280,7ptp4l61490irq/134-eno1-TxRx-007:20:013
4577091280,7ptp4l441ktimers/309:00:003
4577091280,6ptp4l441ktimers/311:50:003
4577091280,6ptp4l441ktimers/311:30:003
4577091280,6ptp4l441ktimers/311:25:003
4164899992825,2cyclictest0-21swapper/311:15:133
4164899992825,2cyclictest0-21swapper/307:51:003
416489999280,26cyclictest0-21swapper/312:00:123
416489999280,26cyclictest0-21swapper/308:35:133
4164894992826,1cyclictest0-21swapper/208:58:582
4164894992825,2cyclictest0-21swapper/209:50:142
416489499280,26cyclictest0-21swapper/212:00:132
416489499280,26cyclictest0-21swapper/210:35:122
416489499280,26cyclictest0-21swapper/210:11:002
416489499280,26cyclictest0-21swapper/209:14:592
416489499280,26cyclictest0-21swapper/208:40:122
416489499280,26cyclictest0-21swapper/208:10:592
416489499280,26cyclictest0-21swapper/207:22:002
4577091270,6ptp4l61490irq/134-eno1-TxRx-011:10:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:10:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-007:40:003
4577091270,6ptp4l441ktimers/312:35:003
4577091270,6ptp4l441ktimers/309:50:013
4577091270,6ptp4l441ktimers/307:45:003
4164899992725,1cyclictest0-21swapper/312:36:003
4164899992725,1cyclictest0-21swapper/307:24:563
4164899992724,2cyclictest0-21swapper/312:05:593
416489999270,1cyclictest0-21swapper/307:25:583
4164894992725,1cyclictest0-21swapper/209:40:002
4577091260,6ptp4l61490irq/134-eno1-TxRx-008:55:003
4577091260,5ptp4l441ktimers/312:29:563
4577091260,5ptp4l441ktimers/312:29:563
4577091260,5ptp4l441ktimers/309:19:553
4577091260,5ptp4l441ktimers/309:05:013
4577091260,5ptp4l441ktimers/308:09:563
4164899992625,1cyclictest0-21swapper/307:50:003
4164894992623,2cyclictest0-21swapper/210:26:592
416489499260,2cyclictest0-21swapper/208:28:582
416489499260,24cyclictest0-21swapper/211:22:592
416489499260,24cyclictest0-21swapper/207:11:582
4577091250,3ptp4l441ktimers/310:25:013
4164899992523,1cyclictest0-21swapper/312:14:553
4164894992422,1cyclictest0-21swapper/210:56:592
4164894992321,1cyclictest0-21swapper/211:55:592
4164894992321,1cyclictest0-21swapper/209:30:002
4164894992321,1cyclictest0-21swapper/207:52:002
4164894992219,2cyclictest0-21swapper/211:33:002
4164894992118,2cyclictest0-21swapper/212:18:002
416489099210,2cyclictest171rcu_preempt07:10:021
4164894991815,2cyclictest0-21swapper/212:35:132
4164894991815,2cyclictest0-21swapper/211:00:592
4164894991815,2cyclictest0-21swapper/210:15:112
41648949930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional