You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 22:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 09, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3157674999795,1cyclictest0-21swapper/109:47:001
3157673999686,7cyclictest3172235-21latency_hist07:55:010
3157674999472,20cyclictest3227137-21apt-get10:45:011
3157673999288,3cyclictest3251560-21kworker/u8:1+events_unbound12:25:250
3157674999182,5cyclictest3207805-21kworker/u8:1+flush-179:010:10:261
3157674998676,7cyclictest3157544-21latency_hist07:10:031
3157673998681,4cyclictest3251560-21kworker/u8:1+events_unbound12:30:250
3157673998674,4cyclictest3251560-21kworker/u8:1+events_unbound12:05:200
3157674998576,6cyclictest3160406-21kworker/u8:2+flush-179:007:20:001
3157674998549,33cyclictest3160406-21kworker/u8:2+flush-179:008:00:311
3157674998272,7cyclictest3196626-21latency_hist09:10:011
3157674998266,13cyclictest3165766-21kworker/u8:3+flush-179:008:10:011
3157673998177,3cyclictest3212514-21kworker/u8:0+events_unbound10:50:250
3157673997969,7cyclictest3210941-21latency_hist09:55:010
3157673997963,11cyclictest271-21systemd-journal10:10:010
3157673997874,3cyclictest3198196-21kworker/u8:2+events_unbound09:15:240
3157674997667,7cyclictest3239025-21/usr/sbin/munin11:20:251
3157674997667,7cyclictest3239025-21/usr/sbin/munin11:20:251
3157673997672,3cyclictest3188658-21kworker/u8:0+events_unbound08:50:240
3157674997565,7cyclictest3188711-21kworker/u8:1+flush-179:008:50:011
3157673997570,4cyclictest3212514-21kworker/u8:0+flush-179:010:15:240
3157673997569,4cyclictest3198196-21kworker/u8:2+events_unbound09:25:190
3157673997564,8cyclictest3177013-21latency_hist08:10:010
3157673997470,3cyclictest3238819-21kworker/u8:0+events_unbound11:45:170
3157673997470,3cyclictest3230792-21kworker/u8:1+events_unbound10:55:270
3157673997469,4cyclictest3238819-21kworker/u8:0+events_unbound12:00:240
3157673997260,9cyclictest3219579-21kworker/u8:1+flush-179:010:30:010
3157674997163,6cyclictest3173876-21kworker/u8:1+flush-179:008:10:231
3157674996859,6cyclictest3237157-21kworker/u8:3+flush-179:011:15:251
3157673996863,4cyclictest3238819-21kworker/u8:0+events_unbound11:25:260
3157674996759,6cyclictest502-21rs:main1
3157674996752,10cyclictest3251560-21kworker/u8:1+events_unbound12:00:031
3157673996763,3cyclictest3183877-21kworker/u8:3+events_unbound08:40:260
4670791660,17ptp4l441ktimers/307:07:533
3157673996660,5cyclictest3198196-21kworker/u8:2+events_unbound09:20:180
3157673996654,8cyclictest3188711-21kworker/u8:1+flush-179:009:10:150
3157674996554,10cyclictest3196605-21kworker/u8:0+flush-179:009:40:001
3157674996456,5cyclictest3251560-21kworker/u8:1+flush-179:012:05:141
3157673996460,3cyclictest3196605-21kworker/u8:0+events_unbound09:45:270
3157673996459,4cyclictest3235574-21kworker/u8:2+flush-179:011:40:160
3157674996353,7cyclictest3180498-21kworker/u8:0+events_unbound08:20:231
3157674996353,7cyclictest3162610-21latency_hist07:25:011
3157673996358,4cyclictest3207805-21kworker/u8:1+flush-179:009:59:550
3157674996252,6cyclictest3230792-21kworker/u8:1+flush-179:010:55:251
3157674996251,8cyclictest3212514-21kworker/u8:0+flush-179:010:50:221
3157673996257,3cyclictest3251560-21kworker/u8:1+events_unbound12:15:200
3157673996156,4cyclictest3160406-21kworker/u8:2+flush-179:008:04:560
3157673996056,3cyclictest3233989-21kworker/u8:0+events_unbound11:10:180
3157674995952,5cyclictest3185724-21/usr/sbin/munin08:35:231
3157673995955,3cyclictest3173876-21kworker/u8:1+events_unbound08:10:250
3157674995852,4cyclictest3214137-21latency_hist10:05:011
3157674995852,4cyclictest3188711-21kworker/u8:1+flush-179:008:55:011
3157674995851,5cyclictest3165766-21kworker/u8:3+flush-179:008:00:011
3157673995852,5cyclictest3165766-21kworker/u8:3+events_unbound07:35:220
3157674995748,6cyclictest3248318-21latency_hist11:50:021
3157673995753,3cyclictest3212514-21kworker/u8:0+events_unbound10:35:180
3157673995753,3cyclictest3173876-21kworker/u8:1+events_unbound08:25:210
3157673995752,4cyclictest3217012-21kworker/u8:2+flush-179:010:10:290
3157673995749,6cyclictest3180459-21latency_hist08:20:010
3157673995747,8cyclictest3165785-21latency_hist07:35:020
3157674995650,4cyclictest3251560-21kworker/u8:1+flush-179:012:30:221
3157673995651,4cyclictest3235574-21kworker/u8:2+events_unbound12:10:310
3157673995651,4cyclictest3217342-21kworker/u8:3+events_unbound10:20:160
3157673995651,4cyclictest3160406-21kworker/u8:2+events_unbound07:40:250
3157674995547,6cyclictest3251560-21kworker/u8:1+events_unbound12:00:001
3157674995546,6cyclictest3248354-21kworker/u8:3+events_unbound11:55:001
3157674995546,6cyclictest3248354-21kworker/u8:3+events_unbound11:55:001
3157673995551,3cyclictest3219579-21kworker/u8:1+flush-179:010:30:310
3157673995550,4cyclictest3191883-21kworker/u8:2+flush-179:009:00:210
3157674995449,4cyclictest3212514-21kworker/u8:0+flush-179:010:20:311
3157674995347,4cyclictest3230792-21kworker/u8:1+flush-179:011:05:221
3157674995346,5cyclictest3230792-21kworker/u8:1+events_unbound11:05:001
3157673995349,3cyclictest3227249-21kworker/u8:3+events_unbound10:45:280
3157673995347,4cyclictest3244073-21journal-offline11:35:150
3157679995249,2cyclictest0-21swapper/210:06:582
3157673995244,6cyclictest3237432-21apt-get11:15:140
3157673995243,7cyclictest3240370-21latency_hist11:25:010
3157673995243,7cyclictest3240370-21latency_hist11:25:000
3157673995239,4cyclictest3207805-21kworker/u8:1+events_unbound10:00:170
3157673995147,3cyclictest3173876-21kworker/u8:1+events_unbound08:30:190
3157673995147,3cyclictest3144865-21kworker/u8:0+events_unbound07:20:290
3157673995145,5cyclictest3183877-21kworker/u8:3+events_unbound08:35:190
3157673995141,8cyclictest3204833-21apt-get09:35:120
3157674995044,4cyclictest3235574-21kworker/u8:2+flush-179:011:30:161
3157673995045,4cyclictest3165766-21kworker/u8:3+flush-179:007:55:210
3157674994941,6cyclictest3238819-21kworker/u8:0+flush-179:011:45:001
3157674994941,6cyclictest271-21systemd-journal12:26:301
3157674994843,4cyclictest3235574-21kworker/u8:2+events_unbound12:10:291
3157673994844,3cyclictest3144865-21kworker/u8:0+flush-179:007:15:190
3157673994841,6cyclictest3188711-21kworker/u8:1+events_unbound09:05:120
3157674994742,4cyclictest3196605-21kworker/u8:0+flush-179:009:14:561
3157674994741,5cyclictest3198196-21kworker/u8:2+flush-179:009:25:001
3157674994741,4cyclictest3160406-21kworker/u8:2+flush-179:007:40:261
3157673994743,3cyclictest3230792-21kworker/u8:1+flush-179:011:05:150
3157673994743,3cyclictest3180498-21kworker/u8:0+flush-179:008:20:250
3157674994643,2cyclictest723-21Xorg10:45:591
3157674994640,4cyclictest3188711-21kworker/u8:1+flush-179:009:05:001
3157673994641,4cyclictest3238819-21kworker/u8:0+events_unbound11:50:290
3157673994641,4cyclictest3238819-21kworker/u8:0+events_unbound11:50:280
3157674994539,4cyclictest3154517-21kworker/u8:1+events_unbound07:15:011
3157674994538,4cyclictest3238819-21kworker/u8:0+flush-179:011:25:191
3157673994541,3cyclictest3251560-21kworker/u8:1+events_unbound12:20:220
315768099440,42cyclictest3258380-21turbostat12:20:003
3157674994440,3cyclictest3198196-21kworker/u8:2+flush-179:009:15:241
3157674994434,8cyclictest3215720-21latency_hist10:10:021
3157673994440,3cyclictest3202449-21kworker/u8:1+events_unbound09:30:190
3157673994439,4cyclictest3160406-21kworker/u8:2+events_unbound07:29:320
3157674994336,4cyclictest3238819-21kworker/u8:0+flush-179:011:35:181
3157673994339,3cyclictest3248354-21kworker/u8:3+events_unbound11:55:220
3157673994339,3cyclictest3212514-21kworker/u8:0+events_unbound10:40:230
3157673994339,3cyclictest3196605-21kworker/u8:0+events_unbound09:40:210
3157673994338,4cyclictest3232377-21kworker/u8:2+flush-179:011:00:010
3157674994231,10cyclictest3191883-21kworker/u8:2+flush-179:009:00:011
3157673994235,5cyclictest3185467-21kworker/u8:4+events_unbound08:45:130
3157674994138,2cyclictest3198196-21kworker/u8:2+events_unbound09:25:251
3157674994136,4cyclictest3237184-21apt11:15:001
3157674994135,5cyclictest3144865-21kworker/u8:0+flush-179:007:25:241
3157674994134,4cyclictest3212514-21kworker/u8:0+events_unbound10:30:011
3157674994132,7cyclictest3187348-21apt-get08:40:121
3157674994131,4cyclictest3196605-21kworker/u8:0+events_unbound09:40:141
315768099400,4cyclictest3235595-21turbostat11:10:013
315768099400,38cyclictest3222099-21turbostat10:30:013
3157674994035,3cyclictest723-21Xorg10:35:591
3157673994036,3cyclictest3188711-21kworker/u8:1+flush-179:008:55:250
3157673994035,4cyclictest3260291-21kworker/u8:0+flush-179:012:35:160
3157673994035,4cyclictest3154517-21kworker/u8:1+events_unbound07:10:310
3157673994035,3cyclictest3243556-21ls11:35:010
3157680993934,4cyclictest3177017-21turbostat08:10:003
315768099390,38cyclictest0-21swapper/310:56:593
315767999390,36cyclictest0-21swapper/209:14:552
3157674993934,4cyclictest3203027-21kworker/u8:3+flush-179:009:31:301
3157674993933,4cyclictest3165766-21kworker/u8:3+flush-179:007:35:261
3157674993931,5cyclictest3207805-21kworker/u8:1+flush-179:009:55:001
315767499390,37cyclictest723-21Xorg08:34:001
315767499390,2cyclictest723-21Xorg12:19:591
315768099380,1cyclictest0-21swapper/307:51:003
3157679993835,2cyclictest0-21swapper/209:31:592
3157679993834,2cyclictest0-21swapper/209:04:552
315767999380,36cyclictest0-21swapper/210:56:592
315767999380,36cyclictest0-21swapper/210:36:592
315767999380,2cyclictest0-21swapper/209:27:592
315767999380,29cyclictest0-21swapper/210:30:002
3157680993735,1cyclictest0-21swapper/307:24:553
3157680993734,2cyclictest0-21swapper/312:22:593
3157679993734,2cyclictest0-21swapper/212:22:592
3157679993734,2cyclictest0-21swapper/208:10:002
3157679993734,2cyclictest0-21swapper/207:24:552
315767999370,2cyclictest0-21swapper/207:51:002
3157674993732,4cyclictest3260291-21kworker/u8:0+flush-179:012:35:241
3157680993634,1cyclictest0-21swapper/311:19:553
3157680993634,1cyclictest0-21swapper/309:32:003
3157680993634,1cyclictest0-21swapper/309:04:553
3157680993633,2cyclictest0-21swapper/307:29:593
3157680993627,5cyclictest3243552-21turbostat11:35:003
315768099360,35cyclictest0-21swapper/310:36:583
315768099360,35cyclictest0-21swapper/309:14:563
3157679993633,2cyclictest0-21swapper/211:19:552
3157679993633,2cyclictest0-21swapper/207:29:592
315767999360,2cyclictest0-21swapper/207:42:592
3157674993630,4cyclictest3165766-21kworker/u8:3+events_unbound07:45:251
3157680993532,2cyclictest0-21swapper/310:07:593
3157679993531,2cyclictest0-21swapper/212:09:552
3157679993531,2cyclictest0-21swapper/210:04:552
3157680993432,1cyclictest0-21swapper/310:04:553
3157680993431,2cyclictest0-21swapper/312:35:593
3157679993431,2cyclictest0-21swapper/212:35:592
3157674993430,2cyclictest723-21Xorg10:25:591
3157674993425,8cyclictest3210949-21idleruntime-cro09:54:591
3157674993424,8cyclictest3160406-21kworker/u8:2+events_unbound07:30:141
315768099330,3cyclictest3187081-21turbostat08:44:553
3157674993328,4cyclictest3165766-21kworker/u8:3+flush-179:008:15:211
3157673993328,4cyclictest3165766-21kworker/u8:3+events_unbound07:45:290
3157680993230,1cyclictest0-21swapper/312:09:563
3157680993227,2cyclictest0-21swapper/311:35:143
3157679993229,2cyclictest0-21swapper/208:21:592
3157679993227,2cyclictest0-21swapper/211:35:132
315767999320,23cyclictest0-21swapper/211:55:142
3157674993228,3cyclictest3183586-21switchtime08:25:231
315767499321,29cyclictest0-21swapper/110:15:141
3157680993128,2cyclictest0-21swapper/308:21:593
3157680993126,4cyclictest3190273-21turbostat08:54:563
3157680993125,4cyclictest3263160-21turbostat12:35:003
3157679993127,2cyclictest0-21swapper/210:10:592
315767999310,28cyclictest0-21swapper/207:39:592
3157674993125,5cyclictest3160406-21kworker/u8:2+flush-179:007:50:151
3157680993028,1cyclictest0-21swapper/310:10:593
315768099300,28cyclictest0-21swapper/312:10:023
315768099300,28cyclictest0-21swapper/310:40:123
315768099300,28cyclictest0-21swapper/308:35:133
315768099300,27cyclictest0-21swapper/309:50:123
3157679993026,2cyclictest0-21swapper/210:44:592
315767999300,28cyclictest0-21swapper/212:00:022
315767999300,28cyclictest0-21swapper/211:05:142
315767999300,28cyclictest0-21swapper/210:50:032
315767999300,27cyclictest0-21swapper/209:50:122
315767999300,27cyclictest0-21swapper/209:37:592
4670791290,7ptp4l441ktimers/311:50:013
4670791290,6ptp4l441ktimers/311:15:003
3157680992926,2cyclictest0-21swapper/309:18:003
3157680992925,2cyclictest0-21swapper/312:00:023
3157680992923,5cyclictest3234017-21turbostat11:05:013
315768099290,2cyclictest0-21swapper/307:55:133
315768099290,28cyclictest0-21swapper/307:30:123
315768099290,27cyclictest0-21swapper/308:25:033
315768099290,1cyclictest0-21swapper/311:55:133
315768099290,1cyclictest0-21swapper/309:27:583
315768099290,1cyclictest0-21swapper/307:39:593
3157679992926,2cyclictest0-21swapper/212:10:042
3157679992926,2cyclictest0-21swapper/209:18:002
3157679992926,2cyclictest0-21swapper/209:06:592
3157679992926,2cyclictest0-21swapper/208:54:552
3157679992926,2cyclictest0-21swapper/207:55:142
3157679992925,2cyclictest0-21swapper/211:42:002
3157679992925,2cyclictest0-21swapper/209:56:592
3157679992925,2cyclictest0-21swapper/207:30:122
315767999290,28cyclictest0-21swapper/210:45:012
315767999290,27cyclictest0-21swapper/208:55:592
315767999290,21cyclictest0-21swapper/211:30:132
4670791280,7ptp4l61690irq/136-eno1-TxRx-007:50:003
3157680992825,2cyclictest0-21swapper/308:35:003
3157680992825,2cyclictest0-21swapper/307:10:593
3157680992822,5cyclictest3178870-21turbostat08:15:003
315768099280,26cyclictest0-21swapper/310:50:023
315768099280,26cyclictest0-21swapper/310:45:023
315768099280,1cyclictest0-21swapper/310:30:033
3157679992825,2cyclictest0-21swapper/212:33:002
3157679992825,2cyclictest0-21swapper/208:25:032
3157679992824,2cyclictest0-21swapper/208:11:592
315767999280,2cyclictest0-21swapper/210:30:032
315767999280,2cyclictest0-21swapper/208:35:132
315767999280,26cyclictest0-21swapper/207:15:032
315767999280,19cyclictest0-21swapper/209:45:592
4670791270,6ptp4l61690irq/136-eno1-TxRx-011:55:013
4670791270,6ptp4l61690irq/136-eno1-TxRx-011:55:003
4670791270,6ptp4l441ktimers/309:44:553
4670791270,6ptp4l441ktimers/308:05:003
4670791270,5ptp4l441ktimers/312:30:013
3157680992725,2cyclictest0-21swapper/309:56:583
3157680992725,1cyclictest0-21swapper/309:06:583
3157680992719,6cyclictest3180471-21turbostat08:20:003
315768099270,26cyclictest0-21swapper/309:37:593
315768099270,24cyclictest0-21swapper/310:15:133
315768099270,1cyclictest0-21swapper/311:41:593
315768099270,1cyclictest0-21swapper/307:42:593
3157679992724,2cyclictest0-21swapper/208:35:002
3157679992724,2cyclictest0-21swapper/207:10:592
315767999270,25cyclictest0-21swapper/208:03:592
4670791260,6ptp4l61690irq/136-eno1-TxRx-010:25:003
4670791260,6ptp4l61690irq/136-eno1-TxRx-008:50:003
4670791260,5ptp4l61690irq/136-eno1-TxRx-011:24:563
4670791260,5ptp4l61690irq/136-eno1-TxRx-011:24:553
315768099260,24cyclictest0-21swapper/307:15:033
315768099260,1cyclictest0-21swapper/308:55:593
315767999260,24cyclictest0-21swapper/211:47:582
4670791250,4ptp4l61690irq/136-eno1-TxRx-009:24:553
4670791250,4ptp4l441ktimers/311:29:543
4670791250,4ptp4l441ktimers/309:49:573
3157679992523,1cyclictest0-21swapper/211:05:002
3157679992522,2cyclictest0-21swapper/208:43:592
3157679992421,2cyclictest0-21swapper/209:24:592
3157679992420,2cyclictest0-21swapper/212:15:132
3157679992218,2cyclictest0-21swapper/208:49:562
3157679992118,2cyclictest0-21swapper/211:14:562
3157679992017,2cyclictest0-21swapper/209:40:132
3157679992016,2cyclictest0-21swapper/211:53:592
3157679992016,2cyclictest0-21swapper/211:53:592
3157673992013,2cyclictest171rcu_preempt07:10:020
3157679991815,2cyclictest0-21swapper/208:15:592
3157679991815,2cyclictest0-21swapper/207:45:592
3157679991714,1cyclictest0-21swapper/211:29:592
3157679991713,2cyclictest0-21swapper/212:26:592
3157679991512,2cyclictest0-21swapper/211:25:002
3157679991512,2cyclictest0-21swapper/211:24:592
3157679991411,2cyclictest0-21swapper/210:25:002
3157679991410,2cyclictest0-21swapper/210:18:002
31576799940,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional