You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 19:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Wed Dec 24, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
376466999485,7cyclictest450118-21latency_hist11:00:010
376466999081,7cyclictest436754-21kworker/u8:0+flush-179:010:35:250
376466998475,6cyclictest415900-21kworker/u8:0+flush-179:009:20:210
376466998274,6cyclictest379570-21latency_hist07:20:020
376468998174,5cyclictest384364-21kworker/u8:2+flush-179:007:55:251
376466997970,7cyclictest392313-21latency_hist08:00:000
376468997870,5cyclictest429425-21latency_hist09:55:011
376466997768,6cyclictest431013-21latency_hist10:00:000
376466997768,6cyclictest431013-21latency_hist10:00:000
376466997565,8cyclictest466025-21latency_hist11:50:020
376466997469,3cyclictest461271-21kworker/u8:2+flush-179:011:40:200
376468997367,4cyclictest446931-21latency_hist10:50:011
376468997263,6cyclictest401841-21kworker/u8:1+flush-179:008:55:191
376468997262,7cyclictest424408-21latency_hist09:40:001
376466997265,5cyclictest446966-21kworker/u8:1+flush-179:010:50:240
376468997164,5cyclictest475838-21latency_hist12:20:011
376468997058,9cyclictest409820-21apt-get08:55:011
376468996861,5cyclictest436754-21kworker/u8:0+flush-179:010:55:011
376466996860,6cyclictest381188-21kworker/u8:3+flush-179:007:45:120
376466996860,6cyclictest381188-21kworker/u8:3+flush-179:007:45:120
376468996760,5cyclictest464442-21latency_hist11:45:011
376468996758,6cyclictest393911-21latency_hist08:05:011
376466996761,4cyclictest384364-21kworker/u8:2+flush-179:007:40:010
376466996757,8cyclictest411678-21latency_hist09:00:020
376466996655,8cyclictest440808-21/usr/sbin/munin10:30:250
376468996353,8cyclictest379821-21apt-get07:20:151
376468996257,4cyclictest479037-21kworker/u8:0+flush-179:012:30:001
376468996257,3cyclictest376383-21kworker/u8:1+flush-179:007:15:251
376468996146,13cyclictest401841-21kworker/u8:1+flush-179:009:14:511
376468995953,4cyclictest459115-21kworker/u8:0+flush-179:011:30:191
376466995952,5cyclictest401841-21kworker/u8:1+flush-179:008:31:020
376468995848,8cyclictest405311-21apt-get08:40:111
376468995847,8cyclictest376383-21kworker/u8:1+events_unbound07:25:211
376468995751,5cyclictest436754-21kworker/u8:0+flush-179:010:40:001
376466995749,6cyclictest458077-21latency_hist11:25:000
376466995749,6cyclictest458077-21latency_hist11:25:000
376466995739,17cyclictest434224-21kworker/u8:3+flush-179:010:15:260
376468995649,5cyclictest466054-21kworker/u8:0+flush-179:012:09:591
376468995646,8cyclictest400532-21apt-get08:25:121
376473995452,1cyclictest0-21swapper/312:21:593
376468995447,5cyclictest421470-21apt-get09:30:131
376468995444,8cyclictest381188-21kworker/u8:3+flush-179:007:54:591
376466995433,3cyclictest439608-21fschecks_time10:25:150
376468995347,4cyclictest479271-21apt-get12:30:131
376466995347,5cyclictest401841-21kworker/u8:1+flush-179:009:10:000
376466995347,4cyclictest422781-21kworker/u8:2+flush-179:009:35:200
376466995345,6cyclictest472649-21latency_hist12:10:010
376473995245,4cyclictest431028-21turbostat09:59:593
376473995245,4cyclictest431028-21turbostat09:59:593
376468995244,5cyclictest440566-21latency_hist10:30:001
376468995143,6cyclictest401841-21kworker/u8:1+flush-179:009:50:011
376468995045,4cyclictest436754-21kworker/u8:0+flush-179:010:45:001
376466995045,4cyclictest459115-21kworker/u8:0+flush-179:011:30:250
37647299490,40cyclictest0-21swapper/210:05:592
376468994942,5cyclictest408226-21latency_hist08:50:011
376468994940,6cyclictest400276-21latency_hist08:25:001
376466994945,3cyclictest393391-21kworker/u8:0+flush-179:008:15:270
376466994843,4cyclictest436754-21kworker/u8:0+flush-179:011:00:260
4577091470,13ptp4l61490irq/134-eno1-TxRx-007:10:003
376468994741,4cyclictest455921-21kworker/u8:2+flush-179:011:20:221
376468994741,4cyclictest455921-21kworker/u8:2+flush-179:011:20:221
376468994739,6cyclictest413265-21latency_hist09:05:011
376466994741,5cyclictest461271-21kworker/u8:2+flush-179:011:35:260
376466994741,4cyclictest384364-21kworker/u8:2+flush-179:008:10:240
376466994741,4cyclictest384364-21kworker/u8:2+flush-179:008:10:240
376466994738,7cyclictest472683-21kworker/u8:3+flush-179:012:15:250
37647299460,39cyclictest0-21swapper/208:34:552
376468994637,7cyclictest395508-21latency_hist08:10:011
376466994638,6cyclictest393391-21kworker/u8:0+flush-179:008:05:240
376468994539,4cyclictest446966-21kworker/u8:1+flush-179:011:50:111
376468994538,5cyclictest266-21systemd-journal07:13:191
376468994536,8cyclictest404435-21netstat08:35:191
376466994537,6cyclictest408464-21/usr/sbin/munin08:50:170
376466994535,8cyclictest425996-21latency_hist09:45:010
376468994433,9cyclictest468126-21apt-get11:55:131
376466994440,3cyclictest401841-21kworker/u8:1+flush-179:009:30:240
376466994438,4cyclictest714-21Xorg11:07:590
376466994438,4cyclictest446966-21kworker/u8:1+flush-179:011:25:150
376466994437,4cyclictest1-21systemd10:43:190
376466994434,8cyclictest411934-21apt-get09:00:130
376468994335,6cyclictest459661-21latency_hist11:30:011
376468994335,6cyclictest401841-21kworker/u8:1+flush-179:009:15:221
376468994335,6cyclictest384338-21apt07:34:591
376466994337,5cyclictest472683-21kworker/u8:3+flush-179:012:20:240
376466994337,5cyclictest443806-21kworker/u8:2+events_unbound10:45:220
376466994335,5cyclictest0-21swapper/012:33:580
37647399420,41cyclictest0-21swapper/310:18:593
37647399420,41cyclictest0-21swapper/308:59:003
376468994236,5cyclictest393945-21kworker/u8:1+flush-179:008:10:271
376468994236,5cyclictest393945-21kworker/u8:1+flush-179:008:10:271
37646899421,38cyclictest434459-21apt-get10:10:141
376466994236,5cyclictest466054-21kworker/u8:0+flush-179:012:10:150
376466994235,5cyclictest266-21systemd-journal11:13:190
37647399410,39cyclictest393918-21turbostat08:05:013
376468994138,2cyclictest0-21swapper/111:07:591
376468994135,4cyclictest461271-21kworker/u8:2+flush-179:011:50:001
376468994134,5cyclictest474241-21munin-plugin-st12:15:011
376468994134,5cyclictest461264-21turbostat11:39:551
376468994133,6cyclictest510-21rs:main1
376468994133,6cyclictest510-21rs:main1
376466994135,4cyclictest0-21swapper/008:26:580
37647399400,39cyclictest0-21swapper/310:49:593
37647399400,39cyclictest0-21swapper/308:16:003
376468994037,2cyclictest415900-21kworker/u8:0+events_unbound10:05:191
376468994036,2cyclictest714-21Xorg09:43:591
37646899401,2cyclictest714-21Xorg09:07:591
376466994035,3cyclictest384340-21basename07:35:000
376466994033,5cyclictest401841-21kworker/u8:1+flush-179:008:35:250
37647399390,5cyclictest385951-21turbostat07:40:013
37647299390,37cyclictest0-21swapper/208:55:582
376468993936,2cyclictest714-21Xorg12:04:001
376468993934,4cyclictest472683-21kworker/u8:3+flush-179:012:20:221
376468993934,4cyclictest434224-21kworker/u8:3+flush-179:010:20:221
376468993930,6cyclictest421214-21latency_hist09:30:021
376468993927,5cyclictest0-21swapper/110:15:141
37646899390,38cyclictest0-21swapper/108:34:001
376466993934,4cyclictest434224-21kworker/u8:3+events_unbound10:20:160
376466993932,6cyclictest429472-21kworker/u8:2+events_unbound10:10:190
376472993835,2cyclictest0-21swapper/211:44:542
376472993834,2cyclictest0-21swapper/211:36:592
376472993826,2cyclictest0-21swapper/212:01:592
37647299380,36cyclictest0-21swapper/209:38:582
376468993833,4cyclictest455921-21kworker/u8:2+flush-179:011:15:211
376466993835,2cyclictest0-21swapper/012:04:000
37646699381,32cyclictest0-21swapper/011:50:130
37646699380,1cyclictest0-21swapper/008:48:590
37647399370,35cyclictest0-21swapper/310:00:593
376472993734,2cyclictest0-21swapper/211:24:552
376472993734,2cyclictest0-21swapper/211:24:552
376472993734,2cyclictest0-21swapper/210:37:592
376472993734,2cyclictest0-21swapper/207:39:002
376472993733,2cyclictest0-21swapper/208:53:582
37647299370,34cyclictest0-21swapper/210:30:002
376468993728,6cyclictest0-21swapper/110:30:591
376466993730,6cyclictest399267-21kworker/u8:3+events_unbound08:20:240
376466993730,5cyclictest382756-21basename07:30:000
376473993634,1cyclictest0-21swapper/307:53:003
37647399360,35cyclictest0-21swapper/312:33:583
37647399360,35cyclictest0-21swapper/312:05:593
37647399360,35cyclictest0-21swapper/308:29:553
37647399360,35cyclictest0-21swapper/307:56:583
37647299360,1cyclictest0-21swapper/212:17:002
37647299360,1cyclictest0-21swapper/210:43:592
376468993627,5cyclictest0-21swapper/111:10:141
376466993633,2cyclictest714-21Xorg08:44:590
376466993632,3cyclictest429472-21kworker/u8:2+flush-179:010:00:260
376466993630,5cyclictest376383-21kworker/u8:1+flush-179:007:20:180
376473993533,1cyclictest0-21swapper/311:11:593
37647399350,34cyclictest0-21swapper/309:04:553
376472993532,2cyclictest0-21swapper/209:34:552
376472993532,2cyclictest0-21swapper/209:07:582
37647299350,1cyclictest0-21swapper/211:19:002
376468993531,3cyclictest450820-21hwlatdetect11:00:181
37646899352,31cyclictest431287-21apt-get10:00:151
376466993531,3cyclictest469515-21systemd-run12:00:000
376468993428,4cyclictest442002-21kworker/u8:3+flush-179:010:55:221
376466993428,5cyclictest475888-21kworker/u8:1+flush-179:012:35:250
376466993428,5cyclictest384364-21kworker/u8:2+flush-179:008:00:120
376472993331,1cyclictest0-21swapper/211:29:592
376472993331,1cyclictest0-21swapper/210:59:592
376472993330,2cyclictest0-21swapper/210:16:592
37647299330,31cyclictest0-21swapper/211:11:592
376468993327,4cyclictest386801-21latency07:40:181
376466993329,3cyclictest415900-21kworker/u8:0+flush-179:009:50:000
37647299320,2cyclictest0-21swapper/209:25:582
376468993228,3cyclictest397768-21hwlatdetect08:15:171
376466993228,3cyclictest714-21Xorg10:06:580
376466993228,3cyclictest0-21swapper/012:30:000
376466993227,3cyclictest377968-21apt07:15:000
376466993226,5cyclictest455921-21kworker/u8:2+flush-179:011:20:010
376466993226,4cyclictest428635-21kernelversion09:50:200
376466993226,4cyclictest401841-21kworker/u8:1+flush-179:009:10:170
376466993226,4cyclictest387587-21systemd07:45:000
37647399310,30cyclictest0-21swapper/308:36:003
376472993128,2cyclictest0-21swapper/208:48:592
376473993024,4cyclictest406655-21turbostat08:44:593
376472993028,1cyclictest0-21swapper/209:49:592
376472993027,2cyclictest0-21swapper/208:14:592
376472993027,2cyclictest0-21swapper/208:14:582
37647299300,28cyclictest0-21swapper/212:10:152
37647299300,1cyclictest0-21swapper/207:20:002
376468993026,2cyclictest714-21Xorg12:36:591
376468993025,4cyclictest419493-21unixbench-2d09:20:261
37646899300,28cyclictest714-21Xorg09:55:591
37646899300,28cyclictest714-21Xorg09:55:591
4577091290,9ptp4l441ktimers/311:49:563
376473992927,1cyclictest0-21swapper/311:00:593
376473992927,1cyclictest0-21swapper/310:33:593
376473992927,1cyclictest0-21swapper/310:28:593
376473992927,1cyclictest0-21swapper/309:06:593
376473992927,1cyclictest0-21swapper/308:10:583
376473992927,1cyclictest0-21swapper/308:10:583
376472992926,2cyclictest0-21swapper/212:37:582
376472992926,2cyclictest0-21swapper/211:00:592
376472992926,2cyclictest0-21swapper/207:25:132
37647299290,2cyclictest0-21swapper/212:21:582
37647299290,28cyclictest0-21swapper/210:00:152
37647299290,27cyclictest0-21swapper/212:05:152
37647299290,27cyclictest0-21swapper/211:50:132
37647299290,27cyclictest0-21swapper/211:05:132
37646699290,27cyclictest714-21Xorg07:52:590
231999290,17rtkit-daemon375833-21ntp_states07:05:281
4577091280,7ptp4l441ktimers/307:24:593
4577091280,6ptp4l441ktimers/312:20:003
4577091280,6ptp4l441ktimers/312:15:003
4577091280,6ptp4l441ktimers/309:15:003
376473992826,1cyclictest0-21swapper/312:35:153
376473992826,1cyclictest0-21swapper/308:20:133
376473992826,1cyclictest0-21swapper/307:44:583
37647399280,27cyclictest0-21swapper/307:10:113
37647399280,26cyclictest0-21swapper/310:50:143
376472992825,2cyclictest0-21swapper/212:32:002
376472992825,2cyclictest0-21swapper/209:03:002
376472992825,2cyclictest0-21swapper/207:20:162
376472992824,2cyclictest0-21swapper/208:22:002
37647299280,26cyclictest0-21swapper/212:25:592
37647299280,26cyclictest0-21swapper/210:30:162
37647299280,26cyclictest0-21swapper/210:10:152
37647299280,26cyclictest0-21swapper/208:05:152
37647299280,24cyclictest0-21swapper/208:05:002
37647299280,21cyclictest0-21swapper/209:10:132
376466992823,3cyclictest420447-21latency09:25:190
376466992819,8cyclictest416691-21apt-get09:15:130
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:10:013
4577091270,6ptp4l441ktimers/312:00:003
4577091270,6ptp4l441ktimers/307:35:013
4577091270,6ptp4l441ktimers/307:25:013
376473992726,1cyclictest0-21swapper/311:33:003
376473992725,1cyclictest0-21swapper/311:16:593
376473992725,1cyclictest0-21swapper/310:39:553
376473992725,1cyclictest0-21swapper/309:30:153
376473992725,1cyclictest0-21swapper/309:22:583
376473992722,4cyclictest435798-21turbostat10:15:003
37647399270,26cyclictest0-21swapper/311:50:033
37647399270,24cyclictest0-21swapper/308:46:593
37647399270,1cyclictest0-21swapper/310:40:133
37647399270,1cyclictest0-21swapper/309:50:153
37647399270,1cyclictest0-21swapper/309:45:023
376472992725,1cyclictest0-21swapper/208:45:002
376472992724,2cyclictest0-21swapper/209:44:002
376468992722,4cyclictest384364-21kworker/u8:2+flush-179:007:35:161
4577091260,6ptp4l61490irq/134-eno1-TxRx-011:25:003
4577091260,6ptp4l61490irq/134-eno1-TxRx-011:24:593
4577091260,6ptp4l61490irq/134-eno1-TxRx-009:30:003
4577091260,6ptp4l441ktimers/311:00:003
4577091260,6ptp4l441ktimers/310:24:553
4577091260,6ptp4l441ktimers/307:50:003
4577091260,6ptp4l441ktimers/307:50:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-008:35:003
4577091260,5ptp4l441ktimers/311:10:013
376473992623,2cyclictest0-21swapper/311:39:593
37647399260,24cyclictest0-21swapper/311:41:593
37647399260,24cyclictest0-21swapper/307:15:163
37647299260,2cyclictest0-21swapper/207:46:582
37647299260,2cyclictest0-21swapper/207:46:582
37647299260,24cyclictest0-21swapper/210:54:592
37647299260,24cyclictest0-21swapper/207:34:592
37647299260,19cyclictest0-21swapper/208:15:592
4577091250,6ptp4l441ktimers/309:40:003
4577091250,5ptp4l61490irq/134-eno1-TxRx-008:55:013
4577091250,5ptp4l441ktimers/309:20:013
4577091250,4ptp4l441ktimers/309:44:553
4577091250,4ptp4l441ktimers/308:10:013
376473992523,1cyclictest0-21swapper/312:03:003
37647399250,2cyclictest0-21swapper/311:27:593
376472992522,2cyclictest0-21swapper/211:48:002
376472992522,2cyclictest0-21swapper/207:13:582
37647299250,2cyclictest0-21swapper/207:59:552
4577091240,5ptp4l61490irq/134-eno1-TxRx-012:29:563
376472992421,2cyclictest0-21swapper/207:52:002
37647299240,1cyclictest0-21swapper/207:41:022
376472992319,2cyclictest0-21swapper/209:51:582
376472992219,2cyclictest0-21swapper/211:55:592
376472992219,2cyclictest0-21swapper/208:35:122
376472992120,1cyclictest0-21swapper/208:30:012
376472992118,2cyclictest0-21swapper/209:56:002
376472992118,2cyclictest0-21swapper/209:55:592
376472992017,2cyclictest0-21swapper/210:20:592
376472992017,2cyclictest0-21swapper/209:22:002
376466991915,3cyclictest0-21swapper/007:10:010
376472991715,1cyclictest0-21swapper/211:34:002
37647299119,1cyclictest0-21swapper/209:19:592
3764729970,1cyclictest0-21swapper/210:45:392
3764729950,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional