You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 16:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Thu Dec 11, 2025 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320475999691,4cyclictest361408-21kworker/u8:1+events_unbound09:25:240
320475999489,4cyclictest418649-21kworker/u8:1+events_unbound12:30:240
320475998979,7cyclictest413593-21latency_hist12:00:010
320475998883,4cyclictest345917-21kworker/u8:0+events_unbound08:30:240
320475998479,4cyclictest404077-21kworker/u8:3+events_unbound11:35:280
320475998371,9cyclictest341391-21/usr/sbin/munin08:15:240
320475997969,7cyclictest410400-21latency_hist11:50:000
320476997868,7cyclictest415184-21latency_hist12:05:011
320476997868,7cyclictest415184-21latency_hist12:05:011
320475997868,7cyclictest421810-21latency_hist12:25:010
320475997868,7cyclictest421810-21latency_hist12:25:010
320475997773,3cyclictest400825-21kworker/u8:2+events_unbound11:30:260
320475997766,9cyclictest352304-21latency_hist08:50:020
320475997766,9cyclictest352304-21latency_hist08:50:020
320475997571,3cyclictest365543-21kworker/u8:0+events_unbound10:00:220
320475997565,7cyclictest399248-21latency_hist11:15:010
320476997262,7cyclictest386255-21latency_hist10:35:001
320475997265,5cyclictest338219-21/usr/sbin/munin08:05:200
320476997163,6cyclictest334785-21latency_hist07:55:011
320476997162,5cyclictest367136-21kworker/u8:1+flush-179:009:40:001
320476997160,8cyclictest375113-21latency_hist10:00:011
320475997059,8cyclictest271-21systemd-journal08:45:010
4670791690,32ptp4l61690irq/136-eno1-TxRx-007:07:003
320475996864,3cyclictest345917-21kworker/u8:0+events_unbound09:00:150
320475996863,4cyclictest415224-21kworker/u8:3+flush-179:012:05:300
320476996655,9cyclictest421821-21apt-get12:25:001
320476996655,9cyclictest421821-21apt-get12:25:001
320476996650,14cyclictest425501-21apt-get12:35:151
320475996662,3cyclictest367136-21kworker/u8:1+events_unbound09:35:190
320480996561,3cyclictest0-21swapper/210:28:592
320476996555,8cyclictest362113-21latency_hist09:20:011
320475996561,3cyclictest381732-21kworker/u8:0+events_unbound11:00:230
320475996556,3cyclictest365543-21kworker/u8:0+events_unbound09:32:300
320475996459,4cyclictest389482-21kworker/u8:1+events_unbound10:45:250
320475996452,9cyclictest387869-21latency_hist10:40:000
320475996359,3cyclictest391699-21kworker/u8:2+events_unbound10:55:230
320483996259,2cyclictest0-21swapper/310:34:593
320475996254,6cyclictest396073-21apt-get11:05:120
320475996254,3cyclictest322068-21kworker/u8:1+flush-179:007:20:160
320475996157,3cyclictest318933-21kworker/u8:2+flush-179:007:14:570
320475996157,3cyclictest318933-21kworker/u8:2+flush-179:007:14:560
320483995957,1cyclictest0-21swapper/312:01:593
320483995957,1cyclictest0-21swapper/312:01:593
320483995957,1cyclictest0-21swapper/311:42:593
320476995943,14cyclictest271-21systemd-journal09:00:281
320475995954,3cyclictest723-21Xorg10:42:590
320475995951,6cyclictest333224-21kworker/u8:1+flush-179:008:15:000
320476995847,7cyclictest411966-21kworker/u8:2+flush-179:012:00:011
320475995853,4cyclictest381732-21kworker/u8:0+flush-179:011:50:270
320476995747,7cyclictest418613-21latency_hist12:15:011
320476995747,7cyclictest325458-21/usr/sbin/munin07:25:231
320475995753,3cyclictest326842-21kworker/u8:3+events_unbound07:40:180
320475995746,9cyclictest401115-21apt-get11:20:110
320483995654,1cyclictest0-21swapper/311:13:593
320476995646,7cyclictest389686-21/usr/sbin/munin10:45:241
320475995651,4cyclictest381732-21kworker/u8:0+flush-179:012:35:300
320475995651,4cyclictest365543-21kworker/u8:0+events_unbound09:49:290
320475995647,7cyclictest420234-21latency_hist12:20:020
320476995544,8cyclictest383318-21/usr/sbin/munin10:25:261
320476995543,11cyclictest371912-21kworker/u8:2+flush-179:010:00:011
320475995552,3cyclictest333232-21kworker/u8:2+events_unbound07:50:210
320475995551,3cyclictest371912-21kworker/u8:2+events_unbound09:55:250
320475995546,7cyclictest271-21systemd-journal07:49:280
320475995450,3cyclictest381732-21kworker/u8:0+events_unbound12:26:160
320475995450,3cyclictest381732-21kworker/u8:0+events_unbound12:26:160
320475995450,3cyclictest381732-21kworker/u8:0+events_unbound12:11:130
320475995449,4cyclictest365543-21kworker/u8:0+events_unbound09:50:230
320476995336,15cyclictest350973-21apt-get08:45:131
320476995336,15cyclictest350973-21apt-get08:45:121
320476995336,15cyclictest331604-21kworker/u8:0+flush-179:007:50:001
320475995349,3cyclictest345917-21kworker/u8:0+events_unbound08:28:290
320475995349,3cyclictest345917-21kworker/u8:0+events_unbound08:28:290
320475995349,3cyclictest336412-21kworker/u8:3+events_unbound08:00:260
320475995348,4cyclictest326842-21kworker/u8:3+events_unbound07:39:300
320475995248,3cyclictest381732-21kworker/u8:0+events_unbound10:50:230
320475995248,3cyclictest357391-21kworker/u8:3+events_unbound09:20:040
320475995248,3cyclictest345971-21kworker/u8:1+events_unbound08:35:180
320475995247,4cyclictest400825-21kworker/u8:2+events_unbound11:19:300
320475995247,4cyclictest325456-21kworker/u8:2+events_unbound07:25:250
320476995147,3cyclictest361408-21kworker/u8:1+flush-179:009:25:261
320476995140,7cyclictest349167-21kworker/u8:2+flush-179:008:55:281
320475995147,3cyclictest339611-21kworker/u8:2+events_unbound08:21:300
320476995045,4cyclictest378332-21kworker/u8:3+events_unbound10:15:241
320476995043,5cyclictest359187-21apt-get09:10:121
320476995040,7cyclictest381732-21kworker/u8:0+flush-179:012:35:001
320475995045,4cyclictest352352-21kworker/u8:3+events_unbound08:50:250
320475995045,4cyclictest318933-21kworker/u8:2+events_unbound07:17:290
320483994946,1cyclictest0-21swapper/310:28:593
320476994941,5cyclictest407217-21latency_hist11:40:021
320475994945,3cyclictest378332-21kworker/u8:3+events_unbound10:26:290
320475994945,3cyclictest357391-21kworker/u8:3+events_unbound09:14:280
320476994838,8cyclictest394483-21apt-get11:00:131
320475994844,3cyclictest333232-21kworker/u8:2+events_unbound07:56:300
32047699471,44cyclictest0-21swapper/108:05:121
320475994743,3cyclictest400825-21kworker/u8:2+events_unbound11:29:300
320480994643,2cyclictest0-21swapper/209:11:592
320476994642,3cyclictest325456-21kworker/u8:2+flush-179:007:30:301
320476994626,18cyclictest353879-21timerandwakeup08:50:251
320476994623,3cyclictest348610-21phc2sys08:35:231
32047699461,2cyclictest0-21swapper/107:20:131
320475994635,4cyclictest367136-21kworker/u8:1+events_unbound09:40:020
320476994537,6cyclictest271-21systemd-journal09:22:281
320476994536,7cyclictest417027-21latency_hist12:10:001
320475994540,4cyclictest381732-21kworker/u8:0+events_unbound10:30:040
320476994437,5cyclictest381732-21kworker/u8:0+flush-179:010:40:001
320476994428,14cyclictest370598-21apt-get09:45:151
32047699440,28cyclictest0-21swapper/107:35:141
320475994440,3cyclictest378332-21kworker/u8:3+events_unbound10:10:180
320476994319,4cyclictest0-21swapper/108:45:011
320480994239,2cyclictest0-21swapper/207:59:552
320476994239,2cyclictest0-21swapper/108:32:581
320476994238,3cyclictest381732-21kworker/u8:0+flush-179:010:50:151
320476994234,6cyclictest422305-21/usr/sbin/munin12:25:191
320476994234,6cyclictest422305-21/usr/sbin/munin12:25:191
320476994231,9cyclictest336649-21apt-get08:00:121
320476994227,4cyclictest407466-21/usr/sbin/munin11:40:161
320476994222,3cyclictest0-21swapper/107:10:231
320476994222,3cyclictest0-21swapper/107:10:231
32047699420,40cyclictest408826-21turbostat11:49:541
320476994136,4cyclictest365543-21kworker/u8:0+flush-179:009:30:261
320476994119,4cyclictest0-21swapper/110:10:181
320475994136,4cyclictest378332-21kworker/u8:3+events_unbound10:21:280
320483994038,1cyclictest0-21swapper/309:09:593
32048399400,1cyclictest0-21swapper/310:44:553
320476994033,5cyclictest339611-21kworker/u8:2+flush-179:008:15:211
320476994032,5cyclictest318933-21kworker/u8:2+flush-179:007:15:161
320476994031,6cyclictest336412-21kworker/u8:3+flush-179:008:25:181
320476994031,6cyclictest336412-21kworker/u8:3+flush-179:008:25:181
320476994025,2cyclictest723-21Xorg12:18:591
32047699401,38cyclictest0-21swapper/109:53:591
320475994035,4cyclictest349167-21kworker/u8:2+flush-179:008:55:310
32047699394,10cyclictest2005-21lightdm-gtk-gre11:28:591
320476993931,6cyclictest400825-21kworker/u8:2+flush-179:011:35:001
32047699390,37cyclictest723-21Xorg11:12:591
32047699390,37cyclictest1-21systemd11:09:291
32047699390,2cyclictest723-21Xorg09:07:581
320475993935,3cyclictest349167-21kworker/u8:2+events_unbound09:05:510
320475993935,3cyclictest322068-21kworker/u8:1+events_unbound07:30:170
320475993930,7cyclictest407780-21kworker/u8:1+flush-179:011:40:250
32047599390,37cyclictest723-21Xorg09:18:000
320483993836,1cyclictest0-21swapper/310:15:003
320483993833,4cyclictest417032-21turbostat12:10:003
320483993832,4cyclictest387868-21turbostat10:40:003
320483993831,5cyclictest360529-21turbostat09:14:593
32048399380,37cyclictest0-21swapper/307:27:593
320480993835,2cyclictest0-21swapper/211:34:562
320480993835,2cyclictest0-21swapper/207:21:592
32048099380,36cyclictest0-21swapper/212:20:592
32048099380,36cyclictest0-21swapper/212:20:592
32048099380,35cyclictest0-21swapper/208:50:012
32048099380,35cyclictest0-21swapper/208:50:012
320476993833,3cyclictest367136-21kworker/u8:1+events_unbound09:40:231
320476993832,4cyclictest341153-21latency_hist08:15:011
320475993825,5cyclictest14-21ksoftirqd/010:15:140
320480993733,2cyclictest0-21swapper/211:26:592
320480993733,2cyclictest0-21swapper/210:43:592
32048099370,35cyclictest0-21swapper/207:11:592
32048099370,35cyclictest0-21swapper/207:11:592
320476993730,5cyclictest333224-21kworker/u8:1+flush-179:007:55:181
320475993730,2cyclictest171rcu_preempt10:05:140
320483993631,4cyclictest391055-21turbostat10:50:013
32048399360,35cyclictest0-21swapper/308:14:553
32048399360,1cyclictest0-21swapper/311:20:583
320480993633,2cyclictest0-21swapper/209:06:002
32048099360,1cyclictest0-21swapper/207:35:002
320476993626,8cyclictest343019-21apt-get08:20:111
320483993533,1cyclictest0-21swapper/308:47:593
320483993533,1cyclictest0-21swapper/308:47:593
320483993533,1cyclictest0-21swapper/307:55:593
320480993532,2cyclictest0-21swapper/211:00:002
320480993532,2cyclictest0-21swapper/210:05:002
320476993523,10cyclictest0-21swapper/111:20:011
320483993432,1cyclictest0-21swapper/308:19:553
320483993431,2cyclictest0-21swapper/311:01:593
320483993431,2cyclictest0-21swapper/309:22:593
320480993432,1cyclictest0-21swapper/209:35:002
320476993430,2cyclictest723-21Xorg10:58:591
320483993331,1cyclictest0-21swapper/308:59:553
320483993331,1cyclictest0-21swapper/307:53:593
320483993326,5cyclictest383086-21turbostat10:25:003
320480993331,1cyclictest0-21swapper/209:19:592
320480993331,1cyclictest0-21swapper/208:45:002
320480993330,2cyclictest0-21swapper/211:42:592
320480993329,2cyclictest0-21swapper/210:34:582
320480993329,2cyclictest0-21swapper/208:37:002
320476993322,8cyclictest371912-21kworker/u8:2+flush-179:010:10:011
320475993329,2cyclictest415189-21idleruntime-cro12:05:010
320475993329,2cyclictest415189-21idleruntime-cro12:05:000
320483993230,1cyclictest0-21swapper/307:42:593
320480993229,2cyclictest0-21swapper/211:38:592
320480993229,2cyclictest0-21swapper/210:14:542
320480993229,2cyclictest0-21swapper/209:25:592
320480993228,2cyclictest0-21swapper/210:39:592
320483993130,1cyclictest0-21swapper/309:54:553
320480993129,1cyclictest0-21swapper/210:54:592
32048099310,29cyclictest0-21swapper/207:40:132
320483993028,1cyclictest0-21swapper/311:49:553
320483993023,5cyclictest328401-21turbostat07:35:003
32048399300,2cyclictest0-21swapper/309:55:143
320480993027,2cyclictest0-21swapper/212:35:162
320480993027,2cyclictest0-21swapper/211:10:032
320480993027,2cyclictest0-21swapper/209:55:142
320480993027,1cyclictest0-21swapper/210:20:012
320476993024,4cyclictest388946-21phc2sys10:40:231
320476993023,4cyclictest0-21swapper/111:20:141
320476993020,8cyclictest381733-21/usr/sbin/munin10:20:241
320483992927,1cyclictest0-21swapper/312:35:163
320483992927,1cyclictest0-21swapper/312:20:123
320483992927,1cyclictest0-21swapper/312:20:123
320483992927,1cyclictest0-21swapper/310:51:593
320483992927,1cyclictest0-21swapper/307:47:593
320483992926,2cyclictest0-21swapper/312:25:163
320483992926,2cyclictest0-21swapper/312:25:163
32048399290,28cyclictest0-21swapper/309:15:143
32048399290,28cyclictest0-21swapper/308:50:023
32048399290,27cyclictest0-21swapper/309:25:133
320480992926,2cyclictest0-21swapper/212:25:162
320480992926,2cyclictest0-21swapper/212:25:162
32048099290,27cyclictest0-21swapper/209:35:132
32048099290,27cyclictest0-21swapper/207:15:142
32048099290,1cyclictest0-21swapper/211:05:132
320476992924,4cyclictest331460-21unixbench-2d07:40:251
4670791280,7ptp4l441ktimers/308:05:003
320483992826,1cyclictest0-21swapper/311:35:173
32048399280,27cyclictest0-21swapper/311:05:143
32048399280,27cyclictest0-21swapper/307:15:153
32048399280,25cyclictest0-21swapper/309:40:593
320480992826,1cyclictest0-21swapper/207:40:002
320480992825,2cyclictest0-21swapper/211:45:152
320480992825,2cyclictest0-21swapper/208:50:032
32048099280,26cyclictest0-21swapper/208:09:592
320476992821,5cyclictest0-21swapper/111:54:591
4670791270,7ptp4l61690irq/136-eno1-TxRx-011:30:013
4670791270,7ptp4l441ktimers/312:35:003
4670791270,7ptp4l441ktimers/311:55:013
4670791270,6ptp4l61690irq/136-eno1-TxRx-012:20:013
4670791270,6ptp4l441ktimers/309:50:003
320483992725,1cyclictest0-21swapper/308:32:593
320483992724,2cyclictest0-21swapper/311:33:583
32048399270,26cyclictest0-21swapper/307:11:593
32048399270,26cyclictest0-21swapper/307:11:593
320480992724,2cyclictest0-21swapper/209:40:592
320480992724,2cyclictest0-21swapper/208:02:592
32048099270,26cyclictest0-21swapper/209:20:012
32048099270,25cyclictest0-21swapper/208:58:582
32048099270,25cyclictest0-21swapper/208:10:592
32048099270,24cyclictest0-21swapper/207:49:592
4670791260,6ptp4l441ktimers/307:24:553
32048399260,25cyclictest0-21swapper/310:57:593
320480992624,1cyclictest0-21swapper/210:25:012
320480992623,2cyclictest0-21swapper/212:10:132
320480992623,2cyclictest0-21swapper/211:51:002
320480992623,2cyclictest0-21swapper/210:05:582
32048099260,24cyclictest0-21swapper/212:04:592
32048099260,24cyclictest0-21swapper/212:04:592
4670791250,6ptp4l441ktimers/308:09:593
4670791250,5ptp4l61690irq/136-eno1-TxRx-009:40:003
4670791250,5ptp4l441ktimers/310:20:013
32048399250,24cyclictest0-21swapper/307:36:593
320480992521,2cyclictest0-21swapper/211:15:592
32048099250,24cyclictest0-21swapper/209:00:132
4670791240,5ptp4l61690irq/136-eno1-TxRx-008:45:013
4670791240,5ptp4l441ktimers/312:00:013
4670791240,5ptp4l441ktimers/308:39:553
4670791240,4ptp4l61690irq/136-eno1-TxRx-010:04:593
4670791240,4ptp4l441ktimers/311:20:003
4670791240,4ptp4l441ktimers/309:04:553
320483992422,1cyclictest0-21swapper/309:34:003
320480992422,1cyclictest0-21swapper/212:35:012
320480992421,2cyclictest0-21swapper/212:05:012
320480992421,2cyclictest0-21swapper/209:50:582
320480992421,2cyclictest0-21swapper/208:24:552
32048099240,1cyclictest0-21swapper/207:29:592
4670791230,4ptp4l61690irq/136-eno1-TxRx-010:09:553
4670791230,4ptp4l61690irq/136-eno1-TxRx-008:24:553
4670791230,4ptp4l441ktimers/312:14:553
4670791230,4ptp4l441ktimers/308:29:563
4670791230,4ptp4l441ktimers/308:29:553
320480992321,1cyclictest0-21swapper/208:20:002
320480992320,2cyclictest0-21swapper/208:32:592
320480992219,2cyclictest0-21swapper/212:15:592
320480992017,2cyclictest0-21swapper/208:25:592
320480992017,2cyclictest0-21swapper/208:25:582
320480991916,2cyclictest0-21swapper/211:57:592
32047599192,13cyclictest320392-21latency_hist07:10:010
320480991816,1cyclictest0-21swapper/211:05:002
320480991815,2cyclictest0-21swapper/209:49:002
320480991612,2cyclictest0-21swapper/211:24:592
32047699166,9cyclictest320480-21cyclictest07:10:011
320480991411,1cyclictest0-21swapper/207:55:002
3204809996,2cyclictest0-21swapper/210:45:142
3204809930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional