You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-24 - 19:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6.osadl.org (updated Tue Jun 24, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67758199122107,12cyclictest734357-21apt-get10:01:451
67757999115101,11cyclictest739491-21apt-get10:20:140
6775819911199,9cyclictest718137-21apt-get09:15:141
6775819911199,9cyclictest718137-21apt-get09:15:131
67757999110104,4cyclictest757017-21kworker/u8:3+events_unbound11:20:030
67757999110102,6cyclictest702820-21kworker/u8:1+events_unbound08:30:180
6775819910888,18cyclictest714687-21/usr/sbin/munin09:05:241
6775799910897,9cyclictest3105085-21systemd-journal10:01:540
6775819910589,11cyclictest758842-21apt-get11:20:001
6775799910499,4cyclictest724238-21kworker/u8:2+events_unbound09:50:010
6775799910295,5cyclictest700364-21kworker/u8:2+events_unbound08:30:000
6775799910294,5cyclictest673136-21kworker/u8:1+events_unbound07:20:170
677579999990,6cyclictest750591-21kworker/u8:3+events_unbound11:00:170
677579999986,11cyclictest679317-21apt-get07:15:140
677579999890,6cyclictest737669-21kworker/u8:3+events_unbound10:25:150
677579999886,9cyclictest747441-21apt-get10:45:130
677579999789,5cyclictest769949-21kworker/u8:0+events_unbound11:55:240
677579999588,5cyclictest695064-21kworker/u8:0+events_unbound08:05:020
677579999488,4cyclictest702820-21kworker/u8:1+events_unbound09:35:170
677579999477,13cyclictest715754-21kworker/u8:2+flush-179:009:20:140
677579999387,4cyclictest769949-21kworker/u8:0+events_unbound12:10:220
677579999281,9cyclictest3105085-21systemd-journal09:40:010
677579999185,4cyclictest696894-21kworker/u8:3+events_unbound08:10:150
677581999078,9cyclictest763993-21gpgv11:35:011
677579999082,6cyclictest760298-21kworker/u8:1+flush-179:011:25:240
677579998983,5cyclictest702820-21kworker/u8:1+events_unbound08:40:000
677579998975,10cyclictest3105085-21systemd-journal11:35:010
677579998883,4cyclictest744932-21kworker/u8:2+flush-179:010:40:250
677579998876,4cyclictest702820-21kworker/u8:1+events_unbound09:10:230
677581998674,10cyclictest769154-21apt-get11:50:111
677579998680,5cyclictest748750-21kworker/u8:1+events_unbound10:55:350
677579998578,5cyclictest748750-21kworker/u8:1+events_unbound10:50:200
677579998578,5cyclictest679104-21kworker/u8:0+flush-179:007:45:150
677581998475,7cyclictest696894-21kworker/u8:3+events_unbound08:10:011
677579998379,3cyclictest753527-21kworker/u8:0+flush-179:011:10:210
677579998378,4cyclictest724238-21kworker/u8:2+events_unbound10:15:000
677579998372,9cyclictest677713-21/usr/sbin/munin07:10:250
677579998276,5cyclictest715754-21kworker/u8:2+events_unbound09:15:040
677579998276,5cyclictest715754-21kworker/u8:2+events_unbound09:15:040
677581998173,5cyclictest715754-21kworker/u8:2+events_unbound09:20:221
677579998176,3cyclictest767551-21kworker/u8:1+flush-179:012:15:230
677579998172,7cyclictest755394-21latency_hist11:10:010
677579998168,4cyclictest673136-21kworker/u8:1+events_unbound07:50:250
677579998073,6cyclictest769949-21kworker/u8:0+flush-179:011:55:000
677581997867,8cyclictest708077-21latency_hist08:45:011
677581997765,9cyclictest775262-21latency_hist12:10:001
677579997772,4cyclictest780068-21kworker/u8:0+events_unbound12:25:200
677579997769,6cyclictest679104-21kworker/u8:0+flush-179:007:30:150
677579997768,7cyclictest776832-21kworker/u8:2+events_unbound12:30:140
677579997765,10cyclictest695087-21apt-get08:05:000
677581997664,10cyclictest783470-21apt-get12:35:121
677579997671,4cyclictest773721-21kworker/u8:3+events_unbound12:20:280
677579997668,6cyclictest679104-21kworker/u8:0+flush-179:007:25:150
677581997566,6cyclictest702820-21kworker/u8:1+flush-179:008:35:231
677579997565,7cyclictest3105085-21systemd-journal10:05:240
677579997469,3cyclictest673136-21kworker/u8:1+events_unbound08:15:150
677579997468,4cyclictest730085-21kworker/u8:0+events_unbound09:55:200
677579997461,4cyclictest737669-21kworker/u8:3+events_unbound10:35:180
677581997358,11cyclictest3105085-21systemd-journal07:20:001
677579997366,6cyclictest753527-21kworker/u8:0+flush-179:011:40:210
677579997366,6cyclictest753527-21kworker/u8:0+flush-179:011:40:200
677579997366,5cyclictest696894-21kworker/u8:3+events_unbound08:20:140
677581997264,6cyclictest3105085-21systemd-journal09:30:161
677581997260,10cyclictest753587-21kworker/u8:2+events_unbound11:10:141
677579997260,3cyclictest702820-21kworker/u8:1+events_unbound09:30:170
677581997161,7cyclictest783212-21latency_hist12:35:011
677579997166,4cyclictest704866-21kworker/u8:3+flush-179:008:55:240
677581997061,7cyclictest767551-21kworker/u8:1+flush-179:011:45:161
677581997061,6cyclictest696894-21kworker/u8:3+flush-179:008:20:171
677581997057,10cyclictest682514-21apt-get07:25:151
677581996961,5cyclictest724238-21kworker/u8:2+flush-179:010:20:181
677579996964,4cyclictest715754-21kworker/u8:2+events_unbound09:05:260
677579996959,8cyclictest736278-21kworker/u8:1+events_unbound10:15:150
677579996957,10cyclictest713117-21apt-get09:00:140
677581996861,5cyclictest673136-21kworker/u8:1+flush-179:007:39:561
677581996848,13cyclictest725875-21kworker/u8:0+events_unbound09:45:021
67758199680,66cyclictest722-21Xorg12:26:591
677579996863,3cyclictest702820-21kworker/u8:1+events_unbound08:45:160
677579996860,6cyclictest736278-21kworker/u8:1+events_unbound10:30:130
677581996754,10cyclictest751943-21latency_hist11:00:001
677579996763,4cyclictest753587-21kworker/u8:2+flush-179:011:15:220
677579996762,4cyclictest769949-21kworker/u8:0+flush-179:012:00:200
677581996660,4cyclictest730085-21kworker/u8:0+flush-179:009:55:221
677579996661,4cyclictest753587-21kworker/u8:2+flush-179:011:45:210
677579996653,10cyclictest3105085-21systemd-journal07:40:010
677581996552,11cyclictest744247-21apt-get10:35:131
677581996458,5cyclictest673136-21kworker/u8:1+flush-179:008:04:561
677581996458,4cyclictest702820-21kworker/u8:1+events_unbound09:45:151
677581996255,5cyclictest753527-21kworker/u8:0+events_unbound11:05:021
677581996250,10cyclictest775519-21apt-get12:10:121
677581996249,10cyclictest778713-21apt-get12:20:151
677581996247,11cyclictest750591-21kworker/u8:3+events_unbound11:00:151
677584996158,2cyclictest0-21swapper/211:13:592
677581996155,4cyclictest748750-21kworker/u8:1+events_unbound10:55:011
677581996154,5cyclictest702820-21kworker/u8:1+flush-179:009:10:191
677581996151,7cyclictest740445-21kworker/u8:0+flush-179:010:45:151
677579996159,1cyclictest0-21swapper/009:50:590
677579996153,5cyclictest673136-21kworker/u8:1+events_unbound07:55:220
677584996057,2cyclictest0-21swapper/212:09:592
677581996055,4cyclictest696894-21kworker/u8:3+flush-179:008:13:041
677581996053,5cyclictest673136-21kworker/u8:1+events_unbound07:10:241
677581996048,10cyclictest760947-21apt-get11:25:131
677581996047,11cyclictest718141-21kworker/u8:3+events_unbound09:25:151
677579996055,4cyclictest702820-21kworker/u8:1+events_unbound08:40:250
677579996054,4cyclictest718141-21kworker/u8:3+flush-179:009:25:230
677581995951,6cyclictest700364-21kworker/u8:2+flush-179:008:30:151
677579995951,6cyclictest753587-21kworker/u8:2+events_unbound11:30:120
677581995853,4cyclictest704866-21kworker/u8:3+flush-179:008:50:251
677581995752,4cyclictest730085-21kworker/u8:0+flush-179:009:54:551
677581995750,5cyclictest679104-21kworker/u8:0+events_unbound07:40:251
677581995749,5cyclictest736278-21kworker/u8:1+events_unbound10:10:201
677581995651,3cyclictest769949-21kworker/u8:0+events_unbound11:55:181
677581995650,4cyclictest737669-21kworker/u8:3+flush-179:010:25:221
677579995650,4cyclictest767551-21kworker/u8:1+events_unbound12:05:120
677579995647,6cyclictest776832-21kworker/u8:2+events_unbound12:35:130
677581995550,4cyclictest704866-21kworker/u8:3+flush-179:008:49:551
677581995548,5cyclictest753527-21kworker/u8:0+events_unbound11:40:011
677581995452,1cyclictest700077-21kworker/u8:0+events_unbound08:25:181
677581995447,5cyclictest679104-21kworker/u8:0+flush-179:007:35:001
67757999543,50cyclictest1-21systemd08:55:000
677581995346,5cyclictest757017-21kworker/u8:3+flush-179:011:20:051
677581995340,10cyclictest737883-21apt-get10:15:141
677579995348,3cyclictest679104-21kworker/u8:0+flush-179:007:40:220
677581995245,5cyclictest673136-21kworker/u8:1+events_unbound08:15:131
677581995142,7cyclictest693476-21latency_hist08:00:001
677581995045,4cyclictest702820-21kworker/u8:1+flush-179:009:35:221
677581995038,10cyclictest777104-21apt-get12:15:131
4505291500,14ptp4l441ktimers/307:10:003
677581994943,5cyclictest769949-21kworker/u8:0+flush-179:012:04:561
677581994843,4cyclictest679104-21kworker/u8:0+events_unbound07:50:191
677581994742,4cyclictest753587-21kworker/u8:2+flush-179:011:40:261
677581994742,4cyclictest753587-21kworker/u8:2+flush-179:011:40:261
677581994739,6cyclictest690297-21latency_hist07:50:011
677581994639,5cyclictest744932-21kworker/u8:2+events_unbound10:40:141
67758499440,42cyclictest0-21swapper/207:30:592
677581994236,4cyclictest3105085-21systemd-journal08:55:111
67758199410,40cyclictest0-21swapper/110:33:001
67758699400,4cyclictest727710-21turbostat09:45:003
67758699400,38cyclictest734459-21turbostat10:05:013
677584994033,6cyclictest0-21swapper/207:42:592
677586993937,1cyclictest0-21swapper/312:26:593
67758499390,37cyclictest0-21swapper/211:29:592
67758499390,32cyclictest0-21swapper/209:48:592
677584993832,5cyclictest0-21swapper/208:17:592
67758499380,36cyclictest0-21swapper/212:34:002
67758499380,36cyclictest0-21swapper/210:30:592
67758499380,36cyclictest0-21swapper/208:05:012
677586993734,2cyclictest0-21swapper/309:06:003
67758699370,36cyclictest0-21swapper/312:14:593
67758699370,36cyclictest0-21swapper/310:10:583
677584993734,2cyclictest0-21swapper/210:01:592
677584993734,2cyclictest0-21swapper/209:11:592
677584993734,2cyclictest0-21swapper/207:21:592
67758499370,35cyclictest0-21swapper/208:40:002
677586993634,1cyclictest0-21swapper/311:40:593
677586993634,1cyclictest0-21swapper/311:40:593
677584993633,2cyclictest0-21swapper/210:48:592
67758499360,1cyclictest0-21swapper/209:21:002
677581993630,4cyclictest673136-21kworker/u8:1+events_unbound07:20:251
677581993629,5cyclictest677447-21latency_hist07:10:021
677586993533,1cyclictest0-21swapper/309:48:003
67758699350,1cyclictest0-21swapper/308:59:563
677584993533,1cyclictest0-21swapper/208:49:592
677584993532,2cyclictest0-21swapper/210:56:592
677584993532,2cyclictest0-21swapper/208:54:002
67758499350,33cyclictest0-21swapper/209:40:012
677581993518,14cyclictest3105085-21systemd-journal10:10:001
677586993432,1cyclictest0-21swapper/308:54:553
677586993432,1cyclictest0-21swapper/307:41:003
677586993432,1cyclictest0-21swapper/307:18:593
677586993429,4cyclictest765722-21turbostat11:40:003
677584993425,7cyclictest0-21swapper/211:33:002
67758499340,33cyclictest0-21swapper/209:30:152
677581993425,7cyclictest704866-21kworker/u8:3+events_unbound09:00:141
4505291340,3ptp4l441ktimers/311:30:133
677586993331,1cyclictest0-21swapper/309:14:553
677586993331,1cyclictest0-21swapper/307:59:553
677586993328,4cyclictest773689-21turbostat12:09:553
677584993330,2cyclictest0-21swapper/209:56:582
677584993325,7cyclictest0-21swapper/210:38:582
67758499330,31cyclictest0-21swapper/208:34:592
677586993230,1cyclictest0-21swapper/307:53:593
677584993229,2cyclictest0-21swapper/212:00:592
677584993229,2cyclictest0-21swapper/211:51:592
677584993226,5cyclictest0-21swapper/211:35:172
677584993226,5cyclictest0-21swapper/208:40:132
677586993129,1cyclictest0-21swapper/310:54:563
677586993129,1cyclictest0-21swapper/309:04:003
67758699310,2cyclictest760705-21turbostat11:25:003
677584993125,5cyclictest0-21swapper/208:55:152
67758499310,30cyclictest0-21swapper/212:24:592
67758499310,30cyclictest0-21swapper/207:25:162
67758499310,29cyclictest0-21swapper/210:44:552
67758499310,29cyclictest0-21swapper/208:10:132
4505291310,11ptp4l61790irq/134-eno1-TxRx-009:40:003
67758699300,28cyclictest0-21swapper/307:45:133
67758499300,29cyclictest0-21swapper/212:10:132
67758499300,28cyclictest0-21swapper/207:55:142
677586992927,1cyclictest0-21swapper/309:50:143
677586992927,1cyclictest0-21swapper/309:27:593
677586992927,1cyclictest0-21swapper/309:20:143
677586992927,1cyclictest0-21swapper/308:35:133
677586992926,2cyclictest709672-21turbostat08:50:013
67758699290,28cyclictest0-21swapper/310:15:143
67758699290,27cyclictest0-21swapper/311:50:123
67758699290,27cyclictest0-21swapper/311:15:113
67758699290,27cyclictest0-21swapper/310:45:143
67758699290,27cyclictest0-21swapper/308:20:133
67758699290,1cyclictest0-21swapper/311:05:023
677584992926,2cyclictest0-21swapper/208:05:042
67758499290,27cyclictest0-21swapper/211:15:152
67758499290,1cyclictest0-21swapper/209:15:042
67758499290,1cyclictest0-21swapper/209:15:032
677586992826,1cyclictest0-21swapper/310:43:593
677586992823,4cyclictest753557-21turbostat11:05:003
67758699280,27cyclictest0-21swapper/308:30:163
67758699280,27cyclictest0-21swapper/307:35:163
677584992825,2cyclictest0-21swapper/211:42:592
677584992825,2cyclictest0-21swapper/211:42:592
677584992825,2cyclictest0-21swapper/210:15:142
677584992825,2cyclictest0-21swapper/209:37:002
677584992825,2cyclictest0-21swapper/207:50:132
67758499280,2cyclictest0-21swapper/210:10:162
67758499280,27cyclictest0-21swapper/211:05:012
67758499280,26cyclictest0-21swapper/211:04:592
4505291280,7ptp4l61790irq/134-eno1-TxRx-010:30:003
677586992725,1cyclictest0-21swapper/310:21:003
677586992725,1cyclictest0-21swapper/309:55:123
677586992725,1cyclictest0-21swapper/308:11:003
67758699270,1cyclictest0-21swapper/308:43:593
677584992725,1cyclictest0-21swapper/212:19:592
677584992724,2cyclictest0-21swapper/209:53:002
677584992724,2cyclictest0-21swapper/209:07:002
677584992724,2cyclictest0-21swapper/207:46:592
677584992724,2cyclictest0-21swapper/207:35:592
4505291270,6ptp4l441ktimers/312:25:013
4505291270,6ptp4l441ktimers/308:10:013
4505291270,5ptp4l441ktimers/309:34:553
677586992624,1cyclictest0-21swapper/308:19:553
677586992624,1cyclictest0-21swapper/307:30:593
677586992623,2cyclictest719479-21turbostat09:20:013
677586992623,2cyclictest719479-21turbostat09:20:013
67758499260,2cyclictest0-21swapper/209:04:592
677579992622,3cyclictest677589-21latency_hist07:10:020
4505291260,6ptp4l61790irq/134-eno1-TxRx-010:35:003
4505291260,5ptp4l441ktimers/312:35:013
677586992523,1cyclictest0-21swapper/310:37:593
677586992522,2cyclictest736047-21turbostat10:10:013
67758699250,1cyclictest0-21swapper/310:57:593
677584992523,1cyclictest0-21swapper/212:37:592
677584992523,1cyclictest0-21swapper/210:08:002
677584992522,2cyclictest0-21swapper/210:24:552
4505291250,6ptp4l441ktimers/312:04:553
4505291250,6ptp4l441ktimers/308:05:003
4505291250,5ptp4l61790irq/134-eno1-TxRx-007:29:553
4505291250,5ptp4l441ktimers/312:39:553
4505291250,4ptp4l61790irq/134-eno1-TxRx-011:50:003
67758699240,1cyclictest0-21swapper/312:15:593
677584992422,1cyclictest0-21swapper/211:20:592
4505291240,5ptp4l61790irq/134-eno1-TxRx-008:29:563
4505291240,5ptp4l61790irq/134-eno1-TxRx-007:25:003
4505291240,4ptp4l441ktimers/311:59:553
4505291240,4ptp4l441ktimers/311:29:563
677586992321,1cyclictest0-21swapper/311:12:003
677584992320,2cyclictest0-21swapper/211:58:592
677584992317,5cyclictest0-21swapper/210:51:592
4505291230,4ptp4l441ktimers/307:15:013
677584992220,1cyclictest0-21swapper/211:49:592
677584992118,2cyclictest0-21swapper/208:26:582
677584992118,2cyclictest0-21swapper/207:15:592
677584991916,2cyclictest0-21swapper/210:28:002
677584991916,2cyclictest0-21swapper/207:13:002
677584991815,2cyclictest0-21swapper/208:23:002
67758499130,11cyclictest0-21swapper/212:29:552
67758499120,11cyclictest0-21swapper/209:29:592
6775849960,4cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional