You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 20:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sun Nov 16, 2025 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1581048999585,7cyclictest1661703-21latency_hist11:20:011
1581045999581,5cyclictest1661325-21kworker/u8:2+events_unbound11:25:010
1581048998976,4cyclictest1642538-21kworker/u8:1+flush-179:010:25:011
1581048998579,4cyclictest1674389-21kworker/u8:0+events_unbound12:10:251
1581045998579,5cyclictest1614704-21kworker/u8:1+events_unbound09:10:000
1581045998479,4cyclictest1614776-21kworker/u8:3+flush-179:009:00:250
1581045998478,5cyclictest1605229-21kworker/u8:2+events_unbound08:45:240
1581045998274,4cyclictest1598794-21kworker/u8:1+events_unbound08:20:250
1581048998075,4cyclictest1591927-21kworker/u8:1+flush-179:007:45:011
1581048997972,4cyclictest1666498-21kworker/u8:3+flush-179:012:00:001
1581048997872,4cyclictest1584466-21kworker/u8:2+events_unbound07:20:241
1581048997666,4cyclictest1666498-21kworker/u8:3+events_unbound11:45:241
1581048997569,5cyclictest1630646-21kworker/u8:1+flush-179:010:00:001
1581048997569,4cyclictest1591927-21kworker/u8:1+events_unbound07:55:001
1581045997469,4cyclictest1598794-21kworker/u8:1+events_unbound08:15:240
1581045997461,10cyclictest1674432-21latency_hist12:00:000
1581048997265,5cyclictest1674389-21kworker/u8:0+flush-179:012:40:011
1581048997263,6cyclictest1587017-21kworker/u8:0+events_unbound07:30:161
1581045997267,4cyclictest1631212-21kworker/u8:2+events_unbound09:55:160
1581045997166,3cyclictest1652162-21kworker/u8:1+flush-179:011:00:220
1581048996963,5cyclictest1648980-21kworker/u8:2+events_unbound10:45:261
1581048996963,4cyclictest1568047-21kworker/u8:1+flush-179:007:20:011
1581045996964,4cyclictest1644152-21kworker/u8:0+events_unbound10:35:250
1581045996963,5cyclictest1674389-21kworker/u8:0+events_unbound12:00:150
1581048996860,6cyclictest1681687-21kworker/u8:3+flush-179:012:30:001
1581048996857,5cyclictest1598794-21kworker/u8:1+events_unbound08:40:341
1581045996864,3cyclictest1658530-21kworker/u8:0+flush-179:011:10:250
1581045996858,4cyclictest1645740-21kworker/u8:2+events_unbound10:30:280
1581048996754,5cyclictest1652162-21kworker/u8:1+events_unbound11:10:211
1581045996761,5cyclictest1598794-21kworker/u8:1+events_unbound08:10:250
1581048996660,4cyclictest1681687-21kworker/u8:3+events_unbound12:20:251
1581048996658,6cyclictest1594011-21kworker/u8:0+flush-179:008:00:011
1581045996656,7cyclictest1606771-21latency_hist08:30:010
1581045996559,5cyclictest1674389-21kworker/u8:0+events_unbound12:30:250
1581048996458,4cyclictest1630646-21kworker/u8:1+flush-179:010:00:241
1581048996453,8cyclictest1631414-21/usr/sbin/munin09:45:241
1581048996450,8cyclictest1598794-21kworker/u8:1+events_unbound08:25:001
1581045996460,3cyclictest1608349-21kworker/u8:0+events_unbound08:35:220
1581045996459,4cyclictest1642538-21kworker/u8:1+flush-179:010:20:210
1581045996457,6cyclictest1598794-21kworker/u8:1+events_unbound08:30:170
1581045996454,7cyclictest1672822-21latency_hist11:55:010
1581048996356,5cyclictest1648980-21kworker/u8:2+flush-179:011:10:001
1581048996356,4cyclictest1664328-21kworker/u8:1+flush-179:011:40:231
1581045996358,4cyclictest1645805-21kworker/u8:3+flush-179:010:50:160
1581048996254,6cyclictest1668057-21latency_hist11:40:011
1581045996257,4cyclictest1685855-21kworker/u8:2+flush-179:012:35:250
1581045996156,3cyclictest1584466-21kworker/u8:2+flush-179:007:20:220
1581045996149,10cyclictest1629846-21apt-get09:40:130
1581048996055,4cyclictest1642538-21kworker/u8:1+flush-179:010:20:001
1581048996055,4cyclictest1614704-21kworker/u8:1+flush-179:009:09:571
1581048996054,4cyclictest1580940-21kworker/u8:0+events_unbound07:10:121
1581048996052,6cyclictest1598794-21kworker/u8:1+events_unbound08:15:131
1581048995948,4cyclictest1648980-21kworker/u8:2+flush-179:010:40:211
1581048995947,4cyclictest1642538-21kworker/u8:1+events_unbound10:25:161
1581045995953,5cyclictest1614776-21kworker/u8:3+events_unbound09:35:020
1581045995952,6cyclictest1584466-21kworker/u8:2+events_unbound07:25:030
1581045995952,5cyclictest1648980-21kworker/u8:2+events_unbound11:05:210
1581048995846,9cyclictest1614727-21latency_hist08:55:011
1581045995854,3cyclictest1674389-21kworker/u8:0+events_unbound12:10:230
1581045995854,3cyclictest1623844-21kworker/u8:0+events_unbound09:25:230
1581045995848,8cyclictest1665123-21apt-get11:30:130
1581048995752,3cyclictest1674389-21kworker/u8:0+flush-179:012:00:221
1581048995751,4cyclictest1600946-21diskstats08:10:171
1581048995751,4cyclictest1598794-21kworker/u8:1+flush-179:008:25:221
1581048995649,5cyclictest1658530-21kworker/u8:0+flush-179:011:20:161
1581045995652,3cyclictest1664328-21kworker/u8:1+events_unbound11:25:290
1581045995646,7cyclictest1584205-21latency_hist07:20:010
158104599561,51cyclictest1-21systemd08:45:000
1581048995550,4cyclictest1594011-21kworker/u8:0+flush-179:007:49:551
1581048995549,4cyclictest1623844-21kworker/u8:0+flush-179:009:40:201
1581048995545,8cyclictest1676272-21apt-get12:05:131
1581048995545,7cyclictest1608361-21latency_hist08:35:011
1581048995449,4cyclictest1623844-21kworker/u8:0+flush-179:009:24:551
1581048995447,5cyclictest1614704-21kworker/u8:1+flush-179:008:55:211
1581045995450,3cyclictest1631212-21kworker/u8:2+events_unbound10:10:250
1581045995449,4cyclictest1648980-21kworker/u8:2+flush-179:010:45:270
1581045995448,5cyclictest1614776-21kworker/u8:3+events_unbound09:30:270
1581045995448,5cyclictest1614776-21kworker/u8:3+events_unbound09:30:260
1581045995348,4cyclictest1587017-21kworker/u8:0+events_unbound07:30:230
1581045995347,5cyclictest1674389-21kworker/u8:0+events_unbound12:20:130
1581045995346,6cyclictest1648980-21kworker/u8:2+events_unbound10:55:140
1581048995244,6cyclictest1630646-21kworker/u8:1+flush-179:010:10:001
1581045995244,3cyclictest1591927-21kworker/u8:1+events_unbound07:40:260
1581045995242,8cyclictest1644411-21/usr/sbin/munin10:25:250
1581048995145,5cyclictest1584466-21kworker/u8:2+flush-179:007:30:001
1581048995144,4cyclictest1674389-21kworker/u8:0+flush-179:012:30:211
1581048995139,4cyclictest1648980-21kworker/u8:2+flush-179:010:55:161
1581048995045,4cyclictest1666498-21kworker/u8:3+flush-179:011:50:201
1581048995039,3cyclictest1674472-21kworker/u8:2+flush-179:012:15:161
1581045995046,3cyclictest1674472-21kworker/u8:2+flush-179:012:15:270
1581045995045,4cyclictest723-21Xorg08:07:590
1581045995044,4cyclictest1648980-21kworker/u8:2+events_unbound10:40:120
1581045995039,4cyclictest1664328-21kworker/u8:1+events_unbound11:40:140
4670791490,13ptp4l441ktimers/307:10:013
1581048994941,6cyclictest271-21systemd-journal09:55:001
1581048994939,8cyclictest1658530-21kworker/u8:0+flush-179:011:34:591
1581048994939,4cyclictest1614704-21kworker/u8:1+flush-179:009:15:191
1581045994944,4cyclictest1674389-21kworker/u8:0+events_unbound12:05:200
1581045994944,4cyclictest1595856-21kworker/u8:2+flush-179:007:55:200
1581048994836,4cyclictest1614776-21kworker/u8:3+events_unbound09:30:141
1581048994836,4cyclictest1614776-21kworker/u8:3+events_unbound09:30:141
1581048994737,8cyclictest1640717-21latency_hist10:15:011
1581045994740,5cyclictest1669661-21turbostat11:49:560
1581049994643,2cyclictest0-21swapper/209:36:582
1581048994641,4cyclictest1614776-21kworker/u8:3+events_unbound09:35:201
1581048994641,4cyclictest1614776-21kworker/u8:3+events_unbound09:00:151
1581048994641,4cyclictest1608349-21kworker/u8:0+events_unbound08:35:151
1581048994637,6cyclictest1648955-21latency_hist10:40:011
1581045994641,4cyclictest1614704-21kworker/u8:1+flush-179:008:55:210
1581048994540,4cyclictest1605229-21kworker/u8:2+events_unbound08:45:491
1581045994537,6cyclictest1614776-21kworker/u8:3+events_unbound09:50:130
1581045994439,4cyclictest1605229-21kworker/u8:2+flush-179:008:50:160
1581045994439,4cyclictest1580940-21kworker/u8:0+events_unbound07:10:260
1581045994437,6cyclictest1594011-21kworker/u8:0+events_unbound07:50:010
1581045994435,7cyclictest1642584-21latency_hist10:20:010
1581049994340,2cyclictest0-21swapper/208:07:582
1581049994339,2cyclictest0-21swapper/208:27:592
1581048994335,6cyclictest271-21systemd-journal08:09:481
1581045994339,3cyclictest1664328-21kworker/u8:1+events_unbound11:35:310
1581045994339,3cyclictest1630646-21kworker/u8:1+events_unbound10:05:160
1581045994339,3cyclictest1614704-21kworker/u8:1+events_unbound09:15:180
1581045994338,4cyclictest1595856-21kworker/u8:2+flush-179:008:00:250
1581045994334,7cyclictest1624551-21latency_hist09:25:010
1581048994237,4cyclictest1645740-21kworker/u8:2+flush-179:010:30:281
1581045994237,4cyclictest1591927-21kworker/u8:1+flush-179:007:50:490
1581050994135,5cyclictest1629581-21turbostat09:40:003
158105099410,39cyclictest1672839-21turbostat11:55:003
158105099410,39cyclictest1639130-21turbostat10:10:003
1581045994130,7cyclictest1661325-21kworker/u8:2+flush-179:011:20:000
1581050994038,1cyclictest0-21swapper/310:48:003
158105099400,38cyclictest1626147-21turbostat09:30:003
158105099390,4cyclictest1589237-21turbostat07:35:013
1581048993928,4cyclictest1614776-21kworker/u8:3+events_unbound09:25:391
158104599390,37cyclictest723-21Xorg12:28:000
158104599390,37cyclictest723-21Xorg09:46:590
1581050993833,4cyclictest1682661-21turbostat12:25:003
1581050993833,4cyclictest1621355-21turbostat09:15:013
1581050993833,4cyclictest1582606-21turbostat07:15:013
1581049993835,2cyclictest0-21swapper/212:04:582
1581049993834,2cyclictest0-21swapper/211:49:562
158104999380,30cyclictest0-21swapper/208:47:592
1581048993835,2cyclictest0-21swapper/108:03:001
1581048993832,4cyclictest1589219-21kworker/u8:3+flush-179:007:35:051
158104899380,37cyclictest723-21Xorg09:13:591
1581045993832,4cyclictest1630646-21kworker/u8:1+events_unbound10:00:020
1581049993734,2cyclictest0-21swapper/212:28:002
1581049993734,2cyclictest0-21swapper/209:46:592
1581049993733,2cyclictest0-21swapper/212:17:002
1581048993732,4cyclictest1648980-21kworker/u8:2+events_unbound11:00:231
1581048993732,4cyclictest1645805-21kworker/u8:3+events_unbound10:50:221
1581045993728,5cyclictest1620023-21apt-get09:10:150
1581050993634,1cyclictest0-21swapper/311:10:593
1581050993634,1cyclictest0-21swapper/310:25:593
1581050993634,1cyclictest0-21swapper/309:19:553
1581050993630,4cyclictest1650554-21turbostat10:44:593
158105099360,35cyclictest0-21swapper/312:14:003
158105099360,35cyclictest0-21swapper/311:02:593
158105099360,35cyclictest0-21swapper/309:08:593
158105099360,35cyclictest0-21swapper/308:06:003
158105099360,1cyclictest0-21swapper/312:17:593
158105099360,1cyclictest0-21swapper/310:22:593
158105099360,1cyclictest0-21swapper/308:38:593
1581049993633,2cyclictest0-21swapper/211:44:542
1581049993633,2cyclictest0-21swapper/207:53:592
158104999360,1cyclictest0-21swapper/211:26:582
1581050993533,1cyclictest0-21swapper/311:19:593
1581050993533,1cyclictest0-21swapper/310:04:553
1581050993532,2cyclictest0-21swapper/310:58:593
1581050993528,5cyclictest1611563-21turbostat08:44:593
158105099350,1cyclictest0-21swapper/311:57:583
158105099350,1cyclictest0-21swapper/307:56:583
1581048993525,8cyclictest1580964-21latency_hist07:10:021
1581050993432,1cyclictest0-21swapper/311:24:593
1581050993432,1cyclictest0-21swapper/309:49:553
1581050993432,1cyclictest0-21swapper/307:24:583
1581050993431,2cyclictest0-21swapper/308:34:593
1581049993432,1cyclictest0-21swapper/210:39:592
1581049993432,1cyclictest0-21swapper/207:35:002
1581049993431,2cyclictest0-21swapper/207:12:592
1581050993328,4cyclictest1595637-21turbostat07:54:593
1581049993330,2cyclictest0-21swapper/208:58:592
1581049993330,2cyclictest0-21swapper/208:34:002
1581049993330,2cyclictest0-21swapper/207:48:592
1581049993330,2cyclictest0-21swapper/207:37:592
1581048993328,4cyclictest1661325-21kworker/u8:2+events_unbound11:25:191
1581050993230,1cyclictest0-21swapper/309:51:593
1581050993230,1cyclictest0-21swapper/307:40:583
1581050993227,4cyclictest1598829-21turbostat08:05:003
1581049993229,2cyclictest0-21swapper/211:21:592
1581050993128,2cyclictest0-21swapper/311:09:593
1581050993128,2cyclictest0-21swapper/307:39:583
158105099310,1cyclictest0-21swapper/311:49:593
1581049993128,2cyclictest0-21swapper/210:05:152
1581049993126,3cyclictest0-21swapper/212:39:582
158104999310,26cyclictest0-21swapper/212:30:152
1581050993028,1cyclictest0-21swapper/311:38:583
1581049993027,2cyclictest0-21swapper/211:55:592
1581049993027,2cyclictest0-21swapper/210:15:022
1581049993027,2cyclictest0-21swapper/209:40:592
1581049993027,2cyclictest0-21swapper/209:30:142
1581049993027,2cyclictest0-21swapper/209:30:132
158104999300,2cyclictest0-21swapper/209:50:152
158104999300,2cyclictest0-21swapper/208:50:142
158104999300,29cyclictest0-21swapper/209:15:142
158104999300,27cyclictest0-21swapper/207:25:012
1581050992927,1cyclictest0-21swapper/311:25:173
1581050992927,1cyclictest0-21swapper/307:19:553
1581050992926,2cyclictest0-21swapper/312:35:163
158105099290,1cyclictest0-21swapper/308:55:033
1581049992926,2cyclictest0-21swapper/209:10:142
158104999290,27cyclictest0-21swapper/210:30:172
158104999290,27cyclictest0-21swapper/210:20:142
158104999290,26cyclictest0-21swapper/210:53:592
4670791280,6ptp4l441ktimers/311:35:003
1581050992826,1cyclictest0-21swapper/312:25:183
1581050992826,1cyclictest0-21swapper/312:08:593
1581050992826,1cyclictest0-21swapper/310:15:163
1581050992826,1cyclictest0-21swapper/310:10:153
1581050992826,1cyclictest0-21swapper/309:01:593
1581050992826,1cyclictest0-21swapper/307:25:593
158105099280,27cyclictest0-21swapper/308:25:163
1581049992825,2cyclictest0-21swapper/212:20:002
1581049992825,2cyclictest0-21swapper/211:33:002
1581049992825,2cyclictest0-21swapper/208:20:142
1581049992825,2cyclictest0-21swapper/207:15:592
158104999280,2cyclictest0-21swapper/208:35:152
158104599280,1cyclictest0-21swapper/007:35:160
4670791270,6ptp4l441ktimers/308:55:013
4670791270,5ptp4l441ktimers/312:35:003
1581050992725,1cyclictest0-21swapper/312:04:553
1581050992725,1cyclictest0-21swapper/311:40:153
1581050992725,1cyclictest0-21swapper/309:55:143
1581050992725,1cyclictest0-21swapper/307:45:153
158105099270,1cyclictest0-21swapper/309:20:153
158105099270,1cyclictest0-21swapper/308:10:153
1581049992725,1cyclictest0-21swapper/209:59:592
158104999270,26cyclictest0-21swapper/211:19:002
4670791260,6ptp4l441ktimers/310:34:563
4670791260,6ptp4l441ktimers/309:44:553
4670791260,5ptp4l61690irq/136-eno1-TxRx-009:34:563
4670791260,5ptp4l61690irq/136-eno1-TxRx-009:34:553
1581049992623,2cyclictest0-21swapper/207:40:162
1581049992622,2cyclictest0-21swapper/207:22:592
158104999260,2cyclictest0-21swapper/209:02:002
158104999260,24cyclictest0-21swapper/212:09:552
158104999260,24cyclictest0-21swapper/209:29:592
158104999260,24cyclictest0-21swapper/208:11:592
158104999260,24cyclictest0-21swapper/208:01:592
4670791250,5ptp4l61690irq/136-eno1-TxRx-010:54:563
4670791250,5ptp4l61690irq/136-eno1-TxRx-008:19:543
4670791250,5ptp4l441ktimers/310:39:553
4670791250,5ptp4l441ktimers/308:25:013
1581050992523,1cyclictest0-21swapper/308:48:593
1581049992523,1cyclictest0-21swapper/211:55:002
1581049992422,1cyclictest0-21swapper/210:44:592
1581049992320,2cyclictest0-21swapper/211:00:142
1581049992320,2cyclictest0-21swapper/210:48:002
1581049992320,2cyclictest0-21swapper/208:45:002
1581049992219,2cyclictest0-21swapper/210:59:592
1581049992118,2cyclictest0-21swapper/211:09:582
1581049992118,2cyclictest0-21swapper/209:07:582
1581049992118,2cyclictest0-21swapper/207:59:002
158104599202,12cyclictest475-21dbus-daemon07:10:020
1581049991917,1cyclictest0-21swapper/210:03:592
1581049991916,2cyclictest0-21swapper/212:10:592
1581049991916,2cyclictest0-21swapper/211:35:592
1581049991714,2cyclictest0-21swapper/208:15:592
158104999129,2cyclictest0-21swapper/211:13:592
158104999107,2cyclictest0-21swapper/209:23:592
15810499996,2cyclictest0-21swapper/210:25:152
15810499980,7cyclictest0-21swapper/210:15:002
15810499930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional