You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 11:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Mon Dec 22, 2025 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16872289910176,6cyclictest1790527-21latency_hist00:30:011
16872289910093,5cyclictest1774510-21kworker/u8:0+flush-179:000:00:011
1687227998983,3cyclictest1764960-21latency_hist23:10:000
1687227998780,5cyclictest1697131-21kworker/u8:1+flush-179:019:49:590
1687227998680,5cyclictest1708279-21kworker/u8:1+flush-179:020:20:240
1687227998478,4cyclictest1708279-21kworker/u8:1+events_unbound20:45:250
1687228998276,4cyclictest1708279-21kworker/u8:1+flush-179:020:35:271
1687227998069,8cyclictest1714854-21latency_hist20:35:020
1687228997872,4cyclictest1685542-21kworker/u8:1+flush-179:019:15:251
1687228997869,7cyclictest1748782-21/usr/sbin/munin22:20:231
1687227997872,4cyclictest1701899-21kworker/u8:3+events_unbound20:15:000
1687228997769,6cyclictest1766546-21latency_hist23:15:001
1687227997771,4cyclictest1774510-21kworker/u8:0+events_unbound00:04:020
1687227997770,6cyclictest1761550-21kworker/u8:1+events_unbound23:00:030
1687227997770,5cyclictest1774510-21kworker/u8:0+flush-179:000:05:250
1687227997767,8cyclictest1722806-21latency_hist21:00:020
1687227997667,7cyclictest266-21systemd-journal20:40:000
1687227997468,4cyclictest1711659-21kworker/u8:0+events_unbound22:05:240
1687227997367,5cyclictest1711659-21kworker/u8:0+flush-179:021:45:010
1687228997265,5cyclictest1708279-21kworker/u8:1+events_unbound20:25:231
1687227997266,5cyclictest1772901-21kworker/u8:3+events_unbound23:45:290
1687227997264,5cyclictest1701899-21kworker/u8:3+events_unbound19:55:010
1687227997167,3cyclictest1758371-21kworker/u8:2+events_unbound22:50:250
1687227997167,3cyclictest1711659-21kworker/u8:0+events_unbound21:35:280
1687227997064,5cyclictest1690466-21apt-get19:20:000
1687227997064,4cyclictest1769736-21kworker/u8:2+flush-179:023:25:200
1687227996961,5cyclictest1701324-21kworker/u8:0+flush-179:020:05:190
1687228996859,7cyclictest1761550-21kworker/u8:1+flush-179:023:20:001
1687227996759,6cyclictest1685542-21kworker/u8:1+events_unbound19:10:030
1687227996660,4cyclictest1774510-21kworker/u8:0+events_unbound00:10:220
1687228996559,4cyclictest1711659-21kworker/u8:0+events_unbound21:25:001
1687227996560,4cyclictest1722486-21kworker/u8:3+events_unbound21:10:010
1687227996558,5cyclictest1690436-21kworker/u8:0+flush-179:019:30:200
1687227996556,6cyclictest1748551-21latency_hist22:20:010
1687228996459,3cyclictest1690436-21kworker/u8:0+flush-179:019:20:271
1687228996458,4cyclictest1708468-21/usr/sbin/munin20:15:261
1687227996461,2cyclictest0-21swapper/023:13:590
1687227996458,4cyclictest1728111-21kworker/u8:2+flush-179:021:15:210
1687227996458,4cyclictest1728111-21kworker/u8:2+flush-179:021:15:200
1687228996362,1cyclictest0-21swapper/122:31:591
1687227996359,3cyclictest1754865-21kworker/u8:0+flush-179:022:45:250
1687227996357,4cyclictest1753267-21kworker/u8:3+flush-179:022:35:230
1687227996356,5cyclictest1790767-21/usr/sbin/munin00:30:250
1687227996355,6cyclictest1697131-21kworker/u8:1+flush-179:019:40:200
1687228996255,5cyclictest1761529-21latency_hist23:00:011
1687227996257,4cyclictest1743630-21kworker/u8:3+flush-179:022:05:010
1687227996156,4cyclictest1774510-21kworker/u8:0+events_unbound23:50:250
1687227996156,4cyclictest1774510-21kworker/u8:0+events_unbound23:50:250
168722799610,59cyclictest1769781-21munin-run23:25:010
1687228996053,4cyclictest1761226-21kworker/u8:0+flush-179:023:05:191
1687228996045,13cyclictest1694908-21kworker/u8:1+flush-179:019:30:261
1687227996057,2cyclictest714-21Xorg00:18:590
1687228995954,4cyclictest1711659-21kworker/u8:0+events_unbound22:00:001
1687228995954,4cyclictest1690436-21kworker/u8:0+flush-179:019:25:221
1687228995953,4cyclictest1690436-21kworker/u8:0+flush-179:019:40:161
1687228995952,5cyclictest266-21systemd-journal22:38:071
1687227995953,5cyclictest1761550-21kworker/u8:1+events_unbound23:00:010
1687228995852,5cyclictest1734210-21kworker/u8:4+flush-179:021:40:011
1687228995851,5cyclictest1774510-21kworker/u8:0+flush-179:000:15:201
1687228995849,7cyclictest1721213-21latency_hist20:55:011
1687227995852,4cyclictest1772901-21kworker/u8:3+events_unbound00:25:240
1687227995846,4cyclictest1670813-21kworker/u8:2+events_unbound19:35:150
1687228995751,4cyclictest1758371-21kworker/u8:2+flush-179:022:50:211
1687228995750,5cyclictest1772901-21kworker/u8:3+flush-179:000:10:231
1687227995650,4cyclictest1722486-21kworker/u8:3+events_unbound21:10:250
1687227995649,5cyclictest1701899-21kworker/u8:3+flush-179:019:55:260
1687227995646,8cyclictest1713006-21latency_hist20:30:010
1687227995544,4cyclictest1701899-21kworker/u8:3+events_unbound20:00:170
1687227995447,5cyclictest1746934-21latency_hist22:15:010
1687227995444,4cyclictest1670813-21kworker/u8:2+events_unbound19:20:020
1687228995348,4cyclictest1790510-21kworker/u8:0+events_unbound00:40:011
1687227995347,5cyclictest1737950-21kworker/u8:1+flush-179:021:50:210
1687227995347,5cyclictest1731535-21kworker/u8:1+flush-179:021:34:590
1687228995247,4cyclictest1750154-21kworker/u8:2+events_unbound22:25:251
1687228995247,4cyclictest1708279-21kworker/u8:1+flush-179:020:40:181
1687228995244,7cyclictest1754865-21kworker/u8:0+flush-179:022:50:011
1687227995246,4cyclictest1793712-21latency_hist00:40:010
1687228995147,3cyclictest1670813-21kworker/u8:2+flush-179:019:35:261
1687228995046,3cyclictest1772901-21kworker/u8:3+flush-179:000:31:261
1687228995045,3cyclictest1697131-21kworker/u8:1+flush-179:019:45:171
1687228995044,5cyclictest1737950-21kworker/u8:1+events_unbound21:50:161
1687228995035,14cyclictest1772901-21kworker/u8:3+flush-179:023:45:011
1687228994944,4cyclictest1772901-21kworker/u8:3+flush-179:023:50:001
1687228994941,5cyclictest1701899-21kworker/u8:3+events_unbound20:00:131
1687227994944,4cyclictest1711659-21kworker/u8:0+flush-179:022:20:200
1687227994944,4cyclictest1711659-21kworker/u8:0+flush-179:020:50:260
1687227994844,3cyclictest1727582-21kworker/u8:1+flush-179:021:20:160
4577091470,13ptp4l441ktimers/319:10:003
1687228994741,5cyclictest1708279-21kworker/u8:1+flush-179:020:20:201
1687228994738,7cyclictest266-21systemd-journal20:33:081
1687228994738,7cyclictest1711659-21kworker/u8:0+events_unbound22:05:191
1687228994738,6cyclictest1761226-21kworker/u8:0+events_unbound23:20:151
1687227994741,4cyclictest1711659-21kworker/u8:0+events_unbound21:04:590
1687228994641,4cyclictest1722486-21kworker/u8:3+flush-179:021:05:191
1687228994641,4cyclictest1722486-21kworker/u8:3+events_unbound21:00:201
1687228994541,3cyclictest1711659-21kworker/u8:0+flush-179:021:25:151
1687228994540,4cyclictest1708279-21kworker/u8:1+flush-179:020:45:231
1687228994534,5cyclictest1761550-21kworker/u8:1+events_unbound23:00:161
1687228994533,4cyclictest1727582-21kworker/u8:1+events_unbound21:15:011
1687227994540,4cyclictest1750154-21kworker/u8:2+flush-179:022:40:210
1687227994539,5cyclictest1731535-21kworker/u8:1+flush-179:021:25:210
168723899440,35cyclictest0-21swapper/221:31:592
1687228994438,5cyclictest1750154-21kworker/u8:2+events_unbound22:40:011
1687228994437,5cyclictest1711659-21kworker/u8:0+events_unbound22:00:241
1687227994440,3cyclictest1769736-21kworker/u8:2+flush-179:023:35:290
1687227994440,3cyclictest1737950-21kworker/u8:1+flush-179:021:45:260
1687227994440,3cyclictest1737950-21kworker/u8:1+flush-179:021:45:250
1687227994439,4cyclictest1772901-21kworker/u8:3+events_unbound23:55:150
1687228994338,4cyclictest1721452-21kworker/u8:2+flush-179:020:55:181
1687228994338,4cyclictest1670813-21kworker/u8:2+flush-179:019:54:551
1687228994237,4cyclictest1745194-21kworker/u8:1+events_unbound22:15:171
1687228994237,4cyclictest1711659-21kworker/u8:0+events_unbound22:10:201
1687227994238,3cyclictest1690436-21kworker/u8:0+flush-179:019:25:280
1687227994233,7cyclictest1708279-21kworker/u8:1+flush-179:020:20:000
1687228994137,3cyclictest1354603-21gdbus00:04:011
1687228994136,4cyclictest1701324-21kworker/u8:0+flush-179:020:05:211
1687228994136,3cyclictest714-21Xorg20:10:591
168724199400,39cyclictest1761527-21turbostat23:00:013
168724199400,39cyclictest1716455-21turbostat20:40:003
1687228994035,4cyclictest1722486-21kworker/u8:3+events_unbound21:15:151
1687228994035,4cyclictest1722486-21kworker/u8:3+events_unbound21:15:141
1687227994033,4cyclictest1774510-21kworker/u8:0+events_unbound23:40:240
1687238993936,2cyclictest0-21swapper/220:01:002
1687238993935,2cyclictest0-21swapper/221:08:582
1687227993936,2cyclictest211irq_work/022:31:590
4577091380,28ptp4l441ktimers/323:45:163
1687238993835,2cyclictest0-21swapper/223:15:592
168723899380,36cyclictest0-21swapper/223:58:582
168723899380,35cyclictest0-21swapper/222:14:582
168723899380,35cyclictest0-21swapper/221:30:002
168723899380,35cyclictest0-21swapper/221:05:002
1687228993833,4cyclictest1769736-21kworker/u8:2+flush-179:023:25:221
1687228993826,10cyclictest1787614-21apt-get00:20:141
1687227993835,2cyclictest714-21Xorg00:24:000
1687227993835,2cyclictest1711659-21kworker/u8:0+flush-179:022:25:250
1687241993734,2cyclictest0-21swapper/321:39:593
1687241993731,5cyclictest1784177-21turbostat00:10:003
1687241993731,5cyclictest1718054-21turbostat20:45:003
168724199370,36cyclictest0-21swapper/300:03:593
1687238993733,2cyclictest0-21swapper/221:38:592
168723899370,35cyclictest0-21swapper/200:34:592
1687228993732,4cyclictest1761550-21kworker/u8:1+flush-179:023:30:161
1687228993730,6cyclictest1701899-21kworker/u8:3+flush-179:020:00:011
1687227993734,2cyclictest1761226-21kworker/u8:0+events_unbound23:15:080
168722799370,36cyclictest0-21swapper/020:40:580
4577091360,28ptp4l441ktimers/322:15:173
1687241993634,1cyclictest0-21swapper/323:40:593
1687241993634,1cyclictest0-21swapper/323:22:593
1687241993634,1cyclictest0-21swapper/319:24:593
1687241993633,2cyclictest0-21swapper/321:08:593
168724199360,35cyclictest0-21swapper/300:12:583
168724199360,1cyclictest0-21swapper/300:36:593
1687238993633,2cyclictest0-21swapper/220:45:002
1687238993633,2cyclictest0-21swapper/200:10:002
168723899360,2cyclictest0-21swapper/200:12:582
168723899360,1cyclictest0-21swapper/222:50:002
1687227993633,2cyclictest211irq_work/023:33:000
1687227993632,2cyclictest0-21swapper/021:58:000
1687241993533,1cyclictest0-21swapper/321:02:583
1687241993533,1cyclictest0-21swapper/320:01:003
1687241993528,5cyclictest1734222-21turbostat21:35:003
1687238993532,2cyclictest0-21swapper/223:25:592
168722899352,4cyclictest1737655-21apt-get21:45:131
168722899352,4cyclictest1737655-21apt-get21:45:121
1687241993432,1cyclictest0-21swapper/323:15:583
1687241993428,5cyclictest1743773-21turbostat22:05:013
1687241993427,5cyclictest1754900-21turbostat22:40:003
1687238993431,2cyclictest0-21swapper/222:39:552
1687238993430,2cyclictest0-21swapper/222:53:592
1687238993430,2cyclictest0-21swapper/200:21:592
1687238993329,2cyclictest0-21swapper/223:31:582
1687238993329,2cyclictest0-21swapper/219:52:592
168723899330,30cyclictest0-21swapper/219:14:592
4577091320,5ptp4l441ktimers/322:10:003
4577091320,3ptp4l61490irq/134-eno1-TxRx-019:10:263
1687241993229,2cyclictest0-21swapper/323:25:593
168723899326,24cyclictest0-21swapper/220:08:592
1687238993229,2cyclictest0-21swapper/222:05:012
1687238993228,2cyclictest0-21swapper/200:37:592
1687228993227,4cyclictest1784165-21munin-run00:10:001
1687228993227,4cyclictest1711659-21kworker/u8:0+events_unbound21:30:251
1687241993129,1cyclictest0-21swapper/300:22:003
1687241993128,2cyclictest0-21swapper/323:08:593
1687238993129,1cyclictest0-21swapper/223:05:002
168723899310,2cyclictest0-21swapper/220:55:152
1687228993127,3cyclictest1774539-21munin-plugin-st23:40:001
1687228993127,3cyclictest1688763-21unixbench_multi19:10:251
1687228993125,4cyclictest1687142-21apt-key19:10:021
1687241993028,1cyclictest0-21swapper/319:45:143
1687241993027,2cyclictest0-21swapper/323:04:593
1687241993025,4cyclictest1740576-21turbostat21:54:593
168724199300,28cyclictest0-21swapper/321:25:153
168723899300,2cyclictest0-21swapper/219:20:592
168723899300,28cyclictest0-21swapper/220:30:012
168723899300,27cyclictest0-21swapper/221:14:592
1687228993024,5cyclictest1772901-21kworker/u8:3+flush-179:023:50:281
1687228993024,5cyclictest1772901-21kworker/u8:3+flush-179:023:50:281
1687241992927,1cyclictest0-21swapper/319:52:593
1687241992926,2cyclictest0-21swapper/323:55:003
1687241992926,2cyclictest0-21swapper/323:54:593
1687241992926,2cyclictest0-21swapper/323:31:593
1687241992926,2cyclictest0-21swapper/320:30:023
168724199290,28cyclictest1698710-21turbostat19:45:003
168724199290,28cyclictest0-21swapper/300:30:143
168724199290,27cyclictest0-21swapper/322:50:133
168724199290,27cyclictest0-21swapper/321:55:123
168724199290,1cyclictest0-21swapper/321:20:123
1687238992927,1cyclictest0-21swapper/223:55:002
1687238992927,1cyclictest0-21swapper/223:54:592
1687238992926,2cyclictest0-21swapper/223:05:592
1687238992926,2cyclictest0-21swapper/222:20:592
1687238992925,2cyclictest0-21swapper/219:57:592
168723899290,2cyclictest0-21swapper/221:20:112
168723899290,2cyclictest0-21swapper/219:40:122
168723899290,27cyclictest0-21swapper/223:40:142
168723899290,27cyclictest0-21swapper/221:55:112
168723899290,27cyclictest0-21swapper/220:50:132
168723899290,27cyclictest0-21swapper/220:35:152
168723899290,27cyclictest0-21swapper/220:15:152
168723899290,27cyclictest0-21swapper/219:45:142
168723899290,27cyclictest0-21swapper/219:28:592
168723899290,21cyclictest0-21swapper/220:25:142
4577091280,7ptp4l61490irq/134-eno1-TxRx-020:25:003
168724199280,27cyclictest0-21swapper/320:50:143
168724199280,27cyclictest0-21swapper/320:25:143
168724199280,27cyclictest0-21swapper/320:15:153
168724199280,26cyclictest0-21swapper/321:46:593
168724199280,26cyclictest0-21swapper/321:46:583
168724199280,26cyclictest0-21swapper/320:55:153
1687238992826,1cyclictest0-21swapper/222:29:592
1687238992826,1cyclictest0-21swapper/221:54:592
1687238992825,2cyclictest0-21swapper/220:13:582
168723899280,2cyclictest0-21swapper/221:46:592
168723899280,2cyclictest0-21swapper/221:46:592
168723899280,26cyclictest0-21swapper/219:33:592
168723899280,25cyclictest0-21swapper/219:15:242
4577091270,6ptp4l441ktimers/320:10:013
4577091270,6ptp4l441ktimers/319:35:003
4577091270,6ptp4l441ktimers/300:30:003
1687241992725,1cyclictest0-21swapper/322:30:593
1687241992725,1cyclictest0-21swapper/321:42:003
1687241992724,2cyclictest0-21swapper/321:13:003
1687238992723,2cyclictest0-21swapper/222:59:562
1687228992723,3cyclictest1734210-21kworker/u8:4+flush-179:021:43:301
1687227992722,3cyclictest0-21swapper/019:10:020
4577091260,6ptp4l61490irq/134-eno1-TxRx-000:00:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-019:40:013
4577091260,5ptp4l441ktimers/323:40:013
1687241992624,1cyclictest0-21swapper/322:29:583
1687241992624,1cyclictest0-21swapper/322:20:583
1687241992623,2cyclictest0-21swapper/321:19:593
1687241992623,2cyclictest0-21swapper/321:19:583
168724199260,24cyclictest0-21swapper/319:16:123
1687238992623,2cyclictest0-21swapper/200:15:152
168723899260,24cyclictest0-21swapper/220:21:592
4577091250,5ptp4l61490irq/134-eno1-TxRx-022:45:003
1687241992523,1cyclictest0-21swapper/319:57:593
1687241992523,1cyclictest0-21swapper/319:28:593
1687238992522,2cyclictest0-21swapper/221:41:592
1687238992522,2cyclictest0-21swapper/221:17:592
1687238992522,2cyclictest0-21swapper/221:17:592
1687238992521,2cyclictest0-21swapper/219:36:592
168723899250,24cyclictest0-21swapper/223:12:592
4577091240,4ptp4l61490irq/134-eno1-TxRx-022:14:563
168724199240,1cyclictest0-21swapper/300:15:593
1687238992421,2cyclictest0-21swapper/222:15:162
1687238992420,2cyclictest0-21swapper/223:38:002
4577091230,4ptp4l61490irq/134-eno1-TxRx-023:15:013
4577091230,3ptp4l61490irq/134-eno1-TxRx-020:49:553
4577091230,3ptp4l441ktimers/320:09:553
1687241992321,1cyclictest0-21swapper/322:49:543
1687238992320,2cyclictest0-21swapper/200:04:592
1687238992319,2cyclictest0-21swapper/200:26:592
1687238992220,1cyclictest0-21swapper/222:10:002
1687238992118,2cyclictest0-21swapper/223:20:592
1687238992017,2cyclictest0-21swapper/220:46:002
1687238992016,2cyclictest0-21swapper/222:30:582
1687238991916,2cyclictest0-21swapper/223:47:592
168723899190,18cyclictest1756760-21turbostat22:45:002
16872389940,3cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional