You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 14:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Wed Nov 12, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14955289910491,10cyclictest1525933-21latency_hist20:45:021
1495528998882,4cyclictest1585968-21kworker/u8:1+events_unbound00:15:001
1495528998778,6cyclictest271-21systemd-journal22:30:011
1495528998474,7cyclictest1539447-21latency_hist21:25:011
1495528998373,7cyclictest1581134-21kworker/u8:2+flush-179:000:00:001
1495526998271,8cyclictest1519563-21latency_hist20:25:010
1495526997969,7cyclictest1530958-21latency_hist21:00:000
1495526997867,8cyclictest1555356-21latency_hist22:15:010
1495528997466,5cyclictest1563939-21kworker/u8:0+flush-179:022:55:241
1495528997465,7cyclictest1513194-21latency_hist20:05:011
1495526997464,7cyclictest1519800-21/usr/sbin/munin20:25:240
1495526997459,11cyclictest1589131-40mandb00:00:010
1495526997362,8cyclictest1511589-21latency_hist20:00:010
1495528997263,6cyclictest1593968-21kworker/u8:0+events_unbound00:20:011
1495528997162,7cyclictest1541033-21latency_hist21:30:011
1495526997162,6cyclictest1556953-21latency_hist22:20:020
1495526996960,6cyclictest1532558-21latency_hist21:05:020
1495526996656,7cyclictest1565470-21/usr/sbin/munin22:45:250
1495526996555,7cyclictest1561965-21/usr/sbin/munin22:35:280
1495528996253,7cyclictest1516603-21/usr/sbin/munin20:15:241
1495526996253,7cyclictest1555402-21kworker/u8:0+flush-179:022:35:000
1495526996251,8cyclictest1503373-21latency_hist19:35:010
1495528996152,7cyclictest1505219-21/usr/sbin/munin19:40:251
1495528996054,4cyclictest723-21Xorg22:15:001
1495528996053,5cyclictest1545852-21kworker/u8:3+flush-179:022:50:221
1495528996051,7cyclictest1521172-21kworker/u8:0+flush-179:020:40:011
1495528996048,9cyclictest271-21systemd-journal21:40:011
1495526996050,7cyclictest1579556-21latency_hist23:30:010
1495528995953,4cyclictest1581124-21kworker/u8:0+flush-179:023:45:181
1495528995951,5cyclictest1550550-21kworker/u8:1+events_unbound22:05:001
1495528995848,7cyclictest1564984-21apt-get22:45:001
1495526995851,5cyclictest1516342-21kworker/u8:0+flush-179:020:20:000
1495528995649,5cyclictest1511657-21kworker/u8:1+events_unbound20:10:231
1495528995550,4cyclictest1532593-21kworker/u8:0+flush-179:021:10:251
1495528995549,4cyclictest1545852-21kworker/u8:3+flush-179:022:40:001
1495528995546,7cyclictest1597133-21latency_hist00:25:011
1495528995539,14cyclictest1593968-21kworker/u8:0+flush-179:000:25:261
1495526995546,7cyclictest1534659-21apt-get21:10:110
1495526995546,6cyclictest271-21systemd-journal19:25:000
1495528995448,5cyclictest1563939-21kworker/u8:0+flush-179:023:15:241
1495528995345,5cyclictest1585968-21kworker/u8:1+events_unbound00:05:001
1495528995345,5cyclictest1585968-21kworker/u8:1+events_unbound00:05:001
1495528995243,6cyclictest1581134-21kworker/u8:2+flush-179:023:45:001
1495528995242,9cyclictest1550550-21kworker/u8:1+flush-179:022:10:001
1495528995145,4cyclictest1496861-21kworker/u8:2+flush-179:019:20:221
1495528995042,6cyclictest1555402-21kworker/u8:0+flush-179:022:20:001
1495528995041,6cyclictest1504978-21latency_hist19:40:011
4670791490,13ptp4l441ktimers/319:10:003
1495528994943,5cyclictest1508448-21kworker/u8:3+events_unbound19:55:251
1495533994845,2cyclictest0-21swapper/322:14:593
1495532994846,1cyclictest0-21swapper/222:14:592
1495528994740,5cyclictest271-21systemd-journal22:23:131
1495528994739,5cyclictest1477536-21kworker/u8:1+flush-179:019:15:161
1495533994639,5cyclictest1506575-21turbostat19:44:593
1495532994642,2cyclictest0-21swapper/220:42:592
1495528994641,3cyclictest1522774-21systemd-run20:35:001
1495528994639,5cyclictest1544468-21kworker/u8:1+events_unbound21:40:251
1495528994638,6cyclictest1581124-21kworker/u8:0+events_unbound23:40:001
1495528994638,6cyclictest1581124-21kworker/u8:0+events_unbound23:40:001
1495528994637,6cyclictest1571602-21latency_hist23:05:011
1495526994641,4cyclictest1532593-21kworker/u8:0+events_unbound21:18:020
149552699461,44cyclictest191rcuc/023:50:590
149552699460,44cyclictest723-21Xorg23:03:590
1495533994541,2cyclictest0-21swapper/320:42:593
1495528994534,9cyclictest1591019-21apt-get00:05:131
1495528994439,3cyclictest1576621-21kworker/u8:1+flush-179:023:30:171
1495528994437,5cyclictest1507064-21/usr/sbin/munin19:45:211
1495526994436,6cyclictest1522737-21latency_hist20:35:010
1495532994340,2cyclictest0-21swapper/219:45:002
1495528994339,3cyclictest1505006-21kworker/u8:2+flush-179:020:29:551
1495526994338,3cyclictest1601958-21systemd-run00:39:590
1495528994237,4cyclictest1530985-21turbostat21:04:561
1495526994239,2cyclictest723-21Xorg23:22:590
1495528994135,4cyclictest723-21Xorg23:12:591
1495526994134,5cyclictest1563593-21apt-get22:40:110
149552699410,39cyclictest723-21Xorg23:09:590
149552699410,39cyclictest1558558-21turbostat22:29:550
1495528994036,3cyclictest1593968-21kworker/u8:0+flush-179:000:35:231
1495528994030,8cyclictest1600310-21latency_hist00:35:001
1495526994035,3cyclictest1506610-21systemd-run19:45:000
1495526994033,4cyclictest1527774-21latency_hist20:50:010
149553399390,37cyclictest0-21swapper/322:41:593
149553399390,2cyclictest0-21swapper/320:12:593
149553299390,36cyclictest0-21swapper/222:42:002
149553299390,35cyclictest0-21swapper/222:47:582
1495528993935,2cyclictest723-21Xorg19:14:591
1495528993932,5cyclictest1545852-21kworker/u8:3+events_unbound21:55:251
1495528993932,5cyclictest1545852-21kworker/u8:3+events_unbound21:55:241
1495526993937,1cyclictest0-21swapper/021:30:000
1495526993936,2cyclictest723-21Xorg20:51:590
1495526993928,9cyclictest1507082-21apt-get19:45:150
149553399380,36cyclictest0-21swapper/322:09:543
1495532993835,2cyclictest0-21swapper/219:23:592
1495532993834,2cyclictest0-21swapper/223:39:592
1495532993834,2cyclictest0-21swapper/223:39:592
149553299380,35cyclictest0-21swapper/221:00:002
149553299380,1cyclictest0-21swapper/200:31:592
1495528993835,2cyclictest723-21Xorg22:50:001
1495528993833,4cyclictest1517932-21kworker/u8:1+flush-179:020:45:191
1495528993831,5cyclictest1581134-21kworker/u8:2+events_unbound23:50:251
1495528993829,7cyclictest1521172-21kworker/u8:0+events_unbound20:50:181
1495526993836,1cyclictest723-21Xorg19:37:590
1495526993834,3cyclictest1-21systemd20:45:010
149552699381,33cyclictest690-21snmpd21:30:140
149552699380,37cyclictest0-21swapper/022:06:590
1495533993734,2cyclictest0-21swapper/319:23:593
149553399370,36cyclictest0-21swapper/322:47:583
1495532993734,2cyclictest0-21swapper/222:24:002
1495532993734,2cyclictest0-21swapper/220:04:592
1495528993732,3cyclictest271-21systemd-journal22:34:381
1495528993730,5cyclictest1545852-21kworker/u8:3+flush-179:021:45:171
1495526993734,2cyclictest1539462-21perf21:25:010
1495526993734,2cyclictest1498652-21systemd-run19:20:010
1495526993732,3cyclictest723-21Xorg20:14:000
1495533993634,1cyclictest0-21swapper/323:33:593
1495533993633,2cyclictest0-21swapper/323:39:593
1495533993633,2cyclictest0-21swapper/323:39:593
149553299360,1cyclictest0-21swapper/222:09:552
1495528993629,5cyclictest1529395-21kworker/u8:3+flush-179:020:55:251
1495526993633,2cyclictest723-21Xorg22:01:590
1495526993633,2cyclictest723-21Xorg21:06:590
1495533993533,1cyclictest0-21swapper/322:23:593
1495533993533,1cyclictest0-21swapper/320:04:583
149553399350,1cyclictest0-21swapper/300:31:593
1495532993530,3cyclictest0-21swapper/219:46:002
1495528993530,3cyclictest0-21swapper/123:10:021
1495528993529,4cyclictest1573222-21kworker/u8:3+events_unbound23:25:281
1495528993528,5cyclictest491-21systemd-logind21:35:001
1495526993534,1cyclictest0-21swapper/020:02:590
1495526993528,5cyclictest475-21dbus-daemon00:05:000
1495526993528,5cyclictest475-21dbus-daemon00:05:000
1495526993528,2cyclictest171rcu_preempt19:10:190
4670791340,3ptp4l61690irq/136-eno1-TxRx-000:05:143
1495533993429,4cyclictest1521160-21turbostat20:30:003
1495532993431,2cyclictest0-21swapper/223:17:592
1495532993430,2cyclictest0-21swapper/221:37:582
1495532993430,2cyclictest0-21swapper/221:04:552
1495532993430,2cyclictest0-21swapper/220:17:002
1495528993428,5cyclictest1573222-21kworker/u8:3+events_unbound23:20:281
1495528993428,5cyclictest1505006-21kworker/u8:2+flush-179:019:50:141
1495528993427,4cyclictest0-21swapper/120:05:591
149552899341,29cyclictest0-21swapper/119:25:131
149552699343,29cyclictest1567074-21apt-get22:50:130
1495526993431,2cyclictest1576373-21idleruntime-cro23:20:000
1495533993331,1cyclictest0-21swapper/323:17:593
1495532993330,2cyclictest0-21swapper/223:06:592
1495532993330,2cyclictest0-21swapper/220:29:592
149553299330,2cyclictest0-21swapper/200:19:552
1495528993330,2cyclictest1534503-21apt-key21:10:001
1495528993327,4cyclictest1529395-21kworker/u8:3+events_unbound21:15:271
1495526993331,1cyclictest0-21swapper/000:24:550
1495526993326,5cyclictest723-21Xorg00:11:590
1495526993325,6cyclictest1542860-21/usr/sbin/munin21:35:200
1495533993229,2cyclictest0-21swapper/321:37:583
1495533993229,2cyclictest0-21swapper/320:16:593
1495532993229,2cyclictest0-21swapper/200:09:582
1495532993228,3cyclictest0-21swapper/200:02:592
1495532993228,3cyclictest0-21swapper/200:02:592
1495528993230,1cyclictest1501763-21kworker/u8:0+flush-179:019:35:001
1495526993229,2cyclictest0-21swapper/000:29:590
1495526993229,2cyclictest0-21swapper/000:09:550
1495526993227,3cyclictest475-21dbus-daemon23:45:000
1495526993227,3cyclictest1595583-21systemd-run00:20:010
1495526993227,2cyclictest1545829-21idleruntime-cro21:45:000
1495526993225,6cyclictest1556959-21turbostat22:24:550
149552699321,29cyclictest1573445-21apt-get23:10:140
149552699321,29cyclictest0-21swapper/019:50:130
1495533993129,1cyclictest0-21swapper/323:06:593
1495533993128,2cyclictest0-21swapper/300:02:593
1495533993128,2cyclictest0-21swapper/300:02:593
149553399310,30cyclictest0-21swapper/300:19:553
149553399310,28cyclictest0-21swapper/321:20:023
149553299310,29cyclictest0-21swapper/221:20:022
149553299310,27cyclictest0-21swapper/222:57:592
149553299310,27cyclictest0-21swapper/219:15:142
1495528993126,4cyclictest1542610-21kworker/u8:2+events_unbound21:50:251
4670791300,10ptp4l441ktimers/320:55:013
1495533993028,1cyclictest0-21swapper/321:04:553
1495533993028,1cyclictest0-21swapper/319:46:003
1495533993027,2cyclictest0-21swapper/323:12:593
149553399300,2cyclictest0-21swapper/319:57:593
149553399300,29cyclictest0-21swapper/322:33:583
1495532993027,2cyclictest0-21swapper/223:12:592
1495532993027,2cyclictest0-21swapper/221:10:032
1495532993027,2cyclictest0-21swapper/219:14:592
1495532993026,2cyclictest0-21swapper/200:14:592
149553299300,2cyclictest0-21swapper/223:50:142
149553299300,28cyclictest0-21swapper/222:33:582
149553299300,28cyclictest0-21swapper/200:22:592
149553299300,1cyclictest0-21swapper/220:12:592
149552699300,28cyclictest723-21Xorg23:32:000
1495533992926,2cyclictest0-21swapper/319:14:593
1495533992925,1cyclictest0-21swapper/320:55:133
149553399290,28cyclictest0-21swapper/322:58:003
149553399290,28cyclictest0-21swapper/320:35:163
149553399290,27cyclictest0-21swapper/323:20:163
149553399290,27cyclictest0-21swapper/321:05:183
149553399290,27cyclictest0-21swapper/320:20:143
149553399290,27cyclictest0-21swapper/319:35:173
149553399290,1cyclictest0-21swapper/323:50:143
1495532992926,2cyclictest0-21swapper/223:44:552
1495532992926,2cyclictest0-21swapper/222:02:002
1495532992925,2cyclictest0-21swapper/200:35:142
149553299290,27cyclictest0-21swapper/223:20:162
149553299290,27cyclictest0-21swapper/221:05:172
149553299290,27cyclictest0-21swapper/220:35:172
149553299290,27cyclictest0-21swapper/219:35:172
149553299290,27cyclictest0-21swapper/219:25:132
149553299290,21cyclictest0-21swapper/220:20:152
149552699297,7cyclictest1495560-21latency_hist19:10:010
1495526992925,3cyclictest1-21systemd21:50:010
1495526992924,3cyclictest0-21swapper/022:00:020
1495526992924,3cyclictest0-21swapper/022:00:010
149552699291,11cyclictest1548481-21phc2sys21:50:230
149552699290,27cyclictest723-21Xorg23:47:590
1495533992826,1cyclictest0-21swapper/321:10:033
1495533992825,2cyclictest0-21swapper/323:44:553
1495533992825,2cyclictest0-21swapper/319:25:133
149553399280,27cyclictest0-21swapper/322:16:593
149553399280,27cyclictest0-21swapper/319:15:143
149553399280,25cyclictest0-21swapper/322:37:003
149553399280,21cyclictest0-21swapper/300:35:143
1495532992825,2cyclictest0-21swapper/222:39:592
1495532992824,2cyclictest0-21swapper/221:58:592
1495532992824,2cyclictest0-21swapper/221:58:592
1495532992824,2cyclictest0-21swapper/220:48:582
1495532992824,2cyclictest0-21swapper/219:55:592
149553299280,26cyclictest0-21swapper/222:16:582
149553299280,26cyclictest0-21swapper/220:50:182
1495526992826,1cyclictest0-21swapper/020:37:580
1495526992825,2cyclictest1581134-21kworker/u8:2+flush-179:023:36:090
1495526992825,2cyclictest1581134-21kworker/u8:2+flush-179:023:36:090
149552699280,27cyclictest1513201-21turbostat20:09:550
4670791270,6ptp4l61690irq/136-eno1-TxRx-019:55:013
4670791270,6ptp4l441ktimers/321:54:553
1495533992725,1cyclictest0-21swapper/300:14:593
149553399270,25cyclictest0-21swapper/323:02:583
149553399270,25cyclictest0-21swapper/321:15:143
1495532992723,2cyclictest0-21swapper/222:54:552
149553299270,2cyclictest0-21swapper/223:49:592
149553299270,19cyclictest0-21swapper/221:15:152
1495526992723,3cyclictest723-21Xorg19:25:590
4670791260,6ptp4l61690irq/136-eno1-TxRx-021:45:003
4670791260,6ptp4l61690irq/136-eno1-TxRx-021:30:013
4670791260,6ptp4l441ktimers/323:50:003
4670791260,6ptp4l441ktimers/321:50:013
4670791260,5ptp4l441ktimers/320:35:003
4670791260,3ptp4l441ktimers/323:30:003
1495533992624,1cyclictest0-21swapper/322:02:003
1495533992624,1cyclictest0-21swapper/320:48:593
149553399260,2cyclictest0-21swapper/321:57:003
149553399260,2cyclictest0-21swapper/321:56:593
1495532992622,2cyclictest0-21swapper/222:28:592
149553299260,24cyclictest0-21swapper/223:02:592
149553299260,24cyclictest0-21swapper/219:30:592
1495528992620,4cyclictest0-21swapper/120:20:251
149552699262,9cyclictest1570156-21latency_hist23:00:000
4670791250,6ptp4l61690irq/136-eno1-TxRx-022:54:563
4670791250,5ptp4l441ktimers/320:09:553
1495533992522,2cyclictest0-21swapper/321:32:583
149553399250,2cyclictest0-21swapper/300:23:593
1495532992522,2cyclictest0-21swapper/221:32:592
1495532992521,2cyclictest0-21swapper/200:25:152
4670791240,4ptp4l61690irq/136-eno1-TxRx-000:30:003
1495532992420,2cyclictest0-21swapper/220:09:542
1495526992421,2cyclictest1585968-21kworker/u8:1+flush-179:000:34:080
4670791230,4ptp4l61690irq/136-eno1-TxRx-022:30:003
4670791230,4ptp4l441ktimers/319:34:553
1495532992320,2cyclictest0-21swapper/223:30:582
1495532992320,1cyclictest0-21swapper/219:54:592
1495532992016,2cyclictest0-21swapper/223:26:592
1495532991815,2cyclictest0-21swapper/221:55:002
1495532991715,1cyclictest0-21swapper/221:29:592
4670791160,8ptp4l441ktimers/323:55:123
1495532991513,1cyclictest0-21swapper/221:44:592
1495532991512,2cyclictest0-21swapper/223:55:592
1495528991410,2cyclictest0-21swapper/119:10:011
149553299129,2cyclictest0-21swapper/221:49:592
14955329996,2cyclictest0-21swapper/220:33:002
14955329930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional