You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-30 - 10:20

x86 Intel Atom x6425RE @1900 MHz, Linux 5.18.0-rt11 (Profile)

Latency plot of system in rack #e, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h800 -q
Total number of samples: 100 million
Resolution of latency scale: reduced 
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot7.osadl.org (updated Mon Jun 06, 2022 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1917936997062,3cyclictest2004443-21latency_hist20:30:020
1917927996759,4cyclictest2070154-21apt-get21:25:120
1917927996659,3cyclictest1923310-21latency_hist19:15:020
1917936996560,2cyclictest2288164-21kworker/u8:0+flush-8:000:10:320
1917936996558,3cyclictest267-21systemd-journal23:25:010
1917927996558,3cyclictest2299193-21apt-get23:55:110
1917927996454,6cyclictest267-21systemd-journal19:45:020
1917927996357,2cyclictest2283053-21latency_hist23:45:020
1917936996254,6cyclictest267-21systemd-journal19:35:010
1917936996251,9cyclictest267-21systemd-journal23:50:270
1917927996255,3cyclictest267-21systemd-journal22:30:010
1917936996152,7cyclictest267-21systemd-journal21:00:020
1917936996055,3cyclictest1185-21rs:main0
1917936995952,5cyclictest2283804-21apt-get23:45:120
1917927995848,8cyclictest2085403-21apt-get21:35:120
1917936995750,4cyclictest2169010-21apt-get22:30:120
1917927995651,3cyclictest2176578-21apt-get22:35:110
750589550,0phc2sys0-21swapper/121:41:171
1917936995549,4cyclictest1185-21rs:main0
1917936995249,2cyclictest2077413-21kworker/u8:2+events_unbound22:05:180
1917927995247,3cyclictest2015111-21latency_hist20:40:010
750589510,1phc2sys0-21swapper/121:32:171
1917936995147,3cyclictest267-21systemd-journal21:50:100
1917927995146,3cyclictest2352011-21apt-get00:30:130
1917936995047,2cyclictest2009852-21kworker/u8:1+flush-8:021:10:410
1917936994946,2cyclictest2168702-21kworker/u8:3+events_unbound22:45:310
1917936994944,3cyclictest267-21systemd-journal22:55:010
1917936994943,4cyclictest1993602-21gpgv20:20:010
1917927994943,5cyclictest2268101-21apt-get23:35:120
1917936994845,2cyclictest2054781-21kworker/u8:4+flush-8:021:33:370
1917936994844,3cyclictest2213080-21kworker/u8:1+flush-8:023:15:310
1917936994842,4cyclictest267-21systemd-journal23:31:110
1917936994741,4cyclictest267-21systemd-journal21:05:000
1917936994639,6cyclictest267-21systemd-journal23:10:230
1917936994639,6cyclictest267-21systemd-journal21:15:150
1917927994640,4cyclictest1972390-21apt-get20:00:130
750589450,0phc2sys0-21swapper/123:56:071
1917936994540,3cyclictest2004756-21apt-get20:30:110
750589440,1phc2sys0-21swapper/123:13:521
750589440,0phc2sys0-21swapper/123:21:571
1917936994441,2cyclictest2009852-21kworker/u8:1+flush-8:021:23:040
1917936994440,3cyclictest2183047-21kworker/u8:0+flush-8:022:44:420
1917936994439,3cyclictest267-21systemd-journal20:45:010
1917936994439,3cyclictest1185-21rs:main0
1917931994437,2cyclictest2306926-21apt-get00:00:130
750589430,1phc2sys0-21swapper/122:31:371
750589430,0phc2sys0-21swapper/121:20:371
750589430,0phc2sys0-21swapper/120:20:231
1917936994340,2cyclictest2336642-21kworker/u8:0+events_unbound00:39:320
1917936994340,2cyclictest2100312-21kworker/u8:0+events_unbound21:46:560
1917936994339,3cyclictest2199191-21kworker/u8:4+flush-8:000:16:260
1917936994336,6cyclictest267-21systemd-journal22:00:010
750589420,0phc2sys0-21swapper/119:30:571
1917936994239,2cyclictest2054781-21kworker/u8:4+events_unbound22:17:330
750589410,0phc2sys0-21swapper/123:43:321
750589410,0phc2sys0-21swapper/119:56:061
750589410,0phc2sys0-21swapper/119:26:281
1917936994136,4cyclictest1185-21rs:main0
1917927994133,6cyclictest1923703-21timerandwakeup19:15:020
750589400,1phc2sys0-21swapper/121:25:051
1917936994037,2cyclictest2327257-21kworker/u8:3+events_unbound00:21:360
1917936994037,2cyclictest2183047-21kworker/u8:0+events_unbound22:55:030
1917936994037,2cyclictest2100312-21kworker/u8:0+flush-8:022:02:390
1917936994037,2cyclictest2077413-21kworker/u8:2+events_unbound21:44:470
1917931994034,3cyclictest267-21systemd-journal23:09:000
1917927994033,6cyclictest267-21systemd-journal23:01:180
750589390,1phc2sys0-21swapper/122:19:031
750589390,0phc2sys0-21swapper/122:36:061
1917936993936,2cyclictest2336642-21kworker/u8:0+flush-8:000:26:260
1917936993936,2cyclictest2306561-21kworker/u8:1+flush-8:000:05:420
750589380,0phc2sys0-21swapper/122:27:081
1917936993834,3cyclictest1999404-21kworker/u8:2+flush-8:021:06:330
750589370,1phc2sys0-21swapper/123:51:361
750589370,1phc2sys0-21swapper/122:53:121
750589370,0phc2sys0-21swapper/122:02:511
750589370,0phc2sys0-21swapper/100:07:471
1917936993734,2cyclictest2077413-21kworker/u8:2+events_unbound22:23:400
750589360,1phc2sys0-21swapper/100:33:511
750589360,1phc2sys0-21swapper/100:25:461
750589360,0phc2sys0-21swapper/119:51:381
750589350,2phc2sys271ktimers/100:17:411
750589350,1phc2sys0-21swapper/122:47:481
750589350,1phc2sys0-21swapper/122:07:411
750589350,1phc2sys0-21swapper/121:19:421
750589350,0phc2sys0-21swapper/122:56:461
750589350,0phc2sys0-21swapper/122:10:571
750589350,0phc2sys0-21swapper/121:37:421
1917931993531,3cyclictest2020787-21apt-get20:45:110
1917927993532,2cyclictest1967030-21apt-get19:55:100
750589340,0phc2sys0-21swapper/121:08:021
750589340,0phc2sys0-21swapper/119:35:261
1917936993431,2cyclictest1945427-21kworker/u8:1+flush-8:019:36:060
1917936993428,4cyclictest1929668-21apt-get19:20:110
750589330,1phc2sys0-21swapper/123:01:161
750589330,1phc2sys0-21swapper/120:38:211
750589330,1phc2sys0-21swapper/119:20:411
750589330,0phc2sys0-21swapper/120:46:281
1917927993326,6cyclictest1185-21rs:main0
750589320,1phc2sys0-21swapper/120:00:361
750589320,0phc2sys0-21swapper/120:08:421
750290320,2ptp4l271ktimers/100:24:221
750290320,20ptp4l271ktimers/122:20:221
1917936993227,3cyclictest1994088-21apt-get20:20:120
750589310,2phc2sys0-21swapper/119:09:221
750589310,0phc2sys0-21swapper/123:18:211
750589310,0phc2sys0-21swapper/121:03:321
750589310,0phc2sys0-21swapper/120:41:581
750290310,2ptp4l271ktimers/123:09:281
1917936993127,3cyclictest1933258-21kworker/u8:0+flush-8:019:48:390
1917927993127,3cyclictest267-21systemd-journal20:05:310
750589300,2phc2sys28-21ksoftirqd/119:43:311
1917936993021,7cyclictest1961692-21apt-get19:50:100
750589290,1phc2sys0-21swapper/121:45:461
750589290,0phc2sys0-21swapper/121:58:231
750589290,0phc2sys0-21swapper/120:25:471
750589270,0phc2sys0-21swapper/100:38:221
750290270,8ptp4l271ktimers/123:25:331
750589260,0phc2sys0-21swapper/121:10:461
750290260,3ptp4l271ktimers/122:40:471
750290260,3ptp4l271ktimers/119:10:191
750290260,2ptp4l271ktimers/121:54:461
750589250,1phc2sys0-21swapper/123:45:481
750589250,1phc2sys0-21swapper/100:10:511
750290250,0ptp4l0-21swapper/123:31:321
750589240,1phc2sys0-21swapper/119:46:171
750589240,0phc2sys0-21swapper/119:18:581
750290240,2ptp4l271ktimers/120:10:201
750290230,2ptp4l271ktimers/123:37:151
750290220,3ptp4l271ktimers/100:00:141
750589210,1phc2sys0-21swapper/120:30:121
750589210,0phc2sys0-21swapper/120:56:111
750290210,2ptp4l271ktimers/120:50:121
750290180,4ptp4l271ktimers/120:15:121
191793699118,2cyclictest141ktimers/019:10:020
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:083
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
none12:21:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional