You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-26 - 20:07

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot4.osadl.org (updated Fri May 20, 2022 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16545802322281,26sleep10-21swapper/119:06:151
16547242296254,27sleep00-21swapper/019:07:470
172099630,4rtkit-daemon1719-21rtkit-daemon19:14:230
16742122590,14sleep013-21ksoftirqd/019:55:100
172099520,4rtkit-daemon1719-21rtkit-daemon21:57:291
172099500,4rtkit-daemon1719-21rtkit-daemon23:47:441
172099490,3rtkit-daemon1719-21rtkit-daemon22:53:301
17720722480,4sleep10-21swapper/122:49:111
172099470,3rtkit-daemon1719-21rtkit-daemon21:42:361
172099450,4rtkit-daemon1719-21rtkit-daemon20:16:550
17120272440,1chrt1712025-21grep21:20:201
17267482420,1sleep00-21swapper/021:41:160
172099390,3rtkit-daemon0-21swapper/121:37:221
165504399384,10cyclictest26-21ksoftirqd/119:35:011
172099370,4rtkit-daemon1719-21rtkit-daemon20:10:191
172099370,3rtkit-daemon1719-21rtkit-daemon00:25:151
172099370,3rtkit-daemon0-21swapper/021:17:461
165504399376,10cyclictest26-21ksoftirqd/123:00:141
172099360,3rtkit-daemon1719-21rtkit-daemon21:24:050
172099360,3rtkit-daemon0-21swapper/021:13:211
1655043993613,4cyclictest26-21ksoftirqd/122:18:031
1655043993612,4cyclictest26-21ksoftirqd/122:20:071
1655043993611,4cyclictest26-21ksoftirqd/122:30:201
172099350,5rtkit-daemon1841924-21sh00:34:110
172099350,5rtkit-daemon1775080-21ssh22:53:090
172099350,4rtkit-daemon1719-21rtkit-daemon20:55:140
172099350,3rtkit-daemon0-21swapper/119:59:581
172099350,3rtkit-daemon0-21swapper/022:13:121
172099350,3rtkit-daemon0-21swapper/000:03:331
1655043993513,4cyclictest26-21ksoftirqd/121:30:221
1655043993512,3cyclictest26-21ksoftirqd/120:35:141
17477992340,5sleep00-21swapper/022:12:270
172099340,4rtkit-daemon1719-21rtkit-daemon23:22:341
172099340,4rtkit-daemon1719-21rtkit-daemon21:27:351
172099340,4rtkit-daemon0-21swapper/022:25:091
172099340,3rtkit-daemon1719-21rtkit-daemon21:45:071
172099340,3rtkit-daemon0-21swapper/122:32:110
172099340,3rtkit-daemon0-21swapper/100:25:430
172099340,3rtkit-daemon0-21swapper/100:24:261
165504399349,2cyclictest1803770-21sh23:35:201
1655043993411,4cyclictest26-21ksoftirqd/123:15:161
1655043993411,4cyclictest26-21ksoftirqd/122:03:491
172099330,5rtkit-daemon1717853-21latency_hist21:30:010
172099330,4rtkit-daemon1730844-21ssh21:48:250
172099330,4rtkit-daemon1719-21rtkit-daemon19:35:500
172099330,3rtkit-daemon1719-21rtkit-daemon23:53:051
172099330,3rtkit-daemon1719-21rtkit-daemon00:35:361
172099330,3rtkit-daemon0-21swapper/120:00:560
1655043993315,4cyclictest26-21ksoftirqd/123:30:221
1655043993315,4cyclictest26-21ksoftirqd/120:55:011
1655043993313,4cyclictest26-21ksoftirqd/100:15:441
1655043993312,4cyclictest26-21ksoftirqd/122:44:091
1655043993312,4cyclictest26-21ksoftirqd/122:35:401
1655043993311,4cyclictest26-21ksoftirqd/123:56:381
165504399330,21cyclictest26-21ksoftirqd/121:50:151
172099320,4rtkit-daemon1719-21rtkit-daemon20:01:551
172099320,4rtkit-daemon1719-21rtkit-daemon19:31:200
172099320,3rtkit-daemon1719-21rtkit-daemon22:22:240
172099320,3rtkit-daemon1719-21rtkit-daemon00:09:171
1655043993228,3cyclictest62050irq/130-enp2s019:25:001
1655043993218,4cyclictest26-21ksoftirqd/119:40:011
1655043993215,4cyclictest26-21ksoftirqd/123:25:171
1655043993213,3cyclictest26-21ksoftirqd/100:30:531
1655043993212,3cyclictest26-21ksoftirqd/122:56:581
1655043993211,4cyclictest26-21ksoftirqd/122:05:541
172099310,4rtkit-daemon1719-21rtkit-daemon22:18:390
172099310,4rtkit-daemon1719-21rtkit-daemon21:17:400
172099310,3rtkit-daemon1719-21rtkit-daemon23:31:360
172099310,3rtkit-daemon1719-21rtkit-daemon20:32:371
172099310,3rtkit-daemon0-21swapper/123:35:060
172099310,3rtkit-daemon0-21swapper/120:37:350
172099310,2rtkit-daemon1719-21rtkit-daemon22:26:090
165504399319,4cyclictest26-21ksoftirqd/123:06:501
165504399319,4cyclictest26-21ksoftirqd/120:55:211
1655043993119,3cyclictest26-21ksoftirqd/119:30:011
1655043993116,3cyclictest26-21ksoftirqd/100:10:181
1655043993111,4cyclictest26-21ksoftirqd/123:12:281
1655043993110,4cyclictest26-21ksoftirqd/123:41:541
165504399310,10cyclictest26-21ksoftirqd/120:15:231
172099300,4rtkit-daemon1719-21rtkit-daemon19:42:280
172099300,3rtkit-daemon0-21swapper/121:52:290
172099300,3rtkit-daemon0-21swapper/120:33:520
1655043993017,4cyclictest26-21ksoftirqd/120:50:001
172099290,4rtkit-daemon1719-21rtkit-daemon21:11:460
172099290,3rtkit-daemon0-21swapper/122:59:280
172099290,3rtkit-daemon0-21swapper/122:35:510
172099290,3rtkit-daemon0-21swapper/120:28:030
172099290,3rtkit-daemon0-21swapper/120:28:020
172099290,3rtkit-daemon0-21swapper/019:13:431
165503999290,7cyclictest161rcuc/022:05:190
172099280,3rtkit-daemon1719-21rtkit-daemon20:12:120
172099280,3rtkit-daemon0-21swapper/119:18:480
165504399287,4cyclictest26-21ksoftirqd/119:53:051
172099270,3rtkit-daemon1719-21rtkit-daemon19:43:261
172099270,3rtkit-daemon0-21swapper/123:48:340
172099270,3rtkit-daemon0-21swapper/123:21:090
172099270,3rtkit-daemon0-21swapper/121:00:400
172099270,3rtkit-daemon0-21swapper/120:21:530
165504399279,4cyclictest26-21ksoftirqd/121:07:271
165504399276,10cyclictest26-21ksoftirqd/120:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional