You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:40

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot4.osadl.org (updated Fri Aug 12, 2022 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5212242280198,27sleep00-21swapper/007:09:420
5208452244201,28sleep10-21swapper/107:05:371
52136399211205,4cyclictest622192-21kworker/u8:310:50:251
172099680,4rtkit-daemon1719-21rtkit-daemon08:53:371
172099660,6rtkit-daemon1719-21rtkit-daemon09:40:141
172099640,5rtkit-daemon1719-21rtkit-daemon10:20:161
7028822600,4sleep00-21swapper/012:15:260
172099600,4rtkit-daemon1719-21rtkit-daemon10:35:381
172099550,12rtkit-daemon1719-21rtkit-daemon08:20:180
172099500,4rtkit-daemon1719-21rtkit-daemon10:32:121
172099490,4rtkit-daemon1719-21rtkit-daemon07:46:321
172099380,9rtkit-daemon550034-21timerandwakeup08:15:250
172099380,3rtkit-daemon0-21swapper/109:50:371
172099370,3rtkit-daemon0-21swapper/110:44:341
172099370,3rtkit-daemon0-21swapper/109:56:590
172099360,8rtkit-daemon598249-21ssh09:48:270
172099360,4rtkit-daemon702765-21sed12:15:251
172099360,3rtkit-daemon0-21swapper/109:32:151
172099360,3rtkit-daemon0-21swapper/109:03:301
172099360,3rtkit-daemon0-21swapper/108:30:341
172099360,3rtkit-daemon0-21swapper/107:55:591
172099350,4rtkit-daemon1719-21rtkit-daemon11:31:180
172099350,4rtkit-daemon1719-21rtkit-daemon11:13:060
172099350,4rtkit-daemon1719-21rtkit-daemon11:06:430
172099350,3rtkit-daemon0-21swapper/111:11:201
172099350,3rtkit-daemon0-21swapper/008:17:301
172099340,4rtkit-daemon1719-21rtkit-daemon09:25:431
172099340,4rtkit-daemon1719-21rtkit-daemon08:25:170
172099340,4rtkit-daemon0-21swapper/008:23:081
172099340,3rtkit-daemon0-21swapper/112:12:540
172099340,3rtkit-daemon0-21swapper/110:14:210
172099340,3rtkit-daemon0-21swapper/109:43:590
172099340,3rtkit-daemon0-21swapper/109:30:210
172099340,3rtkit-daemon0-21swapper/108:36:450
172099340,3rtkit-daemon0-21swapper/107:35:440
172099330,4rtkit-daemon1719-21rtkit-daemon07:51:111
172099330,3rtkit-daemon0-21swapper/112:08:171
172099330,3rtkit-daemon0-21swapper/112:08:161
172099330,3rtkit-daemon0-21swapper/109:09:230
172099330,3rtkit-daemon0-21swapper/107:34:380
172099330,3rtkit-daemon0-21swapper/009:12:281
172099330,3rtkit-daemon0-21swapper/008:25:451
172099320,5rtkit-daemon708365-21ssh12:25:070
172099320,4rtkit-daemon1719-21rtkit-daemon11:47:030
172099320,4rtkit-daemon1719-21rtkit-daemon11:40:580
172099320,4rtkit-daemon1719-21rtkit-daemon09:57:501
172099320,4rtkit-daemon1719-21rtkit-daemon09:08:031
172099320,3rtkit-daemon1719-21rtkit-daemon11:15:300
172099320,3rtkit-daemon0-21swapper/111:56:390
172099320,3rtkit-daemon0-21swapper/108:01:560
172099320,3rtkit-daemon0-21swapper/011:26:011
172099320,3rtkit-daemon0-21swapper/011:15:101
172099320,3rtkit-daemon0-21swapper/011:09:171
172099320,3rtkit-daemon0-21swapper/008:08:091
172099310,4rtkit-daemon1719-21rtkit-daemon08:49:000
172099310,3rtkit-daemon1719-21rtkit-daemon08:00:381
172099310,3rtkit-daemon0-21swapper/110:35:460
172099310,3rtkit-daemon0-21swapper/110:32:470
172099310,3rtkit-daemon0-21swapper/110:27:390
172099310,3rtkit-daemon0-21swapper/107:17:080
172099310,3rtkit-daemon0-21swapper/008:49:151
172099300,4rtkit-daemon1719-21rtkit-daemon08:56:331
172099300,3rtkit-daemon0-21swapper/107:20:490
172099300,3rtkit-daemon0-21swapper/011:31:531
172099300,3rtkit-daemon0-21swapper/010:58:051
6098612290,4sleep10-21swapper/110:05:011
172099290,3rtkit-daemon1719-21rtkit-daemon08:13:150
172099290,3rtkit-daemon0-21swapper/011:02:351
172099290,25rtkit-daemon0-21swapper/007:45:030
172099290,1rtkit-daemon1719-21rtkit-daemon10:00:301
172099280,4rtkit-daemon1719-21rtkit-daemon08:05:560
172099280,3rtkit-daemon0-21swapper/107:40:100
172099280,1rtkit-daemon1719-21rtkit-daemon11:24:580
172099270,3rtkit-daemon0-21swapper/109:51:340
172099270,21rtkit-daemon521354-21cyclictest10:43:220
172099270,1rtkit-daemon1719-21rtkit-daemon07:35:181
521363992613,9cyclictest546916-21apt-get08:10:121
52136399260,7cyclictest0-21swapper/109:16:061
52136399260,6cyclictest0-21swapper/110:27:061
52136399260,6cyclictest0-21swapper/108:41:241
172099260,3rtkit-daemon0-21swapper/107:54:400
172099260,1rtkit-daemon1719-21rtkit-daemon10:47:061
7075582250,5sleep013-21ksoftirqd/012:23:300
52136399253,15cyclictest528367-40apt-check07:25:151
52136399252,16cyclictest617235-21apt-get10:15:151
521363992519,4cyclictest26-21ksoftirqd/111:50:011
52136399250,6cyclictest0-21swapper/111:23:551
52135899253,14cyclictest578218-21apt-get09:20:200
521358992510,10cyclictest711974-21apt-get12:30:180
172099250,1rtkit-daemon1719-21rtkit-daemon09:28:120
5892742240,7sleep00-21swapper/009:35:210
52136399244,18cyclictest691765-21iwlist12:00:231
52136399242,15cyclictest595667-21apt-esm-hook09:45:161
521363992414,7cyclictest712341-21fschecks_time12:30:221
52135899242,15cyclictest609973-21apt-get10:05:180
521358992412,9cyclictest673535-21apt-get11:35:140
172099240,1rtkit-daemon1719-21rtkit-daemon11:56:331
172099240,1rtkit-daemon1719-21rtkit-daemon07:42:121
172099240,17rtkit-daemon649028-21ssh11:00:250
172099240,15rtkit-daemon0-21swapper/112:26:111
5919672230,1sleep10-21swapper/109:40:011
52136399238,9cyclictest609277-1kworker/u9:110:10:171
52136399236,2cyclictest7075562ssh12:23:311
52136399232,14cyclictest683897-21apt-esm-hook11:50:131
521363992315,6cyclictest523842-21fschecks_time07:15:021
52135899232,15cyclictest574605-21apt-get09:15:210
521358992316,5cyclictest562843-21apt-esm-json-ho08:50:130
521358992313,7cyclictest691211-21apt-get12:00:180
172099230,3rtkit-daemon1719-21rtkit-daemon10:23:470
172099230,3rtkit-daemon1719-21rtkit-daemon08:58:400
172099230,19rtkit-daemon1719-21rtkit-daemon07:26:380
52136399223,11cyclictest556893-21apt-esm-hook08:35:131
521363992213,5cyclictest62050irq/130-enp2s011:44:531
52136399220,7cyclictest577847-1kworker/u9:009:20:241
52136399220,19cyclictest526328-21diskstats07:20:191
52135899222,14cyclictest715453-21apt-get12:35:140
52135899222,14cyclictest558853-21/usr/sbin/munin08:40:280
52135899222,13cyclictest617273-21apt-esm-hook10:15:150
52135899222,13cyclictest570860-21apt-get09:10:140
52136399214,10cyclictest521511-21apt-get07:10:141
52136399212,18cyclictest26-21ksoftirqd/107:35:011
52136399212,13cyclictest673556-21apt-esm-hook11:35:141
52136399212,12cyclictest715497-21apt-esm-hook12:35:141
52135899219,7cyclictest62050irq/130-enp2s012:05:200
52135899219,7cyclictest62050irq/130-enp2s012:05:190
52135899213,10cyclictest683875-21apt-get11:50:130
52135899212,8cyclictest641382-21seq10:49:520
52135899212,13cyclictest606582-21apt-get10:00:200
52135899211,14cyclictest566827-21apt-get09:00:130
521358992110,7cyclictest62050irq/130-enp2s010:50:140
172099210,14rtkit-daemon0-21swapper/112:13:231
52135899203,9cyclictest521543-21apt-esm-hook07:10:140
52135899193,10cyclictest645089-21apt-get10:55:110
52135899192,12cyclictest554889-21apt-esm-hook08:30:130
52135899192,10cyclictest540942-21apt-get07:55:120
521358991911,6cyclictest666435-21grep11:25:150
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional