You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 07:53

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Sun Jul 03, 2022 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32255882325282,28sleep10-21swapper/119:07:421
32255542304261,28sleep00-21swapper/019:07:220
172099600,4rtkit-daemon1719-21rtkit-daemon00:11:400
322592199593,36cyclictest3319353-21appstreamcli22:10:020
322592199572,36cyclictest3395496-21apt-get23:55:120
32590872520,34sleep13259089-21apt-get20:30:131
322592199520,7cyclictest3347535-21seq22:48:100
172099520,4rtkit-daemon1719-21rtkit-daemon22:01:030
172099520,4rtkit-daemon1719-21rtkit-daemon20:05:580
322592199517,22cyclictest13-21ksoftirqd/000:20:130
172099510,4rtkit-daemon1719-21rtkit-daemon00:26:090
322592199502,5cyclictest3420729-21apt-get00:30:120
322592199501,4cyclictest3392005-21apt-esm-hook23:50:140
3225921995012,21cyclictest3334172-21apt-esm-json-ho22:30:140
322592199500,3cyclictest3388737-21df23:45:130
172099500,4rtkit-daemon1719-21rtkit-daemon19:12:050
322592199499,27cyclictest3274805-21diskmemload23:33:330
322592199491,4cyclictest3366453-21apt-get23:15:130
322592199490,37cyclictest3373635-21systemd-run23:25:000
172099490,4rtkit-daemon1719-21rtkit-daemon19:57:041
32560742480,2sleep10-21swapper/120:20:211
322592199482,6cyclictest3274805-21diskmemload21:31:150
322592199482,5cyclictest3381151-21apt-get23:35:120
322592199482,5cyclictest3286317-21apt-get21:25:120
172099480,4rtkit-daemon1719-21rtkit-daemon23:39:481
172099480,4rtkit-daemon1719-21rtkit-daemon22:33:511
322592199471,7cyclictest3274805-21diskmemload00:02:340
322592199471,4cyclictest3384884-21apt-get23:40:140
322592199471,4cyclictest3275081-21apt-get21:10:120
3225921994712,20cyclictest3281798-21sh21:18:370
33309202460,1chrt3330919-21/usr/sbin/munin22:25:181
322592199463,6cyclictest3424358-21apt-get00:35:130
322592199462,5cyclictest3282786-21apt-get21:20:260
322592199461,9cyclictest3248602-21munin-run20:05:010
322592199459,19cyclictest3338848-21ssh22:35:240
322592199457,19cyclictest0-21swapper/000:06:050
322592199454,3cyclictest3274805-21diskmemload22:27:000
322592199451,6cyclictest3410650-21ntp_states00:15:220
322592199451,6cyclictest3274805-21diskmemload23:01:480
322592199451,6cyclictest3274805-21diskmemload21:40:100
322592199451,5cyclictest3235654-21ntp_states19:30:210
322592199450,4cyclictest3265058-21apt-get20:45:120
32717442440,2sleep10-21swapper/121:00:201
322592199441,9cyclictest3324984-21ssh22:16:240
322592199441,8cyclictest3361738-21ssh23:07:450
322592199441,8cyclictest3228285-21munin-node19:15:010
322592199441,6cyclictest3274805-21diskmemload21:55:060
322592199441,6cyclictest3274805-21diskmemload21:36:070
322592199441,3cyclictest3263077-21apt-get20:40:110
322592199441,10cyclictest3348593-21apt-get22:50:130
322592199431,6cyclictest3274805-21diskmemload22:08:290
322592199431,6cyclictest3261070-21apt-get20:35:120
322592199431,5cyclictest3274805-21diskmemload22:23:490
322592199431,4cyclictest3267395-21perl20:50:180
322592199422,3cyclictest3257104-21apt-get20:25:110
322592199421,5cyclictest3274805-21diskmemload23:29:550
322592199420,3cyclictest3341307-21apt-esm-hook22:40:140
322592199401,4cyclictest3352068-21apt-get22:55:120
322592199400,4cyclictest3269027-21apt-get20:55:110
322592199391,3cyclictest3232686-21munin-run19:25:010
322592199390,7cyclictest3302754-21sshd21:46:360
322592199390,4cyclictest3304845-21df_inode21:50:140
322592199390,3cyclictest3240852-21apt-esm-hook19:45:150
33061002380,2sleep13306102-21ssh21:50:431
172099380,3rtkit-daemon0-21swapper/119:23:001
172099380,3rtkit-daemon0-21swapper/021:25:471
322592199372,28cyclictest3251140-21apt-esm-hook20:10:130
172099370,5rtkit-daemon1719-21rtkit-daemon00:01:161
172099370,3rtkit-daemon0-21swapper/119:37:171
172099370,3rtkit-daemon0-21swapper/023:22:291
172099370,3rtkit-daemon0-21swapper/020:25:241
172099370,3rtkit-daemon0-21swapper/000:28:061
172099360,3rtkit-daemon0-21swapper/023:10:460
172099350,6rtkit-daemon3369297-21ssh23:18:361
172099350,3rtkit-daemon0-21swapper/119:43:571
322592199343,23cyclictest3255151-21apt-esm-hook20:20:130
172099340,4rtkit-daemon3409400-21ssh00:14:471
172099340,4rtkit-daemon1719-21rtkit-daemon22:58:201
172099340,3rtkit-daemon0-21swapper/119:25:291
172099340,3rtkit-daemon0-21swapper/022:43:451
322592199330,7cyclictest3240537-21seq19:44:060
172099330,3rtkit-daemon0-21swapper/122:54:101
172099330,3rtkit-daemon0-21swapper/121:10:431
172099330,3rtkit-daemon0-21swapper/023:07:511
172099330,3rtkit-daemon0-21swapper/022:48:281
172099330,3rtkit-daemon0-21swapper/021:57:031
322592199322,24cyclictest3271047-21apt-esm-hook21:00:130
322592199321,8cyclictest3273046-21apt-get21:05:150
172099320,4rtkit-daemon1719-21rtkit-daemon23:53:181
172099320,3rtkit-daemon0-21swapper/021:30:041
172099320,3rtkit-daemon0-21swapper/000:21:331
322592199312,8cyclictest3244836-21apt-esm-hook19:55:120
322592199311,8cyclictest3259570-21/usr/sbin/munin20:30:170
322592199311,7cyclictest3232905-21apt-esm-hook19:25:130
172099310,4rtkit-daemon1719-21rtkit-daemon22:00:481
172099310,4rtkit-daemon1719-21rtkit-daemon19:32:101
172099310,18rtkit-daemon0-21swapper/121:42:081
322592199302,5cyclictest3242833-21apt-esm-hook19:50:130
322592199301,7cyclictest3236839-21/usr/sbin/munin19:35:100
172099300,4rtkit-daemon1719-21rtkit-daemon23:14:371
172099300,3rtkit-daemon0-21swapper/022:16:561
172099300,3rtkit-daemon0-21swapper/021:37:121
172099300,3rtkit-daemon0-21swapper/021:19:201
172099300,3rtkit-daemon0-21swapper/020:19:551
172099300,3rtkit-daemon0-21swapper/000:34:351
322592199290,9cyclictest3253106-21/usr/sbin/munin20:15:100
172099290,4rtkit-daemon3379257-21ssh23:31:391
172099290,3rtkit-daemon0-21swapper/120:54:241
172099280,3rtkit-daemon0-21swapper/023:26:331
172099280,3rtkit-daemon0-21swapper/019:11:151
172099280,3rtkit-daemon0-21swapper/000:09:081
172099280,1rtkit-daemon1719-21rtkit-daemon20:04:501
322592699272,13cyclictest3319935-21fschecks_time22:10:201
322592699270,6cyclictest0-21swapper/120:47:291
172099270,3rtkit-daemon0-21swapper/020:06:041
172099270,3rtkit-daemon0-21swapper/019:19:581
172099270,17rtkit-daemon3337958-21/usr/sbin/munin22:35:151
33028572260,2sleep13274805-21diskmemload21:46:511
322592699260,6cyclictest0-21swapper/100:15:531
322592699250,6cyclictest0-21swapper/123:58:181
322592699250,6cyclictest0-21swapper/123:48:081
322592699241,19cyclictest3274805-21diskmemload00:35:131
322592699232,15cyclictest3273017-21apt-get21:05:141
322592699232,15cyclictest3242819-21apt-get19:50:121
322592699232,14cyclictest3251126-21apt-get20:10:121
3225926992313,8cyclictest26-21ksoftirqd/123:05:001
172099230,19rtkit-daemon1719-21rtkit-daemon22:05:221
172099230,18rtkit-daemon1719-21rtkit-daemon20:37:061
322592699222,13cyclictest3282786-21apt-get21:20:261
322592699222,13cyclictest3263090-21apt-esm-hook20:40:121
322592699220,9cyclictest3326764-21apt-get22:20:101
322592699213,11cyclictest3269041-21apt-esm-hook20:55:131
322592699204,9cyclictest3240838-21apt-get19:45:131
322592699202,12cyclictest3384860-21/usr/sbin/munin23:40:261
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional