You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:44

x86 Intel N455 @1660 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6 (updated Sat Aug 13, 2022 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12830210218,38sleep00-21swapper/019:08:310
315322810,7sleep1251rcuc/121:40:171
1319099815,66cyclictest30686-21apt-get23:15:150
989228027,31sleep00-21swapper/020:35:140
43222790,9sleep014-21ksoftirqd/020:15:470
13190997949,10cyclictest14-21ksoftirqd/022:55:150
13190997948,11cyclictest14-21ksoftirqd/022:30:170
1151427932,35sleep10-21swapper/119:05:131
13190997741,22cyclictest14-21ksoftirqd/020:45:430
13190997740,23cyclictest14-21ksoftirqd/022:22:290
13190997714,7cyclictest151rcu_preempt21:55:230
13192997658,12cyclictest26-21ksoftirqd/120:20:131
13190997644,11cyclictest14-21ksoftirqd/019:15:190
13190997643,11cyclictest14-21ksoftirqd/021:40:130
13190997542,21cyclictest14-21ksoftirqd/022:36:490
13190997541,15cyclictest14-21ksoftirqd/000:02:510
13190997536,14cyclictest14-21ksoftirqd/021:00:000
13192997456,12cyclictest26-21ksoftirqd/100:05:211
13190997438,22cyclictest14-21ksoftirqd/023:32:390
1319099735,59cyclictest23161-21apt-get21:15:130
1319099735,59cyclictest23161-21apt-get21:15:130
13190997339,15cyclictest14-21ksoftirqd/023:20:030
13190997339,15cyclictest14-21ksoftirqd/021:05:320
13190997339,15cyclictest14-21ksoftirqd/020:24:380
13190997339,15cyclictest14-21ksoftirqd/000:09:580
13190997338,21cyclictest14-21ksoftirqd/022:09:560
13190997240,21cyclictest14-21ksoftirqd/023:50:340
13190997239,22cyclictest14-21ksoftirqd/021:25:180
13190997139,21cyclictest14-21ksoftirqd/023:05:390
13190997013,40cyclictest5032-21df_inode23:35:200
13190996842,18cyclictest5875-21apt-get22:00:170
1319099669,41cyclictest151rcu_preempt00:12:190
1319099665,49cyclictest0-21swapper/021:49:460
13190996548,11cyclictest14-21ksoftirqd/000:20:150
13190996544,16cyclictest14-21ksoftirqd/023:49:480
13190996541,15cyclictest14-21ksoftirqd/000:25:320
13190996425,17cyclictest14-21ksoftirqd/023:45:000
13190996341,16cyclictest14-21ksoftirqd/021:02:480
13190996341,16cyclictest14-21ksoftirqd/021:02:470
13190996313,20cyclictest171rcuc/019:25:400
1319299624,52cyclictest7635-21wc22:05:211
13192996242,11cyclictest0-21swapper/121:50:211
13192996232,17cyclictest0-21swapper/121:05:141
13190996213,29cyclictest151rcu_preempt20:05:320
13190996128,13cyclictest14-21ksoftirqd/019:37:270
13192996035,17cyclictest26-21ksoftirqd/120:25:141
13190996035,21cyclictest14-21ksoftirqd/021:10:290
13190996028,21cyclictest14-21ksoftirqd/020:44:120
151492590,7sleep1261ksoftirqd/100:05:001
1319299593,25cyclictest11628-21gpgv23:55:011
13192995931,15cyclictest0-21swapper/121:25:131
13190995927,11cyclictest14-21ksoftirqd/000:39:110
13190995921,33cyclictest19826-21proc_pri22:40:320
13190995914,10cyclictest171rcuc/019:48:390
13190995913,7cyclictest151rcu_preempt20:50:280
13192995830,21cyclictest26-21ksoftirqd/122:00:171
13190995820,14cyclictest14-21ksoftirqd/022:15:290
13190995815,9cyclictest171rcuc/022:48:240
176322575,9sleep10-21swapper/122:35:221
13192995740,9cyclictest26-21ksoftirqd/119:50:141
13192995730,16cyclictest0-21swapper/121:15:151
13192995730,16cyclictest0-21swapper/121:15:141
13192995730,16cyclictest0-21swapper/119:30:201
13192995729,19cyclictest487-21dbus-daemon21:39:001
13192995729,16cyclictest0-21swapper/100:30:161
1319099575,48cyclictest0-21swapper/000:15:170
13190995737,15cyclictest31346-21cat21:40:010
13190995729,9cyclictest24405-21ps19:40:320
13190995725,9cyclictest11572-21apt-get23:55:050
13190995716,9cyclictest171rcuc/021:22:000
13190995714,9cyclictest171rcuc/020:04:380
13190995714,9cyclictest171rcuc/020:04:380
13190995713,10cyclictest171rcuc/000:33:050
13192995616,16cyclictest0-21swapper/122:15:131
13190995626,9cyclictest10012-21grep22:10:360
13190995618,15cyclictest14-21ksoftirqd/023:00:150
13190995617,17cyclictest7190-21netstat20:25:280
13190995616,11cyclictest171rcuc/019:22:410
13190995614,9cyclictest171rcuc/023:10:300
13190995614,11cyclictest171rcuc/019:14:270
13190995613,9cyclictest171rcuc/019:31:360
13190995613,10cyclictest171rcuc/019:56:430
49572555,8sleep10-21swapper/121:55:351
1319299555,45cyclictest3206-21/usr/sbin/munin23:30:361
13192995538,10cyclictest26-21ksoftirqd/100:10:171
1319299553,45cyclictest21909-21sort00:25:011
13192995532,17cyclictest272-21systemd-journal20:55:001
13192995526,16cyclictest0-21swapper/123:20:171
1319099558,10cyclictest171rcuc/020:33:320
13190995523,9cyclictest27749-21find19:50:350
13190995515,9cyclictest171rcuc/020:14:110
13190995513,10cyclictest171rcuc/022:28:480
13190995512,10cyclictest171rcuc/021:30:340
13192995441,9cyclictest0-21swapper/122:45:201
13192995435,14cyclictest553-21runrttasks19:37:231
13192995429,18cyclictest487-21dbus-daemon23:39:591
13192995429,14cyclictest0-21swapper/121:10:141
13192995427,18cyclictest487-21dbus-daemon20:05:011
13192995427,18cyclictest487-21dbus-daemon20:05:001
13192995426,19cyclictest26-21ksoftirqd/119:20:161
13192995426,16cyclictest0-21swapper/121:00:181
13192995426,16cyclictest0-21swapper/121:00:171
13192995424,16cyclictest0-21swapper/122:55:161
13192995423,18cyclictest0-21swapper/120:10:161
13190995413,8cyclictest151rcu_preempt21:50:350
13192995338,11cyclictest0-21swapper/122:30:231
1319299533,18cyclictest719-21cron23:15:001
13192995330,15cyclictest0-21swapper/122:20:121
13192995327,15cyclictest0-21swapper/120:05:151
13192995326,19cyclictest26-21ksoftirqd/123:45:141
13192995325,20cyclictest487-21dbus-daemon19:14:591
13192995322,13cyclictest19751-21grep22:40:301
13192995321,18cyclictest0-21swapper/122:50:131
1319099535,43cyclictest0-21swapper/023:25:300
1319099535,43cyclictest0-21swapper/022:50:240
13192995238,9cyclictest251rcuc/123:25:121
13192995229,13cyclictest0-21swapper/100:35:141
13192995227,15cyclictest0-21swapper/121:45:141
13192995210,35cyclictest523-21snmpd23:15:151
1319299516,11cyclictest0-21swapper/120:30:311
1319299515,41cyclictest36-21kcompactd020:15:061
13192995138,8cyclictest251rcuc/100:28:491
13192995137,9cyclictest251rcuc/121:20:111
13192995137,8cyclictest26-21ksoftirqd/122:25:331
13192995130,16cyclictest830-21sendmail-mta20:40:331
13192995130,16cyclictest272-21systemd-journal20:36:541
13192995129,17cyclictest13480-21cron00:00:001
13192995127,15cyclictest0-21swapper/123:05:151
13192995110,35cyclictest553-21runrttasks19:25:141
13192995036,9cyclictest251rcuc/119:48:401
13192995035,10cyclictest251rcuc/120:49:031
1319299503,13cyclictest16020-21ntp_states19:15:361
13192995029,16cyclictest25996-21sort23:00:261
13192995025,19cyclictest487-21dbus-daemon21:00:001
13192995023,16cyclictest0-21swapper/119:55:151
13192994936,9cyclictest251rcuc/119:41:161
1319299493,41cyclictest19144-21missed_timers00:15:281
13192994922,19cyclictest13182-21cyclictest23:40:131
13192994918,15cyclictest0-21swapper/122:10:161
13192994826,17cyclictest487-21dbus-daemon21:30:251
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:153
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
none16:05:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional