You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-07 - 13:25

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot4.osadl.org (updated Tue Feb 07, 2023 00:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7734602270185,28sleep00-21swapper/019:09:160
7732812264190,19sleep10-21swapper/119:07:231
159199780,5rtkit-daemon4000952-21snmpd23:36:281
159199630,4rtkit-daemon1590-21rtkit-daemon22:34:331
159199590,4rtkit-daemon1590-21rtkit-daemon00:11:031
159199550,3rtkit-daemon0-21swapper/122:39:461
159199550,3rtkit-daemon0-21swapper/121:53:021
159199550,3rtkit-daemon0-21swapper/100:08:191
159199540,3rtkit-daemon0-21swapper/122:56:081
159199540,3rtkit-daemon0-21swapper/121:16:471
159199540,3rtkit-daemon0-21swapper/100:10:420
159199540,3rtkit-daemon0-21swapper/100:03:191
159199530,4rtkit-daemon1590-21rtkit-daemon23:11:571
159199530,4rtkit-daemon1590-21rtkit-daemon21:40:351
159199530,4rtkit-daemon1590-21rtkit-daemon19:41:021
159199530,3rtkit-daemon0-21swapper/122:16:191
159199530,3rtkit-daemon0-21swapper/121:23:321
159199530,3rtkit-daemon0-21swapper/121:06:321
159199530,3rtkit-daemon0-21swapper/120:51:381
159199530,3rtkit-daemon0-21swapper/120:29:501
159199530,3rtkit-daemon0-21swapper/120:16:281
159199530,3rtkit-daemon0-21swapper/119:49:071
159199520,4rtkit-daemon1590-21rtkit-daemon23:47:511
159199520,4rtkit-daemon1590-21rtkit-daemon19:10:031
159199520,4rtkit-daemon1590-21rtkit-daemon00:35:221
159199520,3rtkit-daemon0-21swapper/121:46:311
159199520,3rtkit-daemon0-21swapper/120:38:561
159199520,3rtkit-daemon0-21swapper/119:50:141
159199520,20rtkit-daemon773613-21cyclictest21:04:291
159199520,19rtkit-daemon1590-21rtkit-daemon23:57:241
159199510,4rtkit-daemon1590-21rtkit-daemon20:06:191
159199510,3rtkit-daemon1590-21rtkit-daemon00:29:261
159199510,3rtkit-daemon0-21swapper/123:00:371
159199510,3rtkit-daemon0-21swapper/122:46:401
159199510,3rtkit-daemon0-21swapper/122:40:031
159199510,3rtkit-daemon0-21swapper/119:15:201
159199500,4rtkit-daemon1590-21rtkit-daemon23:27:131
159199500,4rtkit-daemon1590-21rtkit-daemon22:12:441
159199500,4rtkit-daemon1590-21rtkit-daemon20:13:111
159199500,4rtkit-daemon1590-21rtkit-daemon00:21:511
159199490,7rtkit-daemon1590-21rtkit-daemon21:20:200
159199490,4rtkit-daemon1590-21rtkit-daemon23:43:071
159199490,4rtkit-daemon1590-21rtkit-daemon22:25:461
159199490,3rtkit-daemon1590-21rtkit-daemon23:05:091
159199490,3rtkit-daemon0-21swapper/120:33:571
159199480,4rtkit-daemon1590-21rtkit-daemon19:59:091
159199480,3rtkit-daemon1590-21rtkit-daemon21:58:351
159199480,3rtkit-daemon1590-21rtkit-daemon21:12:001
159199480,3rtkit-daemon0-21swapper/120:40:531
159199480,2rtkit-daemon1590-21rtkit-daemon21:36:400
9418702470,1sleep0821466-21diskmemload23:44:170
159199470,4rtkit-daemon1590-21rtkit-daemon20:02:121
159199470,3rtkit-daemon1590-21rtkit-daemon22:00:411
159199470,3rtkit-daemon0-21swapper/122:54:361
159199460,4rtkit-daemon1590-21rtkit-daemon20:49:051
159199460,4rtkit-daemon1590-21rtkit-daemon19:35:551
159199460,1rtkit-daemon1590-21rtkit-daemon23:51:081
159199460,1rtkit-daemon1590-21rtkit-daemon21:29:571
159199440,5rtkit-daemon1590-21rtkit-daemon00:20:170
773615994319,3cyclictest141rcu_preempt19:25:190
159199430,4rtkit-daemon801204-21cron20:17:000
77361599427,21cyclictest886141-21strings22:30:220
159199420,3rtkit-daemon0-21swapper/019:56:110
159199410,3rtkit-daemon0-21swapper/023:03:210
159199410,3rtkit-daemon0-21swapper/021:19:330
159199390,6rtkit-daemon880262-21ssh22:22:510
159199390,3rtkit-daemon0-21swapper/022:42:120
159199390,12rtkit-daemon0-21swapper/021:33:051
159199380,3rtkit-daemon0-21swapper/121:50:220
77361599378,2cyclictest141rcu_preempt23:45:280
773615993710,4cyclictest0-21swapper/022:25:280
159199370,3rtkit-daemon0-21swapper/019:54:380
773618993627,5cyclictest881324-21munin-plugin-st22:25:001
159199360,3rtkit-daemon0-21swapper/120:35:420
773618993519,8cyclictest780010-21cron19:25:001
77361599359,3cyclictest0-21swapper/019:35:210
77361599357,2cyclictest0-21swapper/021:45:280
773615993522,3cyclictest947490-21grep23:50:300
773615993513,5cyclictest889542-21grep22:35:240
77361899346,6cyclictest966940-21timerandwakeup00:15:321
77361599347,17cyclictest950418-21ssh23:55:200
773615993416,2cyclictest0-21swapper/019:20:140
77361599341,3cyclictest0-21swapper/023:37:210
773615993412,3cyclictest141rcu_preempt19:15:010
77361599340,8cyclictest967476-21sh00:16:160
159199340,4rtkit-daemon1590-21rtkit-daemon20:24:561
77361599338,2cyclictest0-21swapper/019:30:310
773615993311,1cyclictest0-21swapper/019:17:300
77361599330,21cyclictest923377-21grep23:20:010
773618993222,4cyclictest780213-21/usr/sbin/munin19:25:231
159199310,4rtkit-daemon980704-21ssh00:34:021
77361899308,2cyclictest141rcu_preempt19:34:591
77361599307,2cyclictest141rcu_preempt23:23:310
77361599307,2cyclictest141rcu_preempt22:20:000
159199300,3rtkit-daemon0-21swapper/122:51:320
773615992912,7cyclictest13-21ksoftirqd/020:33:140
159199290,3rtkit-daemon0-21swapper/121:08:190
159199290,3rtkit-daemon0-21swapper/120:26:290
773618992811,3cyclictest0-21swapper/123:31:301
773615992812,6cyclictest13-21ksoftirqd/023:10:160
773615992810,8cyclictest13-21ksoftirqd/000:34:030
77361899278,3cyclictest0-21swapper/121:40:001
77361599279,3cyclictest141rcu_preempt21:00:280
77361599276,2cyclictest141rcu_preempt20:45:010
77361599274,3cyclictest141rcu_preempt22:15:000
77361599272,8cyclictest953943-21apt-get00:00:190
159199270,4rtkit-daemon1590-21rtkit-daemon19:47:280
9604672260,10sleep00-21swapper/000:08:280
773618992615,2cyclictest0-21swapper/123:16:301
77361599269,3cyclictest0-21swapper/020:55:000
77361599261,14cyclictest141rcu_preempt21:35:020
77361599260,6cyclictest0-21swapper/020:40:180
159199260,4rtkit-daemon1590-21rtkit-daemon22:58:520
77361899259,2cyclictest0-21swapper/123:21:571
773618992514,5cyclictest1-21systemd22:08:241
773615992513,5cyclictest13-21ksoftirqd/022:00:000
77361899243,14cyclictest815805-21apt-get20:55:191
77361599245,3cyclictest141rcu_preempt22:07:180
77361599241,5cyclictest821466-21diskmemload23:05:170
77361599240,9cyclictest8619262acpi22:00:130
77361599238,3cyclictest141rcu_preempt21:26:140
77361599237,6cyclictest13-21ksoftirqd/020:03:500
77361599236,10cyclictest1-21systemd21:40:020
773615992315,3cyclictest1-21systemd23:35:000
773615992310,4cyclictest0-21swapper/019:43:570
77361599228,3cyclictest141rcu_preempt22:47:170
77361599228,10cyclictest981536-21apt-get00:35:220
77361599222,14cyclictest927445-21apt-get23:25:160
77361599221,4cyclictest975313-21taskset00:26:140
77361599213,10cyclictest801734-21apt-get20:20:160
77361599212,13cyclictest821812-21apt-get21:10:210
77361599210,4cyclictest793772-1kworker/0:3H20:05:230
77361599200,18cyclictest798581-21ntp_states20:10:250
77361599190,2cyclictest806963-1kworker/0:2H20:55:280
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional