You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-28 - 13:11

x86 Intel Celeron G3900 @2800 MHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot5.osadl.org (updated Sat May 28, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2252599270,26cyclictest9042-21meminfo00:05:151
2252599240,23cyclictest18664-21meminfo20:20:171
2252599230,22cyclictest29059-21meminfo22:10:171
2252599230,22cyclictest26441-21meminfo20:40:171
2252499230,22cyclictest5141-21meminfo23:55:180
2252499230,22cyclictest31708-21meminfo23:40:230
2252599220,21cyclictest3770-21meminfo21:05:171
2252599210,21cyclictest25755-21meminfo19:15:161
2252599210,20cyclictest8359-21meminfo22:40:161
2252599200,20cyclictest31709-21meminfo23:40:231
2252599200,20cyclictest1230-21meminfo23:45:171
2252599180,17cyclictest10887-21meminfo20:00:171
2252599172,11cyclictest29907-21uname19:25:191
2252599170,16cyclictest15452-21meminfo21:35:221
2252499170,17cyclictest27123-21meminfo22:05:180
2252499170,17cyclictest23926-21meminfo23:20:170
2252499170,17cyclictest14187-21meminfo22:55:220
2252599160,16cyclictest4459-21meminfo22:30:181
2252599160,16cyclictest23233-21meminfo21:55:221
2252599160,16cyclictest18088-21meminfo23:05:231
2252599160,15cyclictest14887-21meminfo00:20:141
2252499160,13cyclictest9766-21ntpq21:20:180
2252499150,14cyclictest30997-21meminfo22:15:160
2252599143,5cyclictest0-21swapper/120:55:121
2252599141,12cyclictest23060-21taskset23:19:471
2252599140,10cyclictest10743-21munin-run21:24:591
2252499144,9cyclictest13491-21/usr/sbin/munin20:05:210
2252499144,1cyclictest28521-21ntp_states20:45:160
2252499143,6cyclictest8440-21diskstats19:55:110
2252499143,10cyclictest0-21swapper/021:12:230
22524991413,1cyclictest11-21ksoftirqd/019:50:120
2252499140,3cyclictest131rcu_preempt19:35:190
2252599132,2cyclictest0-21swapper/122:50:131
2252599130,12cyclictest0-21swapper/121:10:121
2252499135,4cyclictest15606-21/usr/sbin/munin23:00:120
2252499132,7cyclictest2714-21diskstats23:50:120
22524991310,3cyclictest11-21ksoftirqd/021:25:220
2252499130,12cyclictest7113-21meminfo00:00:250
2252499130,12cyclictest32253-21meminfo20:55:170
2252499130,12cyclictest13500-21meminfo21:30:160
2252599121,7cyclictest16171-21apt-get00:25:111
2252599121,4cyclictest2547-21apt-get23:50:111
22525991212,0cyclictest0-21swapper/123:55:581
2252599120,11cyclictest508-21meminfo22:20:181
2252499129,2cyclictest0-21swapper/021:40:130
2252499127,2cyclictest11-21ksoftirqd/000:20:170
2252499123,2cyclictest131rcu_preempt00:15:150
2252499122,9cyclictest22575-21/usr/sbin/munin21:55:270
2252499121,3cyclictest131rcu_preempt19:15:140
2252499120,12cyclictest31587-21meminfo19:30:160
2252499120,11cyclictest2520-21meminfo22:25:180
222962122,2sleep10-21swapper/119:09:331
2252599113,4cyclictest9857-21seq19:58:031
2252599112,4cyclictest0-21swapper/119:50:101
2252599112,2cyclictest20054-21apt-get00:35:111
2252599110,8cyclictest4892-21diskmemload22:37:101
2252499116,4cyclictest25211-21apt-get23:25:120
2252499113,5cyclictest0-21swapper/022:35:170
2252499113,4cyclictest22409-21munin-run21:55:000
2252499112,6cyclictest0-21swapper/020:13:140
2252499111,9cyclictest19682-21seq00:32:510
2252499111,6cyclictest29483-21switchtime22:10:210
2252499111,6cyclictest28998-21apt-get19:25:110
2252499111,5cyclictest0-21swapper/023:39:220
22524991110,1cyclictest11-21ksoftirqd/000:35:130
2252499110,7cyclictest4892-21diskmemload22:42:230
2252499110,10cyclictest7654-21meminfo21:15:150
2252599104,3cyclictest30058-21sendmail_mailqu23:35:251
2252599102,3cyclictest4892-21diskmemload23:20:141
2252599102,2cyclictest0-21swapper/121:15:111
2252599100,10cyclictest14764-21meminfo20:10:161
2252499108,2cyclictest18111-21missed_timers23:05:240
2252499108,1cyclictest11-21ksoftirqd/000:09:520
2252499103,3cyclictest0-21swapper/019:45:140
2252499103,2cyclictest0-21swapper/022:00:170
2252499100,9cyclictest27716-21meminfo19:20:160
2252499100,9cyclictest20018-21meminfo23:10:160
2252499100,4cyclictest0-21swapper/022:20:180
2252499100,2cyclictest3400-21perl21:05:130
225259996,2cyclictest21735-21wc21:50:251
225259994,4cyclictest27954-21kworker/u4:122:27:281
225259994,2cyclictest18197-21seq21:41:381
225259993,5cyclictest0-21swapper/119:40:111
225259992,6cyclictest30344-21apt-get22:15:111
225259990,9cyclictest22543-21meminfo20:30:161
225259990,9cyclictest22543-21meminfo20:30:151
225259990,9cyclictest18769-21meminfo00:30:161
225259990,5cyclictest0-21swapper/120:45:111
225249998,1cyclictest2321-21runrttasks00:10:050
225249996,3cyclictest2321-21runrttasks22:50:220
225249993,4cyclictest0-21swapper/020:25:120
225249992,4cyclictest9807-21df22:45:120
225249991,1cyclictest3028-21/usr/sbin/munin19:40:160
225259986,1cyclictest5766-21taskset19:45:451
225259986,1cyclictest271342sleep123:30:051
225259986,1cyclictest253502sleep120:37:201
225259986,1cyclictest25322-21tr23:25:121
225259986,1cyclictest20030-21taskset21:45:291
225259986,1cyclictest1733-21grep19:35:201
225259986,1cyclictest11901-21taskset00:12:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional