You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-16 - 05:44

x86 Intel Celeron G3900 @2800 MHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot5.osadl.org (updated Tue Aug 16, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23102720,1sleep02308-21seq19:05:140
411399290,28cyclictest13293-21meminfo23:40:230
411399270,26cyclictest22332-21meminfo22:40:190
411499260,26cyclictest4793-21meminfo19:10:221
411399260,25cyclictest24853-21meminfo20:00:170
411499240,23cyclictest28145-21meminfo22:55:181
411499240,23cyclictest26209-21meminfo22:50:181
411399241,5cyclictest18264-21kworker/u4:000:27:500
411399230,22cyclictest7343-21meminfo19:15:190
411499210,21cyclictest28734-21meminfo20:10:221
411499210,20cyclictest8715-21meminfo22:05:241
411399210,21cyclictest19109-21meminfo23:55:180
411399210,21cyclictest16488-21meminfo22:25:180
411499200,20cyclictest5507-21meminfo23:20:171
411499200,20cyclictest23590-21meminfo21:20:181
411499200,19cyclictest30666-21meminfo20:15:171
411499190,19cyclictest7443-21meminfo23:25:181
411399192,16cyclictest19677-21wc22:35:010
411499180,18cyclictest11244-21meminfo19:25:181
411399180,18cyclictest26885-21meminfo00:15:190
411399171,15cyclictest26104-21/usr/sbin/munin21:25:270
411399170,16cyclictest9973-21meminfo20:45:190
411399170,16cyclictest32725-21meminfo00:30:200
411399170,16cyclictest15124-21meminfo19:35:180
411499164,11cyclictest14552-21/usr/sbin/munin22:20:181
411399160,16cyclictest4135-21meminfo20:30:200
411399160,16cyclictest11334-21meminfo23:35:210
411499150,15cyclictest30786-21meminfo00:25:211
411499150,0cyclictest0-21swapper/123:43:111
411399152,11cyclictest11463-21fschecks_count20:50:140
411399150,9cyclictest13838-21ls20:55:180
411399150,15cyclictest22897-21meminfo19:55:190
411399150,14cyclictest6774-21meminfo22:00:240
411399150,14cyclictest31373-21meminfo21:40:260
411499144,3cyclictest0-21swapper/121:25:151
411499143,6cyclictest26231-21apt-get00:15:151
411499142,6cyclictest0-21swapper/123:30:171
411499141,4cyclictest28574-21kworker/u4:022:15:301
411499140,14cyclictest873-21meminfo21:45:191
411499140,10cyclictest18870-21diskmemload22:30:131
411399143,6cyclictest2321-21runrttasks23:29:030
411399141,9cyclictest14065-21diskstats22:20:130
411399140,14cyclictest30104-21meminfo23:00:180
411399140,13cyclictest4813-21meminfo21:55:230
411399140,13cyclictest20961-21meminfo19:50:190
411399140,13cyclictest13183-21meminfo19:30:180
411499134,4cyclictest16678-21taskset21:02:261
411499132,4cyclictest0-21swapper/120:00:121
411499131,3cyclictest14470-21apt-get19:35:131
411399130,13cyclictest19020-21meminfo19:45:180
411399130,12cyclictest3550-21meminfo23:15:240
411399130,10cyclictest24721-21munin-run21:24:590
411499122,5cyclictest18870-21diskmemload00:10:361
411499121,6cyclictest0-21swapper/100:35:181
411499120,5cyclictest9456-21kworker/u4:222:41:021
411499120,12cyclictest24268-21meminfo22:45:201
411399122,6cyclictest30014-21apt-get20:15:120
411399121,10cyclictest18264-21kworker/u4:000:11:060
165512120,0sleep10-21swapper/122:25:191
411499110,9cyclictest32083-21seq00:30:151
411499110,10cyclictest29413-21meminfo21:35:231
411399114,4cyclictest0-21swapper/023:20:120
411399112,6cyclictest13591-21runrttasks22:18:480
411399112,5cyclictest1634-21apt-get00:35:160
411399112,1cyclictest0-21swapper/022:55:130
411399111,6cyclictest0-21swapper/021:45:260
21532112,2sleep10-21swapper/119:05:101
411499108,1cyclictest20417-21apt-get00:00:151
411499107,2cyclictest0-21swapper/123:10:211
411499103,4cyclictest26144-21apt-get20:05:161
411499103,3cyclictest0-21swapper/120:20:151
411499101,3cyclictest0-21swapper/123:05:231
411499100,9cyclictest20371-21meminfo22:35:181
411399103,6cyclictest2321-21runrttasks20:39:480
411399102,7cyclictest8217-21/usr/sbin/munin20:40:240
411399102,7cyclictest17092-21apt-get21:05:140
411399102,5cyclictest2321-21runrttasks00:05:520
411399102,2cyclictest0-21swapper/022:50:150
411399101,8cyclictest18870-21diskmemload22:11:450
411399101,2cyclictest0-21swapper/021:12:410
41149997,1cyclictest11254-21apt-get20:50:121
41149995,3cyclictest1662-21snmpd23:57:051
41149993,1cyclictest13994-21ntp_states20:55:201
41149993,1cyclictest0-21swapper/121:15:151
41149991,4cyclictest18701-21runrttasks21:08:221
41149991,4cyclictest0-21swapper/119:30:181
41149990,8cyclictest31492-21ntpdc21:40:281
41139998,1cyclictest77680irq/130-ecat0-r00:00:190
41139996,2cyclictest10285-21taskset23:32:410
41139993,4cyclictest16513-21apt-get23:50:130
41139992,6cyclictest32302-21ps23:05:310
41139992,5cyclictest21069-21chrt22:35:340
41139992,4cyclictest0-21swapper/021:50:010
41139991,3cyclictest27616-21ntp_offset21:30:260
41139990,5cyclictest9834-21munin-run22:10:010
41139990,2cyclictest0-21swapper/022:46:450
41149986,2cyclictest17023-21cut19:40:191
41149986,1cyclictest7887-21cat20:40:201
41149986,1cyclictest6966-21sshd20:37:401
41149986,1cyclictest19098-21cut19:45:201
41149986,1cyclictest107062sleep120:45:581
41149985,2cyclictest3612-21expr20:30:171
41149982,5cyclictest8639-21chrt19:20:061
41149982,4cyclictest0-21swapper/119:55:141
41149982,3cyclictest0-21swapper/121:50:191
41149982,2cyclictest0-21swapper/123:00:141
41149981,6cyclictest4606-21/usr/sbin/munin21:55:201
41149981,5cyclictest8450-21runrttasks19:19:561
41149980,5cyclictest11488-21/usr/sbin/munin23:35:231
41149980,3cyclictest0-21swapper/119:50:141
41139986,2cyclictest20978-21apt-get21:15:160
41139986,1cyclictest16182-21chrt23:48:200
41139986,1cyclictest12040-21taskset19:26:360
41139982,3cyclictest17019-21latency_hist21:05:000
41139981,3cyclictest1522-21apt-get20:25:130
41139980,6cyclictest0-21swapper/000:21:260
41149976,1cyclictest75972sleep122:02:011
41149976,1cyclictest3129-21fschecks_time23:15:201
41149976,1cyclictest30089-21grep00:25:011
41149976,1cyclictest27247-21if_ecat121:30:221
41149976,1cyclictest15020-21cat23:45:181
41149975,1cyclictest3079-21chrt20:27:381
41149975,1cyclictest10918-21wc22:10:321
41149973,1cyclictest22363-21apt-get00:05:191
41149971,3cyclictest0-21swapper/123:50:131
41149970,6cyclictest19693-21meminfo21:10:211
41139976,1cyclictest5024-21awk19:10:250
41139976,1cyclictest29600-21ls21:35:280
41139976,1cyclictest26489-21expr20:05:180
41139976,1cyclictest1128-21taskset20:22:530
41139975,1cyclictest8758-21cut19:20:130
41139975,1cyclictest29456-21taskset20:10:520
41139973,2cyclictest1951-21mailstats23:10:310
41139972,3cyclictest2321-21runrttasks19:41:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional