You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 14:26

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.4.59-rt36 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot5.osadl.org (updated Wed May 12, 2021 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
290542340,0sleep00-21swapper/000:22:510
307699230,1cyclictest17715-21/usr/sbin/munin23:55:211
307699210,20cyclictest22289-21meminfo00:05:221
307599210,20cyclictest3957-21meminfo21:55:230
307599210,20cyclictest20342-21meminfo00:00:180
307699200,19cyclictest6336-21meminfo19:15:271
307699200,0cyclictest17959-21diskmemload22:14:541
307599200,19cyclictest30088-21meminfo00:25:200
307599200,19cyclictest23882-21meminfo20:00:170
3076991917,1cyclictest0-21swapper/100:35:211
3076991915,4cyclictest0-21swapper/121:53:441
307699190,18cyclictest6687-21meminfo23:25:191
307699190,18cyclictest25824-21meminfo20:05:171
307699190,18cyclictest25407-21meminfo22:50:161
307699190,18cyclictest19551-21meminfo22:35:161
307699190,18cyclictest14119-21meminfo19:35:161
307699190,18cyclictest13716-21meminfo22:20:181
307699190,11cyclictest14995-21kworker/u4:022:32:101
307599191,8cyclictest19562-21kworker/u4:522:11:040
307699183,6cyclictest22804-21apt-get22:45:121
3076991818,0cyclictest17959-21diskmemload00:10:521
307699181,7cyclictest3096-21apt-get19:10:111
307699180,17cyclictest24644-21meminfo21:25:191
307699180,17cyclictest18795-21meminfo21:10:241
307699180,17cyclictest15671-21meminfo22:25:231
307599185,5cyclictest73280irq/131-ecat0-r22:46:120
307599181,9cyclictest22038-21apt-get21:20:120
307599181,8cyclictest10325-21apt-get20:50:130
307599180,9cyclictest17959-21diskmemload23:10:550
307599180,1cyclictest0-21swapper/000:09:050
307599180,18cyclictest9042-21meminfo20:45:170
307599180,17cyclictest32442-21meminfo21:45:220
307599180,17cyclictest26589-21meminfo21:30:180
307599180,17cyclictest24227-21meminfo00:10:170
307599180,17cyclictest16833-21meminfo21:05:170
307599180,17cyclictest10575-21meminfo23:35:180
307699177,7cyclictest27870-21apt-get21:35:121
307699171,15cyclictest29061-21kworker/u4:000:26:481
307699171,10cyclictest19480-21kworker/u4:422:42:071
307699170,6cyclictest17128-21kworker/u4:123:51:391
307699170,6cyclictest17128-21kworker/u4:100:00:221
307699170,16cyclictest28653-21/usr/sbin/munin23:00:211
307699170,16cyclictest16086-21meminfo19:40:171
3075991717,0cyclictest0-21swapper/023:25:370
3075991715,1cyclictest1307-21apt-get21:50:100
3075991715,0cyclictest0-21swapper/020:37:500
307599170,8cyclictest15773-21apt-get23:50:150
307599170,16cyclictest32038-21meminfo00:30:200
307599170,16cyclictest12180-21meminfo19:30:170
307599170,10cyclictest3730-21kworker/u4:023:48:380
187262170,0sleep00-21swapper/023:55:270
307699166,7cyclictest32544-21apt-get23:10:121
307699160,9cyclictest23225-21apt-get20:00:131
307699160,15cyclictest7860-21meminfo22:05:181
307699160,15cyclictest5135-21meminfo20:35:191
307599169,4cyclictest2311-21runrttasks22:09:180
307599168,4cyclictest1188-21gmain22:35:180
307599165,8cyclictest2734-21fschecks_count20:30:150
307599165,6cyclictest0-21swapper/022:16:340
307599161,9cyclictest18134-21apt-get21:10:190
3075991616,0cyclictest0-21swapper/022:24:590
307599160,4cyclictest0-21swapper/021:00:110
307599160,16cyclictest29314-21meminfo23:00:160
307599160,15cyclictest28529-21meminfo21:35:170
307599160,15cyclictest12944-21meminfo20:55:280
307599160,12cyclictest0-21swapper/019:50:110
307599160,11cyclictest26353-21kworker/u4:123:31:340
307599160,10cyclictest506-21apt-get20:25:120
307599160,10cyclictest25166-21apt-get20:05:130
307699157,6cyclictest2524-21apt-get20:30:121
307699155,9cyclictest19480-21kworker/u4:422:58:401
307699154,7cyclictest16175-21apt-get21:05:121
307699154,1cyclictest8758-21kworker/u4:222:16:291
307699152,8cyclictest25515-21apt-get00:15:121
3076991513,1cyclictest7972-21apt-get23:30:141
307699150,5cyclictest17371-21apt-get19:45:121
307699150,13cyclictest29722-21meminfo20:15:231
307599157,4cyclictest6559-21wc20:40:130
307599154,5cyclictest9424-21cron19:25:000
307599154,5cyclictest28472-21cron23:00:010
307599153,6cyclictest30166-21kworker/u4:223:40:070
307599153,11cyclictest30600-21apt-get23:05:110
307599152,8cyclictest5770-21runrttasks23:24:080
307599152,7cyclictest2311-21runrttasks19:40:520
307599152,7cyclictest0-21swapper/022:50:120
307599152,4cyclictest11313-21sshd19:29:380
307599151,2cyclictest17371-21apt-get19:45:120
307599150,9cyclictest7047-21perf22:05:010
307599150,7cyclictest2311-21runrttasks19:19:200
307599150,6cyclictest0-21swapper/022:29:250
307599150,4cyclictest19480-21kworker/u4:422:43:580
307599150,4cyclictest0-21swapper/020:15:190
307599150,15cyclictest31680-21meminfo20:20:190
307699148,3cyclictest31777-21apt-get21:45:121
307699147,4cyclictest2046-21snmpd23:07:331
307699143,3cyclictest0-21swapper/123:36:481
307699142,8cyclictest20078-21apt-get21:15:161
307699142,5cyclictest19150-21dump-pmu-power19:54:561
307699141,7cyclictest3298-21apt-get21:55:171
307699141,6cyclictest12274-21apt-get20:55:161
307699141,3cyclictest17959-21diskmemload22:03:321
307699141,2cyclictest0-21swapper/123:20:511
307699140,5cyclictest2101-21apt-get23:15:101
307599145,8cyclictest0-21swapper/019:10:120
307599144,8cyclictest21258-21apt-get19:55:130
307599143,8cyclictest73280irq/131-ecat0-r21:43:080
307599143,6cyclictest16950-21apt-get22:30:130
307599143,5cyclictest13461-21apt-get19:35:120
307599143,3cyclictest0-21swapper/000:35:120
307599142,9cyclictest20078-21apt-get21:15:150
307699132,6cyclictest14905-21ls21:00:161
307699132,6cyclictest10675-21ls19:25:231
307699131,8cyclictest2046-21snmpd20:10:231
307699131,7cyclictest17959-21diskmemload21:23:401
307699130,6cyclictest13828-21apt-get23:45:131
307699130,12cyclictest28141-21meminfo00:20:181
307599132,5cyclictest18104-21kworker/u4:221:28:010
307599130,8cyclictest2101-21apt-get23:15:120
313602120,0sleep10-21swapper/100:30:061
307699125,6cyclictest21917-21memory19:55:171
307699123,5cyclictest338-21awk20:25:001
307699123,3cyclictest0-21swapper/120:45:131
307699122,7cyclictest10325-21apt-get20:50:121
307699122,5cyclictest0-21swapper/119:30:141
307699121,4cyclictest29836-21/usr/sbin/munin21:40:261
3076991211,1cyclictest11869-21kworker/u4:123:41:471
307699120,4cyclictest0-21swapper/120:40:131
307599121,5cyclictest0-21swapper/020:10:120
307599121,3cyclictest25644-21cstates00:15:130
25942122,2sleep00-21swapper/019:06:480
307699115,3cyclictest2046-21snmpd19:22:421
307699112,4cyclictest888-21cut20:25:151
307699110,6cyclictest0-21swapper/121:30:131
2449292,2sleep10-21swapper/119:05:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional