You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 14:14

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 4.16.15-rt7 (Profile)

Latency plot of system in rack #c, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h200 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackcslot2.osadl.org (updated Wed May 12, 2021 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2700426754,8sleep00-21swapper/019:07:070
2663126754,9sleep10-21swapper/119:03:151
200562470,0sleep00-21swapper/023:35:100
27199991716,1cyclictest500-21ssh21:38:441
27199991615,1cyclictest10161-21ssh23:22:191
27199991614,1cyclictest10780-21ls21:52:421
27199991610,6cyclictest0-21swapper/122:45:201
27198991616,0cyclictest0-21swapper/021:02:080
27198991615,1cyclictest3031-21ssh23:57:030
27198991615,1cyclictest22265-21awk23:37:360
27198991611,5cyclictest14719-21kworker/0:020:41:390
27198991610,6cyclictest0-21swapper/022:18:520
27199991515,0cyclictest0-21swapper/122:30:081
27199991515,0cyclictest0-21swapper/121:10:371
27199991514,1cyclictest26982-21ssh22:15:371
27199991514,1cyclictest23928-21ssh23:40:361
27199991513,1cyclictest644-21nscd23:17:371
27199991512,2cyclictest99550irq/99-eth0-rx-00:11:461
27199991512,2cyclictest20249-21apache222:33:161
27199991510,1cyclictest0-21swapper/123:35:561
27199991510,0cyclictest0-21swapper/122:53:111
27199991510,0cyclictest0-21swapper/119:24:321
27198991515,0cyclictest13310-21ssh22:42:040
27198991515,0cyclictest12660-21ssh23:25:090
27198991515,0cyclictest0-21swapper/021:25:240
27198991514,1cyclictest1717-21ls19:22:380
27198991512,2cyclictest20279-21apache222:10:280
27198991511,4cyclictest14719-21kworker/0:022:45:190
27198991511,3cyclictest14719-21kworker/0:021:04:150
27198991510,5cyclictest0-21swapper/021:58:490
27198991510,5cyclictest0-21swapper/019:47:210
27198991510,5cyclictest0-21swapper/019:16:260
27198991510,5cyclictest0-21swapper/000:22:590
27198991510,0cyclictest0-21swapper/023:15:000
897821410,3sleep10-21swapper/100:04:471
859321410,3sleep00-21swapper/022:34:330
27199991414,0cyclictest6059-21ssh00:00:471
27199991414,0cyclictest0-21swapper/121:24:591
27199991414,0cyclictest0-21swapper/119:47:251
27199991414,0cyclictest0-21swapper/100:22:241
27199991413,1cyclictest29675-21ls23:47:401
27199991413,1cyclictest19404-21ssh22:05:251
27199991413,1cyclictest0-21swapper/119:42:351
27199991412,2cyclictest28407-21/usr/sbin/munin00:32:271
27199991412,2cyclictest20279-21apache222:11:521
27199991412,1cyclictest847-21apache222:59:021
27199991412,1cyclictest644-21nscd00:17:191
27199991412,1cyclictest20279-21apache223:10:571
27199991412,1cyclictest20279-21apache223:04:021
27199991411,2cyclictest99550irq/99-eth0-rx-21:17:211
27199991411,2cyclictest3144-21latency_hist23:57:161
27199991411,2cyclictest20249-21apache221:36:191
27199991410,1cyclictest31173-21kworker/u4:123:17:061
27199991410,1cyclictest31173-21kworker/u4:122:51:371
27199991410,1cyclictest11539-21kworker/u4:021:16:281
27198991414,0cyclictest19556-21ssh22:05:470
27198991414,0cyclictest0-21swapper/023:18:300
27198991414,0cyclictest0-21swapper/021:07:370
27198991414,0cyclictest0-21swapper/019:41:530
27198991414,0cyclictest0-21swapper/000:07:570
27198991412,1cyclictest6965-21ssh00:02:290
27198991412,1cyclictest644-21nscd21:47:530
27198991412,1cyclictest3306-21ssh21:42:400
27198991412,1cyclictest31081-21sh00:35:360
27198991412,1cyclictest20249-21apache223:02:470
27198991411,3cyclictest14719-21kworker/0:022:23:470
27198991411,3cyclictest14719-21kworker/0:020:32:030
27198991411,3cyclictest14719-21kworker/0:020:00:470
27198991411,3cyclictest14719-21kworker/0:019:29:450
27198991411,1cyclictest100050irq/100-eth0-rx23:43:480
27198991410,4cyclictest0-21swapper/022:49:370
27198991410,1cyclictest23916-21kworker/u4:200:28:430
27198991410,0cyclictest0-21swapper/000:12:590
27199991313,0cyclictest26821-21ssh00:29:231
27199991313,0cyclictest0-21swapper/120:55:151
27199991312,1cyclictest99550irq/99-eth0-rx-19:55:281
27199991312,1cyclictest20249-21apache222:37:461
27199991311,2cyclictest99550irq/99-eth0-rx-23:43:591
27199991311,2cyclictest100050irq/100-eth0-rx23:27:361
27199991311,1cyclictest7109-21needreboot19:37:331
27199991311,1cyclictest32324-21ssh22:22:391
27199991311,1cyclictest31337-21fschecks_count19:17:301
27199991311,1cyclictest28962-21runrttasks19:12:131
27199991311,1cyclictest28962-21runrttasks19:12:131
27199991311,1cyclictest27056-21sshd20:27:461
27199991311,1cyclictest20249-21apache220:42:391
27199991310,3cyclictest0-21swapper/122:18:091
27199991310,3cyclictest0-21swapper/121:42:201
27199991310,3cyclictest0-21swapper/120:05:471
27199991310,3cyclictest0-21swapper/119:58:561
27199991310,3cyclictest0-21swapper/119:30:151
27199991310,2cyclictest20279-21apache200:12:241
27199991310,1cyclictest99550irq/99-eth0-rx-21:27:491
27199991310,1cyclictest99550irq/99-eth0-rx-20:22:281
27199991310,1cyclictest99550irq/99-eth0-rx-20:17:381
27199991310,1cyclictest13624-21ssh21:57:281
27199991310,1cyclictest11539-21kworker/u4:021:47:591
27199991310,0cyclictest0-21swapper/119:36:261
27198991312,1cyclictest32470-21ssh23:07:340
27198991312,1cyclictest14719-21kworker/0:021:17:250
27198991312,1cyclictest14536-21rm21:13:510
27198991312,0cyclictest1071-21runrttasks20:02:590
27198991311,2cyclictest20249-21apache222:28:020
27198991311,1cyclictest31395-21forks21:37:300
27198991311,1cyclictest10050irq/110-ahci[0019:42:220
27198991310,3cyclictest13721-21kworker/u4:200:00:210
27198991310,3cyclictest0-21swapper/022:12:340
27198991310,3cyclictest0-21swapper/020:48:470
27198991310,3cyclictest0-21swapper/020:22:200
27198991310,3cyclictest0-21swapper/020:12:450
27198991310,2cyclictest99550irq/99-eth0-rx-23:27:160
27198991310,2cyclictest100050irq/100-eth0-rx20:32:330
27198991310,2cyclictest0-21swapper/020:42:340
27198991310,1cyclictest99550irq/99-eth0-rx-19:32:360
27198991310,1cyclictest99550irq/99-eth0-rx-19:17:340
27198991310,1cyclictest11539-21kworker/u4:021:53:090
27198991310,1cyclictest100050irq/100-eth0-rx23:47:380
27198991310,1cyclictest100050irq/100-eth0-rx22:57:340
27198991310,1cyclictest0-21swapper/021:35:550
27198991310,1cyclictest0-21swapper/020:07:270
27198991310,0cyclictest0-21swapper/021:31:210
27198991310,0cyclictest0-21swapper/020:20:000
27198991310,0cyclictest0-21swapper/019:52:320
27198991310,0cyclictest0-21swapper/000:17:160
27199991211,1cyclictest20279-21apache221:02:231
27199991211,1cyclictest20249-21apache219:12:191
27199991210,1cyclictest20249-21apache220:47:161
27199991210,1cyclictest18092-21cstates20:07:271
27199991210,1cyclictest0-21swapper/120:57:251
27199991210,1cyclictest0-21swapper/120:37:281
27199991210,1cyclictest0-21swapper/120:32:271
27199991210,1cyclictest0-21swapper/120:12:191
27198991211,1cyclictest20835-21ssh22:52:210
27198991210,2cyclictest0-21swapper/020:52:310
27198991210,2cyclictest0-21swapper/019:07:260
27198991210,2cyclictest0-21swapper/019:07:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional