You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-20 - 03:06

Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, Linux 4.16.15-rt7 (Profile)

Latency plot of system in rack #b, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackbslot1.osadl.org (updated Sun Jun 20, 2021 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105962660,0sleep20-21swapper/222:10:232
105962660,0sleep20-21swapper/222:10:232
167202600,0sleep1221rcuc/120:35:021
161952580,0sleep00-21swapper/019:40:030
2953325038,7sleep30-21swapper/319:07:383
2949025038,7sleep00-21swapper/019:07:080
2969824734,8sleep20-21swapper/219:09:022
2949824735,7sleep10-21swapper/119:07:131
106432190,1sleep32992099cyclictest22:10:283
106432190,1sleep32992099cyclictest22:10:283
29909991513,1cyclictest22027-21snmpd23:22:051
29902991413,0cyclictest22027-21snmpd23:36:460
29920991313,0cyclictest22027-21snmpd22:17:143
29920991311,1cyclictest22027-21snmpd22:59:573
29920991311,1cyclictest16448-31munin-html21:25:403
29915991311,1cyclictest7262-31munin-graph21:10:442
2990999131,1cyclictest32330-31munin-html19:10:361
29902991313,0cyclictest22027-21snmpd19:52:390
29902991311,1cyclictest28016-31munin-html21:45:320
29902991311,1cyclictest22027-21snmpd20:00:520
29920991211,1cyclictest19588-21kworker/3:121:45:073
29920991211,0cyclictest30055-31munin-html20:00:353
29920991211,0cyclictest22027-21snmpd21:32:433
29920991210,1cyclictest22027-21snmpd20:15:073
29920991210,1cyclictest22027-21snmpd00:01:533
2992099120,11cyclictest0-21swapper/300:05:313
2991599120,1cyclictest15679-31munin-graph20:30:422
29909991210,1cyclictest22027-21snmpd23:52:591
2990999120,1cyclictest7769-21check_ping23:55:151
2990999120,11cyclictest0-21swapper/122:50:401
29902991212,0cyclictest22027-21snmpd23:24:370
29902991211,0cyclictest22027-21snmpd00:34:510
190952120,1sleep119088-21/usr/share/muni19:45:011
2992099119,1cyclictest30009-31munin-html00:30:423
2992099119,1cyclictest27510-21kworker/3:200:35:293
2992099119,1cyclictest0-21swapper/323:55:403
2992099119,1cyclictest0-21swapper/323:09:003
2992099119,1cyclictest0-21swapper/320:46:463
29920991110,0cyclictest829-21irqstats23:45:003
2992099110,1cyclictest0-21swapper/321:05:103
2992099110,10cyclictest0-21swapper/323:29:413
2992099110,10cyclictest0-21swapper/322:48:303
2992099110,10cyclictest0-21swapper/322:34:373
2992099110,10cyclictest0-21swapper/321:16:093
2992099110,10cyclictest0-21swapper/319:49:173
2992099110,10cyclictest0-21swapper/319:25:523
29915991111,0cyclictest22027-21snmpd19:20:262
2991599110,1cyclictest0-21swapper/200:29:002
2991599110,10cyclictest0-21swapper/223:35:252
2991599110,10cyclictest0-21swapper/222:05:092
2991599110,10cyclictest0-21swapper/220:15:022
2990999119,1cyclictest0-21swapper/123:08:061
2990999119,1cyclictest0-21swapper/121:31:331
2990999119,1cyclictest0-21swapper/120:51:211
2990999119,1cyclictest0-21swapper/120:44:151
2990999118,2cyclictest22027-21snmpd21:39:311
2990999113,3cyclictest2511-21munin-run22:00:001
2990999112,6cyclictest26755-21munin-limits00:25:341
2990999112,5cyclictest4290-31munin-graph21:05:401
2990999112,2cyclictest23459-21munin-run22:35:001
2990999111,6cyclictest5801-21/usr/sbin/munin22:05:031
2990999110,1cyclictest0-21swapper/100:05:061
2990999110,10cyclictest0-21swapper/121:20:061
2990999110,10cyclictest0-21swapper/120:10:111
2990999110,10cyclictest0-21swapper/119:55:101
2990999110,10cyclictest0-21swapper/119:53:041
2990999110,10cyclictest0-21swapper/119:41:451
2990999110,10cyclictest0-21swapper/119:31:451
2990999110,10cyclictest0-21swapper/100:13:011
2990999110,10cyclictest0-21swapper/100:01:341
29902991110,0cyclictest9530-21kworker/0:100:05:360
2990299110,1cyclictest0-21swapper/022:35:450
2990299110,1cyclictest0-21swapper/019:15:330
2990299110,1cyclictest0-21swapper/000:01:100
2990299110,10cyclictest0-21swapper/023:56:000
2990299110,10cyclictest0-21swapper/019:21:310
2990299110,10cyclictest0-21swapper/000:39:560
2992099109,1cyclictest22027-21snmpd23:24:103
2992099109,0cyclictest12664-21kworker/3:119:35:173
2992099108,1cyclictest42-21ksoftirqd/319:55:013
2992099108,1cyclictest0-21swapper/321:58:463
2992099108,1cyclictest0-21swapper/321:40:223
2992099108,1cyclictest0-21swapper/321:21:283
2992099108,1cyclictest0-21swapper/320:59:313
2992099108,1cyclictest0-21swapper/320:13:583
2992099108,1cyclictest0-21swapper/319:22:293
2992099108,1cyclictest0-21swapper/300:29:053
2992099107,2cyclictest42-21ksoftirqd/300:15:023
2992099100,9cyclictest0-21swapper/322:24:363
2992099100,9cyclictest0-21swapper/320:41:553
2992099100,9cyclictest0-21swapper/320:08:593
2992099100,1cyclictest0-21swapper/321:04:013
2992099100,1cyclictest0-21swapper/320:21:443
2991599109,0cyclictest22027-21snmpd22:40:482
2991599109,0cyclictest0-21swapper/223:00:032
2991599108,1cyclictest0-21swapper/221:05:242
2991599108,1cyclictest0-21swapper/220:00:202
2990999108,1cyclictest0-21swapper/122:39:511
2990999103,3cyclictest30778-21/usr/share/muni00:35:061
2990999102,5cyclictest7842-21diskstats20:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional