You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-16 - 13:53

Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack0slot7.osadl.org (updated Sat Oct 16, 2021 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292376799457457,0cyclictest1233-21snmpd20:31:034
292377399449449,0cyclictest0-21swapper/1422:29:116
2923767994480,448cyclictest0-21swapper/1223:13:074
2923762994480,0cyclictest0-21swapper/1100:36:333
292376299444443,1cyclictest2982908-21kworker/u32:120:40:353
292375999444443,1cyclictest3139361-21cat22:15:182
292376299443441,1cyclictest3259711-21kworker/u32:100:08:253
292375999443443,0cyclictest0-21swapper/1021:15:282
292374899443441,2cyclictest3159027-21turbostat22:30:0013
292374899443441,2cyclictest0-21swapper/721:29:5613
292376799442442,0cyclictest19750irq/127-xhci_hc23:50:184
292376799442442,0cyclictest19750irq/127-xhci_hc00:14:254
292374899442442,0cyclictest0-21swapper/723:50:1713
292377799441441,0cyclictest2992603-21turbostat20:24:557
292377799441440,1cyclictest0-21swapper/1500:15:017
292376299441441,0cyclictest0-21swapper/1123:47:583
292376299441441,0cyclictest0-21swapper/1123:47:573
292374899441440,1cyclictest3095275-21kworker/u32:321:46:1213
292377799440440,0cyclictest0-21swapper/1521:15:477
292376799440440,0cyclictest19750irq/127-xhci_hc21:46:114
292376799440440,0cyclictest19750irq/127-xhci_hc00:36:334
292376299440440,0cyclictest0-21swapper/1123:23:023
292374899440439,1cyclictest3241123-21kworker/u32:223:28:5913
292377799439439,0cyclictest0-21swapper/1522:35:207
292376799439439,0cyclictest19750irq/127-xhci_hc23:28:584
292376799439439,0cyclictest19750irq/127-xhci_hc00:24:354
292374899439438,1cyclictest3323817-21kworker/u32:400:29:1213
292374899439437,2cyclictest0-21swapper/721:04:5513
292377399438438,0cyclictest0-21swapper/1422:44:596
292376799438438,0cyclictest19750irq/127-xhci_hc22:41:064
292374899438436,2cyclictest0-21swapper/721:54:5513
292374899438436,2cyclictest0-21swapper/721:54:5513
292376799437437,0cyclictest19750irq/127-xhci_hc23:15:234
292376799437435,1cyclictest19750irq/127-xhci_hc21:02:264
292374899437437,0cyclictest0-21swapper/723:34:5413
292376799436436,0cyclictest19750irq/127-xhci_hc21:28:234
292376799436436,0cyclictest19750irq/127-xhci_hc20:57:594
292374899435434,1cyclictest3060270-21kworker/u32:022:02:5813
292377799434432,2cyclictest3024991-21turbostat20:59:547
292375999434433,0cyclictest56949-21Web15:42:522
292374899434434,0cyclictest0-21swapper/720:36:1913
292377799433432,1cyclictest3203944-21turbostat23:04:547
292376799433433,0cyclictest19750irq/127-xhci_hc21:24:504
292375999433433,0cyclictest0-21swapper/1023:13:072
292377799432432,0cyclictest3181452-21turbostat22:49:557
292376799432431,0cyclictest19750irq/127-xhci_hc21:42:384
292377799430430,0cyclictest3233983-21turbostat23:24:547
292376799430430,0cyclictest19750irq/127-xhci_hc22:01:224
292375799430429,1cyclictest3109789-21kworker/u32:222:29:1115
292377799429428,1cyclictest3015751-21turbostat20:49:547
292374899428428,0cyclictest0-21swapper/723:39:5413
292374899427427,0cyclictest0-21swapper/721:09:5513
292374499426426,0cyclictest18150irq/126-ahci[0000:10:0112
292375999424423,1cyclictest3172231-21kworker/u32:023:23:262
292375799424422,2cyclictest0-21swapper/921:19:5515
292374899424423,1cyclictest0-21swapper/722:24:5613
292377799423421,2cyclictest3001920-21turbostat20:34:557
292374899423423,0cyclictest0-21swapper/723:09:5513
292374899423421,2cyclictest3354004-21turbostat00:40:0013
292374899423420,3cyclictest3029645-21turbostat20:59:5913
292374899422422,0cyclictest0-21swapper/723:49:5613
292374899422422,0cyclictest0-21swapper/723:49:5513
292374899421421,0cyclictest3006528-21turbostat20:35:0013
292374899421419,2cyclictest3188965-21turbostat22:49:5913
292377799419417,2cyclictest3020398-21turbostat20:54:557
292374899419418,1cyclictest3233983-21turbostat23:19:5913
292374899419417,2cyclictest0-21swapper/720:44:5613
292375299417417,0cyclictest0-21swapper/822:15:1814
292377799416416,0cyclictest0-21swapper/1500:30:587
292375999415415,0cyclictest0-21swapper/1022:02:582
292375999415415,0cyclictest0-21swapper/1000:33:292
292377799414413,0cyclictest3181462-21perf22:44:597
292377399414413,1cyclictest3323817-21kworker/u32:400:33:286
292375999414414,0cyclictest0-21swapper/1000:35:592
292374899414413,1cyclictest0-21swapper/723:14:5413
292377799413412,1cyclictest0-21swapper/1523:40:017
292377799413412,1cyclictest0-21swapper/1522:10:017
292375999413413,0cyclictest0-21swapper/1020:40:352
292375999413412,0cyclictest3295819-21chrome20:47:352
292377799412410,2cyclictest3083985-21awk21:40:017
292375799412412,0cyclictest0-21swapper/900:24:3415
292375799411411,0cyclictest0-21swapper/921:30:1415
292377799410408,2cyclictest3331607-21turbostat00:29:567
292377799410408,1cyclictest0-21swapper/1521:25:007
292377799409409,0cyclictest3263970-21turbostat23:44:567
292375799409408,1cyclictest3029344-21kworker/u32:021:02:2715
292377799408408,0cyclictest0-21swapper/1500:16:407
292375799408408,0cyclictest0-21swapper/900:38:4415
292374899408408,0cyclictest0-21swapper/722:59:5513
292374899407405,2cyclictest3144019-21turbostat22:20:0113
292377399406403,3cyclictest3188969-21munin-run22:50:006
292374899406406,0cyclictest0-21swapper/722:39:5613
292375999404404,0cyclictest0-21swapper/1021:49:452
292377799403401,2cyclictest0-21swapper/1522:30:017
292374899403401,2cyclictest3188965-21turbostat22:54:5413
292377799402401,1cyclictest3172231-21kworker/u32:023:50:187
292377799401400,1cyclictest3061488-21turbostat21:29:557
292377799400400,0cyclictest0-21swapper/1521:46:117
292377799399399,0cyclictest0-21swapper/1523:28:587
292377799398398,0cyclictest3226508-21turbostat23:19:557
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional