You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 04:30

Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack0slot7.osadl.org (updated Thu Jul 29, 2021 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3863854994514,0cyclictest0-21swapper/823:42:0914
386382699449448,1cyclictest3873760-21kworker/u32:519:28:581
386384699447447,0cyclictest17950irq/126-ahci[0019:55:0012
3863877994460,446cyclictest0-21swapper/1419:55:006
386384999446445,1cyclictest3901030-21turbostat19:50:0013
3863882994450,445cyclictest0-21swapper/1520:39:547
3863865994450,445cyclictest0-21swapper/1120:05:183
386388299444444,0cyclictest4184483-21turbostat23:34:567
386388299444444,0cyclictest0-21swapper/1500:12:437
386388299444442,2cyclictest0-21swapper/1519:25:007
386388299444441,3cyclictest4064028-21turbostat22:14:547
3863858994440,444cyclictest0-21swapper/923:07:3815
3863858994440,444cyclictest0-21swapper/923:07:3815
386384999444441,3cyclictest4071600-21turbostat22:15:0013
386388299443443,0cyclictest0-21swapper/1521:54:187
386384999443441,2cyclictest4048914-21turbostat22:00:0013
386384699443442,1cyclictest17950irq/126-ahci[0023:00:0012
3863826994430,443cyclictest0-21swapper/100:24:101
386386599442442,0cyclictest0-21swapper/1123:38:443
386384999442439,3cyclictest4079126-21turbostat22:19:5913
386388299441439,2cyclictest0-21swapper/1500:20:007
386387799441441,0cyclictest0-21swapper/1423:00:016
386384999440438,2cyclictest3988382-21turbostat21:20:0113
386388299439439,0cyclictest0-21swapper/1520:56:337
386384999439437,2cyclictest4146964-21turbostat23:05:0113
386388299438436,2cyclictest3891994-21perf19:40:007
386388299437437,0cyclictest0-21swapper/1520:20:007
386388299437436,1cyclictest3917525-21kworker/u32:320:32:397
386388299434432,2cyclictest4094198-21turbostat22:34:547
386384999434433,1cyclictest0-21swapper/721:04:5513
386384999433431,2cyclictest3923598-21turbostat20:15:0013
386384999433430,3cyclictest4018705-21turbostat21:40:0013
386388299432432,0cyclictest3988382-21turbostat21:24:567
386388299432432,0cyclictest3988382-21turbostat21:24:557
386384999432430,2cyclictest3959668-21turbostat20:55:0013
386384999431429,2cyclictest44570-21turbostat00:05:0013
386384999430429,1cyclictest0-21swapper/719:19:5613
386384999430427,3cyclictest4124436-21turbostat22:50:0113
386384999430427,3cyclictest4124436-21turbostat22:50:0113
386383099430430,0cyclictest0-21swapper/223:55:428
386383099429428,1cyclictest4167858-21kworker/u32:023:49:098
386383099429428,1cyclictest3940061-21kworker/u32:120:44:108
386388299428428,0cyclictest3932626-21turbostat20:29:557
386384999428426,2cyclictest97050-21turbostat00:39:5913
386384999427426,1cyclictest82049-21turbostat00:30:0013
386385899426423,2cyclictest0-21swapper/900:16:5315
386385899425425,0cyclictest0-21swapper/920:08:4915
386383799425425,0cyclictest0-21swapper/421:39:1010
386385899424424,0cyclictest0-21swapper/923:03:0015
386385899424424,0cyclictest0-21swapper/922:35:4415
386385899424424,0cyclictest0-21swapper/922:19:0215
386385899424424,0cyclictest0-21swapper/921:42:4815
386385899424424,0cyclictest0-21swapper/921:27:2915
386385899424424,0cyclictest0-21swapper/921:14:5215
386385899424424,0cyclictest0-21swapper/920:50:1415
386385899424424,0cyclictest0-21swapper/919:44:0815
386385899423423,0cyclictest4183545-21kworker/9:223:42:4515
386385899423423,0cyclictest0-21swapper/923:47:4115
386385899423423,0cyclictest0-21swapper/923:30:4415
386385899423423,0cyclictest0-21swapper/923:20:4515
386385899423423,0cyclictest0-21swapper/922:43:4815
386385899423423,0cyclictest0-21swapper/922:06:1615
386385899423423,0cyclictest0-21swapper/922:04:4815
386385899423423,0cyclictest0-21swapper/919:28:5815
386385899423423,0cyclictest0-21swapper/900:06:0915
386384999423422,1cyclictest3937110-21turbostat20:29:5913
386388299422422,0cyclictest3973218-21awk21:10:017
386384999422422,0cyclictest4154498-21turbostat23:10:0113
386384999422422,0cyclictest4154498-21turbostat23:10:0013
386383799422422,0cyclictest0-21swapper/422:46:0410
386383799422422,0cyclictest0-21swapper/422:46:0310
386383799422422,0cyclictest0-21swapper/421:54:1810
386383799422422,0cyclictest0-21swapper/400:12:4310
386383799422421,0cyclictest33712-21thunderbird00:19:5010
386383799421421,0cyclictest0-21swapper/423:55:4110
386383799421421,0cyclictest0-21swapper/423:50:2010
386383799421421,0cyclictest0-21swapper/421:41:4910
386383799421420,1cyclictest88935-21kworker/u32:100:36:4810
386383799421420,0cyclictest23741-21Web19:16:2510
386385899420419,1cyclictest50078-21kworker/u32:400:24:1015
386383799420420,0cyclictest0-21swapper/423:35:1010
386383799420420,0cyclictest0-21swapper/419:58:1510
386383799420420,0cyclictest0-21swapper/419:44:0810
386383799420420,0cyclictest0-21swapper/419:11:1010
386383799420419,1cyclictest0-21swapper/420:05:1810
386383799420419,1cyclictest0-21swapper/419:28:5810
386388299419417,1cyclictest3901036-21munin-run19:50:007
386383799419419,0cyclictest0-21swapper/420:44:1010
386388299418414,3cyclictest4048925-21perf22:00:007
386384999418416,2cyclictest4176994-21turbostat23:25:0113
386383799418418,0cyclictest0-21swapper/420:56:3310
386384999417417,0cyclictest3941628-21turbostat20:34:5913
386384999417415,2cyclictest4026260-21turbostat21:49:5513
386383799417416,1cyclictest3964856-21kworker/u32:221:32:5410
386383799416416,0cyclictest0-21swapper/422:26:2410
386383799416416,0cyclictest0-21swapper/420:21:1210
386383799416416,0cyclictest0-21swapper/419:53:4910
386383799414414,0cyclictest0-21swapper/420:32:3910
386388299413411,2cyclictest0-21swapper/1522:19:597
386383799413413,0cyclictest0-21swapper/419:19:1010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional