You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-28 - 12:08

Intel(R) Xeon(R) CPU E3-1270 V2 @ 3.50GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #0, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack0slot1.osadl.org (updated Fri Jan 28, 2022 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1422321500,0sleep114193-21sshd22:08:121
2440921280,0sleep00-21swapper/023:47:130
280452690,0sleep30-21swapper/323:08:143
84942680,1sleep38478-21munin-run19:43:063
182752680,0sleep40-21swapper/400:18:094
174022670,2sleep2970799cyclictest23:43:462
301702660,0sleep10-21swapper/100:01:081
13142660,1sleep234-21ksoftirqd/200:11:262
269542650,0sleep00-21swapper/019:34:140
175652650,1sleep20-21swapper/220:41:132
202032640,0sleep20-21swapper/223:31:532
66482610,0sleep30-21swapper/322:04:143
57162610,0sleep10-21swapper/100:03:481
97422590,0sleep70-21swapper/719:08:107
120262590,0sleep00-21swapper/023:42:000
50182570,0sleep20-21swapper/220:16:142
77382560,0sleep40-21swapper/422:59:104
31082560,0sleep20-21swapper/222:16:382
263502530,0sleep20-21swapper/223:20:392
227982490,2sleep5971099cyclictest19:50:135
790324520,8sleep30-21swapper/319:07:103
503124523,7sleep50-21swapper/519:04:485
9709994238,3cyclictest23579-21kworker/4:020:27:424
740624119,7sleep20-21swapper/219:06:292
9709994036,3cyclictest8272-21kworker/4:219:13:564
9709994036,3cyclictest21532-21kworker/4:222:33:414
505823927,7sleep00-21swapper/019:04:510
9709993836,1cyclictest50-21rcuc/419:43:404
9709993836,1cyclictest0-21swapper/421:11:404
9709993836,1cyclictest0-21swapper/419:42:144
9709993735,1cyclictest32702-21kworker/4:022:51:174
9709993733,3cyclictest24090-21kworker/4:221:44:064
875323724,7sleep70-21swapper/719:07:557
776223725,7sleep60-21swapper/619:06:576
9709993533,1cyclictest32595-21kworker/4:123:33:554
871123523,7sleep40-21swapper/419:07:444
618423521,8sleep10-21swapper/119:05:321
9709993432,1cyclictest32702-21kworker/4:023:18:394
80802320,1sleep013-21rcuc/022:59:140
9709993129,1cyclictest32702-21kworker/4:022:46:314
9709993126,1cyclictest2442-21openvpn22:22:394
970999311,26cyclictest204550irq/27-eth1-tx-20:40:004
970999290,28cyclictest511ktimersoftd/423:48:274
970999280,24cyclictest511ktimersoftd/419:19:244
9709992724,2cyclictest52-21ksoftirqd/423:58:164
9709992723,1cyclictest16041-21kworker/4:119:30:324
970999270,24cyclictest511ktimersoftd/419:57:344
970299271,2cyclictest24525-21GC01:13:110
970999262,21cyclictest511ktimersoftd/421:28:164
9709992615,8cyclictest24090-21kworker/4:221:22:524
970299261,1cyclictest24451-21GC01:13:110
9432260,0sleep40-21swapper/422:56:304
9712992522,2cyclictest79-21ksoftirqd/721:05:137
9712992522,2cyclictest79-21ksoftirqd/720:09:187
9711992523,1cyclictest70-21ksoftirqd/620:09:186
9711992522,2cyclictest70-21ksoftirqd/623:58:166
9710992523,1cyclictest61-21ksoftirqd/523:58:165
970999252,18cyclictest511ktimersoftd/420:14:244
970999250,24cyclictest511ktimersoftd/422:15:194
9709992422,1cyclictest28123-21kworker/4:019:49:184
9709992420,1cyclictest23579-21kworker/4:020:28:544
970999241,16cyclictest511ktimersoftd/400:23:194
970699240,1cyclictest24451-21GC01:13:111
307232240,0sleep216515-1kworker/2:1H23:36:012
970999232,16cyclictest511ktimersoftd/421:54:374
9709992319,1cyclictest8272-21kworker/4:219:08:444
9708992320,2cyclictest43-21ksoftirqd/323:58:163
172872230,1sleep517227-21sshd23:17:145
970999225,16cyclictest204550irq/27-eth1-tx-00:12:454
970999223,15cyclictest204550irq/27-eth1-tx-20:01:584
9709992220,1cyclictest32702-21kworker/4:023:09:174
9711992118,2cyclictest70-21ksoftirqd/622:24:146
970999214,14cyclictest511ktimersoftd/423:55:354
9709992119,1cyclictest0-21swapper/421:33:284
971199207,1cyclictest24524-21GC01:13:116
9709992017,1cyclictest32702-21kworker/4:023:24:054
9709992016,1cyclictest5414-21kworker/u16:021:59:554
9708992016,3cyclictest43-21ksoftirqd/321:05:133
9707992018,1cyclictest34-21ksoftirqd/223:58:162
970299201,1cyclictest24451-21GC01:13:110
9702992010,9cyclictest24529-21GC01:13:110
970299200,1cyclictest0-21swapper/023:18:270
9711991916,2cyclictest70-21ksoftirqd/621:45:136
9711991916,2cyclictest70-21ksoftirqd/620:35:146
9711991916,2cyclictest70-21ksoftirqd/619:44:176
9711991916,2cyclictest70-21ksoftirqd/600:25:156
9710991916,2cyclictest8560-21sshd22:05:175
970999192,13cyclictest204550irq/27-eth1-tx-21:43:024
9709991914,1cyclictest22166-21ntop22:38:314
970999191,17cyclictest511ktimersoftd/420:19:324
970999190,18cyclictest204550irq/27-eth1-tx-00:16:534
9706991917,1cyclictest25-21ksoftirqd/120:34:191
970299195,1cyclictest2442-21openvpn19:23:240
9702991912,6cyclictest2880-21snmpd20:29:480
970299190,1cyclictest24451-21GC01:13:110
292702190,1sleep54202-21runrttasks00:21:145
120372190,1sleep210516-21QueuingRrdStrat21:53:232
971099180,1cyclictest0-21swapper/523:20:085
9709991814,1cyclictest32595-21kworker/4:100:03:514
9709991812,5cyclictest21532-21kworker/4:222:30:394
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional