You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-16 - 13:46

Intel(R) Xeon(R) CPU E3-1270 V2 @ 3.50GHz, Linux 4.4.229-rt200 (Profile)

Latency plot of system in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rack1slot2.osadl.org (updated Sat Oct 16, 2021 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1705424737,0sleep20-21swapper/207:07:282
1687123625,0sleep00-21swapper/007:05:180
1693723525,0sleep10-21swapper/107:06:031
1680323425,0sleep30-21swapper/307:04:333
172559999,0cyclictest5943-21kworker/2:010:47:192
172559977,0cyclictest5943-21kworker/2:009:06:382
172559977,0cyclictest5943-21kworker/2:007:24:342
172559977,0cyclictest28464-21sensors11:39:222
30535060,0irq/33-eth0-tx-0-21swapper/209:12:552
27160,0ktimersoftd/20-21swapper/212:14:562
172569966,0cyclictest0-21swapper/311:16:193
172569960,0cyclictest0-21swapper/311:13:103
172559966,0cyclictest2654-21nvme09:19:562
172559966,0cyclictest15781-21diskmemload10:32:232
172559960,0cyclictest0-21swapper/212:32:022
172559960,0cyclictest0-21swapper/212:09:202
172539966,0cyclictest0-21swapper/011:48:360
172539960,0cyclictest0-21swapper/011:10:460
172539960,0cyclictest0-21swapper/008:09:280
149960,0migration/011708-21latency_hist10:48:540
149960,0migration/010808-21sh11:21:000
8305050,0irq/26-0000:00:15716-21unixbench_multi12:34:202
4150,0ktimersoftd/00-21swapper/011:16:460
35150,0ktimersoftd/30-21swapper/312:14:563
35150,0ktimersoftd/30-21swapper/310:33:453
339950,0migration/319745-21sh10:22:263
339950,0migration/310119-21sh09:38:183
329950,0watchdog/37949-21sh11:53:303
329950,0watchdog/325939-21memory08:24:143
329950,0watchdog/323278-21sh10:25:063
329950,0watchdog/31688-21sh11:45:383
329950,0watchdog/312123-21sh11:57:303
329950,0watchdog/30-21swapper/310:35:023
30535050,0irq/33-eth0-tx-3596-21snmpd07:37:300
30535050,0irq/33-eth0-tx-29800-21tune2fs09:24:122
30535050,0irq/33-eth0-tx-28833-21ssh09:58:072
30535050,0irq/33-eth0-tx-21435-21munin-node10:59:112
30535050,0irq/33-eth0-tx-17474-21munin-node07:09:150
30535050,0irq/33-eth0-tx-16073-21munin-node10:19:122
30535050,0irq/33-eth0-tx-15444-21ssh11:25:552
30535050,0irq/33-eth0-tx-12126-21memory09:39:222
30535050,0irq/33-eth0-tx-0-21swapper/212:00:562
30535050,0irq/33-eth0-tx-0-21swapper/211:23:252
30535050,0irq/33-eth0-tx-0-21swapper/210:55:352
30535050,0irq/33-eth0-tx-0-21swapper/209:38:022
30535050,0irq/33-eth0-tx-0-21swapper/209:31:132
30535050,0irq/33-eth0-tx-0-21swapper/008:31:010
27150,0ktimersoftd/20-21swapper/210:12:212
27150,0ktimersoftd/20-21swapper/209:45:052
259950,0migration/27061-21sh11:51:432
259950,0migration/2513-21taskset10:02:002
259950,0migration/232675-21munin-node11:09:382
259950,0migration/228515-21latency08:29:202
259950,0migration/225133-21sh10:28:522
259950,0migration/224509-21sh11:35:102
259950,0migration/21844-21switchtime08:39:282
259950,0migration/211384-21sh11:56:012
19150,0ktimersoftd/10-21swapper/112:14:561
172569955,0cyclictest0-21swapper/312:27:063
172569955,0cyclictest0-21swapper/312:05:593
172569955,0cyclictest0-21swapper/310:50:183
172569955,0cyclictest0-21swapper/310:12:003
172569954,0cyclictest3596-21snmpd11:06:173
172569954,0cyclictest3596-21snmpd07:11:003
172569953,0cyclictest3640-21lldpd10:45:073
172569950,0cyclictest0-21swapper/312:20:013
172569950,0cyclictest0-21swapper/310:06:573
172569950,0cyclictest0-21swapper/309:28:483
172559955,0cyclictest0-21swapper/210:36:002
172559955,0cyclictest0-21swapper/208:44:132
172559955,0cyclictest0-21swapper/207:14:122
172559953,0cyclictest5943-21kworker/2:011:15:112
172559950,0cyclictest0-21swapper/210:39:472
172549950,0cyclictest0-21swapper/110:23:571
172549950,0cyclictest0-21swapper/110:11:391
172549950,0cyclictest0-21swapper/107:39:211
172539955,0cyclictest0-21swapper/012:35:160
172539955,0cyclictest0-21swapper/011:50:110
172539955,0cyclictest0-21swapper/010:19:130
172539955,0cyclictest0-21swapper/010:00:370
172539955,0cyclictest0-21swapper/009:43:260
172539950,0cyclictest0-21swapper/010:52:570
172539950,0cyclictest0-21swapper/009:25:270
172539950,0cyclictest0-21swapper/007:13:580
179950,0migration/18096-21sshd11:53:471
179950,0migration/12169-21latency_hist10:38:541
179950,0migration/120014-21latency_hist09:13:541
179950,0migration/117964-21fschecks_count07:09:161
179950,0migration/110596-21latency_hist09:38:541
169950,0watchdog/124188-21ntp_kernel_pll_07:19:181
169950,0watchdog/11074-21sed09:28:541
149950,0migration/08432-21sh11:54:020
149950,0migration/08116-21taskset08:53:590
149950,0migration/07925-21switchtime07:49:320
149950,0migration/05431-21sh12:24:140
149950,0migration/030060-21sh11:08:040
149950,0migration/027641-21sh09:55:460
149950,0migration/023028-21taskset10:24:370
149950,0migration/01859-21sh10:04:100
149950,0migration/017337-21timerandwakeup09:44:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional