You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-30 - 22:27

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of system in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack1slot2.osadl.org (updated Thu Jun 30, 2022 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
513423826,0sleep10-21swapper/106:49:271
517123728,0sleep30-21swapper/306:49:493
512023627,0sleep20-21swapper/206:49:162
542323524,0sleep00-21swapper/006:52:470
5510991111,0cyclictest0-21swapper/008:53:120
55109977,0cyclictest3346-21snmpd09:41:130
55129960,0cyclictest0-21swapper/212:03:142
55129960,0cyclictest0-21swapper/209:23:222
55119966,0cyclictest15959-21diskmemload11:38:111
55119960,0cyclictest0-21swapper/112:17:551
55119960,0cyclictest0-21swapper/107:22:561
55109960,0cyclictest15959-21diskmemload10:37:060
55109960,0cyclictest0-21swapper/010:55:130
55109960,0cyclictest0-21swapper/009:08:390
35160,0ktimersoftd/30-21swapper/310:44:153
339960,0migration/37053-21sh11:26:523
339960,0migration/332045-21sh09:35:533
339960,0migration/327596-21runrttasks11:53:253
339960,0migration/325473-21munin-node09:48:203
339960,0migration/32297-21sh10:29:093
339960,0migration/322216-21sh09:29:263
339960,0migration/315527-21sh10:53:553
339960,0migration/310360-21sh09:07:203
28015060,0irq/29-eth0-tx-0-21swapper/208:53:162
28005060,0irq/28-eth0-rx-3259-21kthreadcore12:18:093
28005060,0irq/28-eth0-rx-16807-40yum-updatesd-he11:32:573
149960,0migration/08235-21sh09:03:220
149960,0migration/07370-21sh10:14:210
149960,0migration/025188-21sh11:37:000
55129955,0cyclictest15642-21kworker/2:207:35:492
55129955,0cyclictest15642-21kworker/2:207:25:092
55129955,0cyclictest0-21swapper/210:38:062
55129955,0cyclictest0-21swapper/209:56:382
55129950,0cyclictest0-21swapper/211:17:032
55129950,0cyclictest0-21swapper/209:13:362
55119955,0cyclictest0-21swapper/111:17:321
55119955,0cyclictest0-21swapper/110:50:151
55119955,0cyclictest0-21swapper/109:56:491
55119954,0cyclictest16136-21awk09:28:111
55119950,0cyclictest0-21swapper/112:07:121
55119950,0cyclictest0-21swapper/110:32:571
55119950,0cyclictest0-21swapper/107:08:171
55119950,0cyclictest0-21swapper/107:07:291
55109955,0cyclictest0-21swapper/011:47:150
55109950,0cyclictest0-21swapper/012:20:030
55109950,0cyclictest0-21swapper/011:53:050
55109950,0cyclictest0-21swapper/009:45:510
339950,0migration/38105-21cpuspeed_turbos11:28:063
339950,0migration/37226-21fschecks_count12:03:073
339950,0migration/36595-21kthreadcore08:43:133
339950,0migration/35493-21kthreadcore09:38:143
339950,0migration/35399-21idleruntime10:33:103
339950,0migration/35111-21sh09:57:593
339950,0migration/33851-21taskset09:19:123
339950,0migration/33362-21kthreadcore07:33:143
339950,0migration/331433-21munin-node08:58:203
339950,0migration/323255-21latency_hist10:07:553
339950,0migration/322320-21munin-node08:53:163
339950,0migration/319848-21latency_hist09:12:553
339950,0migration/317244-21kthreadcore11:48:143
339950,0migration/316450-21switchtime09:43:193
339950,0migration/312987-21kthreadcore09:08:143
339950,0migration/312246-21kthreadcore08:03:123
339950,0migration/311960-21timerwakeupswit07:38:203
339950,0migration/311530-21latency06:53:143
339950,0migration/310279-21kthreadcore08:23:133
329950,0watchdog/38396-21sed07:58:203
329950,0watchdog/328625-21kthreadcore08:38:113
329950,0watchdog/3280050irq/28-eth0-rx-11:14:353
329950,0watchdog/323455-21cut10:23:153
329950,0watchdog/314847-21cut06:58:123
329950,0watchdog/313437-21fschecks_time07:43:083
329950,0watchdog/31193-21kthreadcore10:48:113
329950,0watchdog/30-21swapper/311:39:143
329950,0watchdog/30-21swapper/310:58:113
329950,0watchdog/30-21swapper/308:08:113
28015050,0irq/29-eth0-tx-9747-21latency_hist09:42:552
28015050,0irq/29-eth0-tx-5068-21sed11:08:112
28015050,0irq/29-eth0-tx-2635-21kthreadcore11:23:122
28015050,0irq/29-eth0-tx-25910-21munin-node11:38:142
28015050,0irq/29-eth0-tx-25156-21munin-node08:58:242
28015050,0irq/29-eth0-tx-21756-21nfs4_client12:08:142
28015050,0irq/29-eth0-tx-17695-21munin-node10:58:072
28015050,0irq/29-eth0-tx-10188-21ssh11:45:022
28015050,0irq/29-eth0-tx-1011-21kthreadcore11:58:122
28015050,0irq/29-eth0-tx-0-21swapper/212:14:372
28015050,0irq/29-eth0-tx-0-21swapper/211:28:572
28015050,0irq/29-eth0-tx-0-21swapper/210:53:132
28015050,0irq/29-eth0-tx-0-21swapper/209:30:362
28015050,0irq/29-eth0-tx-0-21swapper/007:23:100
28015050,0irq/29-eth0-tx-0-21swapper/007:08:070
28005050,0irq/28-eth0-rx-17757-21kthreadcore10:38:123
28005050,0irq/28-eth0-rx-17381-21ssh10:21:143
28005050,0irq/28-eth0-rx-15807-21sed10:03:123
28005050,0irq/28-eth0-rx-0-21swapper/312:13:103
28005050,0irq/28-eth0-rx-0-21swapper/311:43:113
28005050,0irq/28-eth0-rx-0-21swapper/311:20:453
28005050,0irq/28-eth0-rx-0-21swapper/311:12:473
28005050,0irq/28-eth0-rx-0-21swapper/310:13:153
28005050,0irq/28-eth0-rx-0-21swapper/309:23:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional