You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-20 - 05:04

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of system in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, highest latencies:
System rack1slot2.osadl.org (updated Sat Aug 20, 2022 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1662326763,0sleep10-21swapper/118:44:391
1642523726,0sleep30-21swapper/318:42:213
1662723624,0sleep00-21swapper/018:44:420
1675723425,0sleep20-21swapper/218:46:122
16874991818,0cyclictest287350irq/27-eth123:51:572
16874991717,0cyclictest287350irq/27-eth123:25:362
16874991515,0cyclictest287350irq/27-eth123:48:062
16874991414,0cyclictest287350irq/27-eth123:12:282
16874991414,0cyclictest287350irq/27-eth123:06:592
16874991313,0cyclictest287350irq/27-eth123:57:372
16874991313,0cyclictest287350irq/27-eth123:26:482
16874991313,0cyclictest287350irq/27-eth100:13:282
16874991313,0cyclictest287350irq/27-eth100:02:022
16874991212,0cyclictest287350irq/27-eth123:42:032
16874991212,0cyclictest287350irq/27-eth123:21:162
16874991212,0cyclictest287350irq/27-eth100:06:562
16874991111,0cyclictest287350irq/27-eth123:40:452
16874991111,0cyclictest287350irq/27-eth123:32:012
16874991010,0cyclictest287350irq/27-eth123:05:172
66019770,0rudpserv30756-21cat23:47:033
66019760,0rudpserv4815-21ssh23:12:593
66019760,0rudpserv22270-21df_inode00:01:583
66019760,0rudpserv21919-21ntp_states23:22:063
66019760,0rudpserv21473-21df_inode23:06:593
66019760,0rudpserv21127-21sh00:00:243
66019760,0rudpserv20562-21perl23:41:593
66019760,0rudpserv202342sleep323:05:313
4160,0ktimersoftd/00-21swapper/021:53:560
35160,0ktimersoftd/30-21swapper/321:53:563
35160,0ktimersoftd/30-21swapper/300:10:073
339960,0migration/33744-21fschecks_time22:57:043
339960,0migration/329552-21sh22:33:243
339960,0migration/31818-21sh21:26:463
339960,0migration/311115-21sh20:53:213
28015060,0irq/29-eth0-tx-9516-21munin-node20:12:070
28005060,0irq/28-eth0-rx-8973-21irqstats21:12:043
28005060,0irq/28-eth0-rx-24914-21taskset23:26:473
28005060,0irq/28-eth0-rx-18750-21diskstats22:12:003
28005060,0irq/28-eth0-rx-13918-21perl19:52:013
28005060,0irq/28-eth0-rx-10813-21ntp_states23:52:053
27160,0ktimersoftd/20-21swapper/221:53:562
19160,0ktimersoftd/10-21swapper/121:53:561
168749960,0cyclictest0-21swapper/221:37:142
168739960,0cyclictest0-21swapper/123:52:171
149960,0migration/06070-21runrttasks22:37:530
66019750,0rudpserv2543-21grep23:31:573
339950,0migration/37802-21gltestperf23:17:013
339950,0migration/34389-21cpuspeed_turbos22:21:583
339950,0migration/330730-21kthreadcore22:52:053
339950,0migration/328409-21fschecks_time19:17:003
339950,0migration/327978-21kthreadcore18:52:043
339950,0migration/323835-21kthreadcore19:57:123
339950,0migration/323571-21taskset21:56:493
339950,0migration/322918-21kthreadcore21:37:043
339950,0migration/321328-21munin-node20:42:043
339950,0migration/320306-21kthreadcore18:47:043
339950,0migration/314741-21irqrtprio22:27:053
339950,0migration/313878-21idleruntime20:57:043
329950,0watchdog/35563-21perf20:31:443
329950,0watchdog/328572-21munin-node20:47:043
329950,0watchdog/317568-21iostat_ios21:17:043
329950,0watchdog/317260-21fschecks_time20:17:013
329950,0watchdog/313650-21sed19:06:573
329950,0watchdog/311195-21cpuspeed_turbos21:32:003
329950,0watchdog/310946-21kthreadcore19:47:053
28015050,0irq/29-eth0-tx-32677-21wget22:01:592
28015050,0irq/29-eth0-tx-32205-21perl22:36:582
28015050,0irq/29-eth0-tx-28281-21cat22:52:042
28015050,0irq/29-eth0-tx-23824-21munin-node20:22:050
28015050,0irq/29-eth0-tx-23663-21munin-node21:57:122
28015050,0irq/29-eth0-tx-1913-21munin-node21:27:022
28015050,0irq/29-eth0-tx-12886-21munin-node20:57:092
28015050,0irq/29-eth0-tx-0-21swapper/323:37:453
28015050,0irq/29-eth0-tx-0-21swapper/222:30:252
28015050,0irq/29-eth0-tx-0-21swapper/222:12:002
28015050,0irq/29-eth0-tx-0-21swapper/221:36:442
28015050,0irq/29-eth0-tx-0-21swapper/221:23:192
28015050,0irq/29-eth0-tx-0-21swapper/220:55:042
28015050,0irq/29-eth0-tx-0-21swapper/019:17:100
28015050,0irq/29-eth0-tx-0-21swapper/018:47:110
28005050,0irq/28-eth0-rx-8855-21ssh22:06:253
28005050,0irq/28-eth0-rx-27252-21kthreadcore21:22:033
28005050,0irq/28-eth0-rx-25476-21grep21:02:053
28005050,0irq/28-eth0-rx-13406-21seq22:07:053
28005050,0irq/28-eth0-rx-12615-21tr22:42:023
28005050,0irq/28-eth0-rx-0-21swapper/322:36:543
28005050,0irq/28-eth0-rx-0-21swapper/322:20:023
28005050,0irq/28-eth0-rx-0-21swapper/321:46:593
28005050,0irq/28-eth0-rx-0-21swapper/321:44:053
28005050,0irq/28-eth0-rx-0-21swapper/321:07:303
28005050,0irq/28-eth0-rx-0-21swapper/300:12:093
259950,0migration/28801-21unixbench_multi20:07:122
259950,0migration/28320-21kthreadcore19:02:032
259950,0migration/26812-21fschecks_time19:47:002
259950,0migration/231275-21latency_hist18:56:452
259950,0migration/225532-21sh22:50:502
259950,0migration/221791-21sh21:01:512
259950,0migration/219972-21latency_hist20:41:442
259950,0migration/212043-21munin-node21:47:142
259950,0migration/211817-21latency_hist23:01:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional