You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 09:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of shadow in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 05, 2022 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
294450540,0irq/25-eth10-21swapper/318:58:073
2165723522,0sleep00-21swapper/018:56:440
2159323526,0sleep20-21swapper/218:56:022
2165323324,0sleep10-21swapper/118:56:411
339960,0migration/326722-21sh00:00:313
339960,0migration/32139-21sh21:47:333
339960,0migration/31715-21sh22:25:333
339960,0migration/316450-21sendmail_mailqu21:14:023
339960,0migration/310602-21sh22:33:023
329960,0watchdog/328229-21date23:23:403
28715060,0irq/26-eth0-rx-28888-21cut21:23:573
28715060,0irq/26-eth0-rx-28258-21iostat_ios22:03:563
219089965,0cyclictest12671-21irqcore20:28:552
218989960,0cyclictest0-21swapper/122:45:411
218959966,0cyclictest18724-21diskmemload22:54:420
179960,0migration/111909-21cpuspeed_turbos22:53:521
149960,0migration/021433-21kthreadcore22:38:570
149960,0migration/017335-21sh21:54:280
4150,0ktimersoftd/00-21swapper/023:01:460
4150,0ktimersoftd/00-21swapper/021:13:470
35150,0ktimersoftd/30-21swapper/321:03:503
339950,0migration/38540-21kthreadcore20:48:583
339950,0migration/34762-21kthreadcore19:08:583
339950,0migration/329825-21kthreadcore23:03:563
339950,0migration/328498-21latency_hist23:43:403
339950,0migration/326163-21munin-node23:39:033
339950,0migration/322104-21kthreadcore22:38:573
339950,0migration/322017-21kthreadcore00:18:573
339950,0migration/318422-21kthreadcore19:18:583
339950,0migration/317195-21munin-node19:43:523
339950,0migration/316873-21kthreadcore23:33:573
339950,0migration/31488-21munin-node00:24:003
339950,0migration/310084-21sh22:50:293
329950,0watchdog/39702-21taskset22:10:283
329950,0watchdog/35441-21diskstats20:23:523
329950,0watchdog/319195-21ssh21:18:523
329950,0watchdog/30-21swapper/323:21:403
329950,0watchdog/30-21swapper/323:08:523
329950,0watchdog/30-21swapper/322:13:523
28725050,0irq/27-eth0-tx-23505-21munin-node19:48:520
28725050,0irq/27-eth0-tx-19506-21gltestperf21:18:532
28725050,0irq/27-eth0-tx-18383-21ssh22:36:562
28725050,0irq/27-eth0-tx-10803-21ssh22:13:192
28725050,0irq/27-eth0-tx-10195-21ssh23:09:492
28725050,0irq/27-eth0-tx-0-21swapper/223:22:042
28725050,0irq/27-eth0-tx-0-21swapper/222:55:062
28725050,0irq/27-eth0-tx-0-21swapper/020:48:590
28725050,0irq/27-eth0-tx-0-21swapper/020:46:170
28715050,0irq/26-eth0-rx-9497-21load23:28:583
28715050,0irq/26-eth0-rx-5141-21if_err_eth023:48:563
28715050,0irq/26-eth0-rx-2646-21sed21:28:413
28715050,0irq/26-eth0-rx-19990-21irqcore20:58:573
28715050,0irq/26-eth0-rx-19482-21cut20:33:563
28715050,0irq/26-eth0-rx-1245-21ssh22:44:083
28715050,0irq/26-eth0-rx-11166-21cpuspeed_turbos21:33:533
28715050,0irq/26-eth0-rx-11166-21cpuspeed_turbos21:33:533
28715050,0irq/26-eth0-rx-0-21swapper/323:57:133
28715050,0irq/26-eth0-rx-0-21swapper/323:00:493
28715050,0irq/26-eth0-rx-0-21swapper/321:53:573
28715050,0irq/26-eth0-rx-0-21swapper/320:28:573
28715050,0irq/26-eth0-rx-0-21swapper/300:14:053
28715050,0irq/26-eth0-rx-0-21swapper/300:09:173
28715050,0irq/26-eth0-rx-0-21swapper/300:03:413
27150,0ktimersoftd/20-21swapper/221:03:502
259950,0migration/22785-21sh23:07:062
259950,0migration/225316-21sh21:39:322
259950,0migration/221508-21kthreadcore20:58:582
259950,0migration/221225-21idleruntime23:38:552
259950,0migration/211986-21munin-node21:53:552
259950,0migration/210221-21timerwakeupswit23:49:052
249950,0watchdog/23637-21crond00:08:402
249950,0watchdog/226417-21kthreadcore20:38:562
249950,0watchdog/20-21swapper/222:32:562
219089955,0cyclictest0-21swapper/218:58:592
219089954,0cyclictest18718-21sadc20:58:412
218989955,0cyclictest0-21swapper/122:05:191
218989955,0cyclictest0-21swapper/121:27:201
218989955,0cyclictest0-21swapper/100:12:331
218989950,0cyclictest0-21swapper/123:38:301
218989950,0cyclictest0-21swapper/121:46:051
218959955,0cyclictest0-21swapper/022:18:540
218959950,0cyclictest0-21swapper/023:40:340
218959950,0cyclictest0-21swapper/023:08:060
19150,0ktimersoftd/10-21swapper/123:01:461
179950,0migration/15534-21kthreadcore22:08:571
179950,0migration/13532-21sh23:47:181
179950,0migration/12943-21taskset00:26:571
179950,0migration/127218-21taskset00:01:521
179950,0migration/124613-21munin-node19:48:561
179950,0migration/124500-21munin-node20:59:011
179950,0migration/123539-21munin-node19:23:551
179950,0migration/116302-21kthreadcore23:53:571
169950,0watchdog/129303-21kthreadcore23:03:561
169950,0watchdog/120266-21tr21:18:561
169950,0watchdog/111950-21kthreadcore19:38:571
169950,0watchdog/10-21swapper/120:38:561
149950,0migration/09456-21timerandwakeup19:34:040
149950,0migration/08618-21munin-node22:09:010
149950,0migration/0708-21munin-node22:04:040
149950,0migration/06971-21kthreadcore22:48:570
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional