You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-07 - 01:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of shadow in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 06, 2022 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
294450570,0irq/25-eth10-21swapper/306:54:203
484323526,0sleep20-21swapper/206:57:582
484623422,0sleep00-21swapper/006:58:000
475723424,0sleep10-21swapper/106:56:571
339970,0migration/326168-21munin-node11:48:483
49709965,0cyclictest32691-21crond08:08:332
49709960,0cyclictest1624-21diskmemload10:05:422
49699966,0cyclictest1624-21diskmemload09:59:451
49699965,0cyclictest2925-21ssh09:55:581
49699960,0cyclictest30726-21ssh11:11:201
49699960,0cyclictest0-21swapper/110:37:541
339960,0migration/327464-21sh09:51:563
339960,0migration/316461-21sh12:00:383
28715060,0irq/26-eth0-rx-4789-21awk10:53:573
28715060,0irq/26-eth0-rx-28869-21fschecks_count09:53:463
28715060,0irq/26-eth0-rx-15388-21cut09:03:523
28715060,0irq/26-eth0-rx-0-21swapper/310:09:593
28715060,0irq/26-eth0-rx-0-21swapper/309:23:293
149960,0migration/031850-21sh11:49:510
149960,0migration/016603-21munin-node09:23:540
8215050,0irq/24-0000:00:13426-21cat10:23:332
49709955,0cyclictest1624-21diskmemload11:36:502
49709955,0cyclictest1624-21diskmemload11:20:262
49709950,0cyclictest0-21swapper/211:38:432
49709950,0cyclictest0-21swapper/211:16:202
49699955,0cyclictest0-21swapper/111:55:471
49699955,0cyclictest0-21swapper/111:25:591
49699955,0cyclictest0-21swapper/111:00:551
49699955,0cyclictest0-21swapper/109:44:271
49699955,0cyclictest0-21swapper/109:18:081
49699950,0cyclictest0-21swapper/112:19:541
49699950,0cyclictest0-21swapper/112:14:421
49699950,0cyclictest0-21swapper/111:34:211
49699950,0cyclictest0-21swapper/109:04:151
49689955,0cyclictest0-21swapper/011:23:480
49689955,0cyclictest0-21swapper/011:13:330
49689955,0cyclictest0-21swapper/011:05:210
49689955,0cyclictest0-21swapper/009:04:450
49689950,0cyclictest0-21swapper/010:48:010
49689950,0cyclictest0-21swapper/008:23:450
339950,0migration/38968-21kthreadcore06:58:523
339950,0migration/36954-21proc_pri11:53:533
339950,0migration/36179-21if_eth1.210:18:503
339950,0migration/332147-21kthreadcore10:13:503
339950,0migration/327955-21kthreadcore08:03:493
339950,0migration/32705-21kthreadcore11:13:503
339950,0migration/324801-21munin-node11:08:503
339950,0migration/323987-21kthreadcore08:48:493
339950,0migration/323911-21kthreadcore07:33:513
339950,0migration/323844-21latency09:09:083
339950,0migration/320867-21kthreadcore12:23:503
339950,0migration/320823-21sh10:44:423
339950,0migration/320395-21latency_hist08:23:333
339950,0migration/318586-21sh09:45:393
339950,0migration/318377-21latency_hist07:08:343
339950,0migration/315111-21kthreadcore07:28:503
339950,0migration/314144-21fschecks_time10:23:473
339950,0migration/31333-21kthreadcore07:43:493
339950,0migration/313106-21kthreadcore09:23:493
339950,0migration/310712-21taskset09:59:303
329950,0watchdog/38329-21kthreadcore10:58:493
329950,0watchdog/328023-21diskstats08:53:453
329950,0watchdog/323060-21df_inode10:48:453
329950,0watchdog/32298-21munin-node12:13:453
329950,0watchdog/31384-21iostat_ios11:33:493
28725050,0irq/27-eth0-tx-6244-21iceccd07:13:260
28725050,0irq/27-eth0-tx-3958-21ssh09:58:202
28725050,0irq/27-eth0-tx-3128-21ssh10:14:152
28725050,0irq/27-eth0-tx-27335-21ntp_offset10:28:532
28725050,0irq/27-eth0-tx-25372-21munin-node11:48:502
28725050,0irq/27-eth0-tx-21713-21ntp_offset11:23:522
28725050,0irq/27-eth0-tx-20566-21grep09:28:492
28725050,0irq/27-eth0-tx-1861-21ssh08:58:390
28725050,0irq/27-eth0-tx-17927-21ssh12:03:372
28725050,0irq/27-eth0-tx-10123-21ssh10:58:492
28725050,0irq/27-eth0-tx-0-21swapper/212:23:502
28725050,0irq/27-eth0-tx-0-21swapper/008:11:110
28725050,0irq/27-eth0-tx-0-21swapper/007:43:440
28725050,0irq/27-eth0-tx-0-21swapper/007:06:110
28715050,0irq/26-eth0-rx-32433-21cut10:33:513
28715050,0irq/26-eth0-rx-31704-21nfs4_client12:08:523
28715050,0irq/26-eth0-rx-22842-21taskset11:25:133
28715050,0irq/26-eth0-rx-21813-21kthreadcore09:28:503
28715050,0irq/26-eth0-rx-20082-21kthreadcore11:03:513
28715050,0irq/26-eth0-rx-18988-21sh10:04:263
28715050,0irq/26-eth0-rx-0-21swapper/312:03:533
28715050,0irq/26-eth0-rx-0-21swapper/311:43:333
28715050,0irq/26-eth0-rx-0-21swapper/311:38:463
28715050,0irq/26-eth0-rx-0-21swapper/311:28:463
28715050,0irq/26-eth0-rx-0-21swapper/310:39:453
28715050,0irq/26-eth0-rx-0-21swapper/310:32:543
28715050,0irq/26-eth0-rx-0-21swapper/309:40:383
28715050,0irq/26-eth0-rx-0-21swapper/309:33:523
28715050,0irq/26-eth0-rx-0-21swapper/309:14:323
28715050,0irq/26-eth0-rx-0-21swapper/309:00:113
27150,0ktimersoftd/20-21swapper/212:01:002
259950,0migration/220175-21dump-pmu-power08:23:282
259950,0migration/214340-21latency_hist10:43:332
259950,0migration/212944-21taskset10:22:482
259950,0migration/210687-21kthreadcore07:48:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional