You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-06 - 05:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems

x86 Intel Atom E3825 @1333 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rackbslot6s.osadl.org (updated Wed Jul 06, 2022 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911050,4ptp4l241ktimersoftd/100:59:041
3272591940,2ptp4l241ktimersoftd/103:19:311
3272591940,1ptp4l241ktimersoftd/106:03:401
3272591940,1ptp4l241ktimersoftd/105:18:301
3272591940,1ptp4l241ktimersoftd/103:43:451
3272591920,1ptp4l241ktimersoftd/104:08:111
3272591870,2ptp4l241ktimersoftd/104:03:281
3272591870,2ptp4l241ktimersoftd/103:06:391
3272591850,1ptp4l241ktimersoftd/105:37:011
3272591830,1ptp4l241ktimersoftd/104:32:181
132452790,8sleep11889599cyclictest02:03:251
1889599750,8cyclictest19463-21ssh04:40:081
3272591720,1ptp4l241ktimersoftd/106:10:171
1889599680,6cyclictest10208-21diskstats03:08:231
3272591670,1ptp4l241ktimersoftd/103:14:111
1889599669,29cyclictest197-21systemd-journal05:39:561
1889599660,7cyclictest19593-21ssh03:59:071
1889599660,7cyclictest16504-21ssh05:57:171
1889599660,6cyclictest20991-21munin-run02:23:061
1889599656,33cyclictest22759-21snmp_o5powerctl05:23:381
1889599653,34cyclictest655-21snmp_o5powerctl02:48:381
1889599653,34cyclictest13479-21apt-get04:33:191
1889599652,35cyclictest28697-21apt-get06:13:151
18895996512,30cyclictest16457-21ssh05:16:471
18895996510,28cyclictest30106-21ssh03:33:111
1889599650,8cyclictest30982-21snmp_o5powerctl02:43:381
1889599650,6cyclictest6701-21perl01:48:221
1889599650,6cyclictest24474-21ssh03:25:271
1889599650,4cyclictest28369-21ssh04:51:361
1889599648,30cyclictest6618-21snmp_o5powerctl05:03:391
1889599644,37cyclictest3314-21snmp_o5powerctl01:38:371
1889599644,34cyclictest17174-21diskstats02:13:211
1889599644,34cyclictest1262-21apt-get04:58:211
1889599644,31cyclictest8872-21apt-get06:28:221
1889599643,38cyclictest25602-21apt-get02:33:171
1889599643,35cyclictest31501-21snmp_o5powerctl01:28:341
1889599642,35cyclictest1204-21snmp_o5powerctl01:33:361
18895996413,27cyclictest17308-21ssh03:57:491
1889599640,6cyclictest29348-21snmp_o5powerctl01:23:331
1889599636,29cyclictest23754-21ssh04:45:291
1889599633,32cyclictest29782-21apt-get04:13:181
1889599632,36cyclictest6777-21snmp_o5powerctl04:23:481
1889599632,36cyclictest2025-21diskstats03:38:221
1889599632,36cyclictest17168-21apt-get05:58:201
1889599632,36cyclictest11386-21users03:48:441
1889599632,33cyclictest27972-21munin-run01:23:051
1889599631,40cyclictest30900-21snmp_o5powerctl04:53:421
1889599631,36cyclictest2670-21snmp_o5powerctl04:18:361
1889599630,6cyclictest22363-21snmp_o5powerctl02:23:341
1889599630,4cyclictest5627-21diskmemload05:10:561
1889599625,32cyclictest14853-21apt-get02:08:181
1889599623,32cyclictest4680-21hddtemp_smartct01:43:221
1889599623,32cyclictest4680-21hddtemp_smartct01:43:221
1889599623,30cyclictest1636-21apt-get02:53:181
1889599622,36cyclictest793-21ssh06:18:211
1889599622,35cyclictest29928-21munin-run03:33:071
1889599622,35cyclictest20564-21users01:03:401
1889599622,34cyclictest6502-21snmp_o5powerctl05:43:391
1889599622,34cyclictest24154-21df01:13:191
1889599622,34cyclictest23000-21snmp_o5powerctl01:08:361
1889599622,33cyclictest9321-21apt-get05:48:201
1889599622,33cyclictest26846-21snmp_o5powerctl05:28:431
1889599622,32cyclictest4890-21python02:58:331
1889599622,32cyclictest23474-21apt-get02:28:181
1889599621,34cyclictest9662-21python01:53:311
1889599613,31cyclictest27883-21df02:38:191
1889599612,35cyclictest11436-21memory01:58:281
1889599612,33cyclictest5318-21hddtemp_smartct06:23:291
1889499559,10cyclictest9-21ksoftirqd/003:33:570
18894995410,6cyclictest25767-21apt-get04:08:200
188142514,34sleep00-21swapper/001:02:490
1889499509,9cyclictest9-21ksoftirqd/006:16:010
1889499509,9cyclictest9-21ksoftirqd/004:08:030
1889499509,6cyclictest9-21ksoftirqd/006:11:140
1889499509,6cyclictest9-21ksoftirqd/004:27:260
1889499509,6cyclictest9-21ksoftirqd/003:10:530
1889499509,10cyclictest9-21ksoftirqd/003:27:060
1889499508,9cyclictest9-21ksoftirqd/004:47:050
1889499506,5cyclictest9-21ksoftirqd/005:20:360
1889499505,8cyclictest101ktimersoftd/001:53:390
18894995010,6cyclictest25528-21apt-get05:28:200
1889499499,9cyclictest9-21ksoftirqd/006:18:170
1889499499,9cyclictest9-21ksoftirqd/006:05:430
1889499499,9cyclictest9-21ksoftirqd/005:52:410
1889499499,9cyclictest9-21ksoftirqd/005:33:260
1889499499,9cyclictest9-21ksoftirqd/005:14:060
1889499499,6cyclictest9-21ksoftirqd/005:25:190
1889499499,6cyclictest9-21ksoftirqd/004:56:490
1889499499,6cyclictest9-21ksoftirqd/003:49:310
1889499498,9cyclictest9-21ksoftirqd/006:02:400
1889499498,9cyclictest9-21ksoftirqd/003:53:110
1889499498,9cyclictest9-21ksoftirqd/003:22:290
1889499498,9cyclictest9-21ksoftirqd/003:14:220
1889499498,10cyclictest9-21ksoftirqd/004:32:480
1889499498,10cyclictest9-21ksoftirqd/004:00:550
18894994918,8cyclictest9-21ksoftirqd/003:29:070
1889499489,9cyclictest9-21ksoftirqd/004:15:420
1889499489,5cyclictest9-21ksoftirqd/004:49:070
1889499489,5cyclictest9-21ksoftirqd/003:43:090
1889499488,9cyclictest9-21ksoftirqd/005:56:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional