You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-21 - 04:42

x86 Intel Atom Z530 @1600 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of system in rack #1, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot8.osadl.org (updated Tue Mar 21, 2023 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
178489918261773,46cyclictest0-21swapper/019:34:200
177422815796,12sleep10-21swapper/119:09:221
1784899514435,68cyclictest0-21swapper/019:10:030
17849994714,447cyclictest0-21swapper/119:10:031
1784999450407,29cyclictest0-21swapper/119:34:201
211999960,4rtkit-daemon2118-21rtkit-daemon23:12:380
1778529314,32sleep00-21swapper/019:09:480
1784899924,77cyclictest29417-21yumBackend.py19:44:330
1784999835,29cyclictest29417-21yumBackend.py19:44:351
1784999795,29cyclictest0-21swapper/121:11:581
1784999786,27cyclictest0-21swapper/122:50:131
1784999785,33cyclictest0-21swapper/123:04:231
17849997814,19cyclictest0-21swapper/119:28:041
211999770,4rtkit-daemon2118-21rtkit-daemon21:53:121
1784999779,21cyclictest0-21swapper/123:55:181
1784999778,26cyclictest0-21swapper/121:20:301
1784999777,19cyclictest0-21swapper/120:45:201
1784999767,27cyclictest0-21swapper/100:09:581
1784999767,27cyclictest0-21swapper/100:09:571
1784999766,29cyclictest0-21swapper/122:56:431
1784999766,28cyclictest0-21swapper/122:00:051
1784999766,28cyclictest0-21swapper/121:42:381
1784999766,15cyclictest0-21swapper/123:31:431
1784999765,17cyclictest0-21swapper/123:41:471
17849997619,14cyclictest0-21swapper/122:11:221
1784899763,66cyclictest32629-21grep21:20:300
1784899763,66cyclictest0-21swapper/022:30:010
1784999757,29cyclictest0-21swapper/121:39:551
1784999757,18cyclictest0-21swapper/119:50:181
1784999756,29cyclictest0-21swapper/123:17:091
1784999756,29cyclictest0-21swapper/123:17:081
1784999756,28cyclictest0-21swapper/123:38:531
1784999756,28cyclictest0-21swapper/122:47:381
1784999756,27cyclictest0-21swapper/100:33:211
1784999756,26cyclictest0-21swapper/122:24:471
1784999756,25cyclictest0-21swapper/121:33:381
1784999756,18cyclictest0-21swapper/100:01:141
17849997517,17cyclictest0-21swapper/100:15:301
1784899754,54cyclictest26666-21sshd21:10:290
1784999747,27cyclictest0-21swapper/123:11:531
1784999747,20cyclictest0-21swapper/121:55:221
1784999747,20cyclictest0-21swapper/119:40:021
1784999746,31cyclictest0-21swapper/122:15:221
1784999746,27cyclictest0-21swapper/100:29:191
1784999746,26cyclictest0-21swapper/122:36:561
1784999746,26cyclictest0-21swapper/122:34:331
1784999745,28cyclictest0-21swapper/122:08:381
1784999745,28cyclictest0-21swapper/100:11:051
17849997418,14cyclictest0-21swapper/122:45:011
17849997417,16cyclictest0-21swapper/123:06:431
17849997415,15cyclictest0-21swapper/100:20:051
1784899743,41cyclictest315-21munin-run19:55:000
1784999737,33cyclictest0-21swapper/100:37:551
1784999737,26cyclictest0-21swapper/120:39:101
1784999737,19cyclictest0-21swapper/120:10:261
1784999736,27cyclictest0-21swapper/121:27:111
1784999736,25cyclictest0-21swapper/121:16:021
1784999735,27cyclictest0-21swapper/122:28:031
1784999735,26cyclictest0-21swapper/123:48:271
1784999735,25cyclictest0-21swapper/119:46:181
1784899735,61cyclictest0-21swapper/022:40:290
1784899734,62cyclictest0-21swapper/020:40:590
1784999728,27cyclictest0-21swapper/120:29:221
1784999727,29cyclictest0-21swapper/123:25:261
1784999727,26cyclictest0-21swapper/120:59:311
1784999726,34cyclictest0-21swapper/120:50:201
1784999726,27cyclictest0-21swapper/123:50:241
1784999726,27cyclictest0-21swapper/120:02:591
1784999726,27cyclictest0-21swapper/119:15:251
1784999725,28cyclictest0-21swapper/123:20:171
1784999724,27cyclictest0-21swapper/121:48:001
17849997226,7cyclictest13253-21sshd20:30:281
1784899723,41cyclictest21990-21munin-run21:00:010
1784899723,40cyclictest31919-21ksmtuned23:56:480
1784999717,29cyclictest0-21swapper/120:15:201
1784999716,28cyclictest0-21swapper/120:24:281
1784999715,27cyclictest0-21swapper/120:43:281
1784999715,16cyclictest0-21swapper/120:07:341
17849997114,19cyclictest0-21swapper/121:00:261
17849997110,19cyclictest0-21swapper/120:00:011
1784899712,61cyclictest27267-21gltestperf22:05:200
17848997113,41cyclictest746-21lldpad21:54:150
1784899703,38cyclictest6525-21timerandwakeup23:15:280
1784899703,38cyclictest6525-21timerandwakeup23:15:280
1784899702,60cyclictest9757-21munin-node23:20:300
1784899702,38cyclictest16337-21latency_hist00:25:000
211999690,11rtkit-daemon0-21swapper/119:16:530
17849996910,18cyclictest0-21swapper/121:05:261
1784899696,56cyclictest0-21swapper/023:40:280
1784899693,39cyclictest22532-21munin-run00:35:000
1784899693,39cyclictest14645-21munin-run23:30:000
1784899692,61cyclictest5643-21gltestperf21:30:170
1784899692,6cyclictest30611-21grep19:45:260
1784899692,59cyclictest28209-21unixbench-2d23:50:310
1784999686,27cyclictest0-21swapper/119:20:151
1784899682,59cyclictest1373-21ssh00:00:190
1784899682,41cyclictest10332-21ssh22:30:230
1784899682,39cyclictest9157-21sed20:20:180
1784899675,56cyclictest0-21swapper/021:45:340
1784899675,55cyclictest0-21swapper/000:18:250
1784899673,58cyclictest23915-21seq22:00:100
1784899672,49cyclictest15302-21ssh23:30:270
1784899664,56cyclictest0-21swapper/022:50:250
1784899664,55cyclictest0-21swapper/022:10:150
1784899662,6cyclictest14401-21latency_hist21:45:010
1784899662,58cyclictest18680-21latency_hist20:50:020
1784899662,58cyclictest1442-21runrttasks22:15:220
1784899662,55cyclictest4504-21ssh21:28:220
1784899662,40cyclictest29089-21ssh21:15:240
1784899662,36cyclictest13327-21ssh22:35:200
1784899662,35cyclictest27820-21basename19:40:000
1784899653,56cyclictest32266-21cat23:05:240
1784899653,55cyclictest25617-21munin-node22:55:300
1784899652,57cyclictest9430-21sh00:13:110
1784899652,57cyclictest13010-21switchtime20:30:250
1784899652,56cyclictest28929-21grep23:00:200
1784899652,56cyclictest20785-21munin-node21:55:270
1784899652,36cyclictest12059-21munin-run20:30:010
1784899645,37cyclictest0-21swapper/023:39:250
1784899642,7cyclictest7095-21latency_hist20:15:010
1784899642,56cyclictest22266-21sort22:50:010
1784899642,56cyclictest17598-21grep00:25:320
1784899642,55cyclictest24231-21seq23:45:140
1784899642,37cyclictest1322-21munin-node22:20:370
17848996410,47cyclictest0-21swapper/000:36:040
1784899635,32cyclictest0-21swapper/000:09:430
1784899635,32cyclictest0-21swapper/000:09:430
1784899634,34cyclictest5439-21munin-run20:10:000
1784899632,54cyclictest13863-21awk20:35:110
17848996310,47cyclictest22146-21cpu21:00:140
1784899622,38cyclictest8656-21munin-node21:35:200
1784899612,7cyclictest25370-21latency_hist21:10:010
1784899602,32cyclictest870-21iostat19:55:180
1784899593,50cyclictest8427-21runrttasks20:16:510
1784899592,52cyclictest19422-21munin-node20:50:230
1784899592,51cyclictest23093-21seq19:25:150
1784899583,48cyclictest2480-21gltestperf20:00:170
17848995727,24cyclictest0-21swapper/019:20:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional