You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 04:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Atom D510 @1667 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue Jan 31, 2023 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2345991010,5rtkit-daemon2344-21rtkit-daemon19:40:243
2345991010,5rtkit-daemon2344-21rtkit-daemon19:40:243
467799984,9cyclictest25745-21unixbench_multi23:10:312
467799984,9cyclictest25745-21unixbench_multi23:10:312
467799974,70cyclictest0-21swapper/223:35:212
467799935,12cyclictest0-21swapper/222:30:122
467799935,12cyclictest0-21swapper/222:30:122
467799934,13cyclictest0-21swapper/221:20:262
467799924,12cyclictest0-21swapper/221:00:332
4677999215,69cyclictest27406-21cpuspeed_turbos00:25:092
467799914,12cyclictest0-21swapper/223:19:542
4677999114,50cyclictest0-21swapper/219:20:172
467799905,78cyclictest0-21swapper/219:42:102
467799905,78cyclictest0-21swapper/219:42:102
467799904,13cyclictest0-21swapper/221:40:222
467799894,61cyclictest12544-21tail21:35:332
467799894,13cyclictest0-21swapper/219:50:232
467799894,12cyclictest0-21swapper/222:11:122
467799894,12cyclictest0-21swapper/220:54:592
467799894,12cyclictest0-21swapper/200:30:342
467799885,63cyclictest0-21swapper/220:20:192
467799884,62cyclictest0-21swapper/200:22:372
467799884,56cyclictest0-21swapper/219:35:382
467799884,12cyclictest0-21swapper/223:25:202
467799884,12cyclictest0-21swapper/222:50:352
467799884,12cyclictest0-21swapper/222:25:132
467799884,11cyclictest0-21swapper/200:00:152
4677998822,44cyclictest0-21swapper/219:15:362
467799875,11cyclictest1199-21runrttasks20:49:092
467799874,9cyclictest21461-21basename23:04:542
467799874,61cyclictest0-21swapper/219:33:462
467799874,12cyclictest0-21swapper/223:46:202
467799874,12cyclictest0-21swapper/220:40:192
467799864,59cyclictest0-21swapper/220:31:542
467799864,13cyclictest0-21swapper/223:57:292
467799864,13cyclictest0-21swapper/223:57:292
467799864,13cyclictest0-21swapper/222:20:342
467799864,12cyclictest0-21swapper/222:05:342
234599860,7rtkit-daemon0-21swapper/222:35:172
234599860,5rtkit-daemon2344-21rtkit-daemon20:23:303
467799854,64cyclictest0-21swapper/221:50:142
467799854,64cyclictest0-21swapper/221:50:142
467799854,64cyclictest0-21swapper/200:10:142
467799854,12cyclictest0-21swapper/221:25:252
467799854,12cyclictest0-21swapper/219:10:362
4677998520,42cyclictest0-21swapper/200:15:252
467799844,63cyclictest1199-21runrttasks20:00:372
467799844,57cyclictest0-21swapper/222:56:422
467799844,13cyclictest0-21swapper/223:54:402
467799844,12cyclictest0-21swapper/221:14:592
467799843,13cyclictest0-21swapper/222:16:442
4677998418,47cyclictest0-21swapper/220:26:242
4677998418,47cyclictest0-21swapper/220:26:242
4677998416,61cyclictest0-21swapper/221:59:572
4677998412,11cyclictest0-21swapper/220:35:372
467799834,55cyclictest0-21swapper/221:19:432
467799834,12cyclictest0-21swapper/223:07:342
467799834,12cyclictest0-21swapper/222:44:532
467799834,12cyclictest0-21swapper/220:10:302
467799834,12cyclictest0-21swapper/200:05:392
467799834,11cyclictest0-21swapper/222:45:012
467799823,12cyclictest0-21swapper/221:06:062
467799823,12cyclictest0-21swapper/221:06:062
467799814,61cyclictest0-21swapper/220:56:432
467799814,12cyclictest0-21swapper/223:40:402
467799814,12cyclictest0-21swapper/221:48:342
467799813,13cyclictest0-21swapper/220:17:552
4677998012,51cyclictest0-21swapper/222:00:152
4677998012,50cyclictest3143-21crond20:10:002
199942800,7sleep319998-21cut19:35:293
467799794,11cyclictest0-21swapper/223:24:042
467799784,57cyclictest0-21swapper/219:45:162
467799784,10cyclictest11115-21crond21:34:572
234599780,4rtkit-daemon2344-21rtkit-daemon19:12:103
467799774,12cyclictest0-21swapper/223:32:252
467799764,12cyclictest0-21swapper/219:55:362
467799764,12cyclictest0-21swapper/219:09:382
467799755,10cyclictest102350irq/46-eth019:27:562
467799734,62cyclictest4657-21munin-run19:05:042
4676996120,22cyclictest0-21swapper/122:30:241
4676996120,22cyclictest0-21swapper/122:30:241
234599590,5rtkit-daemon0-21swapper/219:50:243
296452583,47sleep129684-21hwlatdetect23:20:181
467699575,35cyclictest0-21swapper/122:07:091
467299574,46cyclictest0-21swapper/022:40:120
4672995734,8cyclictest20576-21munin-run21:54:570
4672995734,8cyclictest20576-21munin-run21:54:570
234599570,4rtkit-daemon2344-21rtkit-daemon20:37:073
314692564,46sleep10-21swapper/121:08:551
314692564,46sleep10-21swapper/121:08:551
246812563,45sleep10-21swapper/100:19:521
234599560,5rtkit-daemon2344-21rtkit-daemon23:34:520
156492563,45sleep00-21swapper/020:35:250
53172558,40sleep30-21swapper/320:12:303
467699553,25cyclictest0-21swapper/100:10:271
4676995523,12cyclictest0-21swapper/121:40:311
234599550,5rtkit-daemon2344-21rtkit-daemon23:50:140
234599550,5rtkit-daemon2344-21rtkit-daemon23:15:310
234599550,5rtkit-daemon2344-21rtkit-daemon23:04:090
234599550,5rtkit-daemon2344-21rtkit-daemon22:57:460
234599550,5rtkit-daemon2344-21rtkit-daemon22:50:240
234599550,5rtkit-daemon2344-21rtkit-daemon22:49:540
234599550,5rtkit-daemon2344-21rtkit-daemon19:04:180
165042553,45sleep10-21swapper/122:52:291
467899545,30cyclictest0-21swapper/320:15:403
4678995435,13cyclictest0-21swapper/319:25:513
234599540,7rtkit-daemon2344-21rtkit-daemon20:26:373
234599540,7rtkit-daemon2344-21rtkit-daemon20:26:373
234599540,5rtkit-daemon2344-21rtkit-daemon00:30:350
121212542,47sleep00-21swapper/020:25:370
121212542,47sleep00-21swapper/020:25:370
94402533,43sleep10-21swapper/121:30:201
467899536,39cyclictest18359-21gltestperf20:40:243
4678995337,10cyclictest28140-21head23:15:343
4678995336,10cyclictest13043-21sed22:45:173
4678995335,11cyclictest1083-21tail22:20:223
4678995322,12cyclictest0-21swapper/322:40:193
4676995333,13cyclictest0-21swapper/121:35:321
4676995317,30cyclictest2645-21timerwakeupswit20:05:411
43652532,11sleep00-21swapper/023:35:210
234599530,5rtkit-daemon2344-21rtkit-daemon23:20:080
234599530,5rtkit-daemon2344-21rtkit-daemon23:10:310
234599530,5rtkit-daemon2344-21rtkit-daemon23:10:310
234599530,5rtkit-daemon2344-21rtkit-daemon19:05:183
234599530,5rtkit-daemon2344-21rtkit-daemon00:15:130
234599530,5rtkit-daemon2344-21rtkit-daemon00:05:210
234599530,5rtkit-daemon2344-21rtkit-daemon00:00:290
232582533,9sleep10-21swapper/119:41:011
232582533,9sleep10-21swapper/119:41:011
212652533,10sleep10-21swapper/123:02:411
467899529,26cyclictest0-21swapper/321:40:283
467899526,39cyclictest1199-21runrttasks21:15:343
467899523,30cyclictest0-21swapper/323:20:183
4678995221,13cyclictest0-21swapper/321:25:363
4678995210,35cyclictest361ktimersoftd/300:00:113
467699524,13cyclictest0-21swapper/123:54:381
4676995222,13cyclictest0-21swapper/120:30:001
4676995222,13cyclictest0-21swapper/120:30:001
270432523,11sleep10-21swapper/100:24:511
23582523,43sleep10-21swapper/122:23:241
234599520,6rtkit-daemon2344-21rtkit-daemon19:20:173
234599520,4rtkit-daemon2344-21rtkit-daemon00:24:280
228502523,9sleep10-21swapper/121:58:411
185332522,43sleep00-21swapper/019:31:040
467899514,29cyclictest0-21swapper/323:00:153
467899514,29cyclictest0-21swapper/321:05:343
467899514,29cyclictest0-21swapper/321:05:343
467899514,29cyclictest0-21swapper/320:30:243
467899513,40cyclictest870-21switchtime21:10:343
4678995121,12cyclictest0-21swapper/321:22:343
4678995119,12cyclictest0-21swapper/322:50:463
467699519,24cyclictest0-21swapper/120:51:571
467699513,42cyclictest0-21swapper/119:37:291
467699513,11cyclictest0-21swapper/123:35:171
4676995122,11cyclictest0-21swapper/119:10:361
4676995120,25cyclictest4434-21cpuspeed_turbos21:20:161
4676995118,10cyclictest30771-21fschecks_count22:15:171
467299514,38cyclictest0-21swapper/020:30:190
467299513,42cyclictest13480-21crond21:39:570
4672995119,13cyclictest0-21swapper/000:10:270
37092514,40sleep10-21swapper/121:16:051
29162512,9sleep30-21swapper/320:07:063
24682512,9sleep00-21swapper/022:24:310
239632512,9sleep30-21swapper/300:15:343
234599510,5rtkit-daemon2344-21rtkit-daemon23:49:520
234599510,5rtkit-daemon2344-21rtkit-daemon23:25:150
234599510,5rtkit-daemon2344-21rtkit-daemon00:25:200
110712512,9sleep30-21swapper/321:34:293
467899506,38cyclictest24434-21turbostat20:54:593
467899505,37cyclictest0-21swapper/322:04:133
467899504,29cyclictest0-21swapper/321:55:253
4678995032,11cyclictest24863-21cpuspeed_turbos20:55:153
467899503,29cyclictest0-21swapper/300:25:293
4678995024,20cyclictest24922-21munin-node00:20:313
4678995021,22cyclictest1143-21snmpd23:32:253
4678995021,12cyclictest0-21swapper/323:10:513
4678995021,12cyclictest0-21swapper/323:10:513
4678995021,12cyclictest0-21swapper/322:05:583
4678995020,13cyclictest0-21swapper/322:30:313
4678995020,13cyclictest0-21swapper/322:30:313
4678995018,13cyclictest0-21swapper/323:59:523
4678995018,13cyclictest0-21swapper/323:59:523
4678995011,34cyclictest361ktimersoftd/300:05:363
467699505,27cyclictest0-21swapper/121:50:231
467699505,27cyclictest0-21swapper/121:50:231
467699504,41cyclictest0-21swapper/122:25:341
467699504,27cyclictest0-21swapper/100:25:171
4676995033,11cyclictest0-21swapper/120:20:341
4676995020,13cyclictest0-21swapper/120:05:011
467299506,38cyclictest4665-21cyclictest23:06:070
467299504,39cyclictest0-21swapper/021:30:210
467299504,39cyclictest0-21swapper/021:10:240
4672995034,10cyclictest27024-21gltestperf19:50:230
467299503,41cyclictest0-21swapper/020:04:210
4672995024,12cyclictest0-21swapper/022:05:400
4672995019,24cyclictest0-21swapper/022:15:250
26892503,40sleep12780-21sed23:30:341
164992502,9sleep00-21swapper/019:30:030
146582503,9sleep10-21swapper/120:30:581
138552502,42sleep00-21swapper/019:21:450
77792494,9sleep10-21swapper/123:40:461
467899499,34cyclictest361ktimersoftd/319:47:363
467899499,33cyclictest361ktimersoftd/323:05:173
467899498,25cyclictest27051-21munin-node21:00:313
467899495,8cyclictest0-21swapper/323:35:113
467899494,37cyclictest0-21swapper/321:50:103
467899494,37cyclictest0-21swapper/321:50:103
467899494,27cyclictest0-21swapper/322:15:303
467899494,27cyclictest0-21swapper/321:48:543
467699495,27cyclictest0-21swapper/119:20:351
4676994922,11cyclictest0-21swapper/100:04:041
4676994920,9cyclictest8756-21munin-run21:29:571
467299494,39cyclictest0-21swapper/019:45:380
467299493,41cyclictest0-21swapper/022:38:570
467299493,28cyclictest0-21swapper/021:20:360
314212492,10sleep00-21swapper/021:08:180
314212492,10sleep00-21swapper/021:08:180
281362493,41sleep10-21swapper/119:52:581
268052493,40sleep10-21swapper/120:59:571
266532492,9sleep00-21swapper/020:57:580
117942493,10sleep10-21swapper/122:42:421
467899484,27cyclictest0-21swapper/323:50:093
467899484,27cyclictest0-21swapper/323:45:213
467899484,27cyclictest0-21swapper/322:55:283
467899484,26cyclictest0-21swapper/300:30:103
4678994820,12cyclictest0-21swapper/300:10:143
4678994819,12cyclictest0-21swapper/319:30:263
467699488,13cyclictest0-21swapper/122:10:191
467699485,12cyclictest837-21crond23:29:531
467699484,26cyclictest0-21swapper/121:04:591
4676994835,8cyclictest7646-21cpuspeed_turbos22:35:161
4676994820,22cyclictest0-21swapper/119:25:251
4672994833,9cyclictest5744-21tune2fs22:30:150
4672994833,9cyclictest5744-21tune2fs22:30:150
4672994832,10cyclictest24021-21grep20:50:370
467299483,40cyclictest0-21swapper/021:19:260
467299483,37cyclictest0-21swapper/022:25:120
4672994821,12cyclictest0-21swapper/021:00:240
227892482,40sleep00-21swapper/021:57:510
197912483,9sleep10-21swapper/100:07:461
173682483,38sleep10-21swapper/122:55:151
75662473,10sleep10-21swapper/120:15:591
54492473,37sleep10-21swapper/120:14:141
467899475,26cyclictest0-21swapper/322:10:273
467899474,37cyclictest0-21swapper/322:28:273
467899474,27cyclictest0-21swapper/323:25:363
467899474,26cyclictest0-21swapper/323:40:323
467899474,26cyclictest0-21swapper/320:45:343
467899474,26cyclictest0-21swapper/320:00:323
467899473,25cyclictest0-21swapper/321:38:543
467699474,25cyclictest0-21swapper/120:41:561
467699473,26cyclictest0-21swapper/119:31:431
4672994731,10cyclictest1733-21sed20:05:270
467299473,38cyclictest0-21swapper/020:45:110
4672994711,13cyclictest0-21swapper/023:40:320
4672994710,31cyclictest0-21swapper/020:20:170
250342473,38sleep00-21swapper/022:01:220
175802472,9sleep00-21swapper/020:40:170
101412473,38sleep10-21swapper/123:45:421
68942463,38sleep10-21swapper/119:08:281
467899464,26cyclictest0-21swapper/319:55:203
4678994631,9cyclictest7644-21tr22:35:163
467699465,25cyclictest0-21swapper/122:45:151
467699464,35cyclictest0-21swapper/123:15:121
467699464,25cyclictest0-21swapper/119:48:471
4672994632,9cyclictest16532-21cut21:45:160
467299463,36cyclictest1143-21snmpd23:55:290
467299463,36cyclictest1143-21snmpd23:55:290
4672994616,25cyclictest7177-21fschecks_count21:25:200
251862463,10sleep10-21swapper/123:10:231
251862463,10sleep10-21swapper/123:10:231
251122463,10sleep10-21swapper/122:02:241
232972462,37sleep00-21swapper/019:41:320
232972462,37sleep00-21swapper/019:41:320
180592463,37sleep10-21swapper/121:48:051
156582462,9sleep00-21swapper/021:42:400
114992463,37sleep10-21swapper/119:16:501
467699453,36cyclictest0-21swapper/121:10:221
4676994526,12cyclictest31400-21unixbench_singl00:30:341
4676994525,13cyclictest0-21swapper/123:05:141
467299454,33cyclictest0-21swapper/019:35:210
467299454,33cyclictest0-21swapper/019:10:220
304662453,37sleep10-21swapper/119:57:171
467899444,27cyclictest0-21swapper/319:15:253
467699444,33cyclictest0-21swapper/120:35:251
467299444,34cyclictest0-21swapper/020:15:220
467299444,34cyclictest0-21swapper/020:10:240
467299444,33cyclictest0-21swapper/022:10:220
4672994416,12cyclictest0-21swapper/019:55:380
31422444,32sleep10-21swapper/119:00:231
467699435,12cyclictest20126-21cpuspeed_turbos20:45:161
4672994324,13cyclictest0-21swapper/019:09:200
4676994223,12cyclictest13215-21cpuspeed_turbos23:55:121
4676994223,12cyclictest13215-21cpuspeed_turbos23:55:121
467299424,32cyclictest0-21swapper/019:15:200
467899379,12cyclictest0-21swapper/319:05:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional