You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-29 - 08:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed May 29, 2024 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
242299960,5rtkit-daemon2421-21rtkit-daemon17:18:333
12840999338,48cyclictest2014-21gltestperf17:33:180
1284099884,12cyclictest0-21swapper/019:58:160
12844998535,42cyclictest28453-21grep21:38:012
12840998519,13cyclictest0-21swapper/019:43:220
12844998436,40cyclictest27276-21idleruntime-cro20:32:462
12844998336,27cyclictest1286-21runrttasks19:58:162
12844998333,33cyclictest3652-21runrttasks18:39:002
12844998124,47cyclictest0-21swapper/221:27:452
12844997930,42cyclictest0-21swapper/220:47:562
12844997828,42cyclictest0-21swapper/219:53:092
12844997828,34cyclictest0-21swapper/221:07:552
12844997828,34cyclictest0-21swapper/221:07:552
12844997737,32cyclictest19953-21grep17:03:412
12844997726,44cyclictest0-21swapper/220:23:022
12844997726,43cyclictest0-21swapper/219:23:152
12844997726,42cyclictest0-21swapper/219:43:102
12844997635,20cyclictest1286-21runrttasks20:13:132
12844997632,36cyclictest21657-21crond19:17:482
12844997629,39cyclictest0-21swapper/220:43:012
12844997627,42cyclictest0-21swapper/217:23:232
12844997627,33cyclictest0-21swapper/218:13:172
12844997527,33cyclictest0-21swapper/220:53:292
12844997429,38cyclictest200272sleep221:19:412
12844997426,30cyclictest0-21swapper/221:03:512
12844997333,33cyclictest20985-21grep17:08:102
12844997332,33cyclictest25437-21latency_hist17:17:532
12844997330,36cyclictest0-21swapper/217:18:032
12844997328,29cyclictest9376-21processes20:58:222
12844997326,40cyclictest0-21swapper/218:48:072
12844997325,27cyclictest19143-21munin-run19:12:492
12844997323,42cyclictest0-21swapper/220:03:062
12844997321,46cyclictest0-21swapper/216:58:082
12844997321,44cyclictest0-21swapper/221:58:052
12844997321,44cyclictest0-21swapper/221:58:052
12844997321,33cyclictest0-21swapper/218:03:162
12844997319,46cyclictest0-21swapper/217:31:452
12844997233,11cyclictest5375-21timerwakeupswit17:38:352
12844997233,11cyclictest5375-21timerwakeupswit17:38:352
12844997224,41cyclictest0-21swapper/218:33:292
12844997223,32cyclictest0-21swapper/220:18:062
12844997223,32cyclictest0-21swapper/220:18:062
12844997219,44cyclictest0-21swapper/219:28:282
12844997146,19cyclictest0-21swapper/218:28:182
12844997146,19cyclictest0-21swapper/218:28:182
12844997131,12cyclictest31191-21interrupts20:38:092
12844997130,32cyclictest15230-21timerandwakeup22:13:242
12844997123,40cyclictest0-21swapper/221:43:272
12844997123,31cyclictest9265-21munin-node18:52:582
12844997123,26cyclictest0-21swapper/220:33:142
12844997119,44cyclictest0-21swapper/219:03:212
12844997028,34cyclictest8456-21munin-node22:03:162
12844997026,37cyclictest0-21swapper/217:53:072
12844997015,49cyclictest0-21swapper/218:18:132
12844996948,15cyclictest0-21swapper/218:23:212
12844996935,27cyclictest14352-21fschecks_count17:58:122
12844996923,31cyclictest18767-21munin-node18:08:042
12844996837,24cyclictest17042-21grep22:18:052
12844996827,17cyclictest1286-21runrttasks21:35:552
12844996826,34cyclictest1286-21runrttasks16:57:552
12844996826,34cyclictest1286-21runrttasks16:57:552
12844996823,31cyclictest0-21swapper/222:07:552
12844996818,43cyclictest0-21swapper/221:23:062
12844996818,30cyclictest0-21swapper/218:44:122
146772670,13sleep01284099cyclictest19:03:080
12844996730,19cyclictest10943-21munin-run17:52:522
12844996727,33cyclictest0-21swapper/219:38:012
12844996727,21cyclictest0-21swapper/218:59:392
12844996716,31cyclictest0-21swapper/220:08:292
12844996637,22cyclictest7960-21grep17:43:312
12844996619,40cyclictest0-21swapper/217:33:242
12844996527,14cyclictest0-21swapper/221:53:192
12844996522,36cyclictest0-21swapper/219:33:102
12844996519,39cyclictest21890-21munin-node19:18:232
12844996519,39cyclictest21890-21munin-node19:18:232
12844996435,22cyclictest17745-21crond21:17:442
12844996435,22cyclictest17745-21crond21:17:442
12844996338,19cyclictest1715-21grep21:48:052
224762624,50sleep30-21swapper/319:18:073
224762624,50sleep30-21swapper/319:18:073
12844996239,16cyclictest0-21swapper/216:52:542
12844996126,28cyclictest0-21swapper/219:48:242
242299590,6rtkit-daemon0-21swapper/222:09:513
199302593,12sleep30-21swapper/318:08:183
150522593,47sleep30-21swapper/320:08:013
12843995827,9cyclictest3344-21latency_hist17:37:531
242299570,6rtkit-daemon0-21swapper/222:05:293
1284599573,12cyclictest0-21swapper/318:38:323
1284399579,40cyclictest0-21swapper/117:07:541
26802563,8sleep32791-21timerandwakeup17:33:353
1284399564,35cyclictest0-21swapper/117:27:521
12843995613,35cyclictest0-21swapper/121:08:041
12843995613,35cyclictest0-21swapper/121:08:041
1284099564,44cyclictest0-21swapper/020:38:240
273772544,43sleep00-21swapper/019:28:030
182502543,44sleep10-21swapper/118:04:131
13542544,43sleep00-21swapper/021:48:010
1284599544,30cyclictest0-21swapper/317:07:543
12845995422,13cyclictest0-21swapper/320:17:473
1284399545,29cyclictest0-21swapper/119:48:231
1284399544,43cyclictest0-21swapper/118:37:501
12843995434,14cyclictest0-21swapper/118:28:051
12843995434,14cyclictest0-21swapper/118:28:051
12843995432,15cyclictest0-21swapper/117:08:371
12843995429,12cyclictest0-21swapper/117:50:581
1284099545,30cyclictest0-21swapper/020:13:130
1284099543,44cyclictest0-21swapper/020:08:250
199352533,10sleep10-21swapper/120:17:581
199352533,10sleep10-21swapper/120:17:581
1284599535,25cyclictest0-21swapper/320:18:003
1284599535,25cyclictest0-21swapper/320:18:003
12845995336,11cyclictest13944-21gltestperf21:08:063
12845995336,11cyclictest13944-21gltestperf21:08:063
1284399539,38cyclictest0-21swapper/118:57:501
12843995335,11cyclictest13068-21unixbench_multi17:53:471
12843995331,14cyclictest0-21swapper/117:22:531
12843995325,8cyclictest3175-21latency_hist21:52:431
1284099534,21cyclictest0-21swapper/018:38:310
296652522,44sleep00-21swapper/020:36:070
239012522,43sleep00-21swapper/019:19:170
239012522,43sleep00-21swapper/019:19:170
226892523,9sleep30-21swapper/321:26:283
1284599524,29cyclictest0-21swapper/321:03:263
1284599524,28cyclictest0-21swapper/318:03:243
1284599523,35cyclictest0-21swapper/319:15:333
12845995219,15cyclictest0-21swapper/320:28:053
1284399524,40cyclictest0-21swapper/120:58:291
1284399524,31cyclictest0-21swapper/122:02:511
1284399524,29cyclictest0-21swapper/117:28:311
12843995232,15cyclictest0-21swapper/119:33:001
12843995231,14cyclictest0-21swapper/119:44:161
12843995225,8cyclictest12216-21cat20:02:471
12843995220,13cyclictest0-21swapper/116:58:051
12843995218,14cyclictest0-21swapper/118:23:331
12843995218,11cyclictest0-21swapper/120:32:461
12843995216,26cyclictest0-21swapper/118:13:011
317872512,41sleep00-21swapper/017:28:200
174832512,9sleep30-21swapper/321:14:233
174832512,9sleep30-21swapper/321:14:233
13102513,9sleep31374-21timerwakeupswit19:38:343
1284599518,22cyclictest0-21swapper/318:13:033
1284599515,28cyclictest0-21swapper/321:38:143
1284599514,29cyclictest0-21swapper/320:43:053
1284599514,29cyclictest0-21swapper/319:43:023
1284599514,29cyclictest0-21swapper/319:33:133
1284599514,28cyclictest0-21swapper/321:00:163
1284599514,28cyclictest0-21swapper/317:43:033
1284599514,28cyclictest0-21swapper/317:38:153
1284599514,28cyclictest0-21swapper/317:38:153
1284599514,27cyclictest0-21swapper/316:58:073
12845995135,10cyclictest23406-21grep20:23:093
1284599513,11cyclictest0-21swapper/318:53:193
12845995120,13cyclictest0-21swapper/322:18:043
12845995120,13cyclictest0-21swapper/318:48:183
1284399518,21cyclictest17491-21taskset22:18:161
1284399517,23cyclictest9002-21snmpd18:49:081
1284399514,28cyclictest0-21swapper/119:55:051
1284399514,28cyclictest0-21swapper/119:08:311
1284399514,28cyclictest0-21swapper/118:58:381
12843995135,8cyclictest30468-21df_abs20:37:591
1284399513,24cyclictest29316-21sed20:33:271
12843995129,13cyclictest0-21swapper/120:03:001
12843995119,13cyclictest0-21swapper/122:10:281
316752503,9sleep10-21swapper/121:43:151
1284599504,28cyclictest0-21swapper/322:13:213
1284599504,28cyclictest0-21swapper/321:28:103
1284599504,28cyclictest0-21swapper/320:53:263
1284599504,28cyclictest0-21swapper/320:48:263
1284599504,28cyclictest0-21swapper/320:03:153
1284599504,28cyclictest0-21swapper/319:22:583
1284599504,28cyclictest0-21swapper/319:03:303
1284599504,28cyclictest0-21swapper/318:18:183
1284599504,27cyclictest0-21swapper/319:58:093
1284599504,27cyclictest0-21swapper/319:57:473
1284599504,27cyclictest0-21swapper/317:48:003
1284599504,13cyclictest0-21swapper/317:57:523
1284599504,11cyclictest0-21swapper/318:43:023
1284399505,26cyclictest0-21swapper/121:42:431
1284399504,28cyclictest0-21swapper/120:50:141
1284399504,28cyclictest0-21swapper/118:18:151
1284399504,27cyclictest0-21swapper/121:25:201
1284399504,25cyclictest0-21swapper/122:12:551
12843995032,11cyclictest27367-21grep21:33:261
12843995031,14cyclictest0-21swapper/117:44:211
1284399503,26cyclictest0-21swapper/121:18:161
12843995026,16cyclictest0-21swapper/121:28:091
12843995022,21cyclictest0-21swapper/118:12:511
12843995015,12cyclictest0-21swapper/119:25:011
12843995014,13cyclictest0-21swapper/121:53:181
37882493,40sleep10-21swapper/118:40:451
250462492,40sleep00-21swapper/021:29:190
1284599494,28cyclictest0-21swapper/321:33:283
1284599494,28cyclictest0-21swapper/319:49:163
1284599494,27cyclictest0-21swapper/321:55:253
1284599494,27cyclictest0-21swapper/318:33:333
1284599494,27cyclictest0-21swapper/317:13:333
1284599494,27cyclictest0-21swapper/316:53:243
1284599494,27cyclictest0-21swapper/316:53:243
12845994931,11cyclictest28469-21gltestperf20:33:083
1284599493,28cyclictest0-21swapper/318:23:263
12845994919,12cyclictest0-21swapper/317:58:023
1284399495,26cyclictest0-21swapper/122:00:261
1284399495,26cyclictest0-21swapper/122:00:261
1284399494,26cyclictest0-21swapper/120:15:081
12843994930,11cyclictest4598-21gltestperf17:38:151
12843994930,11cyclictest4598-21gltestperf17:38:151
1284399493,26cyclictest0-21swapper/119:28:291
1284399493,25cyclictest0-21swapper/119:40:031
1284399493,25cyclictest0-21swapper/119:18:261
1284399493,25cyclictest0-21swapper/119:18:261
1284099493,39cyclictest0-21swapper/021:33:050
12840994928,14cyclictest0-21swapper/020:43:080
107892492,42sleep00-21swapper/017:51:020
298452487,35sleep00-21swapper/017:23:370
277232482,40sleep00-21swapper/017:19:500
1284599484,12cyclictest0-21swapper/319:28:223
1284599483,27cyclictest0-21swapper/321:18:183
1284599483,27cyclictest0-21swapper/319:09:583
1284399484,37cyclictest0-21swapper/119:07:501
1284399484,23cyclictest0-21swapper/118:43:081
1284399483,25cyclictest0-21swapper/120:53:121
12840994822,20cyclictest0-21swapper/019:52:570
68952472,39sleep00-21swapper/019:50:320
302482472,39sleep00-21swapper/021:41:080
285632472,39sleep00-21swapper/018:26:450
269622472,39sleep00-21swapper/020:28:500
200702472,38sleep00-21swapper/017:03:450
176032472,39sleep00-21swapper/016:59:300
162382472,38sleep00-21swapper/018:02:550
149392472,39sleep00-21swapper/021:09:080
149392472,39sleep00-21swapper/021:09:080
132022472,40sleep00-21swapper/017:54:120
1284599474,28cyclictest0-21swapper/321:50:243
1284599474,27cyclictest0-21swapper/320:37:543
1284599474,26cyclictest0-21swapper/318:58:093
1284599473,27cyclictest0-21swapper/317:30:093
1284599473,26cyclictest0-21swapper/317:27:533
1284399474,36cyclictest0-21swapper/117:13:071
1284399474,35cyclictest0-21swapper/117:58:111
12843994730,10cyclictest15832-21gltestperf20:08:101
1284399473,23cyclictest0-21swapper/120:23:091
12843994718,10cyclictest0-21swapper/119:13:291
1284099474,27cyclictest0-21swapper/022:13:240
1284099474,26cyclictest0-21swapper/017:08:430
83312462,38sleep00-21swapper/017:46:540
49882462,38sleep00-21swapper/020:51:110
41682462,37sleep00-21swapper/017:38:120
41682462,37sleep00-21swapper/017:38:120
225182462,37sleep00-21swapper/018:13:190
213612465,35sleep00-21swapper/019:14:010
138032462,38sleep00-21swapper/018:59:140
1284599464,26cyclictest0-21swapper/317:08:073
1284399464,35cyclictest0-21swapper/121:13:081
1284399464,35cyclictest0-21swapper/121:13:081
12843994627,13cyclictest0-21swapper/120:42:561
12840994633,8cyclictest24845-21grep18:18:140
12840994631,9cyclictest19097-21cut18:08:040
1284099463,35cyclictest13604-21df16:53:100
1284099463,35cyclictest13604-21df16:53:100
89852452,37sleep00-21swapper/018:52:240
308992452,37sleep00-21swapper/018:29:150
308992452,37sleep00-21swapper/018:29:150
265762453,36sleep00-21swapper/019:26:140
175692452,37sleep00-21swapper/021:15:290
175692452,37sleep00-21swapper/021:15:290
12845994529,10cyclictest29231-21tr18:28:043
12845994529,10cyclictest29231-21tr18:28:043
12845994528,11cyclictest6952-21gltestperf21:58:073
12845994528,11cyclictest6952-21gltestperf21:58:073
1284399454,34cyclictest0-21swapper/121:03:121
1284399454,33cyclictest0-21swapper/116:53:191
1284399454,33cyclictest0-21swapper/116:53:191
1284099454,35cyclictest0-21swapper/022:02:420
1284099454,35cyclictest0-21swapper/022:02:420
1284099454,34cyclictest8785-21tr22:02:540
1284099453,34cyclictest0-21swapper/022:17:540
12840994521,6cyclictest473-21latency_hist21:47:430
1284099452,38cyclictest0-21swapper/021:07:220
168412442,34sleep00-21swapper/019:07:560
1284099445,33cyclictest0-21swapper/020:23:270
1284099444,34cyclictest0-21swapper/022:08:180
1284099444,33cyclictest0-21swapper/018:53:120
1284099444,12cyclictest0-21swapper/018:43:070
1284099443,35cyclictest0-21swapper/020:03:260
1284099443,12cyclictest0-21swapper/019:38:180
12840994429,9cyclictest21279-21tune2fs21:23:010
12840994410,27cyclictest0-21swapper/017:13:200
12802442,36sleep00-21swapper/018:37:330
1284099435,33cyclictest0-21swapper/017:58:370
1284099434,33cyclictest0-21swapper/019:33:310
1284099433,34cyclictest0-21swapper/021:52:560
1284099433,32cyclictest0-21swapper/016:52:550
12840994328,9cyclictest8732-21tune2fs20:58:080
71222422,35sleep00-21swapper/020:53:280
1284599424,12cyclictest0-21swapper/321:44:123
1284099423,33cyclictest0-21swapper/020:18:280
1284099423,33cyclictest0-21swapper/020:18:280
12840994021,13cyclictest0-21swapper/021:17:580
1284399388,20cyclictest0-21swapper/116:52:551
1284599334,22cyclictest0-21swapper/316:52:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional