You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-04 - 01:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Oct 03, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8225992620,1cyclictest18608-21sleep11:55:002
821799250,24cyclictest593-21dbus-daemon09:10:000
8220992424,0cyclictest14463-21apt-get10:41:201
822099240,23cyclictest4383-21awk09:15:001
822099240,23cyclictest15172-21cron08:30:001
821799240,23cyclictest7907-21cron08:15:000
8227992323,0cyclictest0-21swapper/308:31:213
822799230,22cyclictest29958-21apt09:01:223
8225992321,1cyclictest15838-21turbostat.cron07:25:002
822599230,22cyclictest766-21snmpd12:26:212
822599230,22cyclictest24452-21apt-get09:56:222
8220992321,1cyclictest0-21swapper/111:20:011
822099230,22cyclictest593-21dbus-daemon11:25:001
822099230,22cyclictest23809-21perf12:05:011
822099230,22cyclictest13349-21sendmail07:20:001
822099230,1cyclictest0-21swapper/112:15:001
8217992322,0cyclictest16196-21apt-get07:26:220
821799230,22cyclictest31352-21munin-run11:15:010
821799230,22cyclictest26499-21perf10:00:000
8227992220,1cyclictest313-21systemd-journal08:55:013
822799220,21cyclictest7934-21awk08:15:003
822799220,21cyclictest1703-21apt-get11:21:223
822799220,21cyclictest0-21swapper/310:06:223
822799220,21cyclictest0-21swapper/309:21:203
8225992220,1cyclictest32050-21apt-get10:11:222
8225992220,1cyclictest19355-21apt-get11:56:232
822599220,21cyclictest7155-21apt-get09:21:202
822599220,21cyclictest4392-21munin-run09:15:002
822599220,21cyclictest29292-21turbostat.cron10:05:002
822599220,21cyclictest22054-21apt-get09:51:212
822599220,21cyclictest13355-21idleruntime-cro07:20:002
8220992221,1cyclictest0-21swapper/108:25:001
8220992220,1cyclictest21407-21sendmail-msp12:00:011
8220992220,1cyclictest11297-21grep10:35:011
8220992220,1cyclictest0-21swapper/110:55:001
8220992220,1cyclictest0-21swapper/107:41:211
822099220,21cyclictest0-21swapper/110:46:221
822099220,21cyclictest0-21swapper/108:31:211
822099220,21cyclictest0-21swapper/107:51:211
8217992221,0cyclictest0-21swapper/012:31:230
8217992220,1cyclictest9819-21apt-get09:25:020
8217992220,1cyclictest29290-21latency_hist10:05:000
821799220,21cyclictest4737-21apt-get09:16:220
821799220,21cyclictest13100-21apt-get08:26:210
821799220,21cyclictest0-21swapper/010:35:150
821799220,21cyclictest0-21swapper/009:51:210
821799220,21cyclictest0-21swapper/008:36:240
8227992120,1cyclictest21702-21apt-get10:56:213
8227992120,0cyclictest30995-21apt-get12:20:013
8227992119,1cyclictest30998-21turbostat12:20:003
822799210,20cyclictest3488-21apt-get08:06:213
822799210,20cyclictest17950-21apt-get08:36:243
822799210,20cyclictest0-21swapper/309:46:223
822799210,20cyclictest0-21swapper/309:11:233
822799210,20cyclictest0-21swapper/308:21:213
822799210,1cyclictest0-21swapper/309:30:003
822799210,1cyclictest0-21swapper/308:01:213
8225992121,0cyclictest1080-21apt-get08:01:212
8225992121,0cyclictest0-21swapper/211:46:222
8225992120,1cyclictest28951-21apt-get12:16:222
822599210,20cyclictest0-21swapper/212:20:012
822599210,20cyclictest0-21swapper/209:01:222
8220992121,0cyclictest0-21swapper/110:56:221
8220992121,0cyclictest0-21swapper/110:21:211
8220992121,0cyclictest0-21swapper/110:06:221
8220992121,0cyclictest0-21swapper/109:56:221
8220992121,0cyclictest0-21swapper/107:31:211
8220992120,1cyclictest8133-21apt-get07:10:021
8220992120,1cyclictest20361-21apt-get08:41:211
8220992120,0cyclictest0-21swapper/109:36:231
8220992120,0cyclictest0-21swapper/109:25:021
8220992120,0cyclictest0-21swapper/108:11:201
822099210,21cyclictest0-21swapper/110:11:221
822099210,20cyclictest0-21swapper/111:46:221
822099210,20cyclictest0-21swapper/111:36:231
822099210,20cyclictest0-21swapper/107:26:221
822099210,0cyclictest0-21swapper/111:40:021
8217992121,0cyclictest0-21swapper/010:06:220
8217992121,0cyclictest0-21swapper/007:31:220
8217992121,0cyclictest0-21swapper/007:21:200
8217992120,1cyclictest17219-21apt-get09:41:230
8217992120,1cyclictest0-21swapper/009:21:210
8217992120,0cyclictest23757-21apt-get11:00:020
8217992120,0cyclictest0-21swapper/012:01:220
821799210,21cyclictest0-21swapper/010:51:210
821799210,20cyclictest0-21swapper/010:31:210
821799210,20cyclictest0-21swapper/010:11:220
821799210,20cyclictest0-21swapper/008:06:220
821799210,0cyclictest0-21swapper/012:20:000
821799210,0cyclictest0-21swapper/009:46:220
8227992020,0cyclictest32355-21apt-get09:06:233
8227992020,0cyclictest20985-21apt-get07:36:223
8227992020,0cyclictest11929-21apt-get10:35:153
8227992020,0cyclictest11329-21apt-get07:16:213
8227992020,0cyclictest0-21swapper/311:06:223
8227992020,0cyclictest0-21swapper/310:51:223
8227992020,0cyclictest0-21swapper/309:51:213
8227992020,0cyclictest0-21swapper/308:46:223
8227992020,0cyclictest0-21swapper/307:26:223
8227992018,1cyclictest23817-21munin-run12:05:013
822799200,20cyclictest0-21swapper/310:16:233
822799200,20cyclictest0-21swapper/310:16:233
822799200,19cyclictest8885-21apt10:30:013
822799200,0cyclictest31697-21apt-get11:16:223
822799200,0cyclictest0-21swapper/312:06:233
822799200,0cyclictest0-21swapper/310:11:223
822799200,0cyclictest0-21swapper/309:56:223
822799200,0cyclictest0-21swapper/308:41:213
8225992020,0cyclictest23757-21apt-get11:00:022
8225992020,0cyclictest19613-21apt-get09:46:222
8225992020,0cyclictest0-21swapper/211:40:022
8225992020,0cyclictest0-21swapper/209:25:022
8225992020,0cyclictest0-21swapper/208:06:222
8225992019,1cyclictest8936-21apt-get07:11:232
822599200,20cyclictest0-21swapper/211:11:282
822599200,20cyclictest0-21swapper/210:16:242
822599200,20cyclictest0-21swapper/210:16:242
822599200,20cyclictest0-21swapper/207:51:212
822599200,0cyclictest0-21swapper/212:06:232
822599200,0cyclictest0-21swapper/207:36:212
8220992020,0cyclictest26496-21apt-get10:00:021
8220992020,0cyclictest0-21swapper/112:31:231
8220992020,0cyclictest0-21swapper/109:46:221
8220992020,0cyclictest0-21swapper/109:06:231
8220992020,0cyclictest0-21swapper/107:36:211
8220992018,1cyclictest313-21systemd-journal08:20:001
822099200,20cyclictest0-21swapper/112:20:021
822099200,0cyclictest0-21swapper/108:51:231
8217992020,0cyclictest0-21swapper/011:31:220
8217992020,0cyclictest0-21swapper/010:56:210
8217992020,0cyclictest0-21swapper/010:41:200
8217992020,0cyclictest0-21swapper/010:26:220
8217992020,0cyclictest0-21swapper/007:46:220
821799200,1cyclictest26521-21/usr/sbin/munin12:11:230
821799200,0cyclictest0-21swapper/010:46:220
821799200,0cyclictest0-21swapper/008:41:210
8227991919,0cyclictest4455-21apt-get10:21:213
8227991919,0cyclictest0-21swapper/312:11:213
8227991919,0cyclictest0-21swapper/311:56:233
8227991919,0cyclictest0-21swapper/310:31:213
8227991919,0cyclictest0-21swapper/308:16:223
8227991917,1cyclictest0-21swapper/309:45:013
8225991919,0cyclictest0-21swapper/211:16:232
8225991919,0cyclictest0-21swapper/209:06:232
8225991919,0cyclictest0-21swapper/208:31:212
8225991915,3cyclictest313-21systemd-journal12:15:002
8220991919,0cyclictest0-21swapper/110:26:221
8220991919,0cyclictest0-21swapper/108:06:221
8220991918,1cyclictest0-21swapper/110:36:241
822099190,0cyclictest0-21swapper/111:26:211
8217991919,0cyclictest2344-21apt-get09:11:230
8217991919,0cyclictest0-21swapper/011:16:230
8217991919,0cyclictest0-21swapper/008:56:230
8217991917,1cyclictest31629-21apt-get12:20:010
8217991917,1cyclictest24777-21cron08:50:010
8227991818,0cyclictest0-21swapper/311:11:283
8227991818,0cyclictest0-21swapper/307:11:233
8227991817,1cyclictest0-21swapper/309:00:003
8227991816,1cyclictest15197-21munin-run08:30:003
8225991818,0cyclictest5880-21apt-get08:11:202
8225991818,0cyclictest25148-21apt-get08:51:232
8225991818,0cyclictest0-21swapper/210:41:202
8225991818,0cyclictest0-21swapper/208:36:242
8225991818,0cyclictest0-21swapper/207:46:222
8225991817,1cyclictest0-21swapper/209:31:222
8225991817,0cyclictest0-21swapper/210:51:222
8225991816,1cyclictest18958-21apt10:50:002
8225991816,1cyclictest15182-21ls08:30:002
8220991818,0cyclictest0-21swapper/111:06:221
8220991818,0cyclictest0-21swapper/111:01:231
8220991818,0cyclictest0-21swapper/109:31:221
8220991818,0cyclictest0-21swapper/109:16:221
8220991818,0cyclictest0-21swapper/109:01:221
8220991818,0cyclictest0-21swapper/108:36:241
8220991817,0cyclictest0-21swapper/108:56:231
8217991818,0cyclictest0-21swapper/011:51:210
8217991818,0cyclictest0-21swapper/011:46:220
8217991818,0cyclictest0-21swapper/008:21:210
8217991818,0cyclictest0-21swapper/008:01:210
8217991818,0cyclictest0-21swapper/007:16:210
8217991816,1cyclictest16854-21perf09:40:010
821799180,1cyclictest0-21swapper/008:16:220
8227991717,0cyclictest8904-21apt-get11:36:233
8227991717,0cyclictest4148-21apt-get12:31:233
8227991717,0cyclictest10951-21apt-get11:40:023
8227991717,0cyclictest0-21swapper/312:26:223
8225991717,0cyclictest8287-21apt-get08:16:222
8225991717,0cyclictest0-21swapper/211:21:222
8225991717,0cyclictest0-21swapper/210:56:222
8225991716,1cyclictest16837-21basename09:40:012
8225991715,1cyclictest11289-21apt-get10:35:152
8225991715,1cyclictest0-21swapper/210:25:012
8220991717,0cyclictest0-21swapper/112:06:231
8220991717,0cyclictest0-21swapper/108:01:211
8220991716,0cyclictest0-21swapper/109:51:211
8217991717,0cyclictest24164-21apt-get12:06:230
8227991616,0cyclictest28290-21apt-get07:51:213
8227991616,0cyclictest25900-21apt-get07:46:223
8227991616,0cyclictest12352-21apt-get09:31:223
8227991614,1cyclictest16914-21apt-get10:46:223
8227991613,2cyclictest25544-21wc07:45:003
8225991616,0cyclictest0-21swapper/212:36:232
8225991616,0cyclictest0-21swapper/207:31:212
8225991615,1cyclictest6496-21apt-get11:31:222
8225991615,0cyclictest29656-21apt-get10:06:222
8225991614,1cyclictest28945-21idleruntime-cro11:10:012
8225991614,1cyclictest18240-21munin-run07:30:002
822599160,16cyclictest0-21swapper/208:56:272
822599160,15cyclictest7479-21expr10:26:252
8220991616,0cyclictest0-21swapper/112:36:231
8220991616,0cyclictest0-21swapper/112:26:211
8220991615,1cyclictest15840-21turbostat07:25:001
8220991615,1cyclictest0-21swapper/111:31:221
8220991614,1cyclictest0-21swapper/109:41:371
822099160,15cyclictest25890-21awk07:46:221
822099160,0cyclictest0-21swapper/109:21:211
8217991616,0cyclictest6544-21apt-get12:36:230
8217991616,0cyclictest0-21swapper/011:21:230
8217991616,0cyclictest0-21swapper/007:36:220
8217991615,1cyclictest19355-21apt-get11:56:230
8217991614,1cyclictest6507-21munin-run10:25:010
8217991613,3cyclictest0-21swapper/007:10:010
821799160,13cyclictest29959-21apt-get09:01:220
8227991515,0cyclictest31083-21apt-get07:56:213
8227991515,0cyclictest0-21swapper/310:41:203
8227991513,1cyclictest8617-21munin-run12:40:003
8227991512,2cyclictest28447-21pmu-power10:01:293
822799150,14cyclictest4924-21cpuspeed_turbos09:16:223
8225991515,0cyclictest0-21swapper/209:16:222
8225991515,0cyclictest0-21swapper/208:46:222
8220991515,0cyclictest0-21swapper/108:46:211
821799153,11cyclictest313-21systemd-journal09:34:350
8217991515,0cyclictest0-21swapper/007:56:210
821799150,14cyclictest0-21swapper/011:36:250
8227991414,0cyclictest0-21swapper/309:35:033
822799140,14cyclictest0-21swapper/311:45:453
822799140,14cyclictest0-21swapper/311:30:043
822799140,14cyclictest0-21swapper/311:26:583
822799140,14cyclictest0-21swapper/311:03:353
822799140,14cyclictest0-21swapper/307:33:303
822799140,14cyclictest0-21swapper/307:20:003
822799140,0cyclictest0-21swapper/311:50:293
8225991414,0cyclictest0-21swapper/208:41:212
822599140,14cyclictest0-21swapper/212:01:202
822599140,14cyclictest0-21swapper/211:35:422
822599140,14cyclictest0-21swapper/211:25:492
822599140,14cyclictest0-21swapper/210:30:532
822599140,14cyclictest0-21swapper/208:20:422
822599140,14cyclictest0-21swapper/207:55:482
822599140,14cyclictest0-21swapper/207:40:252
822599140,0cyclictest0-21swapper/209:41:072
822099140,0cyclictest0-21swapper/111:50:311
822099140,0cyclictest0-21swapper/110:16:231
822099140,0cyclictest0-21swapper/110:16:231
8217991414,0cyclictest0-21swapper/011:05:290
8217991414,0cyclictest0-21swapper/010:16:050
8217991414,0cyclictest0-21swapper/010:16:050
8217991414,0cyclictest0-21swapper/008:50:160
8217991414,0cyclictest0-21swapper/007:51:210
821799140,14cyclictest0-21swapper/012:25:160
821799140,0cyclictest0-21swapper/011:40:070
821799140,0cyclictest0-21swapper/011:25:130
821799140,0cyclictest0-21swapper/008:30:330
821799140,0cyclictest0-21swapper/007:41:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional