You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 11:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Wed Apr 24, 2024 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223392241162,25sleep00-21swapper/019:05:050
242982237161,24sleep30-21swapper/319:09:553
239642225194,21sleep20-21swapper/219:05:382
242742224193,20sleep10-21swapper/119:09:361
2440999106102,3cyclictest0-21swapper/200:38:422
130452980,4sleep232-21ksoftirqd/222:25:182
24409996662,3cyclictest0-21swapper/222:04:552
165652660,5sleep02439999cyclictest23:45:280
303732590,4sleep02439999cyclictest00:20:000
24409995954,3cyclictest0-21swapper/220:05:092
9552580,4sleep02439999cyclictest20:45:120
68102580,5sleep12440499cyclictest22:10:201
41132550,1sleep20-21swapper/200:30:312
24409995451,2cyclictest30-21rcuc/223:05:162
83092450,1sleep30-21swapper/322:15:113
2439999356,13cyclictest31953-21awk23:10:010
2440499291,26cyclictest0-21swapper/120:43:311
2439999296,11cyclictest24728-21awk21:40:010
2440499289,2cyclictest5125-21missed_timers23:20:211
2440499280,26cyclictest0-21swapper/123:05:021
2440499272,16cyclictest0-21swapper/123:41:131
2440499271,17cyclictest0-21swapper/100:07:101
2440499270,25cyclictest0-21swapper/122:47:021
2440499270,16cyclictest0-21swapper/100:05:021
211262270,4sleep339-21rcuc/322:45:013
198842270,3sleep019888-21missed_timers22:40:220
2440499262,15cyclictest0-21swapper/100:15:031
24404992614,3cyclictest0-21swapper/123:53:281
24404992613,9cyclictest3449-21irqstats00:30:191
2440499261,22cyclictest2634-21sensors_temp22:00:261
2441699255,7cyclictest11516-21diskmemload00:20:183
2440999251,5cyclictest0-21swapper/223:31:092
2440499258,3cyclictest28498-21munin-run20:35:011
2440499256,16cyclictest0-21swapper/119:55:221
2440499251,2cyclictest0-21swapper/123:05:361
2440499251,2cyclictest0-21swapper/120:05:351
2440499251,22cyclictest0-21swapper/122:29:281
2440499251,22cyclictest0-21swapper/121:58:031
2440499251,12cyclictest29677-21df21:50:141
257642240,1sleep10-21swapper/121:40:211
2440999242,4cyclictest0-21swapper/221:19:262
24409992417,4cyclictest6519-21tr23:25:112
2440499242,15cyclictest25071-21sshd22:51:481
24404992414,2cyclictest0-21swapper/123:55:281
2440499241,11cyclictest30073-21latency_hist19:25:021
2440499241,11cyclictest18109-21latency_hist21:25:021
24404992410,12cyclictest10415-21kworker/u8:123:35:521
2440499240,17cyclictest0-21swapper/121:35:571
2441699233,8cyclictest11528-40dnf21:10:043
2440999232,6cyclictest20311-21munin-run21:30:022
2440499235,10cyclictest15868-21hwlatdetect23:45:171
2440499232,19cyclictest0-21swapper/120:20:111
2440499231,3cyclictest5760-21latency_hist22:10:021
2440499231,3cyclictest27528-21latency_hist23:00:021
2440499231,3cyclictest21263-21if_enp1s021:30:191
2440499231,3cyclictest19119-21sed20:10:251
2440499231,3cyclictest14387-21ntp_states20:00:221
2440499231,3cyclictest14387-21ntp_states20:00:221
2440499230,5cyclictest0-21swapper/100:11:121
2440499230,15cyclictest0-21swapper/119:32:481
2440999225,9cyclictest86550irq/126-enp1s0-23:25:022
2440999225,4cyclictest23938-21gltestperf22:50:142
2440999224,3cyclictest3761-21kworker/u8:023:40:262
2440999223,9cyclictest4833-21/usr/sbin/munin22:05:272
2440499227,13cyclictest29724-21kworker/u8:123:12:541
2440499227,13cyclictest29724-21kworker/u8:123:12:541
2440499222,3cyclictest0-21swapper/121:02:251
2440499222,3cyclictest0-21swapper/121:02:251
2440499222,18cyclictest0-21swapper/121:17:461
2440499221,2cyclictest2816-21irqstats23:15:201
2440499221,19cyclictest0-21swapper/120:51:511
2440499221,19cyclictest0-21swapper/119:45:171
2440499221,11cyclictest26287-21sh20:30:011
2440499220,11cyclictest0-21swapper/121:28:421
24399992215,4cyclictest5900-21ntp_states00:35:250
2439999221,18cyclictest8370-21munin-run23:30:010
183042220,4sleep232-21ksoftirqd/220:10:142
325672211,2sleep20-21swapper/219:30:132
277792210,18sleep30-21swapper/320:30:233
2441699212,5cyclictest5182-21diskstats00:35:163
24416992116,3cyclictest12845-21cut22:25:163
24416992115,3cyclictest677-21tail19:30:173
24416992114,4cyclictest20237-21sed23:55:183
24416992110,3cyclictest5563-21awk22:10:003
2440999215,5cyclictest11516-21diskmemload22:34:562
2440999213,11cyclictest792-21avahi-daemon21:10:042
2440999212,5cyclictest21763-21gltestperf22:45:172
2440999212,15cyclictest0-21swapper/200:11:332
2440999211,6cyclictest17487-21grep23:50:122
2440999211,6cyclictest11516-21diskmemload00:25:012
2440999211,5cyclictest0-21swapper/200:17:352
2440999211,11cyclictest3514-21unixbench_multi23:15:302
2440999211,11cyclictest27196-21hddtemp_smartct20:30:142
2440999211,10cyclictest0-21swapper/223:14:242
2440999211,10cyclictest0-21swapper/223:14:242
2440499212,18cyclictest0-21swapper/122:44:141
2440499212,17cyclictest0-21swapper/122:37:491
2440499212,17cyclictest0-21swapper/100:25:231
24404992117,3cyclictest0-21swapper/119:16:471
2440499211,3cyclictest0-21swapper/120:48:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional