You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-02 - 22:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sat Dec 02, 2023 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29512242167,25sleep30-21swapper/307:06:293
30582232162,57sleep20-21swapper/207:07:532
29372203164,26sleep10-21swapper/107:06:201
29162201164,24sleep00-21swapper/007:06:020
2024821830,3sleep3333399cyclictest11:35:003
119632600,2sleep00-21swapper/008:40:240
113772530,3sleep230-21rcuc/208:40:012
113772530,3sleep230-21rcuc/208:40:012
9572380,23sleep0961-21latency_hist09:30:020
3333993827,3cyclictest0-21swapper/308:43:073
3333993826,3cyclictest0-21swapper/308:51:073
3333993725,3cyclictest0-21swapper/309:04:113
3333993713,9cyclictest0-21swapper/307:18:283
3333993421,3cyclictest0-21swapper/307:53:533
3333993414,9cyclictest0-21swapper/307:59:313
3333993414,8cyclictest0-21swapper/308:58:573
3333993325,3cyclictest0-21swapper/308:16:073
3333993321,3cyclictest0-21swapper/309:07:153
333399331,12cyclictest5585-21cpuspeed_turbos09:40:153
333399329,10cyclictest0-21swapper/309:25:313
3333993219,8cyclictest0-21swapper/308:24:253
333399321,13cyclictest19885-21gltestperf10:15:233
333399318,3cyclictest0-21swapper/311:29:433
333399311,15cyclictest29605-21ls10:40:233
331799314,13cyclictest25951-21munin-run08:00:010
3333993017,8cyclictest0-21swapper/308:48:113
3333992918,3cyclictest0-21swapper/310:28:333
3333992916,8cyclictest0-21swapper/307:32:113
3333992915,9cyclictest0-21swapper/308:30:073
333399291,13cyclictest0-21swapper/308:10:313
332499291,12cyclictest0-21swapper/109:43:171
333399281,11cyclictest0-21swapper/311:52:293
333399281,11cyclictest0-21swapper/311:52:293
333399281,10cyclictest0-21swapper/312:31:333
332499289,8cyclictest16312-21kworker/u8:008:25:241
331799282,14cyclictest32555-21munin-run08:15:020
333399279,8cyclictest0-21swapper/308:37:533
333399279,8cyclictest0-21swapper/308:37:533
333399278,9cyclictest0-21swapper/312:24:353
3333992717,3cyclictest0-21swapper/310:35:233
3333992714,8cyclictest0-21swapper/308:02:293
3333992714,8cyclictest0-21swapper/307:39:293
3333992713,3cyclictest0-21swapper/312:13:033
3333992712,10cyclictest0-21swapper/307:20:173
333399271,18cyclictest7972-21ntpq12:25:273
3333992710,13cyclictest3490-21cstates09:35:233
331799272,13cyclictest21559-21munin-run07:50:010
331799270,12cyclictest5200-21idleruntime-cro09:40:020
333399266,8cyclictest0-21swapper/307:27:053
333399262,9cyclictest0-21swapper/312:15:513
3333992615,3cyclictest0-21swapper/307:42:173
3333992611,3cyclictest12903-21unixbench_singl12:35:413
333399261,10cyclictest0-21swapper/310:46:533
3333992610,4cyclictest0-21swapper/308:07:273
332499261,5cyclictest0-21swapper/109:46:531
332499261,17cyclictest0-21swapper/107:55:221
332499260,12cyclictest0-21swapper/109:18:291
331799261,12cyclictest19372-21awk07:45:010
331799261,12cyclictest18045-21munin-run11:30:010
333399258,8cyclictest0-21swapper/308:25:533
333399251,13cyclictest0-21swapper/309:45:293
333399251,12cyclictest0-21swapper/309:57:213
333399251,10cyclictest0-21swapper/307:10:053
3333992510,3cyclictest24372-21diskmemload11:56:133
3328992521,3cyclictest0-21swapper/211:38:472
332499250,12cyclictest0-21swapper/112:22:531
331799257,15cyclictest25622-21basename10:30:010
331799251,12cyclictest8901-21munin-run12:30:010
333399247,2cyclictest0-21swapper/310:55:393
333399241,14cyclictest0-21swapper/311:45:213
333399240,11cyclictest0-21swapper/311:05:553
333399240,11cyclictest0-21swapper/310:10:213
333399240,11cyclictest0-21swapper/309:54:573
3324992413,5cyclictest0-21swapper/111:30:081
332499241,19cyclictest823-21snmpd12:35:121
332499241,13cyclictest0-21swapper/111:50:331
332499241,13cyclictest0-21swapper/111:50:331
3324992411,11cyclictest23360-21kworker/u8:110:40:211
331799243,8cyclictest27928-40dnf11:50:320
331799243,8cyclictest27928-40dnf11:50:320
333399235,3cyclictest0-21swapper/311:00:393
333399231,14cyclictest0-21swapper/309:33:433
333399231,12cyclictest0-21swapper/310:53:493
333399231,12cyclictest0-21swapper/309:18:533
333399231,11cyclictest0-21swapper/311:11:413
3333992310,3cyclictest0-21swapper/311:18:473
333399230,9cyclictest0-21swapper/311:43:233
333399230,9cyclictest0-21swapper/309:20:213
332499231,3cyclictest27387-21tail10:30:421
332499231,17cyclictest0-21swapper/108:09:321
332499231,16cyclictest0-21swapper/110:55:071
332499231,16cyclictest0-21swapper/108:21:431
332499231,15cyclictest86850irq/129-enp1s0-09:13:201
331799234,16cyclictest24380-21munin-run09:10:020
214222230,4sleep021424-21missed_timers11:35:300
333399229,8cyclictest0-21swapper/307:48:473
333399228,3cyclictest0-21swapper/309:11:173
333399221,13cyclictest24372-21diskmemload10:05:593
333399220,8cyclictest0-21swapper/312:03:153
333399220,14cyclictest0-21swapper/310:04:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional