You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-13 - 17:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot6s.osadl.org (updated Sat Sep 13, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6500999528,13cyclictest0-21swapper/107:32:491
6500999430,9cyclictest10019-21turbostat.cron06:42:231
6500999338,10cyclictest7432-21gltestperf09:57:381
6500999132,7cyclictest17100-21awk09:12:171
6500999132,7cyclictest17100-21awk09:12:171
6500998931,8cyclictest1160-21snmpd10:17:281
6500998925,12cyclictest0-21swapper/106:10:561
650299853,45cyclictest0-21swapper/310:52:143
650299852,44cyclictest29281-21munin-node09:37:293
6500998229,12cyclictest0-21swapper/107:12:521
6500998226,12cyclictest0-21swapper/110:52:451
305622730,3sleep041ktimersoftd/010:47:270
650299673,45cyclictest6050-21diskstats06:32:433
650299663,55cyclictest27765-21gltestperf09:32:393
650199664,15cyclictest0-21swapper/210:32:282
650199664,15cyclictest0-21swapper/210:32:282
650199655,36cyclictest0-21swapper/208:05:432
650199644,14cyclictest0-21swapper/206:02:252
6498996439,12cyclictest0-21swapper/007:42:350
6501996222,16cyclictest0-21swapper/209:47:392
6501996222,16cyclictest0-21swapper/209:47:392
111922629,9sleep011208-21uname08:57:420
650299613,39cyclictest21978-21iostat_ios08:12:433
6498996132,13cyclictest0-21swapper/005:37:380
649899613,52cyclictest0-21swapper/006:47:440
258122613,8sleep025902-21aten_r1power_fr06:07:370
223099610,4rtkit-daemon2229-21rtkit-daemon07:01:082
223099610,4rtkit-daemon2229-21rtkit-daemon07:01:082
6501996023,13cyclictest0-21swapper/208:07:432
6498996038,11cyclictest0-21swapper/005:57:570
6498996037,11cyclictest0-21swapper/007:27:550
6498996037,10cyclictest0-21swapper/005:32:470
6498996037,10cyclictest0-21swapper/005:32:470
6498996035,11cyclictest0-21swapper/009:22:290
6498996034,14cyclictest0-21swapper/006:12:370
6498996034,13cyclictest0-21swapper/009:52:470
223099600,4rtkit-daemon2229-21rtkit-daemon06:49:082
6500995931,10cyclictest25781-21head10:37:281
6498995941,13cyclictest0-21swapper/009:22:180
649899594,48cyclictest0-21swapper/009:12:490
6498995937,10cyclictest0-21swapper/005:52:470
6498995935,11cyclictest0-21swapper/007:52:330
6498995932,11cyclictest0-21swapper/010:02:470
6498995931,13cyclictest0-21swapper/008:27:360
649899593,49cyclictest0-21swapper/008:22:470
649899593,49cyclictest0-21swapper/008:22:470
223099590,4rtkit-daemon2229-21rtkit-daemon10:48:142
650199585,29cyclictest0-21swapper/206:42:562
650199585,28cyclictest0-21swapper/210:22:372
6498995842,11cyclictest0-21swapper/010:46:170
6498995836,11cyclictest0-21swapper/007:32:540
6498995835,10cyclictest0-21swapper/007:12:380
6498995833,14cyclictest0-21swapper/009:42:300
6498995832,11cyclictest31297-21yum-updatesd-he07:24:490
6498995832,10cyclictest21217-21sendmail_mailqu07:02:520
50372586,44sleep30-21swapper/309:52:383
650199574,29cyclictest0-21swapper/208:12:382
649899574,46cyclictest0-21swapper/006:37:440
649899574,46cyclictest0-21swapper/006:32:470
6498995739,12cyclictest0-21swapper/008:35:040
6498995736,11cyclictest0-21swapper/005:27:270
6498995736,10cyclictest0-21swapper/008:13:400
6498995735,12cyclictest0-21swapper/010:22:470
6498995732,14cyclictest0-21swapper/008:04:390
650299564,45cyclictest32369-21munin-node06:17:593
650299564,45cyclictest32369-21munin-node06:17:593
6498995637,13cyclictest0-21swapper/007:57:570
6498995632,10cyclictest23585-21taskset06:02:400
223099560,6rtkit-daemon2229-21rtkit-daemon10:37:292
650299553,45cyclictest30073-21sshd06:13:563
650299552,46cyclictest8936-21munin-node10:02:353
6500995521,28cyclictest28456-21switchtime07:17:571
649899554,45cyclictest0-21swapper/010:12:420
6498995536,13cyclictest0-21swapper/005:47:390
6498995531,12cyclictest0-21swapper/009:50:590
6498995531,12cyclictest0-21swapper/009:50:590
126212552,44sleep30-21swapper/307:52:483
68972543,44sleep20-21swapper/205:27:412
6502995430,10cyclictest10171-21munin-node08:57:453
6500995431,10cyclictest0-21swapper/105:27:421
650099543,46cyclictest0-21swapper/110:22:431
650099542,47cyclictest0-21swapper/109:37:171
650099542,46cyclictest0-21swapper/105:52:491
6498995437,11cyclictest0-21swapper/007:50:390
6498995433,12cyclictest0-21swapper/010:32:330
6498995433,12cyclictest0-21swapper/010:32:330
649899543,45cyclictest0-21swapper/009:10:090
649899543,45cyclictest0-21swapper/009:10:090
649899543,45cyclictest0-21swapper/006:22:520
6498995429,10cyclictest16032-21latency_hist05:47:270
223099540,5rtkit-daemon2229-21rtkit-daemon09:37:162
223099540,5rtkit-daemon2229-21rtkit-daemon06:27:542
6502995329,10cyclictest29360-21munin-node07:22:393
6502995329,10cyclictest22994-21sshd05:59:573
650199532,44cyclictest0-21swapper/210:21:562
6500995332,10cyclictest0-21swapper/108:32:201
6500995330,10cyclictest0-21swapper/110:32:491
6500995330,10cyclictest0-21swapper/110:32:491
6500995329,9cyclictest22449-21rt-features05:57:561
6500995328,13cyclictest0-21swapper/109:52:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional