You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 18:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Sun Nov 23, 2025 12:44:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
839911213159,67sleep30-21swapper/307:09:473
83965428755,9sleep10-21swapper/107:06:331
83966528064,10sleep20-21swapper/207:06:422
83549327756,14sleep00-21swapper/007:05:140
84005199292,21cyclictest1022519-21chrt09:45:143
840051992622,2cyclictest0-21swapper/311:45:193
84005199262,13cyclictest1285491-21sleep12:35:003
840051992523,1cyclictest0-21swapper/309:30:173
840051992519,3cyclictest0-21swapper/310:20:133
840051992421,1cyclictest0-21swapper/308:15:003
840051992419,3cyclictest0-21swapper/312:10:213
840051992419,2cyclictest0-21swapper/309:35:253
9067652231,11sleep2906937-21/usr/sbin/munin08:10:132
84005199239,9cyclictest1244089-21taskset12:08:253
84005199231,16cyclictest858632-21taskset07:25:133
84005199229,8cyclictest1029632-21taskset09:50:063
840051992219,2cyclictest0-21swapper/312:20:153
840051992219,2cyclictest0-21swapper/310:45:143
84005199221,15cyclictest1091195-21taskset10:30:123
84005199216,13cyclictest0-21swapper/310:40:203
84005199212,13cyclictest1166078-21taskset11:17:133
84005199212,12cyclictest998701-21taskset09:27:423
84005199212,12cyclictest1203204-21taskset11:40:193
840051992117,2cyclictest0-21swapper/311:50:203
84005199211,16cyclictest1235605-21taskset12:02:443
840051992110,7cyclictest66550irq/131-enp1s0-TxRx-312:36:143
840051992017,2cyclictest0-21swapper/312:20:013
840051992017,2cyclictest0-21swapper/310:30:003
840051992017,1cyclictest0-21swapper/310:56:243
840051992014,4cyclictest1193725-21chrt11:35:173
840051992012,4cyclictest1152296-21taskset11:09:563
84005199201,15cyclictest1052116-21chrt10:04:493
9285842191,7sleep0929174-21kthreadcore08:30:150
84005199193,12cyclictest1043563-21taskset09:57:573
84005199192,12cyclictest992302-21taskset09:24:563
84005199192,12cyclictest1065850-21taskset10:11:593
84005199192,11cyclictest879814-21taskset07:45:133
840051991917,1cyclictest0-21swapper/311:25:163
840051991916,2cyclictest0-21swapper/311:55:173
840051991916,1cyclictest0-21swapper/309:10:113
840051991916,1cyclictest0-21swapper/308:45:003
840051991916,1cyclictest0-21swapper/307:50:163
840051991915,2cyclictest0-21swapper/311:30:043
840051991914,2cyclictest0-21swapper/310:36:363
840051991914,2cyclictest0-21swapper/310:36:363
84005199191,14cyclictest1072284-21chrt10:15:243
84005199191,14cyclictest0-21swapper/309:10:013
11609732191,6sleep21160327-21/usr/sbin/munin11:15:172
84005199189,5cyclictest11740722sleep311:22:123
84005199182,12cyclictest1128572-21taskset10:53:053
84005199182,12cyclictest1053080-21taskset10:05:143
84005199182,12cyclictest1019953-21taskset09:40:403
84005199182,11cyclictest1159589-21taskset11:14:213
84005199181,7cyclictest900816-21turbostat08:05:003
84005199181,13cyclictest0-21swapper/312:25:163
84005199181,13cyclictest0-21swapper/312:25:163
84005199181,13cyclictest0-21swapper/309:15:143
84005199180,13cyclictest943918-21chrt08:45:133
84005199180,13cyclictest943918-21chrt08:45:123
10566782181,12sleep01056726-21ntpq10:05:190
9919572170,3sleep10-21swapper/109:24:201
8786552172,10sleep2878779-21/usr/sbin/munin07:40:232
84005199174,10cyclictest0-21swapper/307:20:013
840051991714,2cyclictest0-21swapper/308:20:173
840051991714,1cyclictest0-21swapper/308:15:183
840051991713,2cyclictest0-21swapper/307:35:273
840051991712,3cyclictest0-21swapper/309:00:113
84005199171,13cyclictest0-21swapper/311:01:113
84005199171,12cyclictest0-21swapper/307:55:143
12916742171,4sleep1969996-21diskmemload12:36:381
12513522171,10sleep2969996-21diskmemload12:12:172
12298982171,7sleep11229957-21sort12:00:141
12030682171,3sleep20-21swapper/211:40:182
11596202171,2sleep20-21swapper/211:14:262
11513472171,10sleep2969996-21diskmemload11:08:122
11205042171,2sleep00-21swapper/010:47:100
10976532171,4sleep0969996-21diskmemload10:33:180
10061172171,3sleep00-21swapper/009:32:370
95488321611,2sleep30-21swapper/308:55:163
8947902161,10sleep2894826-21sed07:55:272
84005199160,13cyclictest0-21swapper/307:30:193
84005199160,10cyclictest857818-21taskset07:23:123
12745342161,2sleep00-21swapper/012:25:270
12745342161,2sleep00-21swapper/012:25:260
12525452161,4sleep0969996-21diskmemload12:14:120
12280542161,2sleep20-21swapper/211:57:312
11742192160,3sleep20-21swapper/211:22:272
10993812162,7sleep01099510-21diskstats10:35:150
10993812162,7sleep01099510-21diskstats10:35:140
10897832161,2sleep10-21swapper/110:28:131
10754972161,3sleep20-21swapper/210:20:142
10528622161,7sleep21053079-21hddtemp_smartct10:05:132
9534122151,9sleep1953544-21sed08:50:251
8452592151,9sleep0845274-21latency_hist07:15:010
8402482156,5sleep1840382-21tr07:10:121
84005199151,9cyclictest927472-21taskset08:26:133
840051991512,1cyclictest0-21swapper/307:10:173
84005199151,11cyclictest954113-21turbostat08:54:593
84005199150,12cyclictest0-21swapper/308:35:203
84005199150,12cyclictest0-21swapper/308:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional