You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 12:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Sat Jan 03, 2026 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241922521450,1sleep20-21swapper/219:45:192
2376557212558,62sleep30-21swapper/319:06:363
23764992113104,6sleep10-21swapper/119:05:541
237650329063,19sleep00-21swapper/019:05:570
237676927851,10sleep20-21swapper/219:09:202
26422432230,11sleep134-21ksoftirqd/123:20:001
2376948992219,1cyclictest0-21swapper/321:55:253
237694899221,17cyclictest2520729-21taskset21:20:263
237694899211,15cyclictest0-21swapper/320:35:133
237694899202,12cyclictest2715030-21taskset00:25:193
2376948992018,1cyclictest0-21swapper/319:40:013
2376948992017,1cyclictest0-21swapper/300:20:133
2376948992017,1cyclictest0-21swapper/300:15:013
237694899201,15cyclictest2694383-21taskset00:05:323
2376948992010,7cyclictest2673046-21taskset23:45:273
26850822190,11sleep014-21ksoftirqd/000:00:160
237694899196,6cyclictest2494621-21taskset20:57:423
2376948991916,1cyclictest0-21swapper/319:45:183
237694899191,14cyclictest2621311-21taskset23:00:113
237694899191,14cyclictest0-21swapper/319:50:123
237694899191,11cyclictest2534688-21taskset21:35:173
25572322181,12sleep12557281-21ntpq21:55:201
2376948991815,1cyclictest0-21swapper/321:50:163
2376948991815,1cyclictest0-21swapper/321:10:163
2376948991815,1cyclictest0-21swapper/320:45:143
237694899181,14cyclictest0-21swapper/323:25:123
2376948991811,3cyclictest25624222sleep322:00:203
237694899181,13cyclictest0-21swapper/322:25:113
237694899181,13cyclictest0-21swapper/321:40:173
237694899181,11cyclictest2430281-21taskset19:55:173
25411022171,10sleep22541149-21ntpq21:40:182
24901852171,7sleep02490382-21if_enp1s020:55:150
2376948991715,1cyclictest0-21swapper/321:05:163
2376948991714,1cyclictest0-21swapper/323:15:183
2376948991714,1cyclictest0-21swapper/322:30:163
2376948991714,1cyclictest0-21swapper/300:00:143
2376948991713,2cyclictest0-21swapper/319:30:163
237694899171,13cyclictest0-21swapper/319:15:113
237694899171,10cyclictest2720440-21chrt00:30:283
237694899171,10cyclictest2604182-21taskset22:40:183
237694899171,10cyclictest2526352-21taskset21:30:003
237694899171,10cyclictest2442403-21taskset20:10:003
237694899170,10cyclictest2456714-21taskset20:20:183
25595322161,10sleep02561242-21tr22:00:160
237694899161,9cyclictest2579399-21taskset22:20:063
2376948991614,1cyclictest0-21swapper/320:10:253
2376948991614,1cyclictest0-21swapper/319:25:143
2376948991613,1cyclictest0-21swapper/323:20:173
2376948991613,1cyclictest0-21swapper/323:05:173
2376948991613,1cyclictest0-21swapper/322:55:143
2376948991613,1cyclictest0-21swapper/300:35:173
237694899161,11cyclictest2474108-21chrt20:40:103
237694899161,11cyclictest0-21swapper/322:45:103
2376948991610,4cyclictest0-21swapper/319:35:123
237694899160,14cyclictest0-21swapper/320:54:213
237694899160,13cyclictest0-21swapper/323:50:133
237694899160,13cyclictest0-21swapper/322:35:193
237694899160,13cyclictest0-21swapper/322:35:193
237694899160,13cyclictest0-21swapper/321:45:203
237694899160,13cyclictest0-21swapper/320:30:213
237694899160,13cyclictest0-21swapper/320:30:213
237694899160,13cyclictest0-21swapper/320:15:293
237694899160,13cyclictest0-21swapper/319:20:173
27108122151,8sleep02710428-21apt-get00:25:010
25321692151,10sleep02532363-21/usr/sbin/munin21:35:150
24950772151,4sleep2800-21snmpd21:00:062
237694899156,6cyclictest2662846-21taskset23:39:023
237694899156,5cyclictest23771202sleep319:10:133
237694899155,6cyclictest2684099-21taskset23:58:273
237694899151,8cyclictest2700196-21taskset00:15:013
237694899151,11cyclictest0-21swapper/323:40:143
237694899151,10cyclictest2495365-21chrt21:00:143
237694899150,2cyclictest0-21swapper/322:15:113
237694899150,13cyclictest0-21swapper/321:30:153
237694899150,13cyclictest0-21swapper/321:15:213
237694899150,12cyclictest0-21swapper/323:30:133
237694899150,12cyclictest0-21swapper/323:10:243
237694899150,12cyclictest0-21swapper/322:10:143
237694899150,12cyclictest0-21swapper/320:25:193
237694899150,11cyclictest0-21swapper/322:05:123
26317932141,5sleep12631978-21expr23:10:111
26255512141,9sleep00-21swapper/023:00:240
237694899147,4cyclictest0-21swapper/322:50:113
237694899141,8cyclictest2436792-21taskset20:04:473
27223082131,7sleep12723991-21kthreadcore00:35:161
26734142132,3sleep20-21swapper/223:50:012
25950932131,8sleep12595110-21grep22:35:131
25950932131,8sleep12595110-21grep22:35:121
25898722131,8sleep12589961-21expr22:30:111
25426802131,8sleep02542941-21df_inode21:45:130
25253462131,8sleep02521357-21/usr/sbin/munin21:25:210
24052622132,5sleep12405281-21apt-get19:35:121
26253642121,7sleep22625418-21pmu-power23:00:222
25887042121,7sleep12588826-21/usr/sbin/munin22:25:221
25271122121,7sleep22527520-21kthreadcore21:30:162
25095792120,7sleep12505586-21/usr/sbin/munin21:10:191
24794452121,5sleep02479648-21diskstats20:45:130
27159442111,3sleep22716121-21latency_hist00:30:002
26832742111,5sleep12683331-21ntp_states23:55:201
26476082111,5sleep02647811-21diskstats23:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional