You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 10:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu May 14, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162729912441213,26cyclictest16741-21cut19:25:161
162719911451110,29cyclictest16808-21fschecks_time19:25:150
161152657611,30sleep10-21swapper/119:23:561
158942582501,64sleep00-21swapper/019:21:380
74712480,9sleep01627199cyclictest21:50:180
1627199394,11cyclictest81rcu_preempt19:47:550
16271993714,18cyclictest14924-21ntp_states23:35:250
1627199363,28cyclictest25245-21turbostat.cron00:04:590
204292351,30sleep02225-21dbus-daemon19:32:490
88552341,9sleep10-21swapper/120:28:361
322582341,29sleep132337-21iostat21:30:191
265622341,29sleep126730-21df19:50:111
1627199348,5cyclictest14652-21idleruntime-cro20:45:000
91002330,5sleep0111rcuc/020:30:000
1627199321,4cyclictest81rcu_preempt20:20:210
16271993213,6cyclictest9814-21python21:55:260
16271993212,6cyclictest3413-21irqstats23:05:190
10612321,4sleep11063-21sh20:06:591
99022311,5sleep10-21swapper/123:22:101
93162310,4sleep041ktimersoftd/020:30:100
214542311,3sleep10-21swapper/123:54:591
1627299311,28cyclictest0-21swapper/122:31:381
1627199311,19cyclictest31853-21seq20:04:090
306982301,25sleep130702-21ntp_states21:25:241
193862301,4sleep119424-21hddtemp_smartct19:30:161
1627299306,20cyclictest0-21swapper/120:35:251
16272993010,17cyclictest22-21ksoftirqd/120:40:211
1627199307,10cyclictest0-21swapper/023:33:270
1627199301,4cyclictest81rcu_preempt20:19:410
16271993011,6cyclictest0-21swapper/021:05:150
96842291,5sleep10-21swapper/100:48:191
85032291,5sleep10-21swapper/121:53:371
80852291,5sleep10-21swapper/123:17:591
40162291,5sleep10-21swapper/121:40:261
32812291,5sleep10-21swapper/120:14:261
255102291,5sleep00-21swapper/021:10:370
255102291,5sleep00-21swapper/021:10:360
242792291,5sleep10-21swapper/119:43:381
214512291,5sleep10-21swapper/122:26:101
20852291,5sleep00-21swapper/000:28:540
200412291,5sleep00-21swapper/020:57:320
183552291,5sleep00-21swapper/020:54:320
18082291,5sleep10-21swapper/100:26:081
163642291,5sleep10-21swapper/120:48:201
16272992920,5cyclictest3888-21cut20:15:181
1627199293,12cyclictest0-21swapper/019:51:350
1627199292,3cyclictest81rcu_preempt20:08:150
1627199291,4cyclictest81rcu_preempt23:10:550
1627199291,15cyclictest32350-21irqstats21:30:200
1627199291,15cyclictest24648-21/usr/sbin/munin22:35:240
126842291,5sleep00-21swapper/020:39:230
120152291,5sleep00-21swapper/022:00:540
102622291,5sleep10-21swapper/121:57:231
96052281,5sleep00-21swapper/000:47:300
8132281,5sleep10-21swapper/123:00:061
78572281,4sleep00-21swapper/023:15:390
43232281,5sleep10-21swapper/123:07:541
324132281,5sleep10-21swapper/100:21:271
311972281,5sleep10-21swapper/122:54:481
293812281,5sleep00-21swapper/021:21:380
292512281,5sleep10-21swapper/122:49:021
271882281,5sleep00-21swapper/022:42:050
257592281,5sleep10-21swapper/121:13:121
257592281,5sleep10-21swapper/121:13:111
257522281,5sleep10-21swapper/122:40:071
24102281,5sleep00-21swapper/023:03:270
219352281,5sleep10-21swapper/121:02:321
217942281,5sleep00-21swapper/021:01:010
174472281,5sleep00-21swapper/023:42:200
1627299284,8cyclictest9451-21diskstats20:30:131
16272992818,6cyclictest27731-21fschecks_time00:10:151
16272992818,6cyclictest12773-21cpuspeed_turbos22:05:111
1627199283,13cyclictest10629-21df23:25:130
1627199282,3cyclictest81rcu_preempt22:05:370
1627199282,14cyclictest0-21swapper/020:47:090
1627199282,12cyclictest29072-21needreboot19:55:220
16271992812,4cyclictest0-21swapper/022:57:580
1627199281,22cyclictest22189-21grep22:30:120
16271992811,5cyclictest26567-21perl21:15:170
1627199281,13cyclictest18271-21sort23:45:160
160622281,5sleep10-21swapper/122:14:001
157842281,5sleep10-21swapper/123:39:501
122122281,5sleep10-21swapper/123:30:061
114812281,5sleep10-21swapper/100:52:311
113692281,23sleep111523-21tail23:25:271
60722271,5sleep10-21swapper/123:11:361
3312271,5sleep10-21swapper/122:56:561
29872271,4sleep00-21swapper/020:11:240
286172271,4sleep00-21swapper/000:11:130
268112271,5sleep00-21swapper/000:06:580
255122271,5sleep10-21swapper/122:39:241
222392271,4sleep10-21swapper/119:37:061
195712271,5sleep10-21swapper/123:49:551
176332271,5sleep10-21swapper/122:15:451
173372271,5sleep10-21swapper/123:41:091
1627299273,18cyclictest22219-21iostat_ios23:55:191
16272992718,5cyclictest30659-21fschecks_time20:00:171
16272992717,6cyclictest8103-21cat00:45:021
16272992717,6cyclictest7034-21runrttasks20:24:061
16272992717,6cyclictest29561-21cut00:15:141
16272992711,13cyclictest18233-21/usr/sbin/munin22:20:261
16272992710,12cyclictest10050irq/91-xhci_hcd00:35:141
1627199273,4cyclictest81rcu_preempt23:50:010
1627199272,21cyclictest310-21munin-run00:25:000
1627199271,4cyclictest81rcu_preempt22:17:320
1627199271,23cyclictest0-21swapper/000:31:330
1627199271,13cyclictest8471-21basename23:20:120
1627199271,13cyclictest7264-21switchtime00:40:290
1627199271,13cyclictest3286-21runrttasks00:35:060
16271992710,6cyclictest30569-21cron00:17:000
16271992710,13cyclictest4758-21taskset21:43:380
114172271,5sleep00-21swapper/000:51:530
282332261,5sleep00-21swapper/022:45:220
27462261,5sleep10-21swapper/121:38:141
266822261,5sleep10-21swapper/100:05:391
262092261,5sleep10-21swapper/119:49:111
221642261,5sleep00-21swapper/023:55:190
1627299263,17cyclictest28295-21diskstats21:20:151
1627299263,17cyclictest11296-21iostat_ios22:00:191
1627299262,4cyclictest81rcu_preempt00:30:151
16272992617,5cyclictest5672-21uname21:45:201
16272992610,3cyclictest0-21swapper/121:15:231
1627199269,5cyclictest31358-21taskset21:27:390
1627199268,12cyclictest22893-21cpuspeed_turbos19:40:120
1627199262,12cyclictest5879-21ntp_states21:45:230
1627299253,17cyclictest28623-21diskstats19:55:151
16272992512,7cyclictest22634-21diskstats21:05:141
16271992516,6cyclictest3-21ksoftirqd/022:11:120
16271992515,6cyclictest30737-21grep22:50:270
16271992515,6cyclictest22034-21grep19:35:300
16271992513,7cyclictest18520-21df_inode22:20:130
1627199251,13cyclictest0-21swapper/021:38:350
1627199251,11cyclictest21598-21chrt22:27:400
16272992416,5cyclictest22-21ksoftirqd/100:01:561
16272992414,6cyclictest19576-21runrttasks20:55:261
16272992316,4cyclictest22-21ksoftirqd/120:50:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional