You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sun Apr 26, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122459912511206,24cyclictest0-21swapper/019:25:130
122469912231197,21cyclictest30958-21ntp_states21:20:261
120322722675,32sleep00-21swapper/019:23:210
121872581500,39sleep10-21swapper/119:24:591
1224699245223,19cyclictest12232-21kworker/1:019:25:131
1224599198178,15cyclictest0-21swapper/021:20:250
2455221310,8sleep01224599cyclictest21:47:250
58342611,40sleep05939-21fschecks_time00:50:160
57272540,5sleep01224599cyclictest20:30:200
223512470,4sleep1201rcuc/100:00:011
12245994015,7cyclictest3-21ksoftirqd/000:41:050
1224599401,14cyclictest25721-21idleruntime-cro23:29:590
1224599401,14cyclictest25721-21idleruntime-cro23:29:590
169102391,5sleep116911-21sh21:40:061
12245993923,6cyclictest3-21ksoftirqd/000:01:510
12245993922,6cyclictest3-21ksoftirqd/021:25:260
12245993917,7cyclictest3-21ksoftirqd/022:53:370
12245993914,5cyclictest19229-21wget00:30:120
12245993823,5cyclictest3-21ksoftirqd/000:11:490
1224599381,13cyclictest1257-21/usr/sbin/munin20:20:130
320022371,5sleep00-21swapper/022:29:140
12245993720,6cyclictest3-21ksoftirqd/019:36:060
1224599371,22cyclictest26076-21/usr/sbin/munin21:15:250
1224599362,21cyclictest4082-21ntp_states20:25:250
12245993620,5cyclictest3-21ksoftirqd/021:53:480
12245993612,8cyclictest3-21ksoftirqd/023:19:030
1224599361,22cyclictest196812chrt23:56:090
10002360,9sleep01224599cyclictest23:04:220
51682350,3sleep00-21swapper/000:15:160
133982351,30sleep113413-21ssh00:24:011
1224699358,5cyclictest81rcu_preempt22:53:361
12245993519,6cyclictest3-21ksoftirqd/020:04:530
12245993512,8cyclictest3-21ksoftirqd/022:38:570
172362341,5sleep117281-21ntp_states23:20:231
143242341,5sleep114335-21sh22:44:341
1224699347,23cyclictest0-21swapper/100:45:101
1224699343,4cyclictest81rcu_preempt23:25:251
1224699343,4cyclictest81rcu_preempt23:25:241
1224699342,4cyclictest81rcu_preempt22:20:401
1224599348,15cyclictest0-21swapper/022:32:070
1224599345,18cyclictest8125-21ls20:35:270
12245993419,5cyclictest3-21ksoftirqd/020:14:000
12245993418,5cyclictest3-21ksoftirqd/021:34:380
12245993418,5cyclictest3-21ksoftirqd/019:33:260
12245993418,5cyclictest3-21ksoftirqd/019:33:250
1224599341,21cyclictest30957-21egrep23:35:110
12245993411,7cyclictest14982-21aten_r4power_po22:45:120
12245993411,7cyclictest14982-21aten_r4power_po22:45:120
275562330,5sleep127554-21rm21:50:251
20932331,5sleep12256-21perl23:05:171
200482331,4sleep120049-21sshd19:41:331
186652330,5sleep1201rcuc/122:15:121
1224699339,11cyclictest0-21swapper/122:11:041
1224699332,17cyclictest16689-21munin-run21:39:591
1224699331,4cyclictest81rcu_preempt22:38:571
1224699331,29cyclictest137450irq/90-eth021:48:101
1224699331,12cyclictest291482cron23:33:001
1224599332,12cyclictest0-21swapper/023:41:380
12245993318,5cyclictest3-21ksoftirqd/020:54:380
12245993315,6cyclictest1353-21diskstats00:45:150
12245993313,6cyclictest3-21ksoftirqd/022:20:400
12245993312,6cyclictest3-21ksoftirqd/023:24:460
12245993310,7cyclictest3-21ksoftirqd/021:58:140
231892321,4sleep123277-21iostat00:00:191
186002321,5sleep00-21swapper/021:05:170
12246993217,8cyclictest29147-21diskstats00:40:151
1224599329,8cyclictest3-21ksoftirqd/021:02:210
1224599329,12cyclictest3-21ksoftirqd/000:06:230
1224599328,8cyclictest2401-21NetworkManager22:10:580
1224599328,13cyclictest4682-21sh23:07:330
12245993213,6cyclictest10797-21irqstats22:40:200
1224599321,12cyclictest7188-21hddtemp_smartct23:10:170
113612321,4sleep111368-21iostat_ios20:45:211
321472310,3sleep132157-21ssh22:29:281
244132311,5sleep10-21swapper/121:14:221
224542311,26sleep122465-21ssh00:33:131
1224699318,19cyclictest0-21swapper/121:30:241
1224699311,4cyclictest81rcu_preempt23:19:031
1224699311,26cyclictest0-21swapper/100:52:201
1224699311,16cyclictest32079-21iostat21:55:181
1224599319,8cyclictest3-21ksoftirqd/020:44:320
1224599318,8cyclictest3-21ksoftirqd/000:20:490
12245993118,10cyclictest0-21swapper/022:15:280
12245993111,6cyclictest3-21ksoftirqd/023:48:280
12245993110,7cyclictest3-21ksoftirqd/020:16:120
12245993110,16cyclictest4723-21missed_timers22:00:240
102802311,5sleep10-21swapper/123:46:311
72272301,25sleep17239-21rm23:44:071
289282301,5sleep10-21swapper/122:59:491
1224699307,19cyclictest0-21swapper/121:26:171
1224699304,23cyclictest0-21swapper/123:03:401
1224699302,25cyclictest13254-21iostat_ios20:50:201
1224699302,18cyclictest0-21swapper/122:01:271
1224699301,8cyclictest14985-21rm22:45:121
1224699301,8cyclictest14985-21rm22:45:121
12246993014,12cyclictest22-21ksoftirqd/122:31:131
12246993012,15cyclictest0-21swapper/121:16:181
1224699301,16cyclictest0-21swapper/119:35:261
1224599307,6cyclictest0-21swapper/022:05:130
1224599306,13cyclictest12243-21cyclictest00:28:410
1224599301,9cyclictest17376-21sh21:40:160
12245993017,8cyclictest2225-21dbus-daemon00:37:040
12245993015,5cyclictest19606-21/usr/sbin/munin19:40:260
12245993012,6cyclictest21181-21ssh21:10:240
12245993011,7cyclictest27442-21ssh23:30:320
1224599301,15cyclictest15132-21irqstats20:55:200
12245993010,6cyclictest3-21ksoftirqd/020:05:570
258872291,5sleep00-21swapper/019:58:450
225242291,5sleep10-21swapper/119:50:131
165682291,5sleep10-21swapper/123:53:401
1224699296,4cyclictest81rcu_preempt00:08:381
1224699296,3cyclictest81rcu_preempt20:05:561
1224699294,18cyclictest15126-21iostat_ios20:55:201
1224699292,23cyclictest30631-21memory20:10:221
12246992915,5cyclictest22-21ksoftirqd/123:13:541
1224699291,25cyclictest0-21swapper/100:10:241
12246992912,13cyclictest24797-21ssh00:35:231
12246992911,14cyclictest0-21swapper/100:28:131
12246992910,5cyclictest3286-21runrttasks22:08:311
1224599297,8cyclictest3-21ksoftirqd/022:57:210
1224599293,13cyclictest22921-21hddtemp_smartct19:50:170
12245992913,6cyclictest20970-21fschecks_time19:45:160
12245992912,5cyclictest11923-21ls20:45:290
67292281,5sleep10-21swapper/120:33:571
27712281,4sleep10-21swapper/120:22:321
257032281,5sleep10-21swapper/119:56:511
1224699289,16cyclictest0-21swapper/100:16:591
12246992818,6cyclictest17231-21ntpq21:00:241
12246992816,9cyclictest22-21ksoftirqd/123:36:141
1224599284,6cyclictest0-21swapper/021:36:120
1224599281,13cyclictest13913-21ntp_states23:50:250
104012281,5sleep10-21swapper/120:42:541
8912271,5sleep10-21swapper/120:18:081
1224699271,7cyclictest0-21swapper/119:30:141
1224699271,7cyclictest0-21swapper/119:30:131
85972261,5sleep10-21swapper/120:38:501
276472261,5sleep10-21swapper/120:02:191
1224699262,3cyclictest81rcu_preempt20:25:241
1224699251,3cyclictest81rcu_preempt21:08:251
1224699231,18cyclictest20585-21cut19:45:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional