You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 14:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Dec 11, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33709912301198,27cyclictest14765-21grep19:50:271
33699912131178,31cyclictest3699-21grep19:25:140
33709911201110,7cyclictest0-21swapper/119:25:131
17202510452,46sleep00-21swapper/019:20:150
32572462417,30sleep10-21swapper/119:24:261
336999209179,27cyclictest0-21swapper/019:50:260
3045021230,5sleep1337099cyclictest00:50:291
190021150,27sleep01901-21aten_r4power_po20:45:120
46202970,4sleep0336999cyclictest00:24:080
308552910,9sleep1337099cyclictest22:36:261
109102910,5sleep041ktimersoftd/000:30:190
199112850,6sleep119896-21latency22:25:221
114692790,3sleep1211ktimersoftd/121:10:111
176602780,4sleep041ktimersoftd/021:50:060
127372650,2sleep112736-21ssh22:51:031
4402630,5sleep0441-21kernelversion22:05:230
197702470,7sleep1337099cyclictest21:51:211
314442450,4sleep1211ktimersoftd/123:45:011
180412440,4sleep1337099cyclictest22:56:461
3369993923,6cyclictest3-21ksoftirqd/019:55:050
3369993923,5cyclictest3-21ksoftirqd/023:18:590
3369993922,6cyclictest3-21ksoftirqd/022:55:430
3369993821,6cyclictest3-21ksoftirqd/023:55:080
3369993821,6cyclictest3-21ksoftirqd/023:55:080
3369993821,6cyclictest3-21ksoftirqd/020:14:000
3369993820,6cyclictest3-21ksoftirqd/023:53:510
3369993820,6cyclictest3-21ksoftirqd/000:45:030
3369993814,4cyclictest24344-21sh23:36:540
337099373,5cyclictest81rcu_preempt22:05:331
3369993721,6cyclictest3-21ksoftirqd/021:49:350
3369993721,6cyclictest3-21ksoftirqd/020:37:470
3369993721,5cyclictest3-21ksoftirqd/022:13:260
3369993720,6cyclictest3-21ksoftirqd/023:09:510
3369993720,6cyclictest3-21ksoftirqd/022:40:420
3369993719,6cyclictest3-21ksoftirqd/022:22:410
3369993714,13cyclictest1555-21runrttasks21:33:040
337099361,10cyclictest16127-21ntp_states00:35:271
336999369,14cyclictest21626-21sh22:27:010
3369993621,5cyclictest3-21ksoftirqd/022:54:180
3369993621,5cyclictest3-21ksoftirqd/019:46:480
3369993620,6cyclictest3-21ksoftirqd/020:53:140
90452351,29sleep19068-21ntp_states21:40:261
3369993521,4cyclictest3-21ksoftirqd/022:17:150
3369993521,4cyclictest3-21ksoftirqd/022:17:150
3369993520,5cyclictest3-21ksoftirqd/021:19:520
3369993520,4cyclictest3-21ksoftirqd/023:45:430
3369993519,5cyclictest3-21ksoftirqd/021:37:530
3369993518,5cyclictest3-21ksoftirqd/019:39:070
189342351,4sleep019090-21fschecks_time00:05:200
337099345,4cyclictest81rcu_preempt21:17:181
337099341,13cyclictest129412ssh22:18:261
337099341,13cyclictest129412ssh22:18:251
3369993419,5cyclictest3-21ksoftirqd/021:08:420
3369993419,5cyclictest3-21ksoftirqd/000:18:240
3369993418,5cyclictest3-21ksoftirqd/000:37:340
3369993412,8cyclictest18215-21ssh23:30:270
244412341,4sleep024616-21cut00:45:000
105692341,4sleep010627-21/usr/sbin/munin19:40:260
88252331,28sleep08836-21ssh00:28:150
3369993318,5cyclictest3-21ksoftirqd/020:58:450
3369993318,5cyclictest3-21ksoftirqd/020:02:130
3369993318,5cyclictest3-21ksoftirqd/000:02:110
3369993315,5cyclictest3-21ksoftirqd/021:41:450
39452321,4sleep13959-21ssh23:50:031
337099324,24cyclictest0-21swapper/121:27:201
337099322,26cyclictest0-21swapper/122:45:011
337099322,24cyclictest8596-21memory19:35:211
3370993211,15cyclictest24255-21df_inode22:30:141
3369993217,5cyclictest3-21ksoftirqd/020:31:070
336999321,6cyclictest26793-21ssh21:59:360
301472321,27sleep130159-21sh22:02:261
244322321,27sleep024489-21hddtemp_smartct22:30:170
162322321,26sleep116267-21ntp_states19:55:241
148732321,4sleep114884-21ssh21:46:161
337099318,19cyclictest0-21swapper/100:25:511
337099314,4cyclictest81rcu_preempt19:43:301
337099311,6cyclictest14432-21ssh22:20:121
337099311,4cyclictest81rcu_preempt23:23:041
337099311,4cyclictest81rcu_preempt23:23:031
337099311,13cyclictest0-21swapper/100:12:121
336999319,11cyclictest30044-21kernelversion00:50:210
3369993116,5cyclictest3-21ksoftirqd/020:06:110
336999311,5cyclictest81rcu_preempt23:43:040
3369993115,5cyclictest3-21ksoftirqd/021:02:080
3369993111,5cyclictest23664-21df00:10:140
336999311,10cyclictest0-21swapper/023:03:240
272672311,26sleep127341-21iostat20:25:211
163022311,4sleep116316-21ssh00:02:101
80092301,5sleep10-21swapper/122:13:171
337099309,17cyclictest0-21swapper/100:33:021
337099308,18cyclictest0-21swapper/121:32:091
337099308,16cyclictest0-21swapper/100:09:521
337099305,4cyclictest81rcu_preempt21:02:111
337099304,4cyclictest81rcu_preempt20:36:491
3370993020,6cyclictest28272-21wget00:15:131
3370993015,12cyclictest22-21ksoftirqd/123:01:211
337099301,4cyclictest81rcu_preempt21:06:571
3370993013,13cyclictest22-21ksoftirqd/123:39:531
337099301,14cyclictest7272-21runrttasks20:58:301
3370993010,6cyclictest30944-21snmpd23:25:061
336999308,8cyclictest3-21ksoftirqd/023:23:040
336999308,8cyclictest3-21ksoftirqd/023:23:030
3369993013,5cyclictest12822-21unixbench_multi21:10:290
3369993011,7cyclictest27855-21timerandwakeup20:25:310
336999301,12cyclictest0-21swapper/021:28:570
3369993010,6cyclictest29741-21ntp_states22:35:260
243642301,5sleep00-21swapper/020:16:410
187942301,4sleep181rcu_preempt20:02:211
141332301,5sleep00-21swapper/023:26:040
74192291,5sleep00-21swapper/019:31:360
33852291,5sleep10-21swapper/120:47:091
337099298,16cyclictest0-21swapper/123:13:421
337099295,4cyclictest81rcu_preempt20:14:021
337099295,20cyclictest0-21swapper/121:55:051
337099293,4cyclictest81rcu_preempt22:48:051
3370992919,5cyclictest22-21ksoftirqd/121:22:511
337099291,4cyclictest81rcu_preempt23:45:231
3370992913,12cyclictest0-21swapper/123:58:071
3370992913,12cyclictest0-21swapper/123:58:071
3370992911,14cyclictest0-21swapper/100:22:511
3370992910,5cyclictest22-21ksoftirqd/123:33:511
336999291,5cyclictest81rcu_preempt21:22:070
3369992912,6cyclictest25468-21/usr/sbin/munin20:20:190
3369992911,6cyclictest3020-21runrttasks23:10:550
336999291,14cyclictest7225-21/usr/sbin/munin22:45:280
337099288,16cyclictest0-21swapper/100:45:391
337099288,16cyclictest0-21swapper/100:40:041
337099286,4cyclictest81rcu_preempt19:47:501
337099286,18cyclictest0-21swapper/123:05:051
337099285,18cyclictest0-21swapper/123:15:561
337099282,22cyclictest3941-21iostat21:35:211
3370992820,5cyclictest132-21jbd2/sda2-820:25:001
337099281,4cyclictest81rcu_preempt20:42:161
336999288,4cyclictest30417-21ssh22:02:480
336999281,13cyclictest32682-21df20:40:130
286122281,4sleep10-21swapper/120:30:021
337099272,11cyclictest4108-21df20:50:141
3370992719,5cyclictest19267-21aten_r4power_en20:05:111
337099261,16cyclictest0-21swapper/119:30:301
3370992610,12cyclictest0-21swapper/120:15:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional