You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 18:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Jul 26, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60329912331205,24cyclictest30564-21users09:50:301
60329911321117,12cyclictest0-21swapper/107:25:151
56242562518,29sleep10-21swapper/107:21:181
42692544498,31sleep00-21swapper/007:20:100
603199257215,37cyclictest6175-21/usr/sbin/munin07:25:150
603199126103,18cyclictest0-21swapper/009:50:300
6032997019,17cyclictest22378-21sendmail_mailst10:55:291
6032996817,16cyclictest26881-21/usr/sbin/munin12:35:131
6032996717,16cyclictest2695-21snmpd10:54:161
6032996717,13cyclictest2454-21diskstats11:30:151
6032996619,11cyclictest16339-21munin-run07:50:001
6032996616,17cyclictest29009-21taskset09:48:411
6032996517,16cyclictest32374-21taskset12:50:051
6032996516,17cyclictest16631-21sh10:40:261
6032996516,15cyclictest15880-21taskset09:14:041
6032996515,16cyclictest17894-21grep12:10:181
6032996515,15cyclictest15046-21grep10:35:291
6032996417,16cyclictest2695-21snmpd12:09:301
6032996416,15cyclictest3464-21smartctl08:40:171
6032996416,15cyclictest19447-21taskset09:21:571
6032996416,15cyclictest13363-21chrt10:31:091
6032996317,15cyclictest9843-21seq10:23:361
6032996317,15cyclictest9843-21seq10:23:361
6032996317,15cyclictest29200-21irqstats12:40:201
6032996316,15cyclictest31179-21/usr/sbin/munin09:55:291
6032996316,15cyclictest25835-21df09:40:151
6032996315,17cyclictest7863-21chrt10:17:441
6032996315,15cyclictest6354-21cat10:15:011
6032996315,15cyclictest6318-21runrttasks08:47:271
6032996315,14cyclictest11941-21df_inode11:55:131
6032996217,15cyclictest18221-21cat10:45:171
6032996216,14cyclictest27294-21chrt08:16:501
6032996216,14cyclictest22926-21latency_hist12:25:021
6032996215,16cyclictest4147-21runrttasks10:08:121
6032996215,16cyclictest32052-21wget08:30:201
6032996215,15cyclictest888-21expr10:00:141
6032996215,15cyclictest16670-21cat07:50:131
6032996215,15cyclictest10344-21chrt07:34:061
6032996215,14cyclictest5451-21sh11:36:001
6032996215,14cyclictest2581-21sshd08:38:431
6032996215,14cyclictest21713-21latency_hist09:30:011
6032996215,14cyclictest10627-21grep10:25:221
6032996214,16cyclictest8375-21chrt08:54:171
6032996214,15cyclictest24703-21latency_hist12:30:001
6032996214,13cyclictest23317-21/usr/sbin/munin11:00:171
6032996117,15cyclictest22684-21cat08:05:201
6032996116,16cyclictest16309-21cpuspeed_turbos09:15:131
6032996116,15cyclictest24149-21hddtemp_smartct09:35:171
6032996115,14cyclictest25766-21cat08:15:001
6032996115,14cyclictest25766-21cat08:15:001
6032996114,16cyclictest12191-21runrttasks07:38:251
6032996016,15cyclictest18549-21cat07:55:141
6032996016,14cyclictest29116-21cat11:15:141
6032996014,15cyclictest11863-21runrttasks09:01:201
6032996014,14cyclictest19690-21wget12:15:201
6032995916,15cyclictest13550-21smartctl-wrappe07:40:281
6032995915,15cyclictest30677-21cat12:45:131
6032995915,14cyclictest27789-21/usr/sbin/munin08:20:161
6032995815,11cyclictest26434-21chrt12:33:591
6032995715,14cyclictest26020-21sh11:05:241
6032995617,16cyclictest8708-21awk11:45:231
6032995615,13cyclictest6187-21cpuspeed_turbos11:40:131
6032995615,13cyclictest31674-21ntpq11:20:251
6032995514,13cyclictest30494-21ntpq08:25:251
6032995417,15cyclictest3286-21runrttasks11:27:361
6032995415,17cyclictest10718-21gzip11:50:281
6032995415,17cyclictest10718-21gzip11:50:281
6032995415,14cyclictest13833-21df12:00:131
6032995414,13cyclictest13208-21ntpq09:05:221
6032995317,15cyclictest3286-21runrttasks11:11:091
6032995315,15cyclictest2695-21snmpd09:33:591
6032995313,14cyclictest9111-21smartctl08:55:211
6032995217,15cyclictest21606-21taskset08:01:071
603199374,10cyclictest81rcu_preempt11:31:470
603199363,10cyclictest81rcu_preempt08:51:570
6031993525,6cyclictest25086-21ls12:30:120
603199351,15cyclictest4630-21sshd08:44:280
603199351,13cyclictest0-21swapper/008:19:490
322142351,5sleep03-21ksoftirqd/012:50:000
603199346,5cyclictest81rcu_preempt10:10:110
603199341,13cyclictest22255-21aten_r4power_vo08:05:130
42042341,4sleep011565-21gdbus10:08:490
603199331,8cyclictest81rcu_preempt09:55:030
603199331,14cyclictest0-21swapper/008:29:040
603199323,4cyclictest81rcu_preempt07:57:520
603199322,18cyclictest0-21swapper/012:21:170
603199321,4cyclictest81rcu_preempt10:33:430
6031993210,11cyclictest3-21ksoftirqd/009:30:310
172852321,27sleep02225-21dbus-daemon10:42:450
603199313,4cyclictest81rcu_preempt11:35:100
603199313,14cyclictest30340-21basename12:45:010
603199311,4cyclictest81rcu_preempt09:38:070
603199311,4cyclictest81rcu_preempt08:13:460
603199311,4cyclictest81rcu_preempt08:13:460
603199310,4cyclictest81rcu_preempt08:38:230
134972310,5sleep0111rcuc/009:05:270
603199309,7cyclictest20957-21memory08:00:230
603199306,4cyclictest81rcu_preempt09:15:120
603199303,4cyclictest81rcu_preempt10:25:370
603199301,4cyclictest81rcu_preempt10:58:120
603199301,4cyclictest81rcu_preempt09:04:220
6031993014,13cyclictest3-21ksoftirqd/008:58:380
603199301,24cyclictest15250-21chrt10:36:170
603199301,20cyclictest0-21swapper/010:20:190
603199301,20cyclictest0-21swapper/010:20:190
6031993011,6cyclictest23234-21df12:25:140
603199301,10cyclictest30668-21sh11:20:010
603199300,5cyclictest81rcu_preempt09:28:150
256312301,5sleep00-21swapper/009:40:130
603199293,5cyclictest81rcu_preempt11:05:010
603199292,16cyclictest0-21swapper/010:04:550
603199292,14cyclictest12919-21users11:55:290
603199291,17cyclictest11564-21packagekitd11:23:350
603199291,15cyclictest28166-21/usr/sbin/munin11:10:300
6031992911,5cyclictest0-21swapper/007:40:280
6031992910,6cyclictest8302-21fschecks_time11:45:160
6031992910,6cyclictest6581-21sh08:50:000
6031992910,5cyclictest9945-21head07:30:270
603199290,4cyclictest81rcu_preempt10:45:290
111692291,5sleep00-21swapper/011:51:420
111692291,5sleep00-21swapper/011:51:410
7172281,5sleep00-21swapper/008:34:150
603199289,6cyclictest6957-21iostat10:15:180
603199283,4cyclictest81rcu_preempt12:12:070
603199282,13cyclictest28255-21perl08:20:160
603199281,4cyclictest81rcu_preempt11:44:250
603199281,19cyclictest0-21swapper/010:52:350
603199281,18cyclictest0-21swapper/007:50:100
603199280,4cyclictest81rcu_preempt12:52:560
277122280,6sleep06029-21cyclictest09:45:140
251802281,5sleep00-21swapper/011:05:040
171062281,4sleep00-21swapper/012:09:410
156392281,4sleep00-21swapper/009:11:340
6031992717,6cyclictest14298-21needreboot12:00:230
603199271,14cyclictest27000-21diskstats12:35:160
603199271,14cyclictest19293-21users09:20:280
6031992710,4cyclictest32766-21aten_r4power_en11:25:120
603199262,11cyclictest11649-21python07:35:280
603199261,4cyclictest81rcu_preempt07:46:410
603199258,13cyclictest19462-21df12:15:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional