You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 21:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri May 29, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
224219911671147,14cyclictest23186-21munin-node07:30:011
220182630583,32sleep00-21swapper/007:21:210
215062564517,30sleep10-21swapper/107:20:271
224209911186,19cyclictest23035-21latency_hist07:30:010
122562930,9sleep12242199cyclictest08:45:231
22420995923,6cyclictest23950-21/usr/sbin/munin07:30:110
2242099555,11cyclictest5075-21getprofile11:19:080
22420995216,6cyclictest31786-21sshd12:26:460
265162510,4sleep1201rcuc/110:50:161
78702450,2sleep07871-21expr12:50:100
2242099451,13cyclictest31781-21awk09:40:000
37152420,5sleep1201rcuc/108:15:091
308832361,31sleep130892-21ntp_states09:35:251
2242099369,14cyclictest13232-21cpu08:50:120
22420993415,7cyclictest25222-21switchtime10:45:280
69312330,2chrt6930-21swap11:20:281
68512331,28sleep16902-21memory08:25:221
22421993320,8cyclictest7732-21iostat_ios10:00:191
22421993223,5cyclictest24443-21iostat07:30:181
2242199321,19cyclictest4737-21udevd11:19:111
54422311,5sleep10-21swapper/112:44:071
22421993122,6cyclictest24869-21grep12:10:101
2242199311,8cyclictest20486-21aten_r4power_vo10:35:121
2242099318,19cyclictest277432chrt09:27:060
22420993110,6cyclictest27765-21seq07:41:120
146432310,7sleep114642-21grep11:40:281
306302301,4sleep130639-21df_inode12:25:141
2242199305,3cyclictest81rcu_preempt10:45:391
2242199304,10cyclictest17472-21diskstats11:50:151
2242199303,4cyclictest81rcu_preempt08:07:371
22421993020,6cyclictest1990-21proc_pri11:10:241
2242099305,13cyclictest40250irq/92-i91512:40:270
2242099302,15cyclictest0-21swapper/008:11:300
22420993012,5cyclictest12970-21munin-run08:50:010
22420993012,5cyclictest10019-21mailstats10:05:260
2242099301,17cyclictest81rcu_preempt08:45:000
22420993011,7cyclictest0-21swapper/011:45:590
22420993011,5cyclictest8148-21python10:00:260
2242099301,12cyclictest31385-21latency_hist08:00:010
163592301,5sleep10-21swapper/110:23:521
114192301,25sleep111477-21iostat10:10:191
74342291,24sleep17570-21sort12:50:001
6562291,5sleep10-21swapper/111:07:061
2242199299,7cyclictest27689-21seq09:26:341
2242199296,4cyclictest81rcu_preempt07:39:221
2242199296,3cyclictest81rcu_preempt08:44:171
2242199295,4cyclictest81rcu_preempt10:55:341
2242199295,4cyclictest81rcu_preempt10:32:101
2242199295,4cyclictest81rcu_preempt09:53:401
2242199291,4cyclictest81rcu_preempt10:18:321
2242199291,15cyclictest27401-21/usr/sbin/munin12:15:221
22421992911,14cyclictest23359-21idleruntime12:05:171
2242099299,7cyclictest19964-21runrttasks10:32:200
2242099297,5cyclictest28252-21fschecks_count10:55:160
2242099294,6cyclictest21613-21mailstats09:10:260
2242099294,4cyclictest81rcu_preempt12:13:530
2242099292,14cyclictest26577-21/usr/sbin/munin12:15:230
2242099291,4cyclictest81rcu_preempt11:41:230
2242099291,4cyclictest81rcu_preempt10:54:520
2242099291,4cyclictest81rcu_preempt07:52:020
22420992912,5cyclictest32200-21strings08:00:230
22420992912,12cyclictest316-21fschecks_time12:30:170
2242099291,15cyclictest7928-21cron08:30:000
22420992911,5cyclictest441-21unixbench_singl11:05:290
2242099291,15cyclictest25796-21sshd09:21:220
104832291,4sleep110487-21ntp_states11:30:261
7942281,5sleep10-21swapper/109:40:461
34502281,5sleep10-21swapper/108:14:151
238702281,5sleep10-21swapper/110:43:411
225782281,5sleep10-21swapper/112:04:081
225782281,5sleep10-21swapper/112:04:081
2242199288,8cyclictest90362chrt12:52:061
2242199288,6cyclictest2225-21dbus-daemon11:56:551
2242199287,18cyclictest1622-21ls12:35:001
2242199284,4cyclictest81rcu_preempt09:21:351
2242199283,4cyclictest81rcu_preempt07:54:041
22421992811,5cyclictest13261-21cpu08:50:111
2242199281,14cyclictest28784-21irqstats09:30:201
2242099289,7cyclictest7505-21seq11:23:570
2242099289,6cyclictest11384-21hddtemp_smartct10:10:180
2242099289,5cyclictest9759-21aten_r4power_vo11:30:140
2242099283,12cyclictest22570-21df10:40:130
2242099282,4cyclictest81rcu_preempt11:39:510
2242099282,14cyclictest2551-21seq11:11:550
2242099282,14cyclictest0-21swapper/007:39:350
2242099282,11cyclictest17909-21vmstat10:25:320
2242099281,4cyclictest81rcu_preempt09:44:530
2242099281,15cyclictest23672-21/usr/sbin/munin09:15:280
2242099281,14cyclictest6297-21iwlist12:45:190
22420992810,6cyclictest16298-21taskset08:55:450
144652281,5sleep00-21swapper/010:18:540
66292271,5sleep10-21swapper/109:56:391
54002271,5sleep10-21swapper/108:20:001
308042271,5sleep10-21swapper/107:55:151
283702271,5sleep10-21swapper/107:46:011
238722271,4sleep10-21swapper/109:16:081
2242199278,6cyclictest17027-21fschecks_count10:25:181
2242199277,15cyclictest2695-21snmpd09:06:351
2242199273,19cyclictest10445-21watchsnmpd08:40:001
2242199273,17cyclictest11826-21diskstats11:35:151
2242199271,9cyclictest32198-21grep08:00:231
2242199271,22cyclictest21100-21fschecks_time09:10:161
2242099273,4cyclictest81rcu_preempt12:01:410
2242099273,4cyclictest81rcu_preempt12:01:410
2242099272,13cyclictest2225-21dbus-daemon12:23:370
2242099271,9cyclictest6074-21ntp_states09:55:250
2242099271,4cyclictest81rcu_preempt12:37:000
2242099271,18cyclictest0-21swapper/008:17:230
2242099271,17cyclictest0-21swapper/009:01:390
182592271,5sleep10-21swapper/109:01:241
33622261,4sleep10-21swapper/112:37:341
2242199269,6cyclictest16350-21sed11:45:281
2242199266,4cyclictest81rcu_preempt07:40:481
2242199264,4cyclictest81rcu_preempt08:30:051
2242199263,3cyclictest81rcu_preempt09:48:451
22421992616,6cyclictest29608-21sort12:20:271
2242199261,10cyclictest8055-21df11:25:111
2242099268,5cyclictest0-21swapper/011:57:160
2242099262,8cyclictest0-21swapper/011:00:270
22420992617,5cyclictest21199-21ntpq10:35:240
2242099261,22cyclictest0-21swapper/009:50:240
2242099261,17cyclictest0-21swapper/008:23:510
2242099261,13cyclictest28783-21uname09:30:190
2242099261,13cyclictest2751-21taskset08:09:190
2242099261,13cyclictest24519-21taskset12:09:490
2242099261,12cyclictest17673-21smartctl11:50:170
22420992611,12cyclictest9115-21grep08:35:140
22420992610,5cyclictest8584-21ntpdc11:25:220
2242199253,10cyclictest0-21swapper/108:56:061
2242199251,10cyclictest10734-21latency_hist10:10:001
2242099251,16cyclictest0-21swapper/007:45:410
2242099251,15cyclictest0-21swapper/010:23:540
22420992511,10cyclictest2513-21timerandwakeup09:45:310
2242199241,9cyclictest30871-21wc11:00:281
2242099247,13cyclictest0-21swapper/008:30:470
22420992313,6cyclictest19900-21ls09:05:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional