You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 22:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Sep 07, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319319912601234,23cyclictest8815-21kworker/1:107:25:131
319319910931063,15cyclictest31120-21strings10:10:241
315552522476,31sleep10-21swapper/107:21:391
318282462416,31sleep00-21swapper/007:24:310
319309912199,19cyclictest0-21swapper/010:10:230
254052870,8sleep00-21swapper/009:55:200
31930998467,14cyclictest0-21swapper/007:25:120
3193199592,15cyclictest3286-21runrttasks11:46:501
3193199584,19cyclictest24971-21iostat_ios11:20:191
3193199574,18cyclictest6685-21iostat_ios07:40:201
3193199521,10cyclictest9507-21munin-run09:15:001
3193199511,16cyclictest2192-21hddtemp_smartct10:20:171
3193199481,14cyclictest19169-21ntp_kernel_pll_12:30:231
253722480,8sleep13193199cyclictest08:30:151
253722480,8sleep13193199cyclictest08:30:141
31931994712,9cyclictest18422-21unixbench_singl09:35:301
3193199468,7cyclictest30107-21cpu11:35:121
133972460,8sleep03193099cyclictest12:15:210
3193199451,8cyclictest12069-21grep12:10:291
287802450,7sleep13193199cyclictest10:05:151
125322420,9sleep03193099cyclictest12:14:550
31931993721,12cyclictest9175-21latency_hist10:40:011
31930993617,6cyclictest28329-21latency_hist10:05:000
199432360,4sleep0111rcuc/011:05:290
31931993520,5cyclictest22-21ksoftirqd/111:27:001
31931993520,5cyclictest22-21ksoftirqd/111:26:591
31931993518,6cyclictest22-21ksoftirqd/109:29:141
31931993518,6cyclictest22-21ksoftirqd/108:17:111
31930993512,13cyclictest30101-21cut11:35:100
3193099351,20cyclictest16318-21cron12:24:590
82842341,4sleep08323-21sort09:10:180
31931993418,6cyclictest22-21ksoftirqd/110:53:441
3193099348,5cyclictest0-21swapper/010:15:370
3193099342,20cyclictest5479-21diskstats11:55:150
3193099341,11cyclictest32598-21missed_timers11:40:230
31931993317,6cyclictest22-21ksoftirqd/112:04:581
31931993317,6cyclictest22-21ksoftirqd/107:49:591
31931993316,6cyclictest22-21ksoftirqd/108:39:291
31930993317,7cyclictest8974-21python07:45:270
31930993317,7cyclictest8026-21iostat_ios10:35:190
3193099331,20cyclictest23419-21taskset12:40:350
31930993310,5cyclictest13793-21grep09:25:150
3193199328,13cyclictest40250irq/92-i91508:05:201
3193199321,7cyclictest30557-21cron08:45:001
31931993215,5cyclictest22-21ksoftirqd/107:30:141
3193099327,13cyclictest0-21swapper/012:53:520
3193099323,11cyclictest0-21swapper/012:05:170
3193099322,17cyclictest0-21swapper/007:30:130
3193099322,16cyclictest21061-21ntp_states12:35:240
3193099322,16cyclictest17087-21irqstats12:25:220
3193199318,4cyclictest81rcu_preempt10:49:321
3193199314,4cyclictest81rcu_preempt09:00:001
31931993117,4cyclictest22-21ksoftirqd/107:50:121
31931993116,5cyclictest22-21ksoftirqd/109:44:351
31931993115,6cyclictest22-21ksoftirqd/108:50:191
31931993115,6cyclictest22-21ksoftirqd/107:55:501
3193099315,15cyclictest6007-21aten_r4power_vo09:05:120
3193099312,14cyclictest17139-21df_inode11:00:140
31930993114,12cyclictest26682-21grep11:25:160
31930993114,12cyclictest26682-21grep11:25:150
31930993112,5cyclictest4481-21diskstats07:35:140
3193099311,19cyclictest29850-21grep08:40:280
31930993111,6cyclictest22062-21runrttasks11:12:260
228302311,26sleep00-21swapper/008:22:550
31931993016,4cyclictest22-21ksoftirqd/112:19:351
31931993015,5cyclictest22-21ksoftirqd/111:02:131
31931993015,5cyclictest22-21ksoftirqd/108:12:391
31931993014,5cyclictest22-21ksoftirqd/110:55:351
3193199301,25cyclictest111-21usb-storage09:05:191
3193099305,12cyclictest11110-21latency_hist10:45:010
3193099302,14cyclictest28768-21df10:05:140
31930993020,6cyclictest19477-21wget08:15:110
31930993012,5cyclictest11158-21apt-get07:51:000
31930993011,6cyclictest24028-21ntp_states08:25:240
31930993011,6cyclictest19681-21iostat09:40:190
31930993011,5cyclictest18239-21memory08:10:210
217672301,4sleep021793-21ntp_states09:45:250
197712301,5sleep00-21swapper/012:31:540
41642291,24sleep01-21init10:25:180
3193199299,7cyclictest24832-21taskset08:29:101
31931992921,5cyclictest28485-21fschecks_count11:30:151
3193199292,12cyclictest23443-21iostat_ios09:50:211
3193199291,7cyclictest16333-21pidof12:24:591
31931992913,6cyclictest22-21ksoftirqd/108:20:591
3193099299,6cyclictest3601-21diskstats11:50:140
3193099293,7cyclictest29839-21munin-run11:35:010
31930992921,5cyclictest15322-21fschecks_count10:55:150
3193099292,14cyclictest0-21swapper/010:30:510
3193099292,13cyclictest24568-21munin-plugin-st09:55:010
3193099292,13cyclictest23550-21/usr/sbin/munin11:15:270
3193099292,13cyclictest1163-21python08:50:290
3193099291,7cyclictest12395-21sshd07:55:170
31930992912,5cyclictest2737-21python10:20:270
3193099291,24cyclictest54502sleep009:01:580
31930992911,5cyclictest6974-21proc_pri07:40:260
31930992911,5cyclictest17684-21hddtemp_smartct09:35:170
31930992911,5cyclictest15808-21/usr/sbin/munin09:30:160
31930992911,5cyclictest11228-21wget10:45:110
317432291,5sleep00-21swapper/008:45:280
250722291,5sleep00-21swapper/008:30:080
250722291,5sleep00-21swapper/008:30:080
172772291,5sleep00-21swapper/008:08:570
86822281,4sleep00-21swapper/012:03:560
3193199283,11cyclictest15318-21/usr/sbin/munin09:30:161
3193199282,6cyclictest21488-21ps11:10:271
3193199282,22cyclictest0-21swapper/109:00:111
31931992813,5cyclictest22-21ksoftirqd/112:49:491
31931992813,5cyclictest22-21ksoftirqd/111:17:131
31931992813,11cyclictest24715-21/usr/sbin/munin09:55:221
31931992812,6cyclictest22-21ksoftirqd/112:05:041
31931992812,6cyclictest22-21ksoftirqd/109:48:341
3193199281,22cyclictest4682-21hddtemp_smartct07:35:171
3193199281,14cyclictest11860-21df_inode09:20:141
3193099289,6cyclictest27965-21python08:35:270
3193099282,13cyclictest24431-21/usr/sbin/munin12:45:150
3193099282,13cyclictest13614-21/usr/sbin/munin10:50:230
31930992810,5cyclictest14456-21/usr/sbin/munin08:00:190
3193099280,4cyclictest81rcu_preempt11:45:410
282702281,5sleep10-21swapper/110:04:301
273992281,5sleep10-21swapper/112:52:401
243612281,5sleep00-21swapper/011:20:050
178192281,5sleep10-21swapper/112:26:051
112772281,5sleep00-21swapper/009:18:570
108692281,7sleep10-21swapper/110:43:181
10322281,5sleep10-21swapper/111:43:501
3193199279,5cyclictest40250irq/92-i91511:05:261
3193199273,18cyclictest22732-21iostat_ios12:40:211
3193199272,21cyclictest0-21swapper/110:15:241
3193199272,13cyclictest0-21swapper/110:30:191
31931992711,6cyclictest22-21ksoftirqd/111:55:111
3193099273,16cyclictest0-21swapper/009:24:220
3193099272,12cyclictest2694-21/usr/sbin/munin08:55:200
3193199265,4cyclictest81rcu_preempt11:52:561
3193199264,4cyclictest40250irq/92-i91512:38:361
3193199262,10cyclictest9959-21diskstats09:15:131
31931992611,5cyclictest22-21ksoftirqd/108:46:351
3193199253,8cyclictest3958-21df10:25:131
3193199251,7cyclictest14465-21ls08:00:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional