You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Sun May 03, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
53539911251101,21cyclictest5551-21grep07:25:121
53529910891052,25cyclictest5523-21wget07:25:120
49762624578,30sleep10-21swapper/107:21:381
50022563516,32sleep00-21swapper/007:21:550
535299134110,20cyclictest23907-21awk09:20:290
1418821160,8sleep1535399cyclictest09:10:151
305192700,4sleep00-21swapper/009:29:050
95182490,8sleep1201rcuc/112:46:221
71632410,2sleep07159-21tune2fs11:30:150
137152391,4sleep113766-21memory11:00:231
5352993722,4cyclictest40250irq/92-i91509:53:490
535299372,11cyclictest81rcu_preempt10:19:270
535299371,25cyclictest0-21swapper/008:15:160
290782371,3sleep129088-21ssh09:26:401
121332370,8sleep0535299cyclictest11:35:270
57052361,4sleep15712-21sh12:42:191
535399368,24cyclictest0-21swapper/111:51:381
535399367,17cyclictest0-21swapper/110:29:291
5352993610,6cyclictest84702sh10:55:000
535299359,14cyclictest11282-21ssh10:57:370
535299352,21cyclictest5616-21taskset08:47:100
535299351,7cyclictest538-21ssh10:08:490
5352993511,12cyclictest3011-21sed10:10:300
26612351,30sleep02670-21diskstats11:25:130
260502350,8sleep0535299cyclictest10:00:230
535399342,5cyclictest81rcu_preempt11:43:351
535399342,5cyclictest81rcu_preempt09:55:091
5353993423,7cyclictest22-21ksoftirqd/110:18:151
535299343,18cyclictest14479-21ssh10:25:000
535299341,11cyclictest0-21swapper/011:47:260
535399338,5cyclictest40250irq/92-i91511:45:171
535399335,24cyclictest0-21swapper/111:58:151
535399334,25cyclictest16417-21iostat_ios07:50:201
535399334,25cyclictest16417-21iostat_ios07:50:191
535399332,20cyclictest0-21swapper/112:17:531
5353993312,8cyclictest23177-21cron08:10:001
535399331,18cyclictest3382-21ssh11:25:241
535299339,6cyclictest0-21swapper/012:00:300
535299338,21cyclictest0-21swapper/008:55:000
535299336,11cyclictest40250irq/92-i91509:46:290
535299334,5cyclictest81rcu_preempt11:00:320
535299333,4cyclictest81rcu_preempt12:34:280
535299331,20cyclictest10801-21ssh12:48:320
535299331,15cyclictest25464-21sh11:50:290
535299331,13cyclictest5790-21sh12:42:270
535299331,11cyclictest30548-21runrttasks11:56:240
5352993310,6cyclictest0-21swapper/010:40:570
5352993310,12cyclictest18741-21grep11:05:310
201482331,28sleep120158-21ssh11:07:501
123962331,4sleep112496-21awk09:05:251
5353993217,12cyclictest22-21ksoftirqd/108:45:061
5353993216,6cyclictest22-21ksoftirqd/112:13:151
535399321,5cyclictest81rcu_preempt09:40:481
5353993215,5cyclictest40250irq/92-i91508:45:011
5353993213,5cyclictest31295-21netstat11:20:221
535299326,13cyclictest0-21swapper/008:35:200
535299326,13cyclictest0-21swapper/008:35:190
535299323,15cyclictest5762-21memory12:05:210
535299322,15cyclictest22777-21diskstats12:25:150
535299322,15cyclictest22777-21diskstats12:25:140
5352993213,6cyclictest18411-21diskstats12:20:140
535299321,19cyclictest19860-21ls08:00:120
300852321,4sleep130095-21ssh12:33:391
199802321,3sleep020021-21ntp_states10:30:230
148322321,4sleep114841-21ssh09:47:391
77112311,3sleep17837-21munin-node07:30:061
535399319,18cyclictest0-21swapper/109:23:211
535399318,12cyclictest40250irq/92-i91511:32:331
535399315,4cyclictest81rcu_preempt10:52:381
535399315,22cyclictest0-21swapper/110:05:091
535399312,15cyclictest12104-21ntp_states11:35:251
5353993114,12cyclictest32254-21wc12:35:281
535399311,16cyclictest22381-21irqstats11:10:211
535299319,5cyclictest0-21swapper/009:10:270
535299313,16cyclictest0-21swapper/007:54:280
535299313,16cyclictest0-21swapper/007:54:280
535299312,25cyclictest16497-21awk11:40:270
535299312,19cyclictest0-21swapper/009:36:050
535299312,15cyclictest14624-21ntpq12:15:230
5352993111,6cyclictest18680-21ssh09:15:180
5352993111,5cyclictest32223-21/usr/sbin/munin12:35:270
139512311,26sleep114013-21df07:45:131
535399308,18cyclictest0-21swapper/112:25:411
535399308,18cyclictest0-21swapper/112:25:411
535399305,17cyclictest25513-21diskstats08:15:151
535399301,4cyclictest81rcu_preempt12:08:581
535399301,15cyclictest11649-21ssh10:20:281
535299302,18cyclictest0-21swapper/009:30:100
535299302,14cyclictest16175-21users10:25:320
5352993017,6cyclictest8010-21python07:30:060
535299301,4cyclictest81rcu_preempt09:40:180
535299301,4cyclictest81rcu_preempt08:11:030
5352993011,6cyclictest722-21grep10:45:260
5352993011,6cyclictest23245-21ssh11:10:420
5352993010,7cyclictest23552-21ssh10:35:130
5122301,5sleep10-21swapper/109:30:521
229582301,25sleep122965-21ssh10:34:391
134322301,5sleep10-21swapper/107:43:411
116572301,5sleep00-21swapper/007:39:560
99432291,5sleep10-21swapper/107:35:041
535399294,18cyclictest19885-21diskstats08:00:151
535399293,20cyclictest12441-21hddtemp_smartct12:50:151
535399292,15cyclictest0-21swapper/109:39:511
535399291,4cyclictest81rcu_preempt08:50:331
5353992914,12cyclictest22-21ksoftirqd/110:36:501
535299296,11cyclictest0-21swapper/008:25:180
535299292,3cyclictest40250irq/92-i91512:10:110
535299292,14cyclictest15666-21munin-run07:50:000
535299291,4cyclictest81rcu_preempt09:57:500
535299291,15cyclictest12010-21aten_r4power_vo12:50:100
5352992910,5cyclictest0-21swapper/011:20:230
323242291,5sleep10-21swapper/108:32:251
295142291,5sleep00-21swapper/011:18:560
26472291,5sleep10-21swapper/110:47:581
181812291,4sleep10-21swapper/109:50:551
16912296,6sleep122-21ksoftirqd/108:36:491
16912296,6sleep122-21ksoftirqd/108:36:491
535399289,16cyclictest0-21swapper/110:40:191
535399287,9cyclictest0-21swapper/112:21:081
5353992816,4cyclictest22-21ksoftirqd/112:02:161
5353992812,13cyclictest0-21swapper/110:03:451
535399281,14cyclictest29949-21ssh11:19:391
535399281,13cyclictest5597-21ssh10:14:471
535299284,17cyclictest31161-21diskstats08:30:140
535299282,13cyclictest27608-21/usr/sbin/munin08:20:170
535299281,12cyclictest13319-21taskset07:42:280
202572281,5sleep10-21swapper/109:16:421
192682281,5sleep00-21swapper/007:58:380
108072281,5sleep10-21swapper/109:00:271
94262271,5sleep10-21swapper/108:57:481
535399272,9cyclictest30712-21munin-run08:30:011
535399271,4cyclictest81rcu_preempt10:56:051
535299272,12cyclictest12002-21diskstats09:05:150
535299271,14cyclictest21754-21/usr/sbin/munin08:05:130
535299271,12cyclictest9828-21/usr/sbin/munin09:00:150
535299271,10cyclictest0-21swapper/008:41:250
286862271,5sleep10-21swapper/108:23:381
535399265,4cyclictest81rcu_preempt08:11:181
5353992616,6cyclictest17910-21cpuspeed_turbos07:55:121
535299251,6cyclictest8219-21/usr/sbin/munin08:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional