You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 06:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue May 05, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
286029912581199,44cyclictest28904-21cpuspeed_turbos19:25:120
283632636589,32sleep00-21swapper/019:23:020
282192555511,29sleep10-21swapper/119:21:321
203032920,5sleep120298-21tail00:45:001
159962820,9sleep02860299cyclictest21:40:170
96282770,7sleep12860399cyclictest00:15:191
28603997164,4cyclictest28916-21grep19:25:131
13492590,7sleep02860299cyclictest21:00:280
9332430,8sleep12860399cyclictest21:00:211
219602410,4sleep1211ktimersoftd/121:55:241
305612381,33sleep130562-21/usr/sbin/munin22:20:111
2860399382,28cyclictest40250irq/92-i91522:15:101
65702371,5sleep16574-21ntp_states22:40:221
28603993718,3cyclictest40250irq/92-i91522:35:261
164382361,31sleep016444-21irqstats20:15:210
28603993524,6cyclictest13993-21/usr/sbin/munin00:25:281
2860299351,21cyclictest7543-21df00:10:130
259422351,3sleep026093-21sed22:05:280
2860299349,13cyclictest2225-21dbus-daemon22:55:510
155902341,29sleep111564-21packagekitd20:14:071
29762331,3sleep10-21swapper/119:40:151
2860299336,14cyclictest7187-21needreboot19:50:230
2860299333,4cyclictest81rcu_preempt21:20:260
28602993312,8cyclictest24049-21python22:00:290
2860299331,20cyclictest29978-21chrt23:44:250
250112330,8sleep10-21swapper/123:30:171
2860399317,12cyclictest81rcu_preempt22:45:271
2860399313,4cyclictest81rcu_preempt00:53:061
2860399313,24cyclictest2731-21sed23:55:281
2860399312,24cyclictest25863-21irqstats20:40:201
2860399312,12cyclictest81rcu_preempt23:25:201
2860399311,18cyclictest17349-21memory00:35:201
2860399311,10cyclictest0-21swapper/122:54:251
2860299312,17cyclictest0-21swapper/020:34:170
2860299312,16cyclictest0-21swapper/000:50:110
2860299311,7cyclictest81rcu_preempt22:42:250
28602993113,5cyclictest1273-21iostat_ios19:35:190
28602993112,6cyclictest1494-21munin-node23:55:100
28602993110,17cyclictest32508-21aten_r4power_po22:25:120
325232301,5sleep00-21swapper/020:59:060
318832301,5sleep00-21swapper/022:20:580
2860399304,19cyclictest19553-21diskstats21:50:151
2860399302,24cyclictest5163-21iostat_ios19:45:201
2860399302,24cyclictest5163-21iostat_ios19:45:201
2860399301,16cyclictest3286-21runrttasks22:27:441
2860399301,12cyclictest179732sendmail_mailst23:10:261
2860299304,19cyclictest10098-21iostat_ios22:50:220
2860299303,16cyclictest12231-21grep00:20:250
2860299303,13cyclictest0-21swapper/021:30:120
2860299302,15cyclictest4858-21/usr/sbin/munin22:35:250
2860299302,15cyclictest18995-21/usr/sbin/munin20:20:290
2860299302,15cyclictest0-21swapper/023:48:430
2860299302,15cyclictest0-21swapper/022:12:290
2860299302,15cyclictest0-21swapper/022:12:290
2860299302,15cyclictest0-21swapper/000:03:030
2860299302,14cyclictest8601-21df19:55:120
2860299302,14cyclictest2727-21ntp_states22:30:240
28602993013,4cyclictest29301-21df20:50:140
2860299301,26cyclictest111-21usb-storage23:15:100
28602993012,5cyclictest12386-21diskstats20:05:160
28602993011,7cyclictest5469-21users21:10:290
28602993011,5cyclictest20149-21processes21:50:270
240692301,5sleep00-21swapper/023:26:480
198482301,5sleep00-21swapper/000:40:380
75212291,5sleep00-21swapper/021:17:070
75212291,5sleep00-21swapper/021:17:070
67562291,5sleep00-21swapper/000:06:300
34342291,5sleep10-21swapper/122:32:221
2860399296,19cyclictest0-21swapper/120:55:261
2860399296,13cyclictest40250irq/92-i91521:44:531
2860399294,18cyclictest8278-21diskstats21:20:151
2860399293,4cyclictest81rcu_preempt20:26:321
2860399293,19cyclictest25202-21diskstats22:05:151
2860399291,9cyclictest0-21swapper/120:38:351
2860399291,7cyclictest29021-21/usr/sbin/munin20:50:251
2860399291,4cyclictest81rcu_preempt00:46:581
28603992914,4cyclictest22-21ksoftirqd/100:20:261
2860399291,25cyclictest111-21usb-storage20:19:051
2860399291,25cyclictest111-21usb-storage20:05:211
2860399291,15cyclictest15742-21iostat23:05:211
2860299298,6cyclictest2225-21dbus-daemon23:51:350
2860299296,12cyclictest28727-21aten_r4power_po22:15:100
2860299295,13cyclictest27474-21wc23:35:270
2860299294,18cyclictest20760-21diskstats00:45:140
2860299292,14cyclictest17806-21/usr/sbin/munin23:10:210
2860299292,13cyclictest2542-21diskstats21:05:160
28602992911,6cyclictest24125-21uname20:35:220
28602992911,5cyclictest17927-21users00:35:290
28602992910,6cyclictest27418-21df20:45:130
155982291,5sleep00-21swapper/020:14:120
152152291,5sleep00-21swapper/021:38:550
125112291,5sleep10-21swapper/121:30:231
90862281,5sleep00-21swapper/022:47:250
58322281,5sleep10-21swapper/121:14:061
3702281,5sleep00-21swapper/019:33:370
2860399286,4cyclictest81rcu_preempt23:03:461
2860399286,4cyclictest81rcu_preempt22:57:271
2860399285,4cyclictest81rcu_preempt20:48:061
2860399284,8cyclictest26714-21diskstats23:35:141
2860399284,4cyclictest81rcu_preempt00:08:411
2860399284,3cyclictest81rcu_preempt23:17:141
2860399283,4cyclictest81rcu_preempt23:46:341
2860399283,4cyclictest81rcu_preempt20:33:461
2860399282,4cyclictest81rcu_preempt20:23:451
2860399281,4cyclictest81rcu_preempt21:45:281
2860399281,11cyclictest40250irq/92-i91521:15:091
2860399281,11cyclictest40250irq/92-i91521:15:081
2860399280,4cyclictest81rcu_preempt00:02:551
28602992812,5cyclictest5254-21memory19:45:220
28602992812,5cyclictest5254-21memory19:45:220
2860299281,17cyclictest0-21swapper/023:30:160
28602992811,6cyclictest10498-21df20:00:150
2860299281,16cyclictest0-21swapper/020:40:000
2860299281,13cyclictest4483-21wc19:45:000
28602992810,6cyclictest9371-21cat00:15:140
28602992810,6cyclictest20945-21taskset20:26:020
28602992810,5cyclictest21076-21df23:20:140
225522281,5sleep00-21swapper/021:56:580
164842281,5sleep00-21swapper/000:34:520
143612281,5sleep00-21swapper/000:27:170
85742271,5sleep10-21swapper/100:10:541
37682271,5sleep10-21swapper/121:07:121
312202271,5sleep10-21swapper/119:30:081
296772271,5sleep10-21swapper/123:41:191
2860399273,18cyclictest21088-21diskstats23:20:151
2860399271,21cyclictest7670-21sed19:50:301
2860399271,14cyclictest23527-21hddtemp_smartct22:00:181
2860299274,17cyclictest10152-21diskstats21:25:150
2860299272,13cyclictest17774-21fschecks_time21:45:150
281552271,5sleep10-21swapper/122:11:321
281552271,5sleep10-21swapper/122:11:311
153132271,5sleep10-21swapper/121:39:561
12142271,5sleep10-21swapper/123:53:521
2860399265,11cyclictest40250irq/92-i91519:55:131
2860399264,3cyclictest81rcu_preempt21:25:291
2860399261,11cyclictest14789-21/usr/sbin/munin00:30:291
28603992610,5cyclictest40250irq/92-i91520:02:441
2860299261,17cyclictest0-21swapper/023:00:090
2860299257,5cyclictest0-21swapper/023:08:130
2860399248,12cyclictest0-21swapper/119:35:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional