You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 10:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Jul 25, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
183709912661238,22cyclictest23922-21smartctl19:35:271
183699911481122,7cyclictest0-21swapper/019:25:050
182342584539,30sleep10-21swapper/119:24:071
181122565517,32sleep00-21swapper/019:22:520
183699910481,18cyclictest0-21swapper/019:35:280
288432980,7sleep01836999cyclictest19:50:150
18370997668,5cyclictest0-21swapper/119:25:051
223172620,2sleep022318-21egrep22:25:110
156612520,5sleep015663-21mailstats22:05:260
172762450,7sleep11837099cyclictest20:45:151
1836999393,13cyclictest81rcu_preempt23:51:550
1836999383,21cyclictest6378-21ls21:40:280
1836999383,21cyclictest6378-21ls21:40:270
268122368,4sleep081rcu_preempt21:10:180
18370993515,9cyclictest22-21ksoftirqd/119:50:571
1836999359,13cyclictest10291-21aten_r4power_po00:45:120
1836999351,10cyclictest81rcu_preempt00:11:590
79802341,3sleep18069-21processes21:45:261
18370993424,6cyclictest3461-21/usr/sbin/munin00:25:241
100242341,28sleep010192-21cat00:45:010
277352331,28sleep127737-21cron21:12:011
1837099331,19cyclictest8398-21cut00:40:111
1836999339,12cyclictest21911-21taskset22:23:380
1836999331,11cyclictest19854-21watchsnmpd22:17:000
18369993310,4cyclictest81rcu_preempt23:10:110
18370993223,5cyclictest26732-21/usr/sbin/munin19:45:111
1837099321,17cyclictest13957-21ntp_states20:35:241
1836999327,12cyclictest8229-21latency_hist00:40:000
1836999327,12cyclictest12023-21netstat20:30:230
1836999321,10cyclictest0-21swapper/020:20:430
144252321,5sleep00-21swapper/022:04:080
49102311,10sleep04962-21wget23:05:120
1837099313,4cyclictest40250irq/92-i91520:30:121
1837099311,17cyclictest19817-21awk23:45:001
1836999314,4cyclictest81rcu_preempt23:00:560
1836999312,15cyclictest14848-21cron20:40:000
1836999312,12cyclictest21144-21fschecks_time20:55:180
102012311,3sleep110205-21ntp_states20:25:221
87962301,5sleep10-21swapper/120:20:411
5242301,25sleep1626-21timerwakeupswit21:25:291
4652301,5sleep10-21swapper/100:19:481
1837099305,9cyclictest11565-21gdbus22:06:261
1837099304,19cyclictest8956-21diskstats23:15:141
1837099303,4cyclictest81rcu_preempt00:00:381
1836999303,4cyclictest81rcu_preempt00:06:080
1836999302,6cyclictest21690-21pidof23:50:000
1836999302,14cyclictest6196-21iostat20:15:200
1836999302,14cyclictest19814-21munin-run23:45:000
1836999301,4cyclictest81rcu_preempt23:20:210
1836999301,4cyclictest81rcu_preempt19:49:060
18369993013,5cyclictest2348-21iostat20:05:180
18369993012,5cyclictest19798-21python20:50:270
18369993011,6cyclictest21658-21kernelversion19:30:200
18369993010,6cyclictest3732-21grep21:35:160
6812291,5sleep00-21swapper/022:53:130
47652291,5sleep10-21swapper/121:36:381
4702291,5sleep00-21swapper/000:19:520
31182291,5sleep00-21swapper/021:34:080
1837099295,4cyclictest81rcu_preempt21:44:431
1837099295,4cyclictest81rcu_preempt21:44:421
1837099295,4cyclictest81rcu_preempt21:01:431
1837099295,4cyclictest81rcu_preempt20:54:131
1837099295,4cyclictest81rcu_preempt20:17:011
1837099294,6cyclictest81rcu_preempt00:10:011
1837099294,4cyclictest81rcu_preempt23:36:441
1836999299,11cyclictest0-21swapper/023:34:140
1836999293,23cyclictest0-21swapper/021:00:170
1836999292,14cyclictest23872-21/usr/sbin/munin23:55:120
1836999292,14cyclictest17914-21python20:45:260
18369992918,7cyclictest4673-21fgrep20:10:260
18369992918,7cyclictest4673-21fgrep20:10:260
1836999291,4cyclictest81rcu_preempt22:55:410
1836999291,19cyclictest0-21swapper/021:20:120
18369992911,5cyclictest3819-21timerwakeupswit00:25:310
1836999291,15cyclictest29729-21/usr/sbin/munin22:45:190
1836999291,14cyclictest27405-21runrttasks22:37:150
13122291,5sleep00-21swapper/020:02:190
45152281,5sleep10-21swapper/123:02:371
297962281,5sleep00-21swapper/021:18:550
271642281,5sleep00-21swapper/000:03:250
259512281,5sleep00-21swapper/021:08:010
224562281,5sleep10-21swapper/119:32:031
212522281,3sleep121259-21iostat_ios20:55:211
1837099288,6cyclictest250272sh21:05:181
1837099286,4cyclictest81rcu_preempt21:59:581
1837099285,4cyclictest81rcu_preempt22:56:491
1837099284,4cyclictest81rcu_preempt23:51:531
18370992813,8cyclictest7019-21iostat_ios00:35:221
18370992813,8cyclictest1273-21iostat_ios00:20:211
18370992813,11cyclictest24082-21/usr/sbin/munin22:30:231
18370992811,5cyclictest40250irq/92-i91500:45:131
18370992811,13cyclictest0-21swapper/122:15:101
1837099280,5cyclictest81rcu_preempt23:21:141
1836999284,16cyclictest0-21swapper/021:28:480
1836999282,13cyclictest0-21swapper/000:51:060
1836999281,4cyclictest81rcu_preempt00:21:470
18369992811,5cyclictest13531-21/usr/sbin/munin23:25:270
1836999281,14cyclictest31814-21taskset19:56:410
1836999281,14cyclictest28345-21hddtemp_smartct22:40:180
1836999281,13cyclictest24568-21perl22:30:160
18369992810,6cyclictest15410-21fschecks_count20:40:150
18369992810,5cyclictest3286-21runrttasks23:39:160
1836999280,4cyclictest81rcu_preempt00:31:370
1836999280,3cyclictest81rcu_preempt21:55:120
158822281,5sleep10-21swapper/123:33:341
137242281,5sleep10-21swapper/123:25:371
104842281,4sleep00-21swapper/021:52:240
102512281,5sleep00-21swapper/023:18:440
295782271,5sleep10-21swapper/121:16:401
1837099275,4cyclictest81rcu_preempt19:57:561
1837099275,4cyclictest81rcu_preempt00:13:421
1837099274,4cyclictest81rcu_preempt22:49:371
1837099274,4cyclictest81rcu_preempt21:24:561
1837099273,4cyclictest81rcu_preempt21:33:591
1837099273,18cyclictest24308-21iostat_ios23:55:211
1837099272,10cyclictest7616-21ntp_states23:10:251
1837099271,7cyclictest2695-21snmpd23:46:031
18370992715,8cyclictest2225-21dbus-daemon00:35:001
1837099271,17cyclictest0-21swapper/122:40:181
1837099266,16cyclictest0-21swapper/122:50:121
1837099263,17cyclictest32318-21/usr/sbin/munin20:00:311
1837099263,10cyclictest0-21swapper/123:05:021
1837099262,10cyclictest3105-21users20:05:281
18370992617,6cyclictest22-21ksoftirqd/122:01:461
18370992613,11cyclictest0-21swapper/120:10:131
18370992613,11cyclictest0-21swapper/120:10:131
1836999269,4cyclictest0-21swapper/022:10:230
1836999263,3cyclictest81rcu_preempt19:40:090
18369992612,10cyclictest10477-21grep20:25:270
18369992610,6cyclictest0-21swapper/021:45:180
106472261,5sleep10-21swapper/121:54:071
1837099259,12cyclictest0-21swapper/122:35:261
1837099258,5cyclictest40250irq/92-i91522:25:141
18370992516,6cyclictest22-21ksoftirqd/122:24:151
18370992511,4cyclictest40250irq/92-i91520:40:141
1837099241,9cyclictest25092-21diskstats19:40:131
1837099241,9cyclictest12346-21cat00:50:131
18370992414,6cyclictest16595-21cut22:10:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional