You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 04:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Apr 15, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312839912201197,19cyclictest11760-21ssh21:15:011
312829911991170,26cyclictest0-21swapper/019:25:130
312839911711148,19cyclictest31534-21wget19:25:121
309432610563,31sleep00-21swapper/019:22:010
311072464417,32sleep10-21swapper/119:23:431
3128299168145,16cyclictest11773-21date21:15:010
105012840,8sleep03128299cyclictest22:53:370
3128299655,28cyclictest0-21swapper/021:54:360
3128299636,52cyclictest0-21swapper/022:10:350
3128299602,29cyclictest0-21swapper/021:39:150
92432590,7sleep13128399cyclictest00:32:141
3128299598,6cyclictest9596-21runrttasks00:32:450
31282995916,8cyclictest19012-21iostat_ios21:55:200
3128299583,16cyclictest0-21swapper/019:38:080
3128299582,12cyclictest16424-21ssh21:19:560
3128299563,14cyclictest28159-21diskstats23:45:150
3128299561,20cyclictest12509-21ssh21:48:570
3128299553,19cyclictest0-21swapper/022:15:180
3128299531,20cyclictest12105-21tune2fs22:55:160
3128299531,12cyclictest23325-21/usr/sbin/munin23:40:150
3128299513,14cyclictest5880-21hddtemp_smartct19:40:170
3128399442,32cyclictest0-21swapper/100:49:351
243972420,7sleep13128399cyclictest23:07:421
3128299409,9cyclictest223692ssh23:05:240
9082391,34sleep0969-21memory23:50:200
3128399391,17cyclictest5369-21fschecks_count21:05:171
3128299391,20cyclictest0-21swapper/000:22:100
3128399387,27cyclictest0-21swapper/122:54:151
3128299375,28cyclictest0-21swapper/000:35:560
3128399364,29cyclictest0-21swapper/123:48:151
3128399363,30cyclictest0-21swapper/120:38:351
3128399362,30cyclictest5684-21diskstats19:40:151
3128399361,9cyclictest0-21swapper/120:40:551
31283993610,5cyclictest182732ssh00:41:201
3128299362,20cyclictest25240-21memory00:15:230
171512363,29sleep117168-21wget20:10:171
3128399356,4cyclictest81rcu_preempt22:10:201
3128399356,26cyclictest8198-21cron23:25:001
3128399355,4cyclictest81rcu_preempt00:50:201
3128399354,25cyclictest26823-21diskstats21:30:171
3128399352,5cyclictest0-21swapper/121:37:351
3128299357,4cyclictest81rcu_preempt23:15:240
2761423519,4sleep03-21ksoftirqd/022:37:370
3128399345,4cyclictest81rcu_preempt21:15:131
3128399341,6cyclictest19032-21ssh21:21:391
3128299341,5cyclictest81rcu_preempt22:30:460
3128299341,5cyclictest81rcu_preempt20:20:010
3128299341,30cyclictest0-21swapper/022:29:160
167062341,29sleep116881-21cstates23:00:141
324742330,5sleep0111rcuc/020:50:230
3128399337,4cyclictest81rcu_preempt21:50:241
3128399336,4cyclictest81rcu_preempt00:01:521
3128399335,5cyclictest81rcu_preempt00:35:131
3128399334,4cyclictest81rcu_preempt23:58:311
3128399334,4cyclictest81rcu_preempt22:18:301
3128399334,4cyclictest81rcu_preempt21:40:241
3128399334,4cyclictest81rcu_preempt21:40:231
3128399334,4cyclictest81rcu_preempt00:17:121
3128399333,4cyclictest81rcu_preempt22:25:471
3128399333,4cyclictest81rcu_preempt00:23:461
31283993325,6cyclictest0-21swapper/120:58:151
31283993325,5cyclictest30423-21/usr/sbin/munin20:45:211
3128399332,28cyclictest0-21swapper/121:56:151
3128399331,5cyclictest4369-21ssh23:54:151
3128299336,15cyclictest0-21swapper/021:20:270
3128299333,5cyclictest81rcu_preempt22:48:070
31282993326,5cyclictest0-21swapper/000:04:350
3128299331,5cyclictest0-21swapper/023:23:560
3128299331,30cyclictest0-21swapper/019:57:560
3128299331,29cyclictest30748-21ssh21:34:360
3128299331,15cyclictest20283-21sh23:36:290
3128299331,15cyclictest20283-21sh23:36:280
3128399329,19cyclictest0-21swapper/122:31:191
3128399324,5cyclictest81rcu_preempt22:45:211
3128399323,4cyclictest81rcu_preempt23:39:471
3128399323,4cyclictest81rcu_preempt23:39:461
3128399323,4cyclictest81rcu_preempt20:04:141
3128399321,27cyclictest1968-21lldpad21:01:291
31283993212,6cyclictest19643-21/usr/sbin/munin00:10:121
3128399320,4cyclictest81rcu_preempt23:10:111
3128299324,4cyclictest40550irq/92-i91523:10:290
3128299323,5cyclictest81rcu_preempt22:42:390
31282993225,5cyclictest0-21swapper/000:26:360
31282993212,5cyclictest25963-21iostat_ios00:50:190
31282993211,17cyclictest26565-21http_loadtime20:35:180
136002321,5sleep10-21swapper/122:56:061
3128399314,4cyclictest81rcu_preempt23:18:311
3128399314,4cyclictest81rcu_preempt22:40:231
3128399314,4cyclictest81rcu_preempt22:09:051
3128399314,14cyclictest0-21swapper/121:25:281
3128399313,4cyclictest81rcu_preempt21:45:011
31283993116,4cyclictest22-21ksoftirqd/122:00:151
3128399311,4cyclictest81rcu_preempt23:34:181
3128399311,4cyclictest81rcu_preempt19:39:361
31283993114,5cyclictest40550irq/92-i91519:50:201
3128399311,28cyclictest0-21swapper/120:16:161
3128399311,16cyclictest12775-21ls20:00:001
3128299318,10cyclictest0-21swapper/022:05:160
3128299315,4cyclictest81rcu_preempt22:04:180
3128299314,4cyclictest81rcu_preempt22:22:030
3128299314,4cyclictest81rcu_preempt22:22:030
3128299312,4cyclictest81rcu_preempt23:00:410
3128299312,16cyclictest1787-21diskstats19:30:150
3128299312,14cyclictest20320-21iostat_ios00:10:210
3128299312,14cyclictest16168-21ssh00:05:300
3128299311,4cyclictest81rcu_preempt23:26:150
3128299311,4cyclictest81rcu_preempt21:28:370
3128299311,27cyclictest0-21swapper/021:43:160
3128299311,27cyclictest0-21swapper/021:43:150
3128399307,9cyclictest22662-21fschecks_count20:25:161
3128399303,4cyclictest81rcu_preempt22:22:161
3128399303,4cyclictest81rcu_preempt22:22:151
31283993023,4cyclictest1968-21lldpad00:07:051
31283993015,12cyclictest22-21ksoftirqd/119:32:071
3128399301,4cyclictest81rcu_preempt22:35:121
3128399301,4cyclictest1968-21lldpad23:29:031
3128399301,25cyclictest111-21usb-storage00:29:051
3128299305,4cyclictest81rcu_preempt23:55:290
31282993023,5cyclictest0-21swapper/019:53:360
3128299301,7cyclictest22645-21grep20:25:170
3128299301,4cyclictest81rcu_preempt23:32:530
31282993010,7cyclictest16734-21fschecks_time00:40:170
142632301,5sleep00-21swapper/020:01:170
3128399299,6cyclictest15593-21ntpdc20:05:231
3128399291,4cyclictest81rcu_preempt23:41:021
3128399291,14cyclictest7815-21chrt19:45:191
3128299299,16cyclictest5274-21cstates21:05:140
3128299298,10cyclictest14786-21/usr/sbin/munin20:05:230
3128299293,23cyclictest31073-21unixbench_singl20:45:300
31282992921,6cyclictest0-21swapper/020:23:350
3128299292,13cyclictest25444-21users20:30:290
31282992911,5cyclictest3956-21ntpq21:00:240
3128299291,13cyclictest28549-21awk20:40:200
5832281,5sleep10-21swapper/120:51:011
3128299282,13cyclictest7816-21/usr/sbin/munin19:45:190
3128299281,13cyclictest21488-21hddtemp_smartct00:45:180
31282992810,5cyclictest1899-21taskset20:55:230
31282992810,5cyclictest16949-21runrttasks20:10:120
3128399272,4cyclictest81rcu_preempt20:20:101
255772261,5sleep10-21swapper/120:31:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional