You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 03:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Fri Jan 02, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36779912561221,30cyclictest10013-21cat19:40:011
36779912361189,26cyclictest3843-21grep19:25:101
33002577531,31sleep10-21swapper/119:21:461
30222530436,31sleep00-21swapper/019:20:290
367699203186,12cyclictest0-21swapper/019:40:010
367699179155,6cyclictest0-21swapper/019:25:100
2788321150,7sleep0367699cyclictest00:12:270
1829521100,5sleep0367699cyclictest22:55:320
237942880,22sleep03-21ksoftirqd/000:41:070
160272850,8sleep0367699cyclictest19:55:150
139942820,5sleep10-21swapper/121:45:181
57252730,7sleep0367699cyclictest21:36:180
325432700,3sleep0111rcuc/000:51:240
165452690,5sleep00-21swapper/000:34:410
104742610,8sleep1367799cyclictest21:05:241
27882540,6sleep0367699cyclictest20:45:200
41142530,7sleep1367799cyclictest00:20:461
238692500,28sleep140550irq/92-i91521:55:211
3677994611,6cyclictest296072sh22:00:371
3676994513,28cyclictest2309-21cron21:35:000
222102450,6sleep10-21swapper/100:06:141
192902451,26sleep119301-21ssh00:36:401
3676994420,5cyclictest3-21ksoftirqd/022:36:590
367799427,31cyclictest0-21swapper/122:16:361
3676994227,11cyclictest0-21swapper/022:03:360
41722410,7sleep1367799cyclictest21:35:181
3676994125,6cyclictest3-21ksoftirqd/022:06:330
3676994122,4cyclictest3-21ksoftirqd/023:00:150
3676994110,3cyclictest0-21swapper/022:25:360
109742400,9sleep0367699cyclictest21:05:300
367799397,28cyclictest0-21swapper/123:53:561
3676993915,8cyclictest29509-21irqstats20:30:250
117722390,2sleep011776-21unixbench_singl22:15:310
47272380,23sleep03-21ksoftirqd/000:21:400
367799383,5cyclictest81rcu_preempt00:42:571
3676993818,5cyclictest3-21ksoftirqd/023:50:120
367799375,5cyclictest81rcu_preempt23:42:341
367799373,31cyclictest0-21swapper/120:52:161
367699379,7cyclictest20154-21sh00:37:540
3676993712,12cyclictest6332-21/usr/sbin/munin19:30:230
367699369,24cyclictest3-21ksoftirqd/022:10:580
3676993621,5cyclictest3-21ksoftirqd/023:30:360
3676993616,5cyclictest3-21ksoftirqd/021:28:160
3676993614,5cyclictest3-21ksoftirqd/021:52:510
367699361,23cyclictest24671-21chrt20:16:590
120522361,31sleep112137-21aten_r4power_po22:50:131
367799357,5cyclictest81rcu_preempt23:25:191
367799356,4cyclictest81rcu_preempt21:50:121
367799355,5cyclictest81rcu_preempt22:55:161
367799353,30cyclictest0-21swapper/123:09:551
367799351,9cyclictest0-21swapper/100:47:561
3676993520,5cyclictest3-21ksoftirqd/023:46:480
367699351,30cyclictest21938-21fschecks_time21:20:150
8122341,3sleep10-21swapper/122:05:181
78332341,29sleep17881-21ssh00:25:181
367799343,28cyclictest0-21swapper/100:16:351
367799341,29cyclictest28261-21ssh22:33:151
367699346,4cyclictest12075-21diskstats21:10:170
3676993426,5cyclictest0-21swapper/022:30:150
3676993413,5cyclictest3-21ksoftirqd/000:16:490
367699341,29cyclictest21773-21ssh00:05:350
367699341,29cyclictest20434-21ssh21:18:560
367699341,14cyclictest0-21swapper/023:08:180
3676993410,6cyclictest10086-21ssh23:20:290
286362341,29sleep028743-21/usr/sbin/munin23:40:150
256742341,4sleep125686-21rm21:24:271
367799335,4cyclictest81rcu_preempt22:25:251
367799334,4cyclictest81rcu_preempt00:02:511
367799334,25cyclictest30496-21packagekitd23:12:401
3677993313,6cyclictest78752cut21:00:141
367699337,6cyclictest3-21ksoftirqd/022:45:210
367699336,8cyclictest0-21swapper/019:45:160
3676993318,5cyclictest3-21ksoftirqd/022:41:550
3676993318,5cyclictest3-21ksoftirqd/000:04:430
367699331,7cyclictest14929-21ssh23:59:440
3676993313,6cyclictest8009-21iostat_ios00:25:200
367699331,30cyclictest0-21swapper/020:02:160
367699331,30cyclictest0-21swapper/019:53:560
367699331,29cyclictest0-21swapper/020:52:360
367699331,28cyclictest2309-21cron22:55:000
258682331,28sleep025882-21ssh23:36:560
186792331,28sleep118695-21ssh21:16:251
112432331,28sleep111254-21iostat_ios23:55:231
367799325,4cyclictest81rcu_preempt23:00:421
367799325,4cyclictest81rcu_preempt22:36:071
367799323,4cyclictest81rcu_preempt22:20:421
367799323,4cyclictest81rcu_preempt22:11:231
3677993221,7cyclictest12230-21/usr/sbin/munin21:10:171
367799321,29cyclictest0-21swapper/120:00:161
367799321,29cyclictest0-21swapper/119:53:361
367799321,29cyclictest0-21swapper/100:32:351
367699329,19cyclictest0-21swapper/023:29:190
367699329,19cyclictest0-21swapper/022:20:160
367699325,4cyclictest81rcu_preempt23:12:500
367699321,29cyclictest0-21swapper/023:16:560
287612321,5sleep00-21swapper/000:47:010
99692311,26sleep19976-21ssh22:47:251
79512312,4sleep181rcu_preempt19:34:011
3677993121,6cyclictest1968-21lldpad21:30:451
367799311,8cyclictest11714-21ssh23:22:271
367799311,26cyclictest23775-21diskstats23:35:161
367799311,15cyclictest0-21swapper/121:44:581
3676993124,5cyclictest0-21swapper/021:42:150
367699312,15cyclictest9582-21munin-run21:05:000
3676993120,7cyclictest0-21swapper/021:49:480
367699311,27cyclictest0-21swapper/021:55:370
72542301,5sleep00-21swapper/020:55:340
367799304,4cyclictest81rcu_preempt23:49:151
367799303,4cyclictest81rcu_preempt21:28:441
367799302,23cyclictest12268-21df_inode19:45:161
367799301,4cyclictest81rcu_preempt20:42:201
367699309,7cyclictest23120-21ls20:15:010
3676993023,5cyclictest0-21swapper/020:21:350
367699302,15cyclictest31516-21/usr/sbin/munin20:35:260
35642301,5sleep10-21swapper/120:46:181
170582300,8sleep1367799cyclictest19:56:011
14352301,5sleep10-21swapper/100:53:551
367799294,4cyclictest81rcu_preempt20:58:031
367799294,4cyclictest81rcu_preempt20:37:121
3677992912,13cyclictest0-21swapper/122:41:031
367799291,15cyclictest4491-21fschecks_time23:15:171
107082291,3sleep010791-21memory19:40:220
367799283,4cyclictest81rcu_preempt19:43:191
3677992815,10cyclictest22-21ksoftirqd/100:13:431
367799281,4cyclictest81rcu_preempt23:30:051
367799281,3cyclictest81rcu_preempt20:16:341
3677992811,5cyclictest302732chrt20:31:301
367799281,14cyclictest3302-21runrttasks20:06:031
3676992811,4cyclictest30497-21gdbus20:26:510
367799272,13cyclictest0-21swapper/120:29:421
3676992710,4cyclictest30497-21gdbus20:42:360
367799261,7cyclictest0-21swapper/120:20:121
367799261,15cyclictest0-21swapper/120:10:201
367699261,13cyclictest20833-21seq20:06:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional