You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-03 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri May 02, 2025 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29679912451235,7cyclictest0-21swapper/007:25:100
29689912411218,20cyclictest0-21swapper/107:25:111
29689911911163,24cyclictest7377-21latency_hist07:35:001
25542701605,32sleep00-21swapper/007:22:000
25162562518,29sleep10-21swapper/107:21:341
296799139118,15cyclictest7411-21apt-get07:35:000
1332421100,2sleep113323-21forks09:15:161
73692830,2sleep00-21swapper/009:00:000
208332820,7sleep10-21swapper/109:35:161
21122750,5sleep0111rcuc/010:10:280
306052560,9sleep1296899cyclictest12:51:591
2968995627,4cyclictest22-21ksoftirqd/108:10:131
2968995317,5cyclictest22-21ksoftirqd/109:10:271
2968995217,6cyclictest22-21ksoftirqd/111:55:141
2968995217,6cyclictest22-21ksoftirqd/108:15:131
2968995115,6cyclictest22-21ksoftirqd/107:55:301
2968995016,6cyclictest22-21ksoftirqd/111:20:341
2968995015,6cyclictest22-21ksoftirqd/108:20:151
2968995015,5cyclictest22-21ksoftirqd/112:05:261
2968995014,6cyclictest22-21ksoftirqd/112:04:301
2968995014,6cyclictest22-21ksoftirqd/111:28:281
2968995014,5cyclictest22-21ksoftirqd/109:55:591
2968994916,6cyclictest22-21ksoftirqd/111:06:541
2968994915,6cyclictest22-21ksoftirqd/111:37:001
2968994915,6cyclictest22-21ksoftirqd/111:32:231
2968994915,5cyclictest22-21ksoftirqd/110:00:331
2968994912,5cyclictest22-21ksoftirqd/110:55:141
2968994911,6cyclictest22-21ksoftirqd/111:17:101
2968994825,4cyclictest22-21ksoftirqd/111:45:301
2968994818,4cyclictest22-21ksoftirqd/108:35:191
2968994815,6cyclictest22-21ksoftirqd/111:40:041
2968994815,6cyclictest22-21ksoftirqd/109:23:041
2968994815,6cyclictest22-21ksoftirqd/109:05:421
2968994815,6cyclictest22-21ksoftirqd/108:55:111
2968994815,5cyclictest22-21ksoftirqd/111:10:391
2968994815,5cyclictest22-21ksoftirqd/110:23:401
2968994815,5cyclictest22-21ksoftirqd/109:02:011
2968994815,5cyclictest22-21ksoftirqd/108:54:091
2968994814,6cyclictest22-21ksoftirqd/111:51:441
2968994814,6cyclictest22-21ksoftirqd/110:06:441
2968994814,6cyclictest22-21ksoftirqd/109:44:381
2968994814,6cyclictest22-21ksoftirqd/109:44:371
2968994812,5cyclictest22-21ksoftirqd/112:25:131
2968994811,6cyclictest22-21ksoftirqd/108:05:101
2968994716,10cyclictest22-21ksoftirqd/110:45:151
2968994715,5cyclictest22-21ksoftirqd/109:48:191
2968994715,5cyclictest22-21ksoftirqd/108:45:511
2968994714,6cyclictest22-21ksoftirqd/112:36:101
2968994714,5cyclictest22-21ksoftirqd/112:40:061
2968994714,5cyclictest22-21ksoftirqd/110:11:061
2968994713,6cyclictest22-21ksoftirqd/107:43:581
2968994712,5cyclictest22-21ksoftirqd/109:50:131
2968994711,5cyclictest22-21ksoftirqd/110:30:011
2968994711,5cyclictest22-21ksoftirqd/110:30:011
2968994614,5cyclictest22-21ksoftirqd/110:16:281
2968994613,6cyclictest22-21ksoftirqd/109:30:211
2967994613,20cyclictest3-21ksoftirqd/009:25:250
2968994515,4cyclictest22-21ksoftirqd/107:35:151
2968994515,10cyclictest22-21ksoftirqd/107:50:141
2968994513,5cyclictest22-21ksoftirqd/111:00:161
2968994512,6cyclictest22-21ksoftirqd/112:20:201
2968994510,5cyclictest22-21ksoftirqd/112:35:001
2968994413,5cyclictest22-21ksoftirqd/109:25:091
2968994413,13cyclictest22-21ksoftirqd/108:30:131
2968994412,5cyclictest22-21ksoftirqd/107:45:271
2968994322,4cyclictest22-21ksoftirqd/112:45:271
296899426,6cyclictest22-21ksoftirqd/110:40:291
2968994227,4cyclictest22-21ksoftirqd/108:25:151
2968994224,4cyclictest22-21ksoftirqd/108:05:011
2968994220,10cyclictest22-21ksoftirqd/110:33:111
2968994124,5cyclictest22-21ksoftirqd/112:15:121
2968994112,9cyclictest22-21ksoftirqd/110:35:291
2967994120,5cyclictest3-21ksoftirqd/008:10:000
2968994024,4cyclictest22-21ksoftirqd/112:10:151
2968993924,4cyclictest22-21ksoftirqd/108:40:141
2968993923,4cyclictest22-21ksoftirqd/110:50:171
296799399,13cyclictest28352-21seq09:55:200
296799395,7cyclictest81rcu_preempt11:00:000
2967993630,3cyclictest40950irq/93-i91509:40:280
2967993630,3cyclictest40950irq/93-i91509:40:270
296799362,4cyclictest81rcu_preempt11:12:060
296799358,20cyclictest40950irq/93-i91511:30:400
296799355,4cyclictest81rcu_preempt10:54:300
296799355,4cyclictest81rcu_preempt10:00:140
296799354,6cyclictest3-21ksoftirqd/012:38:260
296799354,6cyclictest3-21ksoftirqd/010:25:450
296799354,6cyclictest3-21ksoftirqd/010:25:450
2967993521,4cyclictest3-21ksoftirqd/009:20:120
2967993521,4cyclictest3-21ksoftirqd/008:00:130
2967993518,4cyclictest3-21ksoftirqd/009:10:250
236532359,4sleep023742-21/usr/sbin/munin08:15:290
83992340,9sleep0296799cyclictest07:35:280
68762341,4sleep06203-21packagekitd08:56:380
296799345,4cyclictest81rcu_preempt12:10:000
2967993420,4cyclictest3-21ksoftirqd/012:20:170
2967993420,4cyclictest3-21ksoftirqd/007:40:200
2967993419,4cyclictest3-21ksoftirqd/011:00:120
296799341,4cyclictest81rcu_preempt11:37:360
296799341,4cyclictest81rcu_preempt11:24:390
296799339,12cyclictest4797-21grep08:50:280
296799333,4cyclictest81rcu_preempt09:30:210
2967993321,9cyclictest40950irq/93-i91509:15:230
296799331,9cyclictest4939-21cron10:20:000
2967993319,4cyclictest3-21ksoftirqd/008:25:200
2967993318,4cyclictest3-21ksoftirqd/010:05:170
296799327,4cyclictest81rcu_preempt09:35:130
296799327,11cyclictest7363-21needreboot11:50:220
296799325,7cyclictest0-21swapper/009:50:300
296799324,4cyclictest81rcu_preempt11:44:200
296799322,4cyclictest81rcu_preempt08:20:220
2967993218,4cyclictest3-21ksoftirqd/012:15:120
2967993218,4cyclictest3-21ksoftirqd/011:05:280
2967993218,4cyclictest3-21ksoftirqd/010:35:180
296799321,6cyclictest0-21swapper/012:25:200
2967993216,5cyclictest3-21ksoftirqd/008:00:000
296799321,4cyclictest81rcu_preempt12:51:340
296799321,4cyclictest81rcu_preempt08:45:190
2967993212,10cyclictest3-21ksoftirqd/012:45:190
2967993117,4cyclictest3-21ksoftirqd/010:45:160
2967993117,4cyclictest3-21ksoftirqd/010:20:150
2967993117,4cyclictest3-21ksoftirqd/007:50:130
2967993117,4cyclictest3-21ksoftirqd/007:48:040
296799311,4cyclictest81rcu_preempt12:00:190
296799311,4cyclictest81rcu_preempt08:43:260
296799311,4cyclictest81rcu_preempt08:10:300
296799311,19cyclictest26981-21runrttasks12:43:370
296799311,10cyclictest81rcu_preempt08:35:260
102342311,5sleep00-21swapper/010:31:240
296799309,10cyclictest3-21ksoftirqd/012:10:330
2967993016,4cyclictest3-21ksoftirqd/012:30:150
2967993016,4cyclictest3-21ksoftirqd/011:55:130
2967993016,4cyclictest3-21ksoftirqd/011:26:390
2967993010,7cyclictest10966-21cron09:10:000
2967992915,4cyclictest3-21ksoftirqd/009:45:170
296799291,14cyclictest13736-21timerandwakeup10:40:330
300042281,5sleep00-21swapper/008:33:340
2967992814,4cyclictest3-21ksoftirqd/011:45:160
296799271,4cyclictest81rcu_preempt11:18:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional