You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 06:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Thu Sep 18, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10849911991190,6cyclictest0-21swapper/119:25:091
10849911961171,19cyclictest81rcu_preempt19:35:011
10839911521127,22cyclictest0-21swapper/019:25:060
6062503461,27sleep00-21swapper/019:20:420
9082462417,30sleep10-21swapper/119:23:491
108399188169,16cyclictest0-21swapper/019:35:020
2562921070,22sleep03-21ksoftirqd/022:35:450
814021020,6sleep0108399cyclictest22:18:180
45992760,4sleep0108399cyclictest23:21:120
102402550,2sleep00-21swapper/000:00:280
233432460,4sleep0108399cyclictest21:25:230
1084994116,10cyclictest22-21ksoftirqd/123:32:311
108499403,19cyclictest0-21swapper/121:50:561
108499403,19cyclictest0-21swapper/121:50:551
108499402,26cyclictest0-21swapper/121:40:111
1084994015,7cyclictest22-21ksoftirqd/123:55:281
1084994015,6cyclictest22-21ksoftirqd/100:43:471
1084994014,10cyclictest22-21ksoftirqd/121:20:201
1083994026,10cyclictest30944-21snmpd22:21:570
108499396,17cyclictest0-21swapper/123:14:041
1084993916,6cyclictest22-21ksoftirqd/122:55:231
1084993916,14cyclictest22-21ksoftirqd/122:33:331
1084993915,6cyclictest22-21ksoftirqd/122:03:541
1084993915,14cyclictest22-21ksoftirqd/123:54:511
1084993914,10cyclictest22-21ksoftirqd/123:40:211
1083993914,8cyclictest15041-21ssh21:16:310
1083993913,8cyclictest22715-21ssh00:47:590
1083993912,5cyclictest19902-21iostat22:30:210
1084993817,6cyclictest22-21ksoftirqd/121:15:221
1084993816,6cyclictest22-21ksoftirqd/121:29:001
1084993816,6cyclictest22-21ksoftirqd/100:29:211
1084993816,6cyclictest22-21ksoftirqd/100:04:541
108499381,19cyclictest30944-21snmpd22:44:521
108399381,7cyclictest10470-21chrt00:35:150
108399381,14cyclictest27925-21tune2fs21:30:190
126012371,3sleep012661-21fschecks_count23:30:140
108499372,18cyclictest0-21swapper/123:46:411
1084993714,7cyclictest22-21ksoftirqd/100:53:421
108499371,14cyclictest0-21swapper/122:38:561
108399372,6cyclictest3020-21runrttasks00:41:520
1083993713,8cyclictest242492sleep000:50:080
1083993712,5cyclictest0-21swapper/000:25:240
108399371,19cyclictest9973-21pidof22:54:010
193572361,4sleep12376-21NetworkManager21:55:351
1084993616,6cyclictest22-21ksoftirqd/123:08:281
1084993615,7cyclictest22-21ksoftirqd/123:35:581
1084993615,6cyclictest22-21ksoftirqd/122:46:011
108499361,18cyclictest0-21swapper/100:14:281
108399361,5cyclictest1382-21sh20:50:000
108399361,11cyclictest0-21swapper/000:18:360
81132351,7sleep18140-21hddtemp_smartct19:40:171
1084993515,6cyclictest22-21ksoftirqd/121:13:521
1084993515,6cyclictest22-21ksoftirqd/100:07:231
1084993514,7cyclictest22-21ksoftirqd/100:34:331
108499351,15cyclictest9013-21ssh22:19:361
108399359,6cyclictest7790-21diskmemload21:45:000
108399357,7cyclictest18943-21ssh21:55:250
108399357,23cyclictest2220-21dbus-daemon20:37:060
108399352,7cyclictest0-21swapper/023:16:030
108399352,13cyclictest8591-21/usr/sbin/munin21:10:150
1083993512,3cyclictest0-21swapper/023:05:290
108399351,14cyclictest5646-21tr21:00:130
108399351,13cyclictest3778-21kernelversion19:30:040
108399351,12cyclictest23647-21sh22:00:250
323882341,4sleep032467-21ntpq23:50:250
108499341,9cyclictest32487-21ssh00:24:511
1084993413,6cyclictest22-21ksoftirqd/122:11:291
108499341,17cyclictest0-21swapper/100:16:371
1084993411,19cyclictest0-21swapper/100:38:241
1083993424,5cyclictest5054-21ps23:55:280
108399342,13cyclictest10943-21/usr/sbin/munin22:55:260
108399342,13cyclictest0-21swapper/021:35:310
108399341,20cyclictest18017-21ssh00:09:480
108399341,13cyclictest111-21usb-storage20:55:150
41562331,5sleep14163-21diskstats19:30:151
272852331,28sleep127289-21ntp_states20:30:251
225972331,28sleep022629-21iostat_ios23:40:220
108499339,20cyclictest0-21swapper/121:35:211
108499337,5cyclictest40950irq/93-i91522:51:291
108499334,5cyclictest40950irq/93-i91522:08:291
108499332,11cyclictest11896-21hddtemp_smartct19:50:191
108499332,11cyclictest11896-21hddtemp_smartct19:50:191
1084993313,6cyclictest22-21ksoftirqd/123:24:261
108499331,26cyclictest24582-21/usr/sbin/munin20:25:271
1084993312,6cyclictest22-21ksoftirqd/123:27:251
108399332,12cyclictest0-21swapper/019:55:210
1083993311,5cyclictest16718-21ntp_states23:00:270
108399331,13cyclictest2680-21/usr/sbin/munin20:50:330
108399331,12cyclictest28776-21irqstats00:20:220
1083993310,6cyclictest19779-21runrttasks21:21:220
310782321,6sleep10-21swapper/121:33:491
108399329,6cyclictest30124-21sh22:07:140
108399325,6cyclictest0-21swapper/020:44:150
108399324,12cyclictest0-21swapper/021:47:100
108399322,25cyclictest8140-21hddtemp_smartct19:40:180
108399321,6cyclictest10041-21hwlatdetect19:45:180
1083993213,4cyclictest206962sleep023:38:380
108399321,15cyclictest30836-21ssh23:49:220
108399321,14cyclictest8188-21ssh23:25:220
108399321,14cyclictest4165-21rm22:47:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional