You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-01 - 23:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Nov 01, 2025 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325589910921083,6cyclictest2078-21munin-node07:30:001
322612686639,32sleep00-21swapper/007:22:340
323692565521,29sleep10-21swapper/107:23:431
3255799281225,51cyclictest1993-21munin-run07:30:000
140002970,8sleep03255799cyclictest12:03:010
100082860,4sleep1201rcuc/111:25:191
168222840,8sleep13255899cyclictest09:18:191
9872720,3sleep1986-21wc11:15:321
138362520,3sleep041ktimersoftd/011:29:480
245212430,4sleep0111rcuc/009:25:330
215032423,6sleep03-21ksoftirqd/012:10:300
183162411,36sleep018326-21ssh12:07:180
3255799396,4cyclictest81rcu_preempt12:29:540
3255799381,17cyclictest0-21swapper/011:01:390
3255899375,4cyclictest81rcu_preempt10:43:411
32558993710,15cyclictest0-21swapper/110:34:201
3255799372,12cyclictest0-21swapper/010:35:150
3255899366,7cyclictest16780-21run-parts12:40:011
32558993619,8cyclictest22-21ksoftirqd/111:38:411
32558993614,13cyclictest22-21ksoftirqd/109:37:321
32558993611,12cyclictest0-21swapper/111:10:541
3255799368,5cyclictest81rcu_preempt09:40:290
3255799366,5cyclictest81rcu_preempt09:30:230
71472351,30sleep17201-21hddtemp_smartct10:15:231
32558993519,5cyclictest22-21ksoftirqd/111:09:491
32558993510,12cyclictest0-21swapper/109:29:241
3255799351,5cyclictest9703-21wc09:10:280
32557993510,13cyclictest3-21ksoftirqd/008:00:250
60082342,28sleep10-21swapper/111:20:321
3255899342,14cyclictest115802ssh09:45:381
3255799341,9cyclictest0-21swapper/012:15:250
3255799341,20cyclictest19037-21if_eth009:20:300
3255799341,13cyclictest26422-21sh10:01:120
3255799341,12cyclictest76792cat12:30:160
323542341,3sleep132365-21ssh11:48:451
3255899339,20cyclictest0-21swapper/112:03:041
3255899337,22cyclictest0-21swapper/109:50:391
3255899334,4cyclictest81rcu_preempt08:38:511
3255899331,19cyclictest0-21swapper/110:46:271
32558993311,4cyclictest40950irq/93-i91512:25:481
3255799337,5cyclictest81rcu_preempt11:35:020
3255799336,5cyclictest81rcu_preempt12:20:240
3255799331,7cyclictest30364-21ssh12:54:280
32557993313,6cyclictest16298-21cut10:25:130
3255799331,20cyclictest24643-21runrttasks12:47:410
3255799331,11cyclictest0-21swapper/010:34:090
323192331,5sleep00-21swapper/010:07:470
122262331,3sleep012272-21grep10:20:250
3255899328,20cyclictest8265-21sh10:50:151
3255899322,25cyclictest5930-21irqstats09:40:241
3255899322,24cyclictest30252-21ntp_states10:05:261
3255899321,9cyclictest22491-21irqstats12:45:201
32558993217,8cyclictest19082-21iostat_ios09:20:331
32558993214,14cyclictest16461-21sh10:58:411
3255799327,5cyclictest81rcu_preempt11:45:030
3255799326,5cyclictest81rcu_preempt09:54:100
3255799321,18cyclictest5674-21ssh11:54:590
3255799321,12cyclictest0-21swapper/010:46:100
181942321,5sleep00-21swapper/008:10:090
181942321,5sleep00-21swapper/008:10:080
34462311,4sleep13495-21iostat07:30:201
3255899319,18cyclictest0-21swapper/110:03:201
3255899315,16cyclictest0-21swapper/112:53:571
32558993115,13cyclictest22-21ksoftirqd/112:08:541
32558993114,9cyclictest22-21ksoftirqd/111:00:251
32558993112,15cyclictest21421-21seq12:10:271
3255799317,5cyclictest81rcu_preempt11:34:190
3255799317,5cyclictest81rcu_preempt10:44:490
3255799317,4cyclictest81rcu_preempt11:14:260
3255799317,19cyclictest19858-21ssh12:42:280
3255799316,4cyclictest81rcu_preempt09:57:490
3255799316,4cyclictest81rcu_preempt09:36:000
32557993123,5cyclictest14095-21mandb07:58:350
32557993121,6cyclictest14339-21ssh10:55:360
3255799312,12cyclictest0-21swapper/011:06:040
3255799311,9cyclictest9912-21ssh10:51:100
32557993113,5cyclictest7619-21ntp_states10:15:320
32557993113,5cyclictest2778-21ntp_states10:10:310
32557993111,6cyclictest7348-21tail11:55:310
3255799311,15cyclictest12763-21ssh12:35:180
228132311,5sleep10-21swapper/108:20:271
157462311,3sleep015753-21ssh09:16:480
6922301,5sleep00-21swapper/011:15:290
3255899304,16cyclictest0-21swapper/111:59:101
3255899301,17cyclictest12151-21chrt07:54:411
3255799305,11cyclictest3950-21switchtime07:30:290
3255799302,14cyclictest10341-21df_inode09:45:140
32557993011,6cyclictest29254-21taskset08:39:180
301132301,5sleep10-21swapper/109:31:391
230302301,5sleep10-21swapper/109:58:201
121172301,5sleep00-21swapper/007:54:170
82002291,4sleep00-21swapper/007:42:380
78722291,5sleep00-21swapper/011:23:080
65732291,5sleep00-21swapper/009:05:050
61542291,5sleep00-21swapper/009:02:170
3255899297,18cyclictest0-21swapper/111:31:311
3255899295,4cyclictest81rcu_preempt11:50:541
3255899295,4cyclictest81rcu_preempt07:41:131
3255899295,18cyclictest24230-21diskstats11:40:161
3255899294,4cyclictest81rcu_preempt12:33:001
3255899293,13cyclictest0-21swapper/110:12:171
32558992915,10cyclictest22-21ksoftirqd/108:05:191
3255899291,4cyclictest81rcu_preempt08:49:391
3255899290,4cyclictest81rcu_preempt09:07:411
3255799296,11cyclictest6204-21gdbus08:22:380
3255799292,4cyclictest40950irq/93-i91507:50:010
3255799292,14cyclictest0-21swapper/007:37:500
3255799291,10cyclictest0-21swapper/011:40:380
24122291,5sleep00-21swapper/008:53:340
238382291,5sleep10-21swapper/108:25:021
216252291,5sleep00-21swapper/008:18:170
99292281,5sleep10-21swapper/107:46:031
63262281,5sleep10-21swapper/109:04:021
56472281,5sleep10-21swapper/107:35:251
3255899289,15cyclictest0-21swapper/110:21:451
3255899288,16cyclictest0-21swapper/109:11:081
3255899286,4cyclictest81rcu_preempt08:43:211
3255899286,12cyclictest40950irq/93-i91512:20:581
3255899284,4cyclictest81rcu_preempt10:35:321
32558992817,8cyclictest22-21ksoftirqd/112:40:121
3255899281,4cyclictest81rcu_preempt08:34:331
32558992810,8cyclictest16293-21aten_r4power_en10:25:131
32557992811,4cyclictest32079-21memory08:45:230
3255799281,14cyclictest30267-21runrttasks08:40:220
3255799280,4cyclictest81rcu_preempt08:56:290
216672281,5sleep10-21swapper/108:18:441
21292281,5sleep10-21swapper/108:50:461
177152281,5sleep00-21swapper/008:06:420
32558992715,9cyclictest22-21ksoftirqd/112:15:281
3255799271,15cyclictest24867-21cut08:25:300
142342271,5sleep10-21swapper/107:59:481
3255899266,5cyclictest81rcu_preempt08:10:211
3255899266,5cyclictest81rcu_preempt08:10:201
3255899252,9cyclictest3017-21cut08:55:151
3255799251,12cyclictest27001-21/usr/sbin/munin08:30:320
32558992415,6cyclictest22-21ksoftirqd/108:00:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional