You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 22:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Nov 08, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50749911981168,26cyclictest9552-21sort07:35:011
50749911471138,6cyclictest0-21swapper/107:25:071
37892648602,29sleep00-21swapper/007:20:180
39892543494,32sleep10-21swapper/107:20:231
507399220199,15cyclictest0-21swapper/007:35:010
507399179170,6cyclictest0-21swapper/007:25:070
1120321200,9sleep0507399cyclictest10:15:000
5092920,10sleep1507499cyclictest08:35:181
254932860,3sleep125492-21ssh09:55:271
196992850,5sleep119697-21unixbench_singl09:15:301
224082840,4sleep1201rcuc/112:40:191
163422840,10sleep0507399cyclictest11:26:260
155612810,8sleep0507399cyclictest09:11:260
194352750,4sleep10-21swapper/112:36:541
16472730,7sleep10-21swapper/109:30:301
5074996811,4cyclictest0-21swapper/112:07:581
5074996811,11cyclictest0-21swapper/110:45:441
5074996714,6cyclictest14855-21runrttasks07:46:481
507499669,39cyclictest0-21swapper/110:31:291
507499661,15cyclictest28313-21ssh12:45:541
507499657,13cyclictest0-21swapper/112:22:391
507499645,4cyclictest0-21swapper/111:53:501
507499637,12cyclictest13177-21diskmemload12:01:291
507499637,12cyclictest13177-21diskmemload12:01:281
507499625,4cyclictest0-21swapper/111:08:511
507499614,7cyclictest15220-21diskstats09:45:151
507499611,9cyclictest3020-21runrttasks08:15:441
507499573,47cyclictest17512-21diskstats07:55:181
507499571,14cyclictest24564-21irqstats11:35:231
5074995710,4cyclictest0-21swapper/111:41:421
507499562,12cyclictest0-21swapper/110:08:081
5074995615,6cyclictest7518-21runrttasks09:36:431
5074995612,3cyclictest0-21swapper/109:27:171
5074995611,4cyclictest0-21swapper/111:19:521
5074995611,4cyclictest0-21swapper/110:04:551
507499561,12cyclictest14299-21needreboot09:10:251
5074995610,4cyclictest0-21swapper/112:29:161
5074995610,4cyclictest0-21swapper/108:08:481
507499557,5cyclictest40950irq/93-i91510:10:151
507499552,13cyclictest0-21swapper/111:58:101
5074995511,4cyclictest0-21swapper/110:18:281
507499551,13cyclictest14976-21irqstats11:25:241
507499551,11cyclictest231412cat11:00:221
5074995510,4cyclictest0-21swapper/111:13:371
507499544,8cyclictest9974-21diskstats07:35:161
507499542,10cyclictest0-21swapper/110:35:251
5074995411,4cyclictest0-21swapper/112:12:071
5074995411,4cyclictest0-21swapper/110:40:231
5074995411,4cyclictest0-21swapper/110:21:501
507499532,7cyclictest3020-21runrttasks10:25:261
507499532,6cyclictest19596-21hddtemp_smartct11:30:171
507499532,5cyclictest0-21swapper/109:23:071
5074995311,4cyclictest0-21swapper/112:15:211
5074995310,4cyclictest0-21swapper/110:56:581
507499528,11cyclictest0-21swapper/110:50:331
507499527,12cyclictest0-21swapper/112:34:501
507499526,5cyclictest0-21swapper/111:24:211
507499526,5cyclictest0-21swapper/111:24:211
507499522,9cyclictest2477-21hddtemp_smartct08:40:411
507499522,45cyclictest0-21swapper/109:50:311
507499522,12cyclictest0-21swapper/111:45:361
507499521,7cyclictest27643-21ntpq08:20:241
5074995212,5cyclictest0-21swapper/109:41:581
507499512,4cyclictest0-21swapper/108:55:101
507499512,12cyclictest0-21swapper/108:30:191
5074995113,5cyclictest0-21swapper/112:54:281
5074995113,4cyclictest0-21swapper/109:02:071
507499502,12cyclictest0-21swapper/108:02:371
5074995011,4cyclictest0-21swapper/108:11:431
5074995010,4cyclictest0-21swapper/107:51:321
507499499,7cyclictest137350irq/90-eth008:45:111
507499493,13cyclictest0-21swapper/109:05:231
507499492,14cyclictest5952-21/usr/sbin/munin08:50:131
507499492,14cyclictest5952-21/usr/sbin/munin08:50:121
507499492,14cyclictest0-21swapper/107:40:161
507499475,8cyclictest29538-21ntpq08:25:261
74162460,3sleep07414-21sed11:50:320
59522410,9sleep0507399cyclictest09:35:240
507399411,8cyclictest32727-21ssh09:30:090
269192410,6sleep00-21swapper/009:56:530
5073993918,14cyclictest19433-21cron09:50:000
139592371,32sleep013971-21ssh12:30:570
507399368,12cyclictest18417-21rm12:02:260
507399368,12cyclictest18417-21rm12:02:260
507399367,5cyclictest81rcu_preempt09:26:340
507399363,5cyclictest81rcu_preempt12:22:580
227142367,4sleep022828-21sh11:00:170
507399359,13cyclictest8077-21iostat12:25:230
5073993514,16cyclictest3-21ksoftirqd/007:59:040
507399351,20cyclictest9968-21sh07:35:140
507399346,5cyclictest81rcu_preempt10:34:110
507399344,4cyclictest81rcu_preempt11:21:390
507399344,4cyclictest81rcu_preempt11:21:380
507399344,4cyclictest81rcu_preempt10:04:190
507399342,15cyclictest26377-21chrt09:23:070
507399341,7cyclictest27311-21ssh12:11:220
507399336,5cyclictest81rcu_preempt10:37:220
507399331,4cyclictest81rcu_preempt10:25:420
507399331,20cyclictest22452-21users08:05:310
5073993311,7cyclictest0-21swapper/010:06:070
5073993310,8cyclictest2166-21cron12:19:590
145002331,26sleep017432-21kworker/0:110:17:510
507399329,12cyclictest0-21swapper/011:55:270
507399327,5cyclictest81rcu_preempt09:40:160
507399327,4cyclictest81rcu_preempt10:21:100
507399322,17cyclictest0-21swapper/008:51:460
507399322,17cyclictest0-21swapper/008:51:450
507399321,4cyclictest81rcu_preempt12:40:240
507399321,4cyclictest81rcu_preempt11:39:440
5073993214,7cyclictest3-21ksoftirqd/012:47:570
507399321,14cyclictest4396-21ssh11:48:060
507399317,4cyclictest81rcu_preempt10:50:220
507399316,5cyclictest81rcu_preempt10:55:240
507399315,4cyclictest81rcu_preempt12:52:470
507399315,4cyclictest81rcu_preempt11:30:560
507399313,4cyclictest81rcu_preempt10:41:350
507399312,14cyclictest21003-21hddtemp_smartct12:05:170
507399311,4cyclictest81rcu_preempt11:44:090
507399311,17cyclictest319-21/usr/sbin/munin08:35:170
5073993111,7cyclictest12100-21ssh10:49:190
5073993110,7cyclictest8971-21runrttasks08:55:430
5073993110,6cyclictest19246-21ssh09:15:250
507399302,5cyclictest81rcu_preempt07:55:000
5073993016,8cyclictest30893-21diskstats08:30:170
507399301,4cyclictest81rcu_preempt11:15:030
507399301,4cyclictest81rcu_preempt08:14:270
5073993011,6cyclictest27230-21ssh11:05:050
507399301,16cyclictest24365-21chrt09:55:010
507399301,15cyclictest32480-21grep11:10:170
507399293,23cyclictest0-21swapper/009:06:080
507399292,13cyclictest4400-21hddtemp_smartct08:45:190
507399291,4cyclictest81rcu_preempt12:36:280
507399291,21cyclictest19901-21iostat08:00:200
5073992910,6cyclictest12421-21open_files07:40:270
507399282,13cyclictest0-21swapper/008:15:230
507399281,14cyclictest30944-21snmpd07:47:260
507399281,14cyclictest2349-21fschecks_count08:40:390
282162281,5sleep00-21swapper/008:21:330
109582281,5sleep00-21swapper/009:01:380
507399272,12cyclictest28858-21cpu08:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional