You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 04:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Sun Apr 05, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269299911721136,18cyclictest27895-21ntp_states19:25:231
269289911701124,33cyclictest27756-21memory19:25:210
264722586496,82sleep00-21swapper/019:20:500
264722586496,82sleep00-21swapper/019:20:490
265062481433,33sleep10-21swapper/119:21:101
265062481433,33sleep10-21swapper/119:21:091
180521110,5sleep01807-21unixbench_singl21:05:290
26929994417,7cyclictest22-21ksoftirqd/123:59:241
20402430,5sleep02692899cyclictest22:15:290
68332420,4sleep02692899cyclictest00:35:120
26929994217,15cyclictest22-21ksoftirqd/100:53:261
2692999417,5cyclictest0-21swapper/123:26:161
2692999417,19cyclictest0-21swapper/122:22:541
26929994114,18cyclictest22-21ksoftirqd/122:37:571
26929994110,27cyclictest0-21swapper/122:12:151
26928994116,8cyclictest15695-21diskstats22:30:150
2692999392,33cyclictest9026-21fschecks_time23:30:151
26929993917,7cyclictest22-21ksoftirqd/100:09:351
26929993917,6cyclictest22-21ksoftirqd/121:35:161
2692899396,18cyclictest4988-21ssh00:33:100
2692899396,18cyclictest4988-21ssh00:33:100
26928993911,5cyclictest728-21munin-run19:40:000
26929993817,6cyclictest22-21ksoftirqd/123:36:021
2692999381,26cyclictest0-21swapper/100:14:431
2692899388,12cyclictest0-21swapper/022:50:300
26928993814,4cyclictest81rcu_preempt20:25:000
2692999373,5cyclictest0-21swapper/100:33:361
2692999373,5cyclictest0-21swapper/100:33:361
26929993717,6cyclictest22-21ksoftirqd/122:15:251
26929993716,7cyclictest22-21ksoftirqd/122:05:231
26929993716,6cyclictest22-21ksoftirqd/123:42:021
26929993716,6cyclictest22-21ksoftirqd/122:54:141
26929993716,6cyclictest22-21ksoftirqd/122:32:021
26929993713,14cyclictest22-21ksoftirqd/122:48:471
2692899373,30cyclictest0-21swapper/000:07:150
26928993726,8cyclictest0-21swapper/023:35:160
2692899371,16cyclictest3286-21ssh21:10:190
2692899371,13cyclictest2295-21diskmemload23:25:260
198292371,4sleep119918-21fschecks_count00:15:161
26929993615,7cyclictest22-21ksoftirqd/122:42:541
26929993615,6cyclictest22-21ksoftirqd/100:42:541
2692899366,12cyclictest9847-21sh21:16:460
2692899363,5cyclictest24192-21iostat22:05:200
2692899363,30cyclictest0-21swapper/000:44:360
2692899362,14cyclictest0-21swapper/022:25:240
2692899362,13cyclictest5097-21/usr/sbin/munin00:00:230
2692899362,12cyclictest0-21swapper/023:01:050
26928993613,6cyclictest30361-21/usr/sbin/munin00:25:280
26928993612,6cyclictest26572-21ssh22:40:370
2692899361,13cyclictest3483-21ssh23:58:030
2692899361,13cyclictest11705-21ssh23:32:580
281842351,30sleep128188-21ntp_states20:50:251
2692999359,4cyclictest40550irq/92-i91522:56:451
2692999355,27cyclictest0-21swapper/123:51:361
2692999354,28cyclictest0-21swapper/121:45:351
26929993527,5cyclictest0-21swapper/100:38:561
2692999352,30cyclictest0-21swapper/100:26:551
2692899358,10cyclictest32145-21fschecks_time21:40:150
2692899351,16cyclictest19677-21turbostat.cron20:30:000
2692899351,15cyclictest20649-21taskset22:01:130
2692899351,13cyclictest29674-21grep20:55:160
2692899351,12cyclictest0-21swapper/000:20:590
26928993510,7cyclictest2295-21diskmemload21:20:320
95632341,3sleep00-21swapper/020:00:290
296662340,4sleep041ktimersoftd/022:10:280
292182341,5sleep10-21swapper/120:55:031
2692999349,5cyclictest40550irq/92-i91521:40:261
2692999348,5cyclictest40550irq/92-i91521:55:291
2692999348,5cyclictest40550irq/92-i91521:00:171
2692999341,30cyclictest19833-21/usr/sbin/munin20:30:161
2692999341,29cyclictest2403-21irqbalance21:05:151
26929993411,5cyclictest40550irq/92-i91520:30:001
2692899348,22cyclictest0-21swapper/021:36:300
2692899342,4cyclictest0-21swapper/021:45:550
2692899341,6cyclictest23940-21ssh22:38:510
2692899341,5cyclictest6011-21ssh22:20:120
2692899341,5cyclictest19490-21/usr/sbin/munin00:15:150
2692899341,17cyclictest25445-21ssh23:46:570
260612341,3sleep126075-21ssh23:14:521
304782331,28sleep030538-21iostat22:45:210
2692999333,4cyclictest40550irq/92-i91523:01:571
26929993320,10cyclictest28893-21ssh23:16:571
2692999331,30cyclictest0-21swapper/120:45:351
2692999331,30cyclictest0-21swapper/120:00:371
2692999331,29cyclictest29588-21/usr/sbin/munin19:30:161
2692899338,9cyclictest0-21swapper/000:13:170
2692899338,10cyclictest0-21swapper/023:15:020
2692899335,25cyclictest0-21swapper/023:24:330
2692899333,28cyclictest0-21swapper/019:42:360
26928993326,5cyclictest0-21swapper/023:07:150
2692899332,28cyclictest0-21swapper/000:51:160
2692899332,27cyclictest0-21swapper/022:57:070
2692899332,13cyclictest28194-21/usr/sbin/munin20:50:260
2692899332,13cyclictest2295-21diskmemload21:51:220
2692899331,6cyclictest31243-21sh23:53:240
2692899331,30cyclictest0-21swapper/000:45:560
2692899331,16cyclictest0-21swapper/021:27:100
2692899331,15cyclictest26301-21ntp_states20:45:240
2692899331,13cyclictest13424-21timerwakeupswit20:10:280
2692899331,13cyclictest13424-21timerwakeupswit20:10:270
26928993310,5cyclictest24535-21ssh21:31:590
2692999329,19cyclictest0-21swapper/121:50:491
2692999327,5cyclictest40550irq/92-i91522:00:291
2692999321,7cyclictest343-21ssh23:20:361
2692999321,28cyclictest16081-21/usr/sbin/munin20:20:151
2692999321,28cyclictest0-21swapper/122:28:561
2692999321,15cyclictest0-21swapper/121:27:211
2692899328,6cyclictest20265-21sh23:41:220
2692899328,5cyclictest2645-21snmpd20:30:210
2692899322,8cyclictest3302-21runrttasks20:18:000
2692899321,6cyclictest4413-21taskset19:47:530
2692899321,13cyclictest21840-21sh23:10:120
2692899321,12cyclictest22986-21chrt20:35:340
26928993210,5cyclictest32111-21mailstats21:00:280
140352321,4sleep014138-21df21:55:120
97932311,5sleep10-21swapper/121:16:421
26929993123,5cyclictest0-21swapper/121:30:161
2692999312,25cyclictest0-21swapper/121:11:271
2692999311,14cyclictest0-21swapper/119:54:201
26929993110,7cyclictest26926-21cyclictest21:20:101
2692899319,5cyclictest8204-21taskset19:58:170
2692899311,12cyclictest24427-21ntp_states20:40:230
258702311,26sleep125881-21ssh23:47:341
200402311,5sleep10-21swapper/123:08:071
47952301,5sleep04782-21/usr/sbin/munin19:50:110
2692999308,8cyclictest3302-21runrttasks19:45:021
26929993022,6cyclictest0-21swapper/100:04:151
2692999301,17cyclictest0-21swapper/119:42:091
2692899302,24cyclictest10728-21diskstats20:05:160
2692999291,24cyclictest18571-21taskset00:47:221
26929992910,4cyclictest40550irq/92-i91519:55:031
2692899291,14cyclictest30853-21users19:30:300
2692999281,13cyclictest0-21swapper/120:09:241
251312281,5sleep10-21swapper/120:43:101
232872281,5sleep10-21swapper/120:38:421
2692999275,5cyclictest40550irq/92-i91519:40:001
2692999274,5cyclictest40550irq/92-i91500:20:271
26929992616,5cyclictest12697-21grep20:10:151
26929992616,5cyclictest12697-21grep20:10:151
26929992517,5cyclictest15919-21cron20:20:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional