You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 12:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Mon Nov 24, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4019581212156,60sleep30-21swapper/319:08:323
401939128653,9sleep20-21swapper/219:06:082
401941328553,10sleep10-21swapper/119:06:231
401965127656,14sleep00-21swapper/019:09:260
4019813992824,2cyclictest0-21swapper/323:40:133
4019813992622,3cyclictest0-21swapper/322:15:193
4019813992521,2cyclictest0-21swapper/322:49:423
4019813992521,2cyclictest0-21swapper/300:15:213
401981399251,18cyclictest25311-21taskset21:50:213
4019813992421,1cyclictest0-21swapper/300:05:193
4019813992418,3cyclictest4037653-21turbostat19:25:003
758962231,9sleep24149465-21diskmemload22:21:122
401981399232,14cyclictest12299-21taskset21:44:403
4019813992321,1cyclictest0-21swapper/321:30:013
4019813992320,1cyclictest0-21swapper/320:20:013
4019813992319,2cyclictest0-21swapper/322:05:153
401981399231,13cyclictest0-21swapper/300:35:593
1665662231,2sleep00-21swapper/023:17:310
401981399222,15cyclictest259312-21sleep00:14:593
4019813992219,1cyclictest0-21swapper/320:10:233
4019813992218,2cyclictest0-21swapper/323:19:533
401981399221,16cyclictest4173397-21chrt21:24:313
4019813992210,8cyclictest1567-21chrt21:35:573
401981399220,20cyclictest0-21swapper/319:59:443
940372211,8sleep24149465-21diskmemload22:33:592
875152218,3sleep086902-21/usr/sbin/munin22:30:150
401981399212,13cyclictest84224-21taskset22:26:213
4019813992119,1cyclictest0-21swapper/322:10:153
4019813992118,1cyclictest0-21swapper/320:20:233
4019813992117,2cyclictest0-21swapper/323:10:173
4019813992117,2cyclictest0-21swapper/322:38:543
182762211,2sleep10-21swapper/121:46:191
1331672211,3sleep00-21swapper/022:56:380
1013402211,2sleep10-21swapper/122:37:351
401981399203,10cyclictest4027788-21taskset19:15:123
401981399202,13cyclictest4157026-21taskset21:14:253
401981399202,13cyclictest133918-21taskset22:57:483
4019813992017,1cyclictest0-21swapper/322:40:113
4019813992016,2cyclictest0-21swapper/319:35:253
4019813992015,2cyclictest0-21swapper/322:20:173
4019813992014,3cyclictest0-21swapper/300:00:173
4019813992013,4cyclictest217979-21turbostat23:50:003
401981399201,15cyclictest225624-21chrt23:54:123
401981399201,12cyclictest4165027-21taskset21:19:143
401981399201,11cyclictest4138056-21taskset20:55:253
401981399200,13cyclictest226180-21sleep23:59:553
2983272200,2sleep20-21swapper/200:39:152
2673802201,2sleep00-21swapper/000:19:530
178852201,2sleep20-21swapper/221:45:442
401981399192,12cyclictest290231-21taskset00:33:303
401981399192,12cyclictest190577-21taskset23:30:513
401981399192,12cyclictest150207-21taskset23:07:233
4019813991916,2cyclictest0-21swapper/323:30:013
4019813991916,2cyclictest0-21swapper/322:00:003
4019813991916,1cyclictest0-21swapper/320:10:003
4019813991912,4cyclictest66550irq/131-enp1s0-TxRx-300:28:523
401981399191,17cyclictest0-21swapper/323:04:523
401981399191,14cyclictest4187304-21chrt21:30:533
401981399191,14cyclictest176041-21chrt23:24:213
401981399191,14cyclictest125205-21taskset22:51:463
401981399191,14cyclictest0-21swapper/319:10:143
315822191,13sleep233194-21/usr/sbin/munin21:55:182
787692181,4sleep24149465-21diskmemload22:25:132
684362181,3sleep10-21swapper/122:17:261
614212181,3sleep10-21swapper/122:14:411
41895352181,2sleep00-21swapper/021:34:190
4019813991815,1cyclictest0-21swapper/323:35:163
4019813991814,1cyclictest0-21swapper/321:05:233
401981399181,14cyclictest37455-21chrt22:00:113
401981399181,13cyclictest4069609-21turbostat19:54:593
401981399181,13cyclictest12843-21chrt21:45:073
401981399181,13cyclictest0-21swapper/322:30:123
401981399181,13cyclictest0-21swapper/300:20:073
1497902181,3sleep10-21swapper/123:06:451
840182175,1sleep0171rcu_preempt22:26:030
603052171,2sleep20-21swapper/222:12:582
504102171,4sleep0171rcu_preempt22:05:270
427342171,2sleep00-21swapper/022:01:090
41794442171,2sleep10-21swapper/121:26:191
401981399179,5cyclictest4064013-21turbostat19:50:013
401981399177,1cyclictest0-21swapper/319:30:263
4019813991714,2cyclictest0-21swapper/320:30:153
4019813991714,1cyclictest0-21swapper/321:00:153
401981399171,12cyclictest0-21swapper/320:50:213
2899892171,4sleep24149465-21diskmemload00:33:052
2831872171,3sleep00-21swapper/000:29:510
2315542171,4sleep14149465-21diskmemload23:55:481
2104712171,10sleep1210686-21hddtemp_smartct23:45:141
41553892160,3sleep00-21swapper/021:11:390
41552752161,2sleep10-21swapper/121:11:271
40751742161,10sleep04075203-21grep20:00:120
401981399161,9cyclictest4112407-21taskset20:35:093
4019813991612,2cyclictest0-21swapper/320:28:543
401981399161,10cyclictest4122550-21taskset20:43:143
401981399161,10cyclictest4058399-21taskset19:41:233
2955802162,6sleep0295634-21ntpq00:35:200
1997412161,9sleep04149465-21diskmemload23:37:190
1912222161,4sleep24149465-21diskmemload23:31:512
1739312161,2sleep10-21swapper/123:21:131
1664062161,3sleep10-21swapper/123:17:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional