You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 13:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Tue Nov 25, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
216061021250,3sleep134-21ksoftirqd/119:55:111
2110467212351,67sleep30-21swapper/319:06:003
211052728460,6sleep00-21swapper/019:06:460
211058427862,10sleep10-21swapper/119:07:271
211074627660,10sleep20-21swapper/219:09:322
2110924993011,15cyclictest2176760-21chrt20:10:123
21510812270,2sleep30-21swapper/319:45:153
211092499261,10cyclictest2127613-21taskset19:20:183
24020252251,10sleep12402136-21ntpq22:45:201
211092499251,8cyclictest2526379-21taskset00:01:303
22792182241,2sleep00-21swapper/021:30:470
2110924992421,1cyclictest0-21swapper/321:23:543
2110924992319,2cyclictest0-21swapper/323:55:183
2110924992311,8cyclictest2397058-21taskset22:44:053
211092499231,17cyclictest2452646-21chrt23:17:003
211092499231,17cyclictest2452646-21chrt23:17:003
211092499231,17cyclictest2297539-21taskset21:43:233
211092499220,13cyclictest2463163-21taskset23:25:073
211092499219,2cyclictest0-21swapper/323:45:313
2110924992117,2cyclictest0-21swapper/321:55:193
2110924992112,5cyclictest24958222sleep323:44:583
211092499211,16cyclictest2427636-21taskset23:01:253
211092499210,8cyclictest2566367-21taskset00:27:203
2110924992017,1cyclictest0-21swapper/319:15:143
2110924992015,4cyclictest15950irq/132-ahci[0000:00:17.0]00:10:183
2110924992015,3cyclictest0-21swapper/321:15:183
2110924992011,6cyclictest0-21swapper/322:36:433
211092499201,15cyclictest66550irq/131-enp1s0-TxRx-321:11:003
211092499201,15cyclictest2304167-21chrt21:46:003
211092499201,15cyclictest0-21swapper/322:05:213
211092499200,13cyclictest2369713-21taskset22:25:253
24631882191,2sleep12240796-21diskmemload23:25:091
22303202191,11sleep02230443-21diskstats21:00:120
22142552191,6sleep02214273-21apt-get20:45:130
211092499195,13cyclictest0-21swapper/322:19:303
211092499192,12cyclictest2559811-21taskset00:24:243
211092499192,12cyclictest2289725-21taskset21:39:063
211092499192,11cyclictest2575531-21taskset00:35:093
211092499192,11cyclictest2504383-21taskset23:50:033
2110924991917,1cyclictest0-21swapper/320:20:003
2110924991916,1cyclictest0-21swapper/321:25:133
2110924991916,1cyclictest0-21swapper/320:40:193
2110924991915,2cyclictest0-21swapper/323:37:353
2110924991913,2cyclictest0-21swapper/322:52:043
211092499191,14cyclictest2403888-21chrt22:47:093
211092499191,14cyclictest2323575-21chrt22:00:113
211092499191,14cyclictest0-21swapper/323:20:573
211092499191,14cyclictest0-21swapper/322:30:393
211092499191,13cyclictest0-21swapper/321:50:103
24714502182,10sleep02471476-21apt-get23:30:130
24266782181,4sleep02240796-21diskmemload23:00:260
22469832181,3sleep00-21swapper/021:11:580
21923342182,7sleep1802-21snmpd20:22:101
21698722181,5sleep12169916-21ntpq20:00:211
211092499187,7cyclictest2444628-21taskset23:12:193
211092499184,7cyclictest2133752-21taskset19:27:243
211092499184,7cyclictest2133752-21taskset19:27:243
211092499182,12cyclictest2476414-21taskset23:30:353
211092499182,12cyclictest2347712-21taskset22:14:263
211092499182,11cyclictest2550493-21taskset00:16:533
2110924991815,2cyclictest0-21swapper/320:05:013
2110924991815,1cyclictest0-21swapper/321:00:173
2110924991814,2cyclictest0-21swapper/321:00:013
211092499181,14cyclictest66550irq/131-enp1s0-TxRx-322:55:223
211092499181,14cyclictest0-21swapper/322:22:143
211092499181,14cyclictest0-21swapper/319:55:013
211092499181,14cyclictest0-21swapper/300:06:233
211092499181,13cyclictest0-21swapper/323:05:203
211092499181,13cyclictest0-21swapper/321:30:133
211092499181,13cyclictest0-21swapper/300:30:253
211092499181,11cyclictest2171451-21taskset20:05:113
25822102171,3sleep10-21swapper/100:39:331
25584632171,3sleep00-21swapper/000:22:080
23902442171,11sleep02390451-21sed22:40:140
23705602171,3sleep20-21swapper/222:26:132
23651762171,3sleep10-21swapper/122:25:081
22473582171,3sleep10-21swapper/121:12:361
2110924991714,1cyclictest0-21swapper/320:50:123
211092499171,10cyclictest2197928-21taskset20:30:003
211092499170,14cyclictest0-21swapper/319:40:153
25514592161,4sleep02240796-21diskmemload00:18:320
25369012161,3sleep00-21swapper/000:10:060
25177382161,3sleep22240796-21diskmemload23:55:532
25105192161,3sleep02240796-21diskmemload23:52:180
24628152161,3sleep10-21swapper/123:24:571
24430252162,8sleep02443073-21sed23:10:250
24281502160,4sleep12240796-21diskmemload23:02:131
24218042161,3sleep12240796-21diskmemload22:59:591
23975402160,3sleep20-21swapper/222:44:532
23738512161,10sleep12373960-21/usr/sbin/munin22:30:131
211092499161,9cyclictest2144137-21taskset19:35:293
2110924991612,2cyclictest0-21swapper/319:14:523
211092499161,11cyclictest2198392-21chrt20:30:123
211092499161,11cyclictest0-21swapper/320:20:123
25270762150,1sleep10-21swapper/100:02:371
24869122151,9sleep12486915-21ssh23:38:561
24309652152,9sleep00-21swapper/023:05:150
23547682151,3sleep22354778-21ssh22:17:112
23150072151,9sleep12315017-21latency_hist21:55:011
22948832151,9sleep12294948-21ntpq21:40:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional