You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 05:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Wed Nov 19, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1125973212159,58sleep30-21swapper/319:05:093
140950821200,2sleep10-21swapper/122:36:581
113088628553,10sleep10-21swapper/119:09:321
113073028252,9sleep20-21swapper/219:07:342
113078628156,19sleep00-21swapper/019:08:150
113121399351,30cyclictest1378487-21turbostat22:20:003
1131213992723,2cyclictest0-21swapper/323:50:003
113121399272,10cyclictest1444077-21taskset22:58:533
14591482260,2sleep1321rcuc/123:07:011
1131213992623,1cyclictest0-21swapper/319:50:003
113121399252,16cyclictest1596300-21taskset00:30:223
113121399237,12cyclictest1386052-21chrt22:23:543
113121399232,16cyclictest1261693-21turbostat21:10:003
113121399231,18cyclictest1369934-21taskset22:14:353
113121399222,14cyclictest1503358-21taskset23:35:183
113121399222,13cyclictest1591062-21taskset00:28:413
113121399221,8cyclictest1285967-21taskset21:23:403
1131213992217,3cyclictest0-21swapper/322:35:203
1131213992213,4cyclictest12766842sleep321:17:123
113121399221,17cyclictest1606059-21taskset00:37:193
113121399221,17cyclictest1342356-21taskset21:55:553
113121399221,13cyclictest1345708-21taskset22:00:083
15739852211,7sleep11261686-21diskmemload00:16:181
13097942211,8sleep01261686-21diskmemload21:37:050
113121399215,13cyclictest66550irq/131-enp1s0-TxRx-323:03:223
113121399212,14cyclictest1469403-21sleep23:15:003
113121399212,13cyclictest1584045-21taskset00:24:573
113121399212,13cyclictest1494191-21taskset23:29:563
1131213992119,1cyclictest0-21swapper/322:50:003
1131213992117,2cyclictest0-21swapper/322:50:183
1131213992117,2cyclictest0-21swapper/322:50:183
1131213992116,3cyclictest0-21swapper/321:45:233
1131213992115,1cyclictest0-21swapper/300:00:003
113121399211,16cyclictest1359384-21taskset22:06:143
113121399211,15cyclictest1548421-21chrt00:00:193
14368782201,13sleep21261686-21diskmemload22:55:092
13283942202,11sleep01328453-21munin-run21:50:000
113121399202,12cyclictest1334598-21taskset21:51:583
1131213992017,1cyclictest0-21swapper/323:22:133
1131213992017,1cyclictest0-21swapper/319:15:183
1131213992016,2cyclictest0-21swapper/323:17:003
1131213992016,2cyclictest0-21swapper/320:00:003
1131213992016,2cyclictest0-21swapper/300:20:013
1131213992014,3cyclictest0-21swapper/322:40:193
113121399201,3cyclictest0-21swapper/321:32:113
113121399201,15cyclictest1402702-21chrt22:34:083
113121399201,13cyclictest1495235-21chrt23:30:163
13684202191,2sleep10-21swapper/122:12:221
13664722191,5sleep21366531-21ntpq22:10:232
12976062191,13sleep11299272-21grep21:30:211
113121399192,13cyclictest1535553-21taskset23:54:463
1131213991916,1cyclictest0-21swapper/319:45:003
1131213991916,1cyclictest0-21swapper/300:05:183
113121399191,14cyclictest1319556-21chrt21:44:133
113121399191,14cyclictest1293771-21chrt21:27:573
113121399191,14cyclictest0-21swapper/322:29:023
113121399191,14cyclictest0-21swapper/300:10:283
113121399191,13cyclictest1458522-21chrt23:05:593
15674932181,10sleep21261686-21diskmemload00:13:382
12858122181,3sleep10-21swapper/121:23:271
113121399188,7cyclictest1256131-21taskset21:02:283
113121399182,10cyclictest1269574-21taskset21:13:583
1131213991814,2cyclictest0-21swapper/319:25:173
113121399181,14cyclictest0-21swapper/321:35:303
15994792171,3sleep20-21swapper/200:34:512
15505302171,3sleep20-21swapper/200:02:202
14187842171,2sleep10-21swapper/122:43:291
14028102171,3sleep10-21swapper/122:34:191
14025092171,10sleep21261686-21diskmemload22:33:522
13509572171,12sleep11350969-21ssh22:00:591
12959062171,4sleep21296128-21hddtemp_smartct21:30:182
12459852172,4sleep11246004-21apt-get20:55:131
113121399172,10cyclictest1187331-21taskset20:00:153
1131213991714,1cyclictest0-21swapper/320:30:153
1131213991714,1cyclictest0-21swapper/320:10:203
113121399171,3cyclictest1159744-21turbostat19:35:003
1131213991713,2cyclictest0-21swapper/323:40:193
1131213991711,4cyclictest0-21swapper/320:20:133
113121399171,13cyclictest0-21swapper/320:55:223
113121399171,10cyclictest1240711-21chrt20:50:053
113121399170,14cyclictest0-21swapper/320:35:173
113121399170,10cyclictest1214070-21taskset20:25:083
15895842161,3sleep00-21swapper/000:26:030
15095692160,2sleep10-21swapper/123:38:211
14921382161,9sleep01261686-21diskmemload23:26:540
14272172161,2sleep20-21swapper/222:48:192
13101182161,8sleep11261686-21diskmemload21:37:341
12779892161,2sleep20-21swapper/221:19:072
113121399164,6cyclictest1147334-21taskset19:20:193
1131213991613,1cyclictest0-21swapper/320:40:183
113121399161,11cyclictest1176470-21chrt19:50:133
113121399160,13cyclictest0-21swapper/320:45:223
113121399160,13cyclictest0-21swapper/320:15:203
16076192151,9sleep21-21systemd00:40:012
15747712151,8sleep21261686-21diskmemload00:17:362
15608362151,2sleep01560846-21ssh00:10:110
15418862150,9sleep272-21kcompactd023:56:502
15416922150,10sleep11541703-21ssh23:56:341
15070962151,8sleep21507155-21ntp_states23:35:262
14835112151,8sleep11261686-21diskmemload23:21:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional