You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 23:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Fri Nov 14, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180077622240,2sleep10-21swapper/111:44:211
1438236212667,55sleep30-21swapper/307:06:093
16377392890,2sleep20-21swapper/209:55:172
143823928554,9sleep10-21swapper/107:06:121
143833328352,10sleep20-21swapper/207:07:252
143831627952,19sleep00-21swapper/007:07:110
1438657993834,2cyclictest0-21swapper/312:40:003
15675362350,2sleep30-21swapper/309:10:013
1438657993229,1cyclictest0-21swapper/309:45:263
1438657993215,14cyclictest541ktimers/309:55:353
1438657993026,2cyclictest0-21swapper/311:00:173
1438657993026,2cyclictest0-21swapper/310:50:003
16196912281,11sleep21567537-21diskmemload09:44:272
1438657992824,2cyclictest0-21swapper/310:30:243
1438657992822,3cyclictest66550irq/131-enp1s0-TxRx-310:22:573
1438657992817,8cyclictest0-21swapper/309:42:363
1438657992621,3cyclictest0-21swapper/312:35:013
1438657992621,2cyclictest0-21swapper/307:20:123
1438657992615,8cyclictest0-21swapper/310:44:213
1438657992613,2cyclictest541ktimers/310:05:143
1438657992523,1cyclictest0-21swapper/309:38:183
1438657992522,1cyclictest0-21swapper/307:38:243
143865799252,17cyclictest1725600-21sleep10:55:003
1438657992521,2cyclictest0-21swapper/311:34:493
1438657992519,4cyclictest15950irq/132-ahci[0000:00:17.0]12:15:133
1438657992513,2cyclictest541ktimers/312:25:083
1438657992510,2cyclictest0-21swapper/311:17:163
143865799250,19cyclictest1696650-21chrt10:35:153
1438657992422,1cyclictest0-21swapper/311:38:243
1438657992421,1cyclictest0-21swapper/311:14:223
1438657992421,1cyclictest0-21swapper/309:27:223
1438657992414,7cyclictest0-21swapper/311:06:023
1438657992413,8cyclictest0-21swapper/312:12:503
1438657992410,2cyclictest0-21swapper/309:23:013
143865799239,2cyclictest0-21swapper/310:12:013
143865799239,2cyclictest0-21swapper/309:53:183
1438657992320,1cyclictest0-21swapper/312:20:153
1438657992319,2cyclictest0-21swapper/311:23:533
1438657992319,2cyclictest0-21swapper/310:55:283
1438657992319,2cyclictest0-21swapper/307:50:013
1438657992317,3cyclictest66550irq/131-enp1s0-TxRx-312:06:513
1438657992310,4cyclictest541ktimers/312:00:143
18778002221,9sleep11567537-21diskmemload12:32:551
15453542221,9sleep21545402-21ntpq08:45:192
143865799229,4cyclictest541ktimers/309:32:133
143865799227,11cyclictest1772652-21taskset11:25:173
143865799222,13cyclictest1805990-21taskset11:45:263
1438657992218,2cyclictest0-21swapper/311:56:093
1438657992218,2cyclictest0-21swapper/311:52:533
1438657992218,2cyclictest0-21swapper/310:15:163
1438657992218,2cyclictest0-21swapper/310:00:243
1438657992218,2cyclictest0-21swapper/309:11:293
1438657992210,7cyclictest1545676-21taskset08:45:243
1438657992118,1cyclictest0-21swapper/307:40:133
1438657992117,2cyclictest0-21swapper/310:25:143
17698642201,7sleep00-21swapper/011:23:080
17026722201,6sleep00-21swapper/010:38:090
16966162201,8sleep21567537-21diskmemload10:35:152
143865799209,6cyclictest1494063-21taskset08:00:143
143865799206,10cyclictest1540776-21taskset08:40:343
1438657992018,1cyclictest0-21swapper/308:05:453
1438657992017,2cyclictest0-21swapper/308:50:173
1438657992017,1cyclictest0-21swapper/309:15:193
1438657992017,1cyclictest0-21swapper/308:30:193
1438657992016,2cyclictest0-21swapper/311:40:283
1438657992016,2cyclictest0-21swapper/307:53:073
1438657992013,3cyclictest15150992sleep308:20:113
1438657991916,2cyclictest0-21swapper/309:00:143
1438657991916,1cyclictest0-21swapper/308:25:243
1438657991916,1cyclictest0-21swapper/308:10:163
1438657991915,2cyclictest0-21swapper/307:25:173
143865799191,13cyclictest0-21swapper/308:35:143
18233892181,10sleep01567537-21diskmemload11:58:280
16879732181,4sleep20-21swapper/210:28:412
16877662181,3sleep00-21swapper/010:28:190
16788702181,2sleep20-21swapper/210:20:402
16565502180,4sleep21656560-21ssh10:06:322
16503802181,11sleep21567537-21diskmemload10:04:162
14721872180,11sleep11472172-31find07:38:261
1438657991816,1cyclictest0-21swapper/307:33:033
1438657991815,2cyclictest0-21swapper/308:58:353
1438657991815,2cyclictest0-21swapper/307:20:003
1438657991815,2cyclictest0-21swapper/307:13:273
1438657991815,1cyclictest0-21swapper/308:17:253
18379692171,5sleep11567537-21diskmemload12:05:581
18012292171,9sleep11567537-21diskmemload11:45:011
17767052171,8sleep01776716-21sh11:27:040
16803352171,3sleep10-21swapper/110:23:281
16577552171,3sleep10-21swapper/110:08:401
16334572171,10sleep21567537-21diskmemload09:51:452
15873372171,3sleep00-21swapper/009:20:490
143865799171,4cyclictest1488755-21taskset07:55:023
17679302161,3sleep20-21swapper/211:20:212
17558422161,4sleep01567537-21diskmemload11:14:340
16498212161,3sleep00-21swapper/010:03:140
16334862161,10sleep11567537-21diskmemload09:51:491
15873572161,4sleep21567537-21diskmemload09:20:502
18870992151,9sleep11887109-21ssh12:39:421
18701082151,8sleep11567537-21diskmemload12:27:591
18646162151,6sleep00-21swapper/012:25:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional