You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 06:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Mon Dec 01, 2025 00:44:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3114124212571,49sleep30-21swapper/319:05:243
311470929381,6sleep00-21swapper/019:07:420
311482828476,5sleep10-21swapper/119:09:151
311463528063,11sleep20-21swapper/219:06:482
35714162530,2sleep2421rcuc/200:30:202
3114998992823,1cyclictest0-21swapper/321:45:133
3114998992624,1cyclictest0-21swapper/300:30:183
32656882251,20sleep23245106-21diskmemload21:20:182
3114998992521,2cyclictest0-21swapper/322:25:143
31707962240,2sleep10-21swapper/120:00:001
311499899242,14cyclictest3348132-21taskset22:10:293
311499899242,14cyclictest3348132-21taskset22:10:293
3114998992419,3cyclictest0-21swapper/300:35:303
33847002233,14sleep03384909-21cat22:35:170
326908922315,4sleep13269100-21sshd21:24:221
311499899232,13cyclictest3539797-21taskset00:10:203
3114998992320,1cyclictest0-21swapper/323:50:003
3114998992320,1cyclictest0-21swapper/300:25:273
311499899231,7cyclictest3212954-21taskset20:35:293
3114998992312,7cyclictest3439644-21taskset23:07:343
3114998992312,7cyclictest3439644-21taskset23:07:343
311499899222,14cyclictest3376229-21taskset22:30:143
311499899222,12cyclictest3445421-21taskset23:10:193
3114998992220,1cyclictest0-21swapper/323:00:003
3114998992219,1cyclictest0-21swapper/322:05:273
3114998992217,2cyclictest0-21swapper/323:15:173
311499899221,18cyclictest3358103-21taskset22:18:233
311499899212,13cyclictest3397711-21taskset22:41:003
311499899212,13cyclictest3389470-21taskset22:35:553
3114998992118,1cyclictest0-21swapper/323:57:533
3114998992117,2cyclictest0-21swapper/321:25:183
3114998992117,1cyclictest0-21swapper/323:00:193
3114998992117,1cyclictest0-21swapper/323:00:193
311499899210,19cyclictest0-21swapper/300:24:163
311499899208,1cyclictest0-21swapper/321:30:173
311499899202,13cyclictest3458090-21taskset23:20:133
311499899202,13cyclictest3265840-21taskset21:20:183
311499899202,12cyclictest3466127-21taskset23:25:023
3114998992015,3cyclictest66550irq/131-enp1s0-TxRx-322:01:443
3114998992011,6cyclictest3551352-21turbostat00:20:013
311499899201,15cyclictest66550irq/131-enp1s0-TxRx-322:21:583
311499899201,14cyclictest3474368-21chrt23:30:073
311499899201,14cyclictest3203056-21chrt20:30:123
3114998992010,6cyclictest3239842-21turbostat21:05:003
34561522191,6sleep13245106-21diskmemload23:18:041
33669912191,3sleep10-21swapper/122:24:251
311499899197,1cyclictest0-21swapper/323:35:213
311499899192,13cyclictest3317313-21taskset21:53:223
311499899192,13cyclictest3245124-21turbostat21:10:003
311499899192,12cyclictest3532429-21taskset00:06:043
311499899192,12cyclictest3496075-21taskset23:41:063
3114998991915,2cyclictest0-21swapper/323:50:153
3114998991914,2cyclictest0-21swapper/321:15:173
3114998991913,4cyclictest66550irq/131-enp1s0-TxRx-322:53:513
311499899191,14cyclictest3531330-21chrt00:04:433
311499899191,14cyclictest0-21swapper/321:56:483
311499899191,14cyclictest0-21swapper/321:40:123
311499899191,14cyclictest0-21swapper/320:45:133
35326102181,12sleep13532623-21sshd00:06:221
311499899182,11cyclictest3127907-21taskset19:20:143
3114998991816,1cyclictest0-21swapper/319:30:003
3114998991815,1cyclictest0-21swapper/320:15:343
3114998991815,1cyclictest0-21swapper/319:35:163
3114998991814,2cyclictest0-21swapper/319:10:153
3114998991813,2cyclictest0-21swapper/322:45:163
3114998991812,3cyclictest3218302-21taskset20:40:543
311499899181,13cyclictest3250329-21chrt21:10:323
311499899180,16cyclictest0-21swapper/321:35:093
35812052171,4sleep13245106-21diskmemload00:37:291
35397562171,2sleep20-21swapper/200:10:202
35303192171,3sleep20-21swapper/200:03:072
34739512171,3sleep00-21swapper/023:29:530
34735822171,4sleep23245106-21diskmemload23:29:192
34227542171,4sleep13245106-21diskmemload22:57:071
34045962172,8sleep13404747-21ntpq22:45:201
33488882171,3sleep00-21swapper/022:11:450
33488882171,3sleep00-21swapper/022:11:440
32585482170,3sleep00-21swapper/021:15:430
32529432171,10sleep23245106-21diskmemload21:14:412
32521452171,3sleep00-21swapper/021:13:270
311499899172,11cyclictest3122541-21taskset19:15:133
311499899172,11cyclictest3122541-21taskset19:15:133
311499899171,9cyclictest3224664-21taskset20:50:163
311499899171,11cyclictest3181155-21taskset20:10:003
35592632161,2sleep00-21swapper/000:24:330
35161482161,9sleep13516847-21cut23:55:161
34880942161,2sleep20-21swapper/223:36:252
34388102162,7sleep03325939-21kworker/u16:0+rpciod23:06:200
34388102162,7sleep03325939-21kworker/u16:0+rpciod23:06:200
34232922160,3sleep00-21swapper/022:57:580
33516742162,8sleep03351886-21sed22:15:170
32912582161,8sleep03245106-21diskmemload21:35:530
32760552161,2sleep10-21swapper/121:27:311
311499899168,4cyclictest32014012sleep320:25:203
3114998991613,1cyclictest0-21swapper/319:30:233
3114998991612,2cyclictest0-21swapper/320:00:223
311499899161,12cyclictest3164963-21turbostat19:55:003
311499899161,12cyclictest0-21swapper/320:55:243
311499899161,12cyclictest0-21swapper/320:20:143
311499899161,12cyclictest0-21swapper/319:55:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional