You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 19:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Mon Apr 27, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160972721160,15sleep2341ksoftirqd/207:05:252
139099790,61rtkit-daemon0-21swapper/007:05:150
161014427757,14sleep10-21swapper/107:06:331
161015126344,14sleep30-21swapper/307:06:383
16313072520,3sleep20-21swapper/208:05:202
16347022400,2sleep00-21swapper/008:15:210
161056999381,23cyclictest1626051-21python307:50:200
161056999381,22cyclictest1673690-21python310:05:220
161056999380,24cyclictest1689551-21python310:50:210
161056999371,20cyclictest1715557-21python312:05:200
161056999370,25cyclictest0-21swapper/010:15:110
161056999370,16cyclictest0-21swapper/010:00:010
161056999370,16cyclictest0-21swapper/009:25:010
161056999365,17cyclictest1651467-21taskset09:05:100
161056999361,24cyclictest1895067-21snapd10:34:130
161056999361,19cyclictest1629514-21python308:00:200
161056999360,27cyclictest1717175-21sh12:10:180
161056999360,26cyclictest1725371-21apt12:35:100
161056999360,25cyclictest0-21swapper/012:20:110
161056999360,25cyclictest0-21swapper/009:50:110
161056999360,23cyclictest1653481-21cat09:10:130
161056999351,22cyclictest1724501-21python312:30:200
161056999351,18cyclictest1613387-21hddtemp_smartct07:15:160
161056999350,26cyclictest1656221-21sed09:15:220
161056999350,23cyclictest1713128-21expr12:00:130
161056999350,23cyclictest1647744-21/usr/sbin/munin08:55:240
161056999350,20cyclictest1719824-21date12:20:000
161056999350,20cyclictest0-21swapper/010:50:010
161056999350,17cyclictest1667523-21latency_hist09:50:000
161056999350,16cyclictest0-21swapper/010:45:000
161056999341,19cyclictest1696367-21ntp_states11:10:180
161056999340,24cyclictest0-21swapper/011:50:110
161056999340,23cyclictest1650124-21cat09:00:180
161056999340,20cyclictest1660896-21irqstats09:30:160
161056999340,20cyclictest1659547-21python309:25:210
161056999340,20cyclictest1631122-21ntp_states08:05:180
161056999340,20cyclictest1628376-21sh07:59:590
161056999340,20cyclictest0-21swapper/007:45:110
161056999340,18cyclictest1611503-21ntp_states07:10:190
161056999340,18cyclictest0-21swapper/007:20:110
161056999333,16cyclictest0-21swapper/011:01:270
161056999332,17cyclictest1617323-21python307:25:230
161056999331,23cyclictest1699208-21cpuspeed_turbos11:20:120
161056999331,21cyclictest1665556-21nm-dispatcher09:44:300
161056999330,24cyclictest1674525-21chrt10:10:040
161056999330,23cyclictest1680682-21needreboot10:25:190
161056999330,18cyclictest1678958-21needreboot10:20:170
161056999320,22cyclictest1646236-21expr08:50:150
161056999320,21cyclictest0-21swapper/010:00:120
161056999320,19cyclictest1694640-21ntp_states11:05:190
161056999320,19cyclictest1638397-21users08:25:240
161056999320,19cyclictest1636431-21ps08:20:190
161056999320,18cyclictest1722963-21users12:25:210
161056999320,18cyclictest1722963-21users12:25:210
161056999320,18cyclictest1640786-21apt08:35:110
161056999320,18cyclictest1640786-21apt08:35:110
161056999310,18cyclictest1691287-21python310:55:210
161056999301,20cyclictest0-21swapper/007:30:140
161056999290,18cyclictest1684798-21taskset10:38:080
161056999290,15cyclictest0-21swapper/008:30:170
161056999280,19cyclictest1662819-21smartctl09:35:170
161056999280,16cyclictest0-21swapper/008:15:010
1610580992710,4cyclictest42-21ksoftirqd/310:03:463
1610575992711,4cyclictest34-21ksoftirqd/211:20:012
161056999270,15cyclictest1698663-21pool-udisksd11:18:040
16886512250,9sleep234-21ksoftirqd/210:50:012
16349262250,4sleep20-21swapper/208:15:232
161058099258,3cyclictest141rcu_preempt09:25:113
161058099253,2cyclictest141rcu_preempt10:10:013
161058099250,5cyclictest3056-21PK-Backend10:55:013
1610575992514,4cyclictest34-21ksoftirqd/212:35:012
1610575992512,4cyclictest34-21ksoftirqd/208:00:012
1610575992511,3cyclictest34-21ksoftirqd/208:15:012
161056999258,15cyclictest1095-21runrttasks11:48:370
161058099246,10cyclictest42-21ksoftirqd/307:50:013
161058099244,10cyclictest42-21ksoftirqd/309:40:223
1610580992414,6cyclictest1683494-21apt10:35:113
161056999245,17cyclictest1704581-21expr11:35:140
161056999240,9cyclictest16443762tr08:45:120
161056999240,23cyclictest0-21swapper/011:32:270
161056999240,22cyclictest1712857-21ls12:00:010
161056999240,22cyclictest1643605-21vmstat08:40:230
161058099236,3cyclictest42-21ksoftirqd/309:15:133
1610580992315,6cyclictest1698071-21ntpq11:15:183
161058099230,3cyclictest1709032-21taskset11:47:403
161057599239,2cyclictest141rcu_preempt11:04:322
161057599237,4cyclictest34-21ksoftirqd/207:25:232
1610575992312,5cyclictest34-21ksoftirqd/207:30:202
161057599230,22cyclictest1389-21rtkit-daemon11:36:102
161056999238,13cyclictest1621454-21sh07:40:000
161056999238,13cyclictest1621454-21sh07:39:590
161056999230,22cyclictest0-21swapper/011:41:260
161056999230,21cyclictest1622572-21grep07:40:200
139099230,2rtkit-daemon3056-21PK-Backend10:57:011
16821232220,2sleep20-21swapper/210:30:122
161058099227,4cyclictest42-21ksoftirqd/309:23:563
1610580992220,1cyclictest3056-21PK-Backend12:21:343
1610580992220,1cyclictest3056-21PK-Backend12:07:153
1610580992220,1cyclictest3056-21PK-Backend09:07:073
1610580992220,1cyclictest3056-21PK-Backend08:26:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional