You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 03:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon May 18, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169251999845,52cyclictest1745880-21/usr/sbin/munin00:20:191
169251999775,44cyclictest1715868-21/usr/sbin/munin21:25:181
169251999751,35cyclictest0-21swapper/123:55:011
169251999751,35cyclictest0-21swapper/123:55:011
169252099739,18cyclictest1746718-21/usr/sbin/munin00:25:182
169251999731,55cyclictest0-21swapper/123:45:141
169251999721,45cyclictest0-21swapper/120:55:021
1692519997032,35cyclictest1728407-21cron22:40:001
169251999671,38cyclictest0-21swapper/122:05:011
169251999661,53cyclictest0-21swapper/119:25:131
169251999661,52cyclictest0-21swapper/120:20:161
169251999641,50cyclictest0-21swapper/123:05:151
169251999641,49cyclictest0-21swapper/120:25:121
169251999641,49cyclictest0-21swapper/120:00:141
1692519996320,34cyclictest0-21swapper/122:35:001
1692519996125,33cyclictest1694665-21/usr/sbin/munin19:20:281
1692519996125,33cyclictest1694665-21/usr/sbin/munin19:20:281
169251999611,51cyclictest1744092-21apt-get00:10:161
169251999611,47cyclictest0-21swapper/122:45:131
169251999601,48cyclictest0-21swapper/123:30:101
169251999601,48cyclictest0-21swapper/121:10:121
169251999601,47cyclictest0-21swapper/100:15:131
169251999582,47cyclictest1738858-21apt-get23:40:121
1692519995817,34cyclictest0-21swapper/122:25:291
169251999581,31cyclictest0-21swapper/122:20:291
169251999581,11cyclictest0-21swapper/121:10:011
1692516995849,5cyclictest1720820-21munin-plugin-st21:55:000
169251999571,49cyclictest1746775-21ssh00:25:161
169251999571,49cyclictest1702565-21/usr/sbin/munin20:05:241
169251999571,48cyclictest1708274-21apt-get20:40:151
169251999571,48cyclictest1693803-21munin-node19:15:141
169251999571,47cyclictest1720179-21apt-get21:50:121
169251999571,45cyclictest0-21swapper/123:35:121
169251999564,45cyclictest1731151-21apt-get22:55:151
169251999561,48cyclictest1730914-21/usr/sbin/munin22:50:281
169251999561,47cyclictest1723027-21/usr/sbin/munin22:05:251
169251999561,46cyclictest1703193-21apt-get20:10:131
1692516995645,7cyclictest1719978-21munin-plugin-st21:50:010
169251999552,47cyclictest1692745-21/usr/sbin/munin19:10:171
169251999552,42cyclictest1699915-21/usr/sbin/munin19:50:201
169251999551,47cyclictest1748920-21/usr/sbin/munin00:35:271
169251999551,47cyclictest1719386-21/usr/sbin/munin21:45:171
169251999551,47cyclictest1714382-21/usr/sbin/munin21:15:261
169251999551,47cyclictest1696548-21/usr/sbin/munin19:30:201
169251999551,46cyclictest1734027-21/usr/sbin/munin23:10:241
169251999551,46cyclictest1723973-21/usr/sbin/munin22:10:271
169251999551,46cyclictest1723973-21/usr/sbin/munin22:10:271
169251999551,45cyclictest1721020-21apt-get21:55:141
169251999551,45cyclictest1709412-21/usr/sbin/munin20:45:251
169251999551,45cyclictest1698133-21apt-get19:40:151
169251999551,45cyclictest1698133-21apt-get19:40:151
169251999542,45cyclictest1732009-21apt-get23:00:171
169251999542,45cyclictest1701043-21/usr/sbin/munin19:55:271
169251999542,45cyclictest1699046-21/usr/sbin/munin19:45:201
169251999541,46cyclictest1747932-21/usr/sbin/munin00:30:291
169251999541,46cyclictest1747932-21/usr/sbin/munin00:30:281
169251999541,46cyclictest1742325-21apt-get00:00:161
169251999541,46cyclictest1742325-21apt-get00:00:161
169251999541,46cyclictest1736925-21/usr/sbin/munin23:25:281
169251999541,46cyclictest1710868-21/usr/sbin/munin20:55:181
169251999541,45cyclictest1742962-21apt-get00:05:051
169251999541,41cyclictest0-21swapper/120:35:131
169252099533,34cyclictest32-21ksoftirqd/200:05:012
169252099533,34cyclictest32-21ksoftirqd/200:05:012
1692520995314,32cyclictest0-21swapper/219:10:232
169251999533,42cyclictest1735681-21/usr/sbin/munin23:20:221
169251999533,42cyclictest1735681-21/usr/sbin/munin23:20:221
169251999531,45cyclictest1728627-21/usr/sbin/munin22:40:291
169251999531,45cyclictest1716967-21irqstats21:30:231
169251999531,45cyclictest1697886-21/usr/sbin/munin19:35:281
169251999531,44cyclictest1718849-21/usr/sbin/munin21:40:261
169251999531,44cyclictest1704032-21munin-node20:15:111
169251999531,43cyclictest0-21swapper/122:15:131
169251999523,41cyclictest1734618-21apt-get23:15:141
169251999522,42cyclictest1715100-21diskstats21:20:201
169251999512,41cyclictest1706574-21apt-get20:30:161
1692516995140,6cyclictest1734344-21unixbench_singl23:10:300
1692516995137,6cyclictest20650irq/252-8000000.ethernet00:30:130
1692516995137,6cyclictest20650irq/252-8000000.ethernet00:30:130
1692520995041,5cyclictest1736900-21grep23:25:282
1692520995029,14cyclictest311ktimers/200:20:122
169251999502,39cyclictest1711703-21df21:00:171
169251999502,39cyclictest1711703-21df21:00:161
169251999501,42cyclictest1741534-21/usr/sbin/munin23:55:171
169251999501,41cyclictest1717679-21/usr/sbin/munin21:35:211
1692520994938,6cyclictest1744671-21grep00:10:292
1692520994828,14cyclictest311ktimers/222:05:122
1692516994837,8cyclictest1711446-21sendmail21:00:000
169251699471,43cyclictest0-21swapper/021:35:120
1692516994637,4cyclictest1747181-21mailstats00:25:270
1692516994630,9cyclictest0-21swapper/019:55:290
1692516994619,11cyclictest14-21rcu_preempt23:45:010
1692520994533,6cyclictest1695242-21grep19:20:292
1692520994533,6cyclictest1695242-21grep19:20:292
1692516994538,4cyclictest167350irq/118-8000000.ethernet-tx023:55:160
169251699453,39cyclictest0-21swapper/020:20:310
1692516994526,15cyclictest131ktimers/020:05:130
1692520994425,14cyclictest0-21swapper/221:55:002
169251699446,4cyclictest1744729-21apt-get00:15:020
1692516994437,4cyclictest167350irq/118-8000000.ethernet-tx023:00:250
1692516994429,9cyclictest0-21swapper/019:45:300
1692516994417,19cyclictest1726093-21/usr/sbin/munin22:25:190
169251699441,40cyclictest0-21swapper/021:25:150
1692520994329,9cyclictest0-21swapper/221:10:302
1692520994327,11cyclictest311ktimers/219:45:142
1692520994324,11cyclictest0-21swapper/220:15:012
1692516994338,4cyclictest0-21swapper/019:15:050
169251699432,5cyclictest1748710-21meminfo00:35:230
169251699432,5cyclictest1701580-21diskstats20:00:180
169251699432,4cyclictest1715327-21meminfo21:20:250
1692520994233,5cyclictest1729165-21grep22:40:282
1692520994228,9cyclictest0-21swapper/220:35:002
1692516994235,4cyclictest1693313-21cron19:15:000
1692516994235,4cyclictest167350irq/118-8000000.ethernet-tx023:35:130
1692516994224,15cyclictest131ktimers/020:45:130
169251699421,39cyclictest0-21swapper/023:20:190
169251699421,39cyclictest0-21swapper/023:20:190
169251699421,39cyclictest0-21swapper/019:50:180
1692520994128,8cyclictest0-21swapper/222:30:292
1692520994113,20cyclictest30-21rcuc/223:35:012
1692516994132,4cyclictest167350irq/118-8000000.ethernet-tx000:15:280
1692516994129,8cyclictest1728200-21ptp4l-jitter22:35:250
169251699411,5cyclictest1725327-21diskstats22:20:190
169251699411,5cyclictest1698344-21cat19:40:230
169251699411,5cyclictest1698344-21cat19:40:220
169251699411,38cyclictest0-21swapper/023:25:170
169251699411,34cyclictest0-21swapper/021:10:000
1692520994030,5cyclictest1714771-21unixbench_singl21:15:322
1692520994029,7cyclictest0-21swapper/219:40:292
1692520994029,7cyclictest0-21swapper/219:40:292
1692520994022,13cyclictest311ktimers/223:50:142
1692520994022,13cyclictest311ktimers/223:50:142
1692520994013,2cyclictest0-21swapper/221:55:272
169251699407,29cyclictest0-21swapper/022:30:180
1692516994033,4cyclictest167350irq/118-8000000.ethernet-tx023:45:180
1692516994032,5cyclictest20850irq/208-8000000.ethernet19:40:000
1692516994032,5cyclictest1660-21snmpd22:42:590
1692516994031,4cyclictest1721662-21sendmail22:00:000
1692516994026,10cyclictest0-21swapper/021:10:280
169251699401,4cyclictest0-21swapper/000:05:160
169251699401,37cyclictest0-21swapper/021:30:230
1692520993924,11cyclictest0-21swapper/220:00:222
1692520993923,11cyclictest311ktimers/220:45:112
1692516993932,5cyclictest1730109-21munin-plugin-st22:50:000
1692516993930,5cyclictest1734775-21dropbear23:15:210
1692516993924,12cyclictest131ktimers/023:05:130
1692516993923,14cyclictest0-21swapper/020:40:220
169251699391,36cyclictest0-21swapper/023:50:190
169251699391,36cyclictest0-21swapper/023:50:190
169251699391,36cyclictest0-21swapper/020:17:030
169251699391,36cyclictest0-21swapper/000:20:210
169251699391,36cyclictest0-21swapper/000:00:180
169251699391,36cyclictest0-21swapper/000:00:170
1692520993830,5cyclictest1735266-21sendmail23:20:002
1692520993825,9cyclictest0-21swapper/220:35:272
169251999381,35cyclictest1692560-21latency_hist19:10:011
1692516993832,4cyclictest0-21swapper/019:29:400
1692516993832,3cyclictest167350irq/118-8000000.ethernet-tx023:30:130
1692516993831,4cyclictest20850irq/208-8000000.ethernet20:50:180
1692516993822,14cyclictest0-21swapper/021:15:180
169251699381,35cyclictest0-21swapper/020:10:250
169251699381,35cyclictest0-21swapper/019:24:100
169251699381,35cyclictest0-21swapper/019:24:100
1692520993729,5cyclictest0-21swapper/222:55:282
1692520993724,9cyclictest0-21swapper/221:25:272
1692520993724,8cyclictest0-21swapper/223:00:292
1692520993721,9cyclictest1748137-21unixbench_singl00:30:302
1692520993721,9cyclictest1748137-21unixbench_singl00:30:302
1692520993720,11cyclictest0-21swapper/222:15:212
1692516993731,4cyclictest0-21swapper/022:00:120
1692516993726,8cyclictest1712226-21grep21:00:290
1692516993726,8cyclictest1712226-21grep21:00:290
169251699371,34cyclictest0-21swapper/020:25:150
1692520993626,6cyclictest1736054-21grep23:20:292
1692520993626,6cyclictest1736054-21grep23:20:292
1692520993624,7cyclictest0-21swapper/220:20:312
1692520993623,8cyclictest0-21swapper/222:45:292
1692520993619,9cyclictest0-21swapper/219:15:052
1692520993616,15cyclictest311ktimers/221:00:152
1692520993616,15cyclictest311ktimers/221:00:152
1692516993630,4cyclictest20850irq/208-8000000.ethernet21:40:230
1692516993630,4cyclictest0-21swapper/019:33:170
169251699361,33cyclictest0-21swapper/022:50:290
1692520993528,4cyclictest167550irq/134-8000000.ethernet-tx222:10:282
1692520993528,4cyclictest167550irq/134-8000000.ethernet-tx222:10:282
1692520993527,5cyclictest0-21swapper/221:40:002
1692520993524,7cyclictest0-21swapper/219:50:292
1692520993524,6cyclictest1696036-21grep19:25:282
1692520993522,9cyclictest0-21swapper/219:55:172
1692520993522,4cyclictest0-21swapper/223:10:022
1692516993528,4cyclictest20850irq/208-8000000.ethernet22:15:240
1692520993427,4cyclictest1702983-21cron20:10:002
1692520993426,6cyclictest1743778-21unixbench_multi00:05:282
1692520993425,5cyclictest0-21swapper/223:45:312
1692520993425,5cyclictest0-21swapper/219:35:212
1692520993424,7cyclictest311ktimers/223:55:262
1692520993423,7cyclictest0-21swapper/221:20:302
169252099342,25cyclictest0-21swapper/222:50:232
1692516993427,5cyclictest1724151-21unixbench_singl22:10:290
1692516993427,5cyclictest1724151-21unixbench_singl22:10:290
1692516993427,5cyclictest0-21swapper/020:30:210
169251699341,31cyclictest0-21swapper/020:36:090
1692520993324,5cyclictest1730939-21kworker/u8:1+rpciod00:38:222
1692520993322,6cyclictest30-21rcuc/221:40:272
1692520993321,8cyclictest0-21swapper/222:40:012
1692520993314,14cyclictest311ktimers/223:35:112
169251699331,30cyclictest0-21swapper/022:57:200
1692520993223,5cyclictest0-21swapper/222:20:272
1692520993222,5cyclictest0-21swapper/222:00:262
1692520993218,9cyclictest0-21swapper/223:10:232
1692520993217,13cyclictest311ktimers/219:35:012
169252099321,26cyclictest0-21swapper/220:40:182
1692520993123,6cyclictest0-21swapper/220:15:302
1692520993123,5cyclictest0-21swapper/200:20:002
1692520993122,6cyclictest0-21swapper/223:40:272
169251699311,3cyclictest0-21swapper/022:08:500
1692516993021,7cyclictest1692528-21grep19:10:000
1692520992922,5cyclictest0-21swapper/222:25:212
169252099291,26cyclictest0-21swapper/220:55:222
1692520992820,5cyclictest0-21swapper/220:50:272
1692520992819,6cyclictest0-21swapper/221:45:292
1692520992721,3cyclictest0-21swapper/221:30:182
169252099269,13cyclictest311ktimers/221:05:142
1692520992619,4cyclictest0-21swapper/220:25:282
1692520992113,4cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional