You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 06:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon May 04, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1905664991211,2cyclictest0-21swapper/000:05:000
1905664997973,3cyclictest0-21swapper/000:25:110
190566899702,31cyclictest0-21swapper/221:25:012
190566499654,25cyclictest15-21rcuc/023:50:010
190566799634,38cyclictest0-21swapper/122:20:001
1905667996134,16cyclictest0-21swapper/100:00:131
190566499599,20cyclictest1906599-21irqstats19:15:010
190566899584,40cyclictest311ktimers/223:30:022
190566899584,40cyclictest311ktimers/223:30:012
1905667995739,12cyclictest1939323-21apt-get22:25:141
190566499571,54cyclictest0-21swapper/019:20:130
190566499570,46cyclictest131ktimers/021:25:020
1905667995637,11cyclictest1957963-21apt-get00:15:141
1905667995631,13cyclictest0-21swapper/120:25:141
1905667995538,9cyclictest1935009-21/usr/sbin/munin22:00:291
1905667995537,10cyclictest1920645-21apt-get20:35:171
1905667995530,16cyclictest1944048-21/usr/sbin/munin22:50:291
1905667995530,16cyclictest1932929-21/usr/sbin/munin21:45:271
1905667995523,6cyclictest274-21systemd-journal22:32:261
1905667995431,15cyclictest1956800-21/usr/sbin/munin00:05:291
1905667995431,15cyclictest1956800-21/usr/sbin/munin00:05:291
1905667995430,15cyclictest1944608-21/usr/sbin/munin22:55:211
1905668995340,9cyclictest0-21swapper/221:50:292
1905667995337,10cyclictest1946071-21apt-get23:05:161
1905667995337,10cyclictest1910426-21apt-get19:35:161
1905667995336,9cyclictest1954594-21apt-get23:55:151
1905667995336,9cyclictest1934156-21apt-get21:55:171
1905667995336,9cyclictest1934156-21apt-get21:55:171
1905667995336,10cyclictest1907816-21apt-get19:20:151
1905667995329,14cyclictest0-21swapper/100:20:121
1905667995328,13cyclictest0-21swapper/122:10:121
1905667995244,4cyclictest1908655-21apt-get19:25:151
1905667995244,4cyclictest1908655-21apt-get19:25:151
1905667995241,5cyclictest1905832-21apt-get19:10:151
1905667995239,5cyclictest1961360-21apt-get00:35:161
1905667995238,8cyclictest0-21swapper/120:00:141
1905667995237,7cyclictest1947748-21/usr/sbin/munin23:15:301
1905667995235,10cyclictest1915583-21apt-get20:05:131
1905667995232,12cyclictest0-21swapper/121:25:101
190566499524,10cyclictest1936485-21apt-get22:10:020
1905667995139,6cyclictest1933360-21/usr/sbin/munin21:50:151
1905667995136,9cyclictest1931636-21apt-get21:40:151
1905667995136,8cyclictest1941859-21apt-get22:40:171
1905667995134,11cyclictest1936052-21/usr/sbin/munin22:05:211
1905667995134,11cyclictest1919907-21/usr/sbin/munin20:30:201
1905667995131,14cyclictest0-21swapper/120:15:121
1905667995131,13cyclictest1922796-21/usr/sbin/munin20:45:281
1905667995131,12cyclictest1926683-21/usr/sbin/munin21:10:201
1905667995130,14cyclictest1930043-21/usr/sbin/munin21:30:191
1905667995124,20cyclictest1960267-21grep00:25:271
1905667995124,15cyclictest0-21swapper/119:30:121
1905667995042,4cyclictest1950359-21/usr/sbin/munin23:30:181
1905667995040,5cyclictest1906957-21apt-get19:15:161
1905667995037,9cyclictest1939105-21sshd22:23:091
1905667995036,7cyclictest1949092-21/usr/sbin/munin23:20:271
1905667995035,7cyclictest1942695-21/usr/sbin/munin22:45:301
1905667995035,7cyclictest1942695-21/usr/sbin/munin22:45:301
1905667995034,9cyclictest1941107-21/usr/sbin/munin22:35:201
1905667995031,12cyclictest1925400-21tail21:00:261
1905667995029,13cyclictest1961046-21unixbench_multi00:30:281
1905667995028,14cyclictest1951198-21/usr/sbin/munin23:35:191
190566799501,22cyclictest0-21swapper/100:10:021
190566499506,11cyclictest1915458-21rm20:05:010
190566499503,43cyclictest0-21swapper/000:20:270
190566499502,43cyclictest1922899-21sed20:45:290
1905668994938,4cyclictest311ktimers/220:05:092
1905668994932,11cyclictest0-21swapper/221:45:292
190566899492,23cyclictest30-21rcuc/200:20:012
1905667994938,8cyclictest1954002-21/usr/sbin/munin23:50:261
1905667994938,8cyclictest1954002-21/usr/sbin/munin23:50:261
1905667994936,9cyclictest1918126-21apt-get20:20:161
1905667994936,9cyclictest1918126-21apt-get20:20:161
1905667994935,9cyclictest1949451-21apt-get23:25:161
1905667994935,9cyclictest1949451-21apt-get23:25:161
1905667994931,10cyclictest1947157-21/usr/sbin/munin23:10:221
1905667994929,12cyclictest1912414-21/usr/sbin/munin19:45:241
1905667994926,15cyclictest1925894-21/usr/sbin/munin21:05:231
1905664994941,4cyclictest1930576-21munin-plugin-st21:35:010
1905664994931,14cyclictest167350irq/118-8000000.ethernet-tx021:00:010
190566499491,43cyclictest1954549-21latency_hist23:55:010
190566499491,43cyclictest1954549-21latency_hist23:55:010
1905667994835,8cyclictest1930778-21apt-get21:35:171
1905667994835,7cyclictest1924318-21/usr/sbin/munin20:55:231
1905667994831,11cyclictest1928611-21/usr/sbin/munin21:20:251
1905667994829,11cyclictest1916500-21/usr/sbin/munin20:10:191
1905667994823,18cyclictest1923714-21grep20:50:281
1905668994739,4cyclictest0-21swapper/222:25:002
1905668994721,15cyclictest311ktimers/221:55:152
1905668994721,15cyclictest311ktimers/221:55:142
1905667994737,5cyclictest1927397-21apt-get21:15:161
1905667994733,10cyclictest0-21swapper/119:40:121
1905667994733,10cyclictest0-21swapper/119:40:121
1905667994731,12cyclictest0-21swapper/120:40:111
1905667994731,10cyclictest1945652-21/usr/sbin/munin23:00:261
1905667994712,28cyclictest1952824-21/usr/sbin/munin23:45:271
1905664994739,4cyclictest0-21swapper/022:40:010
1905664994736,8cyclictest1955236-21sendmail00:00:000
1905664994729,13cyclictest15-21rcuc/000:05:120
1905664994729,13cyclictest15-21rcuc/000:05:120
190566499472,40cyclictest1947629-21latency_hist23:15:000
190566499471,44cyclictest0-21swapper/022:25:230
1905668994630,8cyclictest0-21swapper/200:25:272
1905667994639,3cyclictest1912960-21apt-get19:50:161
190566499463,39cyclictest0-21swapper/020:05:240
190566499461,6cyclictest1944103-21grep22:50:290
190566499461,42cyclictest0-21swapper/000:15:270
190566499461,39cyclictest0-21swapper/023:45:020
1905668994537,5cyclictest1945014-21munin-plugin-st23:00:002
1905668994533,7cyclictest0-21swapper/223:55:012
1905668994533,7cyclictest0-21swapper/223:55:012
1905667994528,10cyclictest1913803-21/usr/sbin/munin19:55:161
1905664994539,4cyclictest0-21swapper/023:15:120
1905664994530,12cyclictest131ktimers/021:40:120
1905664994529,13cyclictest15-21rcuc/020:30:120
1905668994434,6cyclictest1923773-21grep20:50:282
1905667994438,3cyclictest1952285-21/usr/sbin/munin23:40:251
1905664994437,4cyclictest167350irq/118-8000000.ethernet-tx020:40:120
1905664994435,5cyclictest167350irq/118-8000000.ethernet-tx023:25:220
1905664994435,5cyclictest167350irq/118-8000000.ethernet-tx023:25:220
1905664994425,15cyclictest131ktimers/021:00:130
190566499442,12cyclictest15-21rcuc/021:25:000
190566499441,40cyclictest0-21swapper/022:40:270
190566499441,40cyclictest0-21swapper/021:45:280
1905668994333,7cyclictest0-21swapper/222:30:302
1905668994331,8cyclictest0-21swapper/221:05:312
1905668994324,10cyclictest0-21swapper/219:45:192
1905664994337,4cyclictest1934750-21unixbench_singl21:55:280
1905664994337,4cyclictest1934750-21unixbench_singl21:55:280
1905664994337,4cyclictest167350irq/118-8000000.ethernet-tx022:10:130
1905664994336,4cyclictest14-21rcu_preempt19:50:270
1905664994326,13cyclictest131ktimers/023:05:140
190566499432,36cyclictest0-21swapper/019:10:000
190566499431,39cyclictest1940461-21meminfo22:30:250
190566499431,39cyclictest0-21swapper/020:20:120
190566499431,39cyclictest0-21swapper/020:20:120
1905668994234,5cyclictest311ktimers/222:05:172
1905668994218,12cyclictest311ktimers/221:30:142
190566499425,34cyclictest0-21swapper/023:35:210
190566499425,14cyclictest15-21rcuc/021:15:010
1905664994237,2cyclictest0-21swapper/020:10:200
190566499421,9cyclictest0-21swapper/020:00:010
190566499421,3cyclictest1919596-21sh20:29:590
190566499421,39cyclictest0-21swapper/020:20:000
190566499421,38cyclictest0-21swapper/021:40:010
190566499421,37cyclictest0-21swapper/000:35:160
1905668994128,8cyclictest1955982-21grep00:00:302
1905668994125,9cyclictest0-21swapper/220:10:292
190566899411,20cyclictest0-21swapper/223:10:002
190566499412,36cyclictest0-21swapper/019:45:260
190566499411,38cyclictest0-21swapper/022:00:190
190566499411,38cyclictest0-21swapper/000:30:180
1905668994031,5cyclictest1914442-21sendmail20:00:002
1905668994031,4cyclictest0-21swapper/221:00:282
1905668994029,7cyclictest0-21swapper/222:10:282
1905668994029,6cyclictest0-21swapper/223:15:012
1905668994028,8cyclictest0-21swapper/219:35:012
1905668994027,9cyclictest0-21swapper/221:15:272
190566499402,4cyclictest1949220-21users23:20:280
190566499401,5cyclictest1910495-21diskstats19:35:190
190566499401,4cyclictest1927696-21memory21:15:240
190566499401,37cyclictest0-21swapper/023:00:200
1905664994010,28cyclictest1907605-21sendmail19:20:000
1905668993932,4cyclictest1949249-21munin-plugin-st23:25:002
1905668993930,4cyclictest0-21swapper/220:00:292
1905668993923,8cyclictest0-21swapper/222:15:272
1905668993919,14cyclictest311ktimers/222:00:102
1905667993918,14cyclictest1905735-21latency_hist19:10:001
1905664993932,4cyclictest0-21swapper/019:40:200
1905664993932,4cyclictest0-21swapper/019:40:200
1905664993929,7cyclictest0-21swapper/019:30:290
1905664993924,10cyclictest131ktimers/020:35:130
190566499391,36cyclictest0-21swapper/022:20:230
190566499391,36cyclictest0-21swapper/021:53:130
190566499391,34cyclictest0-21swapper/000:10:250
190566899388,25cyclictest2-21kthreadd19:17:202
1905668993829,7cyclictest311ktimers/222:35:202
1905668993829,5cyclictest311ktimers/222:50:262
1905668993827,7cyclictest311ktimers/219:20:122
1905664993831,4cyclictest0-21swapper/023:30:160
1905664993821,11cyclictest0-21swapper/021:05:310
190566499381,35cyclictest0-21swapper/022:55:260
190566499381,35cyclictest0-21swapper/020:50:120
1905668993727,4cyclictest0-21swapper/223:55:212
1905668993726,6cyclictest311ktimers/220:30:212
1905668993725,8cyclictest0-21swapper/220:35:292
1905664993725,7cyclictest0-21swapper/022:15:290
190566499371,3cyclictest0-21swapper/022:45:270
190566499371,3cyclictest0-21swapper/022:45:260
190566499371,34cyclictest0-21swapper/019:25:150
190566499371,34cyclictest0-21swapper/019:25:140
1905668993627,6cyclictest1943334-21munin-plugin-st22:50:002
1905668993627,6cyclictest1943334-21munin-plugin-st22:50:002
1905668993627,5cyclictest311ktimers/221:20:102
1905668993623,8cyclictest0-21swapper/221:40:282
190566899361,29cyclictest0-21swapper/223:35:202
1905668993528,4cyclictest311ktimers/219:40:302
1905668993528,4cyclictest311ktimers/219:40:302
1905668993527,5cyclictest0-21swapper/223:15:302
1905668993526,7cyclictest311ktimers/220:25:102
1905668993526,5cyclictest0-21swapper/223:00:262
1905668993525,7cyclictest311ktimers/220:45:122
1905668993524,7cyclictest311ktimers/219:25:152
1905668993524,7cyclictest311ktimers/219:25:152
1905668993522,8cyclictest0-21swapper/223:45:282
1905668993522,8cyclictest0-21swapper/220:15:202
1905668993520,8cyclictest0-21swapper/219:15:012
1905668993518,8cyclictest0-21swapper/222:45:022
1905668993425,6cyclictest311ktimers/220:20:182
1905668993425,6cyclictest311ktimers/220:20:182
1905668993423,8cyclictest0-21swapper/200:40:012
190566899342,27cyclictest1913016-21df19:50:162
1905668993420,8cyclictest0-21swapper/200:15:272
1905668993327,4cyclictest1923796-21kworker/u8:4+rpciod20:57:212
1905668993325,5cyclictest311ktimers/221:35:272
1905668993323,6cyclictest0-21swapper/200:05:292
1905668993323,6cyclictest0-21swapper/200:05:282
1905668993222,8cyclictest311ktimers/223:30:142
1905668993219,9cyclictest0-21swapper/219:35:302
1905668993126,3cyclictest14-21rcu_preempt21:10:272
1905668993123,6cyclictest1939320-21/usr/sbin/munin22:25:292
1905668993122,6cyclictest0-21swapper/220:42:202
190566899311,25cyclictest0-21swapper/200:30:112
1905668993018,8cyclictest30-21rcuc/223:40:282
190566899291,26cyclictest0-21swapper/200:10:262
1905668992115,3cyclictest30-21rcuc/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional