You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon Nov 03, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1861643996812,9cyclictest1916487-21/usr/sbin/munin00:30:211
186164099681,63cyclictest0-21swapper/023:15:140
186164499667,12cyclictest1902596-21apt-get23:10:012
1861643996421,6cyclictest0-21swapper/100:00:291
1861643996219,6cyclictest0-21swapper/119:35:281
1861643996121,34cyclictest0-21swapper/119:50:231
1861643996120,3cyclictest0-21swapper/120:10:281
186164499605,23cyclictest32-21ksoftirqd/220:30:012
1861643995920,31cyclictest0-21swapper/119:25:271
1861643995919,4cyclictest0-21swapper/120:20:191
186164499583,37cyclictest30-21rcuc/220:50:202
1861643995823,27cyclictest0-21swapper/119:45:311
1861643995822,4cyclictest0-21swapper/119:55:331
1861643995821,32cyclictest0-21swapper/100:25:251
1861643995821,32cyclictest0-21swapper/100:25:251
1861643995818,4cyclictest0-21swapper/122:40:281
1861643995718,3cyclictest0-21swapper/120:35:231
1861643995717,3cyclictest0-21swapper/120:15:211
1861643995629,23cyclictest0-21swapper/120:45:321
1861643995619,8cyclictest0-21swapper/121:05:301
1861643995616,9cyclictest0-21swapper/122:10:301
1861643995616,6cyclictest1905349-21latency_hist23:25:011
1861644995536,13cyclictest311ktimers/223:55:172
1861644995536,13cyclictest311ktimers/223:55:172
1861643995518,8cyclictest1896617-21grep22:30:351
1861643995514,8cyclictest0-21swapper/119:20:291
1861644995436,12cyclictest311ktimers/222:50:132
1861643995419,7cyclictest1888975-21grep21:45:301
1861644995330,14cyclictest311ktimers/221:20:142
186164499523,31cyclictest32-21ksoftirqd/223:35:012
1861644995029,16cyclictest311ktimers/221:10:112
1861643995021,5cyclictest1884740-21grep21:20:321
1861644994940,5cyclictest1878871-21munin-plugin-st20:50:002
1861644994932,11cyclictest311ktimers/200:05:122
186164399497,17cyclictest1861637-21cyclictest00:15:011
186164399497,17cyclictest1861637-21cyclictest00:15:011
1861643994918,6cyclictest0-21swapper/121:35:291
1861643994913,10cyclictest1901218-21sh23:00:211
1861640994918,13cyclictest131ktimers/023:10:320
1861643994839,5cyclictest1862446-21munin-plugin-st19:15:001
1861643994835,8cyclictest0-21swapper/120:05:011
1861643994835,8cyclictest0-21swapper/120:05:011
1861644994729,13cyclictest311ktimers/220:05:122
1861644994726,15cyclictest311ktimers/200:10:162
1861644994726,15cyclictest311ktimers/200:10:162
1861643994724,19cyclictest166150irq/127-8000000.ethernet-tx121:10:151
1861643994720,8cyclictest1880764-21/usr/sbin/munin21:00:241
1861640994739,4cyclictest20850irq/251-8000000.ethernet20:35:130
1861640994739,4cyclictest131ktimers/020:30:010
1861640994737,4cyclictest0-21swapper/020:40:170
186164099473,19cyclictest15-21rcuc/019:30:010
1861644994630,12cyclictest311ktimers/222:55:162
1861644994612,5cyclictest30-21rcuc/222:05:312
1861643994634,9cyclictest0-21swapper/123:40:281
1861643994634,9cyclictest0-21swapper/123:40:281
1861640994636,5cyclictest1890776-21munin-plugin-st22:00:010
1861640994632,9cyclictest1885543-21grep21:25:310
1861644994528,11cyclictest311ktimers/223:35:122
1861644994525,13cyclictest311ktimers/200:25:132
1861644994525,13cyclictest311ktimers/200:25:132
1861643994521,5cyclictest1646-21snmpd22:07:221
1861640994540,3cyclictest0-21swapper/023:40:010
1861640994524,18cyclictest20850irq/251-8000000.ethernet00:30:250
1861640994522,20cyclictest0-21swapper/000:15:280
1861644994428,12cyclictest311ktimers/200:30:142
1861640994438,4cyclictest0-21swapper/019:35:200
1861640994436,4cyclictest0-21swapper/022:10:290
1861640994432,8cyclictest0-21swapper/023:40:280
1861640994432,8cyclictest0-21swapper/023:40:280
186164099441,9cyclictest0-21swapper/023:25:010
1861644994335,5cyclictest1905172-21grep23:20:312
1861644994324,15cyclictest311ktimers/220:40:152
1861640994329,10cyclictest0-21swapper/020:15:210
186164099431,33cyclictest0-21swapper/020:00:120
186164099431,33cyclictest0-21swapper/020:00:120
1861644994232,6cyclictest0-21swapper/222:45:282
1861640994236,4cyclictest0-21swapper/019:15:120
1861640994236,3cyclictest0-21swapper/022:15:280
1861640994232,6cyclictest131ktimers/022:30:350
1861640994227,11cyclictest0-21swapper/023:50:220
1861644994131,7cyclictest0-21swapper/200:20:282
1861644994130,8cyclictest1883815-21grep21:15:302
1861644994127,9cyclictest0-21swapper/220:00:292
1861644994127,9cyclictest0-21swapper/220:00:292
1861644994126,11cyclictest0-21swapper/223:10:292
1861644994126,11cyclictest0-21swapper/219:25:312
1861644994123,12cyclictest311ktimers/221:05:152
186164499411,10cyclictest0-21swapper/219:45:012
1861643994129,8cyclictest0-21swapper/121:30:011
1861643994120,3cyclictest27250irq/343-s-wl18xx19:30:131
1861640994133,5cyclictest1909534-21munin-plugin-st23:50:000
1861640994133,4cyclictest20850irq/251-8000000.ethernet00:05:170
186164099411,5cyclictest0-21swapper/021:55:010
186164099411,37cyclictest0-21swapper/020:50:160
186164099411,34cyclictest0-21swapper/021:15:150
186164499407,24cyclictest30-21rcuc/222:25:012
1861644994022,13cyclictest311ktimers/200:35:192
1861644994020,11cyclictest0-21swapper/221:55:302
1861643994027,9cyclictest0-21swapper/123:15:321
186164099403,33cyclictest1897471-21unixbench_singl22:35:290
1861640994027,9cyclictest0-21swapper/023:00:000
1861644993929,5cyclictest0-21swapper/221:25:302
1861644993929,4cyclictest0-21swapper/221:35:012
1861644993926,8cyclictest0-21swapper/223:40:282
1861644993926,8cyclictest0-21swapper/223:40:282
1861643993931,5cyclictest14-21rcu_preempt23:35:011
1861643993925,10cyclictest0-21swapper/100:05:271
186164099396,6cyclictest27150irq/343-wl18xx22:05:200
1861640993931,4cyclictest21050irq/209-8000000.ethernet00:35:290
1861640993930,4cyclictest20850irq/251-8000000.ethernet19:50:170
1861640993927,8cyclictest0-21swapper/023:00:300
1861640993924,12cyclictest131ktimers/021:20:150
1861640993912,24cyclictest922-21dropbear22:40:220
186164499388,9cyclictest1903725-21/usr/sbin/munin23:15:212
1861644993829,5cyclictest0-21swapper/220:20:322
1861644993826,8cyclictest0-21swapper/223:50:232
1861644993823,7cyclictest0-21swapper/219:50:212
1861644993811,13cyclictest30-21rcuc/200:05:012
1861643993828,5cyclictest0-21swapper/122:20:001
1861643993827,4cyclictest166150irq/127-8000000.ethernet-tx123:35:281
1861643993826,9cyclictest0-21swapper/100:15:271
1861643993821,11cyclictest0-21swapper/123:50:291
1861640993826,8cyclictest0-21swapper/019:20:300
1861640993823,9cyclictest0-21swapper/019:45:180
1861640993821,4cyclictest27150irq/343-wl18xx20:55:140
186164099381,32cyclictest0-21swapper/021:10:150
186164099381,21cyclictest1906265-21apt23:30:130
186164499379,9cyclictest30-21rcuc/222:40:012
1861644993727,5cyclictest0-21swapper/221:50:282
1861644993723,7cyclictest0-21swapper/219:45:232
1861644993710,11cyclictest1896883-21/usr/sbin/munin22:35:202
1861643993726,4cyclictest0-21swapper/120:05:271
1861643993724,8cyclictest0-21swapper/123:45:291
1861640993726,7cyclictest131ktimers/021:30:300
1861640993722,10cyclictest0-21swapper/022:05:010
1861644993626,6cyclictest1882224-21kworker/u8:0-ext4-rsv-conversion21:40:012
1861644993625,6cyclictest0-21swapper/219:30:262
1861643993623,7cyclictest1883936-21sendmail21:20:001
1861640993629,4cyclictest21050irq/209-8000000.ethernet00:00:000
1861640993629,4cyclictest21050irq/209-8000000.ethernet00:00:000
1861640993626,6cyclictest131ktimers/000:10:330
1861640993626,6cyclictest131ktimers/000:10:330
1861640993626,5cyclictest1881304-21grep21:00:300
1861640993624,7cyclictest131ktimers/023:25:310
186164099361,3cyclictest0-21swapper/019:35:010
1861640993610,23cyclictest131ktimers/021:40:300
1861644993526,4cyclictest0-21swapper/223:00:212
1861643993527,5cyclictest0-21swapper/120:25:291
186164399351,6cyclictest0-21swapper/121:55:011
1861640993529,4cyclictest0-21swapper/020:05:130
1861640993528,4cyclictest21050irq/209-8000000.ethernet20:20:300
186164099352,6cyclictest1899289-21latency_hist22:50:000
1861640993525,6cyclictest131ktimers/020:10:290
1861640993521,10cyclictest0-21swapper/022:20:280
1861640993513,7cyclictest0-21swapper/019:58:240
186164099350,2cyclictest1881606-21apt-get21:05:170
1861644993425,6cyclictest0-21swapper/220:35:292
1861644993424,6cyclictest1895748-21grep22:25:322
1861644993421,9cyclictest1909485-21grep23:45:322
1861644993419,9cyclictest0-21swapper/221:45:302
1861643993426,5cyclictest0-21swapper/100:00:011
1861643993426,5cyclictest0-21swapper/100:00:011
1861643993423,7cyclictest0-21swapper/122:35:221
1861640993424,7cyclictest1902555-21grep23:05:330
1861640993424,5cyclictest0-21swapper/000:20:270
186164099341,3cyclictest0-21swapper/000:30:010
186164099341,3cyclictest0-21swapper/000:30:010
186164099341,2cyclictest0-21swapper/019:15:010
186164099341,2cyclictest0-21swapper/019:10:010
186164099341,27cyclictest0-21swapper/021:40:010
186164499334,22cyclictest1864363-21sed19:20:302
1861644993324,6cyclictest0-21swapper/220:30:002
1861644993319,10cyclictest311ktimers/220:10:112
1861643993323,7cyclictest1-21systemd00:20:161
1861640993326,5cyclictest0-21swapper/000:00:280
1861640993325,5cyclictest1900063-21munin-plugin-st22:55:000
1861644993224,5cyclictest0-21swapper/221:40:282
1861644993224,3cyclictest0-21swapper/223:25:292
186164399321,26cyclictest0-21swapper/119:40:171
186164099323,25cyclictest884-21systemd-logind21:48:130
1861644993122,4cyclictest0-21swapper/220:55:262
1861644993120,6cyclictest0-21swapper/222:10:302
1861644993111,4cyclictest27250irq/343-s-wl18xx22:01:042
1861643993124,4cyclictest0-21swapper/123:05:331
1861643993122,5cyclictest0-21swapper/122:00:291
1861643993122,5cyclictest0-21swapper/120:30:211
1861640993125,4cyclictest0-21swapper/020:25:200
186164099311,25cyclictest0-21swapper/022:30:020
186164099311,18cyclictest0-21swapper/020:47:280
1861644993010,4cyclictest27250irq/343-s-wl18xx20:17:032
1861643993023,4cyclictest0-21swapper/123:25:241
1861643993023,4cyclictest0-21swapper/100:35:311
1861643993021,7cyclictest0-21swapper/121:30:291
186164399301,3cyclictest0-21swapper/119:20:011
1861643993011,4cyclictest27250irq/343-s-wl18xx21:44:191
1861640993024,4cyclictest21050irq/209-8000000.ethernet19:40:290
1861644992921,3cyclictest0-21swapper/200:15:292
1861644992920,7cyclictest1869687-21/usr/sbin/munin19:55:162
1861644992920,6cyclictest0-21swapper/219:10:012
186164499291,3cyclictest1866311-21apt-get19:35:122
1861643992918,8cyclictest1900317-21dropbear22:55:201
1861644992816,8cyclictest0-21swapper/219:10:272
1861644992815,10cyclictest30-21rcuc/222:30:332
186164399288,3cyclictest27250irq/343-s-wl18xx20:51:321
1861643992821,5cyclictest1879907-21/usr/sbin/munin20:55:251
1861643992821,4cyclictest0-21swapper/123:10:221
1861643992819,5cyclictest0-21swapper/119:10:011
1861643992818,4cyclictest166150irq/127-8000000.ethernet-tx122:50:121
1861644992716,4cyclictest0-21swapper/221:05:012
1861643992720,4cyclictest0-21swapper/122:50:011
1861644992615,7cyclictest0-21swapper/219:15:292
186164399264,6cyclictest0-21swapper/122:30:011
1861643992616,6cyclictest0-21swapper/120:40:211
1861643992516,7cyclictest1894464-21dropbear22:20:201
1861644992419,3cyclictest311ktimers/222:15:122
186164399241,13cyclictest0-21swapper/121:57:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional