You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 14:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun Jun 28, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14410299899,42cyclictest200048-21cmp00:35:001
14410299899,42cyclictest200048-21cmp00:35:001
14410399742,51cyclictest30-21rcuc/219:50:012
144099997331,35cyclictest168692-21/usr/sbin/munin21:30:210
144099997320,46cyclictest200206-21latency_hist00:35:020
144099997320,46cyclictest200206-21latency_hist00:35:010
144099997123,44cyclictest196441-21sed00:10:310
14410299686,24cyclictest0-21swapper/123:30:011
144102996850,11cyclictest145661-21kernelversion19:15:241
144099996825,36cyclictest0-21swapper/021:35:160
144099996455,6cyclictest0-21swapper/021:45:010
144099996426,35cyclictest195667-21sed00:05:300
144099996133,3cyclictest186501-21df23:15:150
144099996038,16cyclictest0-21swapper/019:30:130
144099996027,30cyclictest194306-21diskstats00:00:180
144099996024,3cyclictest183075-21apt-get22:55:130
144099995942,13cyclictest0-21swapper/020:40:120
144099995941,12cyclictest0-21swapper/021:10:110
144099995941,12cyclictest0-21swapper/021:10:110
144099995930,3cyclictest146249-21apt-get19:20:110
144099995924,32cyclictest1660-21snmpd21:51:450
144099995921,3cyclictest193548-21irqstats23:55:230
144103995816,20cyclictest30-21rcuc/222:55:012
144099995832,14cyclictest0-21swapper/022:05:140
144099995830,3cyclictest191782-21irqstats23:45:240
144099995830,3cyclictest181304-21apt22:45:120
144099995830,3cyclictest147481-21memory19:25:260
144099995815,7cyclictest152740-21mailstats19:55:280
144099995815,7cyclictest152740-21mailstats19:55:280
144099995812,40cyclictest159832-21latency_hist20:40:010
144099995751,3cyclictest176210-21/usr/sbin/munin22:15:170
144099995742,12cyclictest0-21swapper/023:35:150
144099995742,10cyclictest164148-21munin-node21:05:110
144099995738,15cyclictest0-21swapper/020:45:140
144099995738,15cyclictest0-21swapper/020:45:140
144099995641,12cyclictest184837-21/usr/sbin/munin23:05:170
144099995640,12cyclictest0-21swapper/000:20:140
144099995638,13cyclictest0-21swapper/020:15:120
144099995632,21cyclictest166857-21cut21:20:210
144099995632,12cyclictest0-21swapper/022:50:130
144099995628,3cyclictest162755-21meminfo20:55:250
144099995619,34cyclictest1660-21snmpd19:47:240
144099995545,5cyclictest175301-21apt-get22:10:120
144099995545,5cyclictest175301-21apt-get22:10:120
144099995534,10cyclictest0-21swapper/022:25:140
144099995518,10cyclictest0-21swapper/020:15:020
14410399545,18cyclictest32-21ksoftirqd/220:00:012
144103995446,5cyclictest189629-21munin-plugin-st23:34:592
144099995426,24cyclictest163897-21sed21:00:290
144099995418,32cyclictest200310-21/usr/sbin/munin00:35:170
144099995416,31cyclictest0-21swapper/019:55:000
144099995342,8cyclictest158775-21sshd20:33:240
144099995338,9cyclictest179581-21/usr/sbin/munin22:35:160
144099995338,9cyclictest179581-21/usr/sbin/munin22:35:160
144099995338,12cyclictest0-21swapper/020:20:150
144099995323,3cyclictest178750-21diskstats22:30:160
144099995318,33cyclictest0-21swapper/023:40:270
144099995237,9cyclictest184169-21/usr/sbin/munin23:00:220
144099995236,12cyclictest0-21swapper/019:35:150
144099995233,14cyclictest0-21swapper/023:10:120
144099995215,30cyclictest0-21swapper/020:10:010
144099995210,35cyclictest0-21swapper/019:15:190
144103995139,8cyclictest193938-21sendmail00:00:012
14410399511,20cyclictest0-21swapper/220:50:022
14410399511,20cyclictest0-21swapper/220:50:012
144099995141,8cyclictest188767-21sshd23:26:240
144099995141,6cyclictest165830-21apt-get21:15:120
144099995139,9cyclictest157371-21/usr/sbin/munin20:25:170
144099995139,9cyclictest144483-21/usr/sbin/munin19:10:230
144099995137,10cyclictest172674-21/usr/sbin/munin21:55:110
144099995135,13cyclictest198664-21/usr/sbin/munin00:25:230
144099995134,13cyclictest167690-21/usr/sbin/munin21:25:210
144099995116,32cyclictest177497-21tr22:20:270
144099995040,4cyclictest189317-21phc2sys23:30:260
144099995038,9cyclictest192361-21/usr/sbin/munin23:50:110
144099995038,8cyclictest161870-21/usr/sbin/munin20:50:210
144099995033,14cyclictest173931-21/usr/sbin/munin22:00:250
144099995033,13cyclictest0-21swapper/023:20:110
144099995024,3cyclictest180635-21irqstats22:40:240
14410299491,8cyclictest0-21swapper/119:45:011
144099994937,8cyclictest197056-21/usr/sbin/munin00:15:260
144099994937,8cyclictest170201-21/usr/sbin/munin21:40:170
144099994937,8cyclictest170201-21/usr/sbin/munin21:40:160
144099994933,13cyclictest149966-21/usr/sbin/munin19:40:240
144102994829,13cyclictest0-21swapper/123:50:291
144103994732,8cyclictest0-21swapper/223:45:302
144102994710,8cyclictest173313-21apt-get22:00:021
144099994735,8cyclictest153141-21/usr/sbin/munin20:00:130
144102994629,8cyclictest0-21swapper/120:40:281
14410299462,18cyclictest22-21rcuc/122:25:001
144102994527,6cyclictest0-21swapper/119:20:301
144102994527,11cyclictest0-21swapper/122:55:051
144102994432,7cyclictest0-21swapper/120:19:591
144103994327,10cyclictest0-21swapper/220:50:172
144103994325,9cyclictest0-21swapper/200:00:302
144103994313,11cyclictest0-21swapper/221:50:012
144102994336,4cyclictest182786-21munin-plugin-st22:55:001
144102994330,7cyclictest0-21swapper/123:25:201
144102994329,9cyclictest193884-21grep23:55:291
144103994227,8cyclictest0-21swapper/220:55:282
144103994223,14cyclictest311ktimers/221:15:142
144102994223,9cyclictest0-21swapper/123:10:291
14410299421,33cyclictest164682-21unixbench_multi21:05:291
144099994228,7cyclictest144212-21latency_hist19:10:010
144102994129,7cyclictest168198-21grep21:25:311
14410299411,37cyclictest169874-21unixbench_singl21:35:301
14410299411,32cyclictest178371-21unixbench_multi22:25:281
14410399409,19cyclictest200236-21/usr/sbin/munin00:35:182
144103994028,9cyclictest200080-21apt-key00:35:012
144103994028,9cyclictest200080-21apt-key00:35:012
144103994026,9cyclictest0-21swapper/222:40:282
144103994014,14cyclictest311ktimers/200:10:132
14410299403,2cyclictest0-21swapper/100:30:001
144102994032,4cyclictest187101-21sendmail23:20:001
144102994028,7cyclictest149390-21grep19:35:281
144103993926,8cyclictest0-21swapper/219:25:302
144103993924,7cyclictest0-21swapper/221:55:302
144102993930,5cyclictest0-21swapper/120:10:201
144102993929,5cyclictest169054-21grep21:30:281
144103993830,5cyclictest192920-21unixbench_multi23:50:292
144103993830,4cyclictest146818-21grep19:20:292
144103993827,8cyclictest0-21swapper/222:25:292
14410399382,28cyclictest0-21swapper/220:45:012
144103993819,10cyclictest30-21rcuc/222:15:012
144103993819,10cyclictest30-21rcuc/222:15:012
144102993830,4cyclictest0-21swapper/100:05:001
144102993828,5cyclictest0-21swapper/120:55:011
144102993826,9cyclictest190472-21sendmail23:40:001
144102993826,5cyclictest0-21swapper/119:15:011
144103993730,4cyclictest0-21swapper/219:55:302
144103993730,4cyclictest0-21swapper/219:55:302
144103993729,4cyclictest0-21swapper/223:20:002
144103993726,7cyclictest14-21rcu_preempt19:15:212
144103993726,6cyclictest0-21swapper/221:05:302
144103993723,7cyclictest187833-21grep23:20:272
144103993722,10cyclictest0-21swapper/222:20:292
14410399372,12cyclictest30-21rcuc/222:05:012
144103993720,11cyclictest0-21swapper/223:05:292
144103993710,22cyclictest311ktimers/221:40:202
144103993710,22cyclictest311ktimers/221:40:192
144103993710,16cyclictest311ktimers/221:00:102
144102993730,4cyclictest148659-21munin-plugin-st19:35:011
144102993729,5cyclictest0-21swapper/122:15:241
144102993727,4cyclictest0-21swapper/121:00:281
144102993726,7cyclictest0-21swapper/120:05:301
144102993724,6cyclictest0-21swapper/122:00:291
144102993723,8cyclictest0-21swapper/100:15:301
14410299372,29cyclictest0-21swapper/119:50:271
144103993629,5cyclictest0-21swapper/223:10:292
144103993629,4cyclictest14-21rcu_preempt21:20:222
144103993623,7cyclictest156196-21grep20:15:292
14410399362,29cyclictest1660-21snmpd23:25:012
144103993621,10cyclictest149156-21sshd19:35:242
144103993619,9cyclictest0-21swapper/222:35:292
144103993619,9cyclictest0-21swapper/222:35:282
144102993628,4cyclictest163031-21unixbench_singl20:55:281
144102993619,9cyclictest0-21swapper/122:05:291
144102993619,9cyclictest0-21swapper/121:20:211
14410299361,29cyclictest164987-21/usr/sbin/munin21:10:181
14410299361,29cyclictest164987-21/usr/sbin/munin21:10:181
14410399355,4cyclictest0-21swapper/221:15:022
14410399355,4cyclictest0-21swapper/221:15:022
144103993528,2cyclictest0-21swapper/223:45:022
144103993526,5cyclictest0-21swapper/220:30:302
144103993526,4cyclictest0-21swapper/219:10:312
144103993523,6cyclictest168456-21/usr/sbin/munin21:30:262
144102993528,3cyclictest0-21swapper/120:30:271
144102993521,9cyclictest0-21swapper/121:15:231
14410299351,4cyclictest0-21swapper/121:50:001
14410299351,3cyclictest0-21swapper/120:25:011
14410299351,2cyclictest0-21swapper/122:35:011
144103993421,9cyclictest311ktimers/200:25:132
144103993418,13cyclictest311ktimers/223:35:122
144102993426,5cyclictest47-21kauditd00:15:011
144102993425,4cyclictest0-21swapper/120:25:201
144102993424,6cyclictest0-21swapper/121:55:001
144102993420,8cyclictest231ktimers/123:05:231
144103993326,4cyclictest154764-21/usr/sbin/munin20:10:222
144103993324,6cyclictest0-21swapper/220:05:292
144103993324,5cyclictest0-21swapper/221:25:182
144103993322,7cyclictest0-21swapper/222:55:302
14410399332,26cyclictest156468-21/usr/sbin/munin20:20:252
144103993321,8cyclictest0-21swapper/222:30:272
144102993322,7cyclictest181893-21grep22:45:301
144102993322,5cyclictest0-21swapper/123:45:201
144102993322,4cyclictest0-21swapper/122:10:211
144102993322,4cyclictest0-21swapper/122:10:201
144102993319,10cyclictest0-21swapper/121:45:001
144102993319,10cyclictest0-21swapper/121:45:001
14410299331,5cyclictest0-21swapper/123:45:011
144102993313,9cyclictest150553-21/usr/sbin/munin19:45:181
14410299331,2cyclictest0-21swapper/123:05:011
14410299331,29cyclictest0-21swapper/122:35:291
14410299331,29cyclictest0-21swapper/122:35:291
14410299331,25cyclictest147465-21kernelversion19:25:251
144103993224,5cyclictest0-21swapper/221:35:292
144103993223,5cyclictest0-21swapper/219:50:292
144103993223,4cyclictest0-21swapper/220:25:282
144102993219,10cyclictest0-21swapper/119:10:011
144102993217,11cyclictest0-21swapper/123:25:001
144102993217,10cyclictest0-21swapper/100:05:301
14410399311,4cyclictest171616-21kworker/u8:2+events_power_efficient22:16:192
144102993120,8cyclictest231ktimers/120:45:051
144102993120,8cyclictest231ktimers/120:45:051
144102993120,8cyclictest198234-21sshd00:21:231
144103993018,8cyclictest0-21swapper/200:25:002
144102993022,4cyclictest0-21swapper/122:40:271
144103992920,4cyclictest0-21swapper/200:05:222
144103992919,6cyclictest0-21swapper/220:40:012
144103992917,7cyclictest184456-21grep23:00:292
14410399291,26cyclictest0-21swapper/221:45:202
144102992920,7cyclictest1660-21snmpd00:35:151
144102992920,6cyclictest159577-21grep20:35:281
144102992917,8cyclictest0-21swapper/120:05:011
144103992819,6cyclictest311ktimers/222:00:192
144103992818,7cyclictest311ktimers/222:45:132
14410399280,26cyclictest200-21pr/ttyS200:19:592
144102992819,5cyclictest0-21swapper/120:00:021
144102992819,5cyclictest0-21swapper/120:00:011
14410399262,17cyclictest144096-21cyclictest19:10:022
144103992619,5cyclictest0-21swapper/219:40:242
144103992619,4cyclictest0-21swapper/219:30:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional