You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 07:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun May 17, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80467199787,34cyclictest0-21swapper/020:30:010
804671997669,5cyclictest131ktimers/022:10:010
804671997333,3cyclictest831559-21/usr/sbin/munin21:45:190
804671997322,46cyclictest0-21swapper/022:15:000
804671996719,41cyclictest823724-21cat21:00:010
804671996719,14cyclictest840735-21cat22:40:010
804674996415,19cyclictest14-21rcu_preempt22:15:011
804674996415,19cyclictest14-21rcu_preempt22:15:011
804671996326,10cyclictest0-21swapper/023:35:020
804671996326,10cyclictest0-21swapper/023:35:010
804671996325,34cyclictest836759-21/usr/sbin/munin22:15:210
804671996325,34cyclictest836759-21/usr/sbin/munin22:15:210
804671996323,4cyclictest861071-21irqstats00:35:230
804671996318,39cyclictest0-21swapper/000:25:160
804671996225,33cyclictest807167-21phc2sys-jitter19:20:250
804671996122,35cyclictest812211-21phc2sys19:50:250
804671996024,2cyclictest855198-21/usr/sbin/munin00:00:270
804671995929,27cyclictest824685-21df21:05:170
804671995918,3cyclictest815315-21df_inode20:10:160
804671995830,3cyclictest845982-21/usr/sbin/munin23:10:170
804671995821,3cyclictest806030-21diskstats19:15:180
804671995815,3cyclictest809410-21diskstats19:35:180
804671995752,3cyclictest0-21swapper/020:35:140
804671995723,5cyclictest827620-21find21:20:270
804671995637,14cyclictest131ktimers/022:40:120
804671995636,14cyclictest0-21swapper/000:15:150
804671995628,26cyclictest833479-21phc2sys21:55:270
804671995621,9cyclictest820571-21tune2fs20:40:200
804671995621,32cyclictest832485-21fschecks_time21:50:190
804674995546,5cyclictest838876-21munin-plugin-st22:30:001
80467199554,26cyclictest0-21swapper/000:15:010
804671995528,3cyclictest810838-21munin-run19:45:010
804671995527,3cyclictest853004-21df_inode23:50:180
804671995520,8cyclictest852244-21sh23:45:200
804671995520,8cyclictest852244-21sh23:45:200
804671995520,31cyclictest848905-21/usr/sbin/munin23:25:260
804671995520,31cyclictest848905-21/usr/sbin/munin23:25:260
80467199551,5cyclictest0-21swapper/021:30:100
80467199551,5cyclictest0-21swapper/021:30:100
80467499541,8cyclictest0-21swapper/121:35:191
804671995437,11cyclictest0-21swapper/019:45:140
804671995431,13cyclictest0-21swapper/021:15:140
804671995427,25cyclictest853856-21/usr/sbin/munin23:55:200
804671995426,3cyclictest839398-21phc2sys22:30:250
804671995426,3cyclictest839398-21phc2sys22:30:250
804671995337,13cyclictest0-21swapper/023:00:120
804671995334,14cyclictest0-21swapper/021:00:130
80467199533,2cyclictest0-21swapper/020:25:020
804671995324,3cyclictest808566-21df_inode19:30:310
804671995234,12cyclictest0-21swapper/020:15:140
804671995225,2cyclictest830402-21sshd21:38:010
804671995224,3cyclictest860033-21df_inode00:30:180
804671995220,3cyclictest828790-21gpgv21:30:000
804671995220,3cyclictest828790-21gpgv21:30:000
804671995218,5cyclictest855962-21ps00:05:260
804671995214,3cyclictest851559-21meminfo23:40:240
804671995214,36cyclictest842202-21unixbench_singl22:45:270
804674995140,8cyclictest0-21swapper/119:15:291
804671995136,11cyclictest0-21swapper/023:15:160
804671995134,12cyclictest0-21swapper/023:05:130
804674995042,4cyclictest817593-21munin-plugin-st20:25:001
80467199507,41cyclictest0-21swapper/022:50:260
804671995036,9cyclictest830937-21memory21:40:260
804671995034,12cyclictest837749-21/usr/sbin/munin22:20:260
804671995033,14cyclictest807958-21/usr/sbin/munin19:25:250
804671995033,14cyclictest807958-21/usr/sbin/munin19:25:250
804671995021,27cyclictest804900-21df_inode19:10:180
804671995016,29cyclictest813349-21cron20:00:000
80467199493,6cyclictest834311-21cut22:00:240
804671994930,13cyclictest838671-21/usr/sbin/munin22:25:300
804671994915,31cyclictest813679-21fschecks_count20:00:180
804674994831,12cyclictest0-21swapper/100:00:271
804671994833,10cyclictest858331-21grep00:20:190
804671994832,12cyclictest825529-21/usr/sbin/munin21:10:170
804674994738,5cyclictest0-21swapper/122:55:291
804674994738,5cyclictest0-21swapper/122:55:291
804671994733,11cyclictest822404-21/usr/sbin/munin20:50:240
804671994730,12cyclictest819122-21/usr/sbin/munin20:30:270
804671994730,10cyclictest843892-21sed22:55:280
804671994730,10cyclictest843892-21sed22:55:280
804671994723,17cyclictest851203-21latency_hist23:40:000
804674994636,6cyclictest857900-21sendmail00:20:011
804671994637,5cyclictest20850irq/208-8000000.ethernet23:20:280
804671994612,28cyclictest0-21swapper/019:10:000
804675994537,5cyclictest0-21swapper/200:40:012
804675994536,6cyclictest814988-21grep20:05:292
804675994536,6cyclictest814988-21grep20:05:282
804675994530,9cyclictest843932-21munin-plugin-st23:00:002
804675994530,9cyclictest843932-21munin-plugin-st23:00:002
804675994526,13cyclictest311ktimers/220:15:102
804674994538,5cyclictest832118-21munin-plugin-st21:50:011
804671994529,14cyclictest167350irq/118-8000000.ethernet-tx020:05:210
804671994529,14cyclictest167350irq/118-8000000.ethernet-tx020:05:200
804671994515,27cyclictest821878-21sshd20:47:540
804674994432,8cyclictest823591-21sendmail21:00:001
804674994428,11cyclictest0-21swapper/119:40:281
804674994424,8cyclictest0-21swapper/121:55:291
804675994330,8cyclictest813367-21sendmail20:00:012
804675994329,9cyclictest809874-21grep19:35:282
804675994327,11cyclictest311ktimers/222:30:102
804675994327,11cyclictest311ktimers/222:30:102
804675994325,10cyclictest0-21swapper/221:20:282
804674994332,8cyclictest0-21swapper/121:25:301
804674994332,8cyclictest0-21swapper/121:25:291
804674994331,7cyclictest0-21swapper/121:50:271
804674994327,11cyclictest0-21swapper/119:15:011
804675994223,12cyclictest311ktimers/222:25:132
80467599422,25cyclictest845836-21cat23:10:012
804674994233,5cyclictest850114-21munin-plugin-st23:35:011
804674994233,5cyclictest850114-21munin-plugin-st23:35:001
804674994229,8cyclictest0-21swapper/121:30:291
804674994229,8cyclictest0-21swapper/121:30:291
804674994214,26cyclictest0-21swapper/120:35:241
804675994134,5cyclictest0-21swapper/219:25:012
804675994133,4cyclictest805624-21if_eth019:15:022
804675994133,4cyclictest0-21swapper/222:00:292
804675994132,5cyclictest0-21swapper/221:30:292
804675994132,5cyclictest0-21swapper/221:30:292
804675994131,6cyclictest830336-21grep21:35:292
80467499419,26cyclictest860211-21if_eth100:30:231
804674994133,4cyclictest14-21rcu_preempt23:25:271
804674994133,4cyclictest14-21rcu_preempt23:25:271
804674994129,7cyclictest0-21swapper/100:05:281
80467499411,5cyclictest0-21swapper/120:20:011
804675994030,6cyclictest0-21swapper/220:25:012
804675994025,8cyclictest0-21swapper/223:15:292
804675994019,13cyclictest852935-21/usr/sbin/munin23:50:182
804675994017,13cyclictest311ktimers/200:30:152
804674994029,7cyclictest0-21swapper/120:40:291
804674994026,10cyclictest0-21swapper/120:10:261
80467499402,20cyclictest841608-21/usr/sbin/munin22:45:171
804675993930,5cyclictest0-21swapper/222:35:282
804675993926,9cyclictest311ktimers/221:50:102
804675993925,10cyclictest311ktimers/200:15:132
804674993931,4cyclictest0-21swapper/119:25:301
804674993931,4cyclictest0-21swapper/119:25:301
804674993929,7cyclictest0-21swapper/100:14:591
804674993925,9cyclictest0-21swapper/123:35:291
804674993925,10cyclictest0-21swapper/121:40:291
804675993829,4cyclictest0-21swapper/221:10:282
804675993828,7cyclictest0-21swapper/222:15:292
804675993828,7cyclictest0-21swapper/222:15:292
804675993827,7cyclictest0-21swapper/200:05:292
804675993826,6cyclictest0-21swapper/221:45:282
804675993823,11cyclictest311ktimers/223:20:102
80467599381,30cyclictest311ktimers/223:40:052
804674993828,5cyclictest0-21swapper/120:00:281
804674993823,9cyclictest0-21swapper/100:30:011
804675993728,5cyclictest0-21swapper/221:15:312
804675993726,7cyclictest821853-21grep20:45:292
804675993725,9cyclictest814210-21munin-plugin-st20:05:002
804675993725,9cyclictest311ktimers/222:50:162
804675993723,7cyclictest1660-21snmpd22:05:252
804675993723,10cyclictest311ktimers/222:20:122
804674993725,6cyclictest0-21swapper/100:20:281
804675993628,4cyclictest846482-21grep23:10:282
804675993628,4cyclictest0-21swapper/220:40:222
804675993628,4cyclictest0-21swapper/220:10:172
804675993625,6cyclictest311ktimers/220:35:152
804675993615,12cyclictest804668-21cyclictest22:40:122
804674993624,8cyclictest861360-21unixbench_multi00:35:291
804674993622,10cyclictest0-21swapper/123:20:261
80467499361,4cyclictest0-21swapper/100:00:011
804675993524,8cyclictest0-21swapper/223:25:282
804675993524,8cyclictest0-21swapper/223:25:272
804675993517,11cyclictest835692-21/usr/sbin/munin22:10:192
804675993514,17cyclictest2-21kthreadd23:38:212
80467599351,29cyclictest806017-21df19:15:182
804674993525,5cyclictest0-21swapper/123:50:291
804674993523,7cyclictest0-21swapper/121:10:281
804674993522,8cyclictest0-21swapper/120:30:281
80467499351,10cyclictest0-21swapper/121:10:011
804675993426,5cyclictest1261-21rs:main2
804674993424,6cyclictest0-21swapper/119:55:271
804674993422,7cyclictest0-21swapper/122:20:291
804675993323,6cyclictest0-21swapper/200:10:172
804675993322,7cyclictest0-21swapper/220:30:292
804674993324,5cyclictest0-21swapper/122:05:281
804674993323,7cyclictest0-21swapper/121:20:001
804674993322,7cyclictest0-21swapper/122:50:291
804674993322,6cyclictest846841-21/usr/sbin/munin23:15:281
804674993319,9cyclictest0-21swapper/119:55:011
804674993311,4cyclictest8321systemd-network19:46:221
804675993226,4cyclictest14-21rcu_preempt21:00:212
804675993225,4cyclictest0-21swapper/223:55:292
804675993224,5cyclictest0-21swapper/219:40:282
804675993223,7cyclictest833154-21/usr/sbin/munin21:55:182
804675993223,6cyclictest0-21swapper/200:30:012
804675993223,5cyclictest30-21rcuc/223:45:292
804675993223,5cyclictest30-21rcuc/223:45:292
804674993224,4cyclictest14-21rcu_preempt22:10:261
804674993223,6cyclictest0-21swapper/123:45:291
804674993223,6cyclictest0-21swapper/123:45:291
804674993223,5cyclictest0-21swapper/119:30:291
804674993219,9cyclictest0-21swapper/120:50:191
80467499321,2cyclictest0-21swapper/122:40:001
80467499321,29cyclictest0-21swapper/120:05:141
80467499321,29cyclictest0-21swapper/120:05:141
804675993124,4cyclictest14-21rcu_preempt23:30:292
804675993124,4cyclictest14-21rcu_preempt23:30:292
804675993122,5cyclictest30-21rcuc/200:20:192
804675993121,7cyclictest0-21swapper/222:45:272
804675993120,7cyclictest809057-21grep19:30:412
804674993123,5cyclictest22-21rcuc/120:45:231
80467499311,28cyclictest0-21swapper/121:20:211
80467499311,16cyclictest844144-21/usr/sbin/munin23:00:191
804675993021,5cyclictest0-21swapper/221:45:012
804675993019,7cyclictest828560-21grep21:25:302
804675993019,7cyclictest828560-21grep21:25:302
804675993018,6cyclictest0-21swapper/200:05:012
804675993017,9cyclictest0-21swapper/221:05:122
80467499308,8cyclictest0-21swapper/121:03:281
80467499302,3cyclictest841211-21gzip22:40:271
804674993018,9cyclictest1660-21snmpd22:00:231
804675992919,7cyclictest818450-21grep20:25:292
804675992913,5cyclictest167550irq/134-8000000.ethernet-tx219:52:232
804674992923,3cyclictest0-21swapper/122:30:201
804674992923,3cyclictest0-21swapper/122:30:201
804674992922,4cyclictest0-21swapper/120:25:051
804674992919,6cyclictest0-21swapper/123:40:221
804675992822,3cyclictest0-21swapper/219:25:292
804675992822,3cyclictest0-21swapper/219:25:292
804674992818,7cyclictest845751-21cat23:10:011
804674992818,5cyclictest0-21swapper/119:20:281
804674992816,8cyclictest0-21swapper/123:10:201
804675992720,5cyclictest844209-21df23:00:182
804675992720,4cyclictest30-21rcuc/220:50:202
804675992715,10cyclictest14-21rcu_preempt20:55:292
804674992720,5cyclictest1660-21snmpd19:38:581
80467599225,10cyclictest0-21swapper/219:10:012
80467499181,9cyclictest804729-21latency_hist19:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional