You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 08:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat Aug 15, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52037099846,40cyclictest0-21swapper/022:30:010
520370998411,40cyclictest0-21swapper/022:05:010
52037099821,65cyclictest0-21swapper/020:15:110
520370997428,40cyclictest0-21swapper/020:20:150
520374997362,8cyclictest0-21swapper/222:30:012
520370996930,35cyclictest558027-21ps22:45:240
520370996816,46cyclictest0-21swapper/022:10:220
520370996734,26cyclictest533749-21/usr/sbin/munin20:25:200
520370996633,9cyclictest545154-21/usr/sbin/munin21:30:250
520370996532,26cyclictest527957-21memory19:50:250
520370996532,26cyclictest527957-21memory19:50:240
520370996513,46cyclictest0-21swapper/020:50:020
520370996429,4cyclictest570562-21df00:00:170
520370996334,3cyclictest560262-21df_inode23:00:190
520370996235,25cyclictest524681-21ptp4l19:30:240
520370996034,23cyclictest0-21swapper/022:25:010
520370996031,15cyclictest0-21swapper/000:05:120
520370996029,3cyclictest541641-21memory21:10:250
520370996022,35cyclictest556738-21cpu22:40:160
520370996021,6cyclictest0-21swapper/023:50:100
520370995829,3cyclictest545629-21df_inode21:35:190
520370995829,3cyclictest521855-21/usr/sbin/munin19:15:240
520370995828,27cyclictest531358-21grep20:10:260
520370995738,14cyclictest0-21swapper/020:35:170
520370995722,31cyclictest554716-21grep22:25:280
520370995646,7cyclictest559633-21/usr/sbin/munin22:55:220
520370995628,26cyclictest526603-21sshd19:42:360
520370995627,3cyclictest539730-21df_inode21:00:180
520370995627,3cyclictest539730-21df_inode21:00:180
520370995615,3cyclictest577238-21ls00:40:010
520370995539,12cyclictest549291-21/usr/sbin/munin21:55:270
520370995529,3cyclictest566440-21irqstats23:35:240
520370995528,3cyclictest561475-21/usr/sbin/munin23:05:260
520370995526,3cyclictest567038-21apt23:40:120
520370995443,8cyclictest529116-21sshd19:56:560
520370995441,9cyclictest568255-21/usr/sbin/munin23:45:270
520370995437,13cyclictest0-21swapper/000:25:130
520370995431,13cyclictest0-21swapper/021:45:110
520370995427,24cyclictest523152-21apt-get19:25:050
520370995426,3cyclictest539201-21/usr/sbin/munin20:55:280
520370995425,27cyclictest548399-21memory21:50:250
520370995421,31cyclictest534903-21ptp4l20:30:240
520370995415,32cyclictest559276-21latency_hist22:55:020
520374995338,11cyclictest0-21swapper/219:25:002
52037199537,16cyclictest22-21rcuc/100:15:021
52037199537,16cyclictest22-21rcuc/100:15:021
520370995341,8cyclictest543120-21/usr/sbin/munin21:20:190
520370995330,20cyclictest563118-21/usr/sbin/munin23:15:230
520370995324,3cyclictest573324-21memory00:15:240
520370995321,29cyclictest562031-21diskstats23:10:160
520370995320,26cyclictest566168-21date23:35:020
520370995318,3cyclictest552546-21df22:15:160
520370995235,13cyclictest0-21swapper/000:20:140
520370995225,3cyclictest520933-21/usr/sbin/munin19:10:310
520370995225,24cyclictest575704-21/usr/sbin/munin00:30:190
520370995222,3cyclictest543936-21/usr/sbin/munin21:25:150
520370995222,27cyclictest550860-21cut22:05:200
520371995143,5cyclictest532518-21run-parts20:20:001
520371995140,5cyclictest523155-21munin-plugin-st19:25:001
520370995145,4cyclictest564919-21/usr/sbin/munin23:25:260
520370995135,10cyclictest569906-21/usr/sbin/munin23:55:190
520370995134,3cyclictest555945-21diskstats22:35:190
520370995129,17cyclictest542526-21cut21:15:250
520371995031,13cyclictest1283-21cron21:39:591
520370995043,4cyclictest546421-21apt-get21:40:110
520370995043,4cyclictest546421-21apt-get21:40:110
520370995040,7cyclictest529510-21ssh20:00:220
520370995033,13cyclictest564079-21/usr/sbin/munin23:20:260
520370995033,13cyclictest564079-21/usr/sbin/munin23:20:260
520370995012,35cyclictest0-21swapper/020:40:220
520374994941,4cyclictest547900-21munin-plugin-st21:50:002
520370994939,8cyclictest0-21swapper/019:35:130
520370994935,9cyclictest530486-21/usr/sbin/munin20:05:240
520370994931,14cyclictest527127-21/usr/sbin/munin19:45:220
520370994923,24cyclictest522573-21df19:20:170
520370994919,3cyclictest538225-21irqstats20:50:240
520371994840,4cyclictest47-21kauditd23:10:001
520370994837,8cyclictest572180-21munin-node00:10:090
520370994837,8cyclictest572180-21munin-node00:10:090
520370994835,10cyclictest540703-21/usr/sbin/munin21:05:210
52037499472,5cyclictest0-21swapper/221:55:192
520371994725,15cyclictest231ktimers/122:15:101
520374994637,5cyclictest0-21swapper/223:05:292
520374994632,9cyclictest0-21swapper/223:55:002
520374994628,11cyclictest0-21swapper/222:05:272
520371994632,9cyclictest0-21swapper/120:50:011
520374994535,5cyclictest537927-21grep20:50:012
52037199454,11cyclictest0-21swapper/123:05:011
520374994432,8cyclictest0-21swapper/220:30:012
520371994433,8cyclictest538569-21grep20:50:291
52037499431,23cyclictest0-21swapper/221:30:012
520371994330,9cyclictest0-21swapper/121:40:271
520371994330,9cyclictest0-21swapper/121:40:271
520371994324,11cyclictest0-21swapper/120:00:291
520371994235,4cyclictest0-21swapper/123:20:201
520371994235,4cyclictest0-21swapper/123:20:201
52037199423,23cyclictest564499-21/usr/sbin/munin23:25:181
520371994231,7cyclictest570301-21sendmail00:00:011
520371994228,9cyclictest0-21swapper/121:50:211
520371994219,16cyclictest231ktimers/119:15:161
520374994131,5cyclictest535890-21grep20:35:302
520374994129,8cyclictest546941-21grep21:40:282
520374994129,8cyclictest546941-21grep21:40:282
520374994124,13cyclictest311ktimers/200:05:122
520371994134,4cyclictest541144-21munin-plugin-st21:10:001
520371994131,5cyclictest0-21swapper/122:30:291
520374994031,4cyclictest556489-21kworker/u8:1-events_power_efficient22:55:262
520374994028,7cyclictest575298-21grep00:25:292
520374994027,7cyclictest1-21systemd20:56:332
520374994025,10cyclictest0-21swapper/222:10:272
520374994024,9cyclictest0-21swapper/200:00:322
520371994027,6cyclictest0-21swapper/123:40:191
520374993928,7cyclictest0-21swapper/220:05:292
520374993926,10cyclictest0-21swapper/221:35:212
520374993921,13cyclictest311ktimers/222:45:092
52037499391,13cyclictest0-21swapper/223:15:172
520371993928,7cyclictest571035-21grep00:00:311
520371993927,8cyclictest0-21swapper/100:25:281
52037199392,5cyclictest0-21swapper/121:00:001
520370993930,5cyclictest520329-21latency_hist19:10:000
52037499389,27cyclictest538457-21tr20:50:282
520374993832,3cyclictest573662-21sh00:19:592
520374993828,5cyclictest0-21swapper/220:00:202
520374993827,8cyclictest0-21swapper/200:35:282
520374993827,5cyclictest0-21swapper/222:40:252
520371993830,4cyclictest0-21swapper/120:05:291
520371993828,5cyclictest0-21swapper/123:35:201
520371993824,10cyclictest0-21swapper/121:10:271
520371993821,11cyclictest231ktimers/121:30:111
520374993729,3cyclictest0-21swapper/221:05:212
520374993728,6cyclictest0-21swapper/219:50:002
520374993725,7cyclictest0-21swapper/219:40:292
520374993724,9cyclictest0-21swapper/222:20:212
52037499371,5cyclictest0-21swapper/221:05:022
52037499371,5cyclictest0-21swapper/221:05:022
52037499371,30cyclictest0-21swapper/222:15:272
520371993729,5cyclictest14-21rcu_preempt22:00:301
520371993727,7cyclictest0-21swapper/122:20:261
520371993727,6cyclictest525656-21grep19:35:271
52037199372,22cyclictest0-21swapper/120:41:171
520371993721,13cyclictest231ktimers/122:40:141
520374993629,4cyclictest0-21swapper/219:50:252
520374993629,4cyclictest0-21swapper/219:50:252
520374993626,6cyclictest572770-21grep00:10:262
520374993626,6cyclictest572770-21grep00:10:262
520371993625,8cyclictest559931-21grep22:55:261
520371993624,8cyclictest0-21swapper/123:50:011
520371993624,8cyclictest0-21swapper/121:25:271
520371993624,8cyclictest0-21swapper/100:05:291
520371993622,7cyclictest0-21swapper/122:25:281
520371993620,7cyclictest0-21swapper/119:40:191
52037199361,30cyclictest0-21swapper/122:35:281
52037199353,28cyclictest22-21rcuc/122:15:011
52037199351,6cyclictest0-21swapper/120:35:021
520371993424,7cyclictest0-21swapper/119:25:211
520374993322,7cyclictest0-21swapper/200:30:272
520374993321,9cyclictest0-21swapper/222:05:002
520374993226,3cyclictest0-21swapper/222:30:292
520374993225,4cyclictest0-21swapper/221:15:282
520374993224,5cyclictest0-21swapper/221:30:172
520374993216,11cyclictest311ktimers/221:10:122
52037499321,2cyclictest0-21swapper/200:00:022
52037499321,26cyclictest0-21swapper/223:10:472
520374993212,14cyclictest311ktimers/223:25:122
520371993223,7cyclictest524280-21/usr/sbin/munin19:30:231
520371993223,6cyclictest540231-21grep21:00:291
520371993223,6cyclictest540231-21grep21:00:291
520371993223,5cyclictest562519-21sed23:10:271
520371993222,5cyclictest0-21swapper/100:35:181
520371993221,6cyclictest0-21swapper/119:15:011
52037199321,4cyclictest0-21swapper/122:45:211
520374993124,4cyclictest167550irq/134-8000000.ethernet-tx219:10:202
520374993124,4cyclictest0-21swapper/223:40:002
520374993123,4cyclictest0-21swapper/221:20:282
520374993121,5cyclictest0-21swapper/219:15:302
52037499311,4cyclictest560558-21ps23:00:262
520371993120,7cyclictest535927-21grep20:35:311
520371993116,11cyclictest231ktimers/121:55:131
520371993115,12cyclictest231ktimers/100:15:141
520371993114,4cyclictest167450irq/126-8000000.ethernet-tx123:50:211
52037499302,3cyclictest531543-21find20:10:292
520374993022,5cyclictest14-21rcu_preempt19:35:012
520374993021,6cyclictest528694-21cut19:55:202
520374993020,7cyclictest548699-21grep21:50:302
520374993020,7cyclictest0-21swapper/223:40:262
520374993018,8cyclictest0-21swapper/220:30:192
520374993018,7cyclictest0-21swapper/219:25:292
52037499301,4cyclictest525377-21irqstats19:35:222
520374993014,9cyclictest0-21swapper/222:40:012
520371993022,6cyclictest534153-21grep20:25:281
520371993021,4cyclictest0-21swapper/122:50:201
520371993012,4cyclictest167450irq/126-8000000.ethernet-tx121:45:221
520371993010,14cyclictest231ktimers/121:15:121
520374992916,6cyclictest0-21swapper/220:20:292
52037499291,26cyclictest0-21swapper/223:30:242
52037199298,10cyclictest22-21rcuc/122:05:181
520371992922,4cyclictest0-21swapper/119:55:201
520371992920,6cyclictest543601-21grep21:20:291
520371992919,7cyclictest0-21swapper/100:20:281
520371992917,8cyclictest0-21swapper/120:20:201
52037199291,23cyclictest0-21swapper/119:50:111
52037199291,23cyclictest0-21swapper/119:50:111
520374992819,6cyclictest311ktimers/200:20:212
520374992813,10cyclictest311ktimers/220:40:122
520371992819,4cyclictest0-21swapper/123:30:281
52037199281,25cyclictest0-21swapper/119:46:371
520374992720,4cyclictest30-21rcuc/222:55:012
520374992716,6cyclictest568768-21wc23:50:022
52037199277,4cyclictest8321systemd-network23:17:011
52037199271,24cyclictest0-21swapper/100:33:121
52037199271,23cyclictest1653-21lldpd20:11:501
52037499261,22cyclictest311ktimers/220:15:252
520374992516,6cyclictest30-21rcuc/223:22:262
520374992516,6cyclictest30-21rcuc/223:22:262
520371992415,6cyclictest0-21swapper/119:10:011
520374991813,2cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional