You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 13:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun May 31, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
577451998278,2cyclictest0-21swapper/000:30:180
577452997716,42cyclictest22-21rcuc/121:30:181
57745299704,30cyclictest24-21ksoftirqd/122:45:021
577452995644,7cyclictest0-21swapper/100:40:011
577452995542,9cyclictest601552-21apt-key21:30:011
577451995519,17cyclictest14-21rcu_preempt22:40:010
57745299548,19cyclictest22-21rcuc/121:45:011
57745599534,37cyclictest30-21rcuc/223:10:012
57745599534,37cyclictest30-21rcuc/223:10:012
577452995327,15cyclictest14-21rcu_preempt21:05:011
577452995327,15cyclictest14-21rcu_preempt21:05:011
577451995345,5cyclictest0-21swapper/019:15:090
577455995242,7cyclictest580238-21munin-plugin-st19:25:002
577455995235,8cyclictest0-21swapper/220:50:282
577452995218,6cyclictest0-21swapper/123:10:021
577452995218,6cyclictest0-21swapper/123:10:011
577455995139,7cyclictest626454-21munin-plugin-st23:55:002
577455995134,12cyclictest0-21swapper/220:15:282
57745299515,8cyclictest608366-21apt-get22:10:011
57745199513,6cyclictest584471-21grep19:45:280
577455995039,6cyclictest593839-21munin-plugin-st20:45:002
577451995020,19cyclictest630024-21/usr/sbin/munin00:15:190
577455994936,8cyclictest0-21swapper/200:20:282
577455994932,11cyclictest0-21swapper/222:55:292
57745199491,2cyclictest0-21swapper/020:30:000
577455994836,8cyclictest14-21rcu_preempt19:50:292
577455994831,10cyclictest0-21swapper/221:25:302
577455994829,12cyclictest311ktimers/200:10:142
577455994821,19cyclictest32-21ksoftirqd/221:05:012
577455994821,19cyclictest32-21ksoftirqd/221:05:012
577452994835,9cyclictest614490-21latency_hist22:45:011
577452994835,9cyclictest614490-21latency_hist22:45:011
577455994738,6cyclictest604152-21munin-plugin-st21:45:002
577455994733,10cyclictest0-21swapper/220:10:272
577455994732,9cyclictest0-21swapper/223:30:272
577455994727,10cyclictest0-21swapper/200:30:282
577452994734,8cyclictest0-21swapper/120:10:271
577451994742,2cyclictest0-21swapper/023:50:130
577455994638,5cyclictest14-21rcu_preempt19:25:202
577455994631,9cyclictest0-21swapper/222:45:292
577455994628,13cyclictest0-21swapper/221:10:202
57745299463,39cyclictest0-21swapper/122:35:021
57745299463,39cyclictest0-21swapper/122:35:011
577451994631,6cyclictest131ktimers/021:35:280
577451994630,14cyclictest167350irq/118-8000000.ethernet-tx023:25:170
57745199461,39cyclictest601698-21gpg-connect-age21:30:010
57745199461,39cyclictest580324-21wc19:25:010
577455994535,7cyclictest590462-21munin-plugin-st20:25:002
577455994535,7cyclictest590462-21munin-plugin-st20:25:002
57745599451,21cyclictest0-21swapper/223:20:012
577452994536,5cyclictest14-21rcu_preempt22:25:291
577451994537,6cyclictest617931-21munin-plugin-st23:05:000
57745199452,7cyclictest591943-21/usr/sbin/munin20:30:260
577455994431,9cyclictest0-21swapper/219:40:282
577455994431,9cyclictest0-21swapper/219:40:282
577455994430,10cyclictest0-21swapper/222:45:012
577455994430,10cyclictest0-21swapper/222:45:012
57745299443,5cyclictest633220-21apt-get00:35:021
57745199445,8cyclictest577446-21cyclictest22:50:010
577451994435,5cyclictest131ktimers/021:15:320
577451994432,7cyclictest0-21swapper/022:50:270
577451994431,10cyclictest20850irq/208-8000000.ethernet20:15:270
57745199441,37cyclictest619851-21latency_hist23:15:020
577455994331,8cyclictest0-21swapper/221:35:292
577455994330,9cyclictest0-21swapper/222:00:292
577455994322,10cyclictest311ktimers/219:30:152
577452994332,6cyclictest0-21swapper/100:00:281
577452994332,6cyclictest0-21swapper/100:00:281
577452994328,10cyclictest0-21swapper/120:25:201
577452994325,11cyclictest0-21swapper/122:15:001
577451994333,6cyclictest0-21swapper/019:10:270
57745199432,5cyclictest627768-21/usr/sbin/munin00:00:230
57745199432,5cyclictest627768-21/usr/sbin/munin00:00:220
577451994325,16cyclictest0-21swapper/020:20:190
577451994325,16cyclictest0-21swapper/020:20:190
57745199432,4cyclictest593269-21diskstats20:40:180
57745199432,38cyclictest620811-21/usr/sbin/munin23:20:170
57745199432,38cyclictest620811-21/usr/sbin/munin23:20:160
57745199431,36cyclictest0-21swapper/019:40:010
577455994223,10cyclictest0-21swapper/220:05:292
577452994234,4cyclictest274-21systemd-journal22:20:001
577452994232,6cyclictest605742-21unixbench_multi21:50:271
577452994232,6cyclictest0-21swapper/120:55:001
577451994235,4cyclictest167350irq/118-8000000.ethernet-tx020:50:260
577451994233,6cyclictest20850irq/208-8000000.ethernet23:20:000
577451994233,3cyclictest598267-21latency_hist21:10:010
577451994228,10cyclictest0-21swapper/022:05:180
577455994134,4cyclictest582844-21cat19:39:592
577455994132,5cyclictest0-21swapper/223:30:002
577455994130,7cyclictest0-21swapper/221:05:282
577455994129,8cyclictest0-21swapper/220:50:012
577455994129,8cyclictest0-21swapper/220:50:012
577455994125,8cyclictest0-21swapper/200:00:282
577455994125,8cyclictest0-21swapper/200:00:282
577452994126,8cyclictest0-21swapper/119:09:591
57745299411,2cyclictest0-21swapper/123:40:011
57745199415,11cyclictest15-21rcuc/000:10:000
577451994132,6cyclictest0-21swapper/022:24:590
57745199411,4cyclictest606101-21diskstats21:55:160
57745199411,37cyclictest0-21swapper/019:30:180
57745199411,2cyclictest0-21swapper/022:20:010
57745199411,13cyclictest0-21swapper/023:00:010
577455994028,8cyclictest0-21swapper/222:30:292
577455994028,8cyclictest0-21swapper/222:30:292
577455994027,9cyclictest0-21swapper/223:20:282
577455994027,9cyclictest0-21swapper/223:20:282
577455994026,8cyclictest0-21swapper/222:10:292
577455994025,9cyclictest0-21swapper/222:05:252
577455994024,9cyclictest0-21swapper/223:40:282
57745299407,29cyclictest24-21ksoftirqd/123:45:011
577452994033,4cyclictest630681-21sendmail00:20:001
577452994029,7cyclictest0-21swapper/119:15:011
577451994035,2cyclictest0-21swapper/021:00:210
577451994035,2cyclictest0-21swapper/021:00:210
577451994034,3cyclictest167350irq/118-8000000.ethernet-tx020:05:130
577451994033,4cyclictest167350irq/118-8000000.ethernet-tx023:30:170
57745199401,5cyclictest601871-21df21:30:160
57745199401,4cyclictest633774-21irqstats00:35:230
57745199401,4cyclictest603772-21irqstats21:40:230
57745199401,37cyclictest618337-21if_err_eth023:05:220
57745199401,37cyclictest618337-21if_err_eth023:05:220
57745199401,2cyclictest0-21swapper/020:35:200
577455993933,3cyclictest623915-21sh23:40:012
577455993932,4cyclictest599829-21sendmail21:20:002
577455993927,8cyclictest0-21swapper/219:15:012
577455993926,8cyclictest0-21swapper/220:35:302
577455993925,9cyclictest0-21swapper/221:50:282
577455993925,10cyclictest0-21swapper/221:45:292
577455993925,10cyclictest0-21swapper/221:45:292
57745599391,2cyclictest0-21swapper/223:10:022
577452993930,4cyclictest0-21swapper/121:10:221
577452993927,7cyclictest596386-21grep20:55:291
57745299392,20cyclictest0-21swapper/121:20:021
57745299391,28cyclictest584519-21kworker/u8:0+rpciod19:52:211
57745199391,4cyclictest0-21swapper/019:25:180
57745199391,3cyclictest599100-21sed21:15:010
57745199391,36cyclictest0-21swapper/020:45:260
57745199391,36cyclictest0-21swapper/020:45:260
57745199391,35cyclictest612087-21/usr/sbin/munin22:30:160
57745199391,35cyclictest612087-21/usr/sbin/munin22:30:160
577455993830,5cyclictest584472-21grep19:45:282
577455993827,7cyclictest0-21swapper/223:45:292
57745299384,21cyclictest583062-21/usr/sbin/munin19:40:191
57745299384,21cyclictest583062-21/usr/sbin/munin19:40:191
577452993826,8cyclictest0-21swapper/100:20:271
577452993825,8cyclictest0-21swapper/120:20:281
577452993825,8cyclictest0-21swapper/120:20:281
577452993811,5cyclictest0-21swapper/123:20:011
577451993833,3cyclictest167350irq/118-8000000.ethernet-tx023:55:140
57745199383,2cyclictest0-21swapper/019:55:010
57745199381,4cyclictest588415-21meminfo20:10:230
57745199381,3cyclictest623730-21/usr/sbin/munin23:35:280
57745199381,35cyclictest0-21swapper/023:45:270
57745199381,35cyclictest0-21swapper/020:02:050
577455993725,8cyclictest0-21swapper/219:15:272
577455993724,8cyclictest0-21swapper/221:20:292
577455993720,8cyclictest0-21swapper/222:35:292
57745299374,10cyclictest0-21swapper/123:05:011
577452993727,7cyclictest610893-21grep22:20:281
577452993726,8cyclictest0-21swapper/122:35:291
57745299371,29cyclictest581363-21/usr/sbin/munin19:30:251
577451993731,4cyclictest0-21swapper/023:44:060
577451993730,4cyclictest629727-21grep00:10:280
57745199371,4cyclictest0-21swapper/019:41:290
57745199371,4cyclictest0-21swapper/019:41:290
57745199371,3cyclictest0-21swapper/000:25:250
57745199371,34cyclictest0-21swapper/022:40:140
57745199371,34cyclictest0-21swapper/022:40:140
57745199371,34cyclictest0-21swapper/021:50:120
57745199371,34cyclictest0-21swapper/000:20:130
577455993627,5cyclictest0-21swapper/219:55:172
577455993626,5cyclictest0-21swapper/223:55:222
577455993625,4cyclictest14-21rcu_preempt23:00:292
577455993623,6cyclictest0-21swapper/221:30:192
577452993627,5cyclictest0-21swapper/123:45:301
577452993626,6cyclictest0-21swapper/119:20:271
577452993619,9cyclictest0-21swapper/120:45:221
577452993619,9cyclictest0-21swapper/120:45:221
57745299361,4cyclictest0-21swapper/121:40:011
57745299361,29cyclictest0-21swapper/119:15:221
577451993624,7cyclictest0-21swapper/022:00:290
577451993621,12cyclictest19750irq/27-20000000.i2c20:55:180
577452993527,5cyclictest231ktimers/123:55:211
577452993526,5cyclictest632303-21grep00:25:301
577452993511,18cyclictest2-21kthreadd21:18:261
57745199351,4cyclictest0-21swapper/021:20:160
577455993425,5cyclictest0-21swapper/222:15:292
577455993424,7cyclictest0-21swapper/200:15:302
577455993422,7cyclictest0-21swapper/222:20:282
577455993419,11cyclictest0-21swapper/221:55:262
577452993426,5cyclictest622435-21/usr/sbin/munin23:30:141
577452993426,5cyclictest0-21swapper/120:40:001
577452993425,5cyclictest0-21swapper/119:35:261
577452993424,6cyclictest231ktimers/122:50:251
577452993419,10cyclictest0-21swapper/121:50:011
577452993419,10cyclictest0-21swapper/121:50:011
57745299341,4cyclictest0-21swapper/120:00:011
57745299341,2cyclictest0-21swapper/120:35:011
577455993325,4cyclictest14-21rcu_preempt20:30:192
577455993325,4cyclictest0-21swapper/220:25:262
577455993323,7cyclictest0-21swapper/200:35:282
577455993322,7cyclictest0-21swapper/220:55:292
577455993322,6cyclictest0-21swapper/220:00:202
577452993327,4cyclictest14-21rcu_preempt22:55:261
577452993326,3cyclictest14-21rcu_preempt23:50:231
57745299332,4cyclictest606672-21munin-run22:00:001
577452993324,6cyclictest22-21rcuc/119:25:251
577452993324,5cyclictest22-21rcuc/119:45:211
577452993323,7cyclictest231ktimers/122:00:161
577452993320,6cyclictest0-21swapper/123:20:281
577452993320,6cyclictest0-21swapper/123:20:281
577451993327,3cyclictest0-21swapper/022:10:320
577455993224,4cyclictest0-21swapper/222:50:262
577452993225,4cyclictest231ktimers/100:05:011
577452993224,4cyclictest0-21swapper/123:10:271
577451993224,6cyclictest23850irq/422-mmc119:10:000
57745199321,29cyclictest0-21swapper/022:27:190
577455993123,5cyclictest0-21swapper/200:25:222
577452993121,7cyclictest22-21rcuc/121:05:281
577452993120,7cyclictest0-21swapper/123:25:201
577451993126,3cyclictest0-21swapper/019:59:410
57745199311,3cyclictest0-21swapper/021:46:410
57745199311,3cyclictest0-21swapper/021:46:410
577455993021,6cyclictest0-21swapper/222:25:272
577452993021,6cyclictest593723-21unixbench_multi20:40:281
577452993021,6cyclictest22-21rcuc/100:10:181
577452992924,4cyclictest14-21rcu_preempt20:00:201
57745599287,18cyclictest32-21ksoftirqd/219:10:002
577452992820,5cyclictest231ktimers/120:05:221
577452992818,7cyclictest231ktimers/120:15:151
577455992510,13cyclictest167550irq/134-8000000.ethernet-tx200:09:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional