You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 04:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Thu Jun 18, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
389236099831,3cyclictest0-21swapper/021:35:010
3892361998128,45cyclictest0-21swapper/100:25:011
389236099775,48cyclictest0-21swapper/020:15:020
389236199751,64cyclictest0-21swapper/121:35:021
389236099731,65cyclictest3897406-21processes19:35:270
3892360996933,32cyclictest3907934-21grep20:35:290
389236099692,60cyclictest3921516-21uname21:55:250
389236099681,64cyclictest3924257-21unixbench_singl22:10:300
389236099681,60cyclictest3932771-21unixbench_singl23:00:280
3892361996719,36cyclictest0-21swapper/123:15:211
389236099671,64cyclictest0-21swapper/022:45:250
389236099671,4cyclictest3927296-21irqstats22:30:220
389236099671,3cyclictest3897663-21apt-get19:40:050
389236099661,59cyclictest3920317-21fschecks_time21:50:180
389236699657,13cyclictest3913893-21apt-get21:15:022
389236099652,3cyclictest3893973-21phc2sys19:15:250
3892360996520,41cyclictest3493028-1kworker/0:2H+mmc_complete00:05:010
389236099651,56cyclictest3915118-21diskstats21:20:160
3892361996425,31cyclictest0-21swapper/121:20:281
389236099642,58cyclictest3946407-21/usr/sbin/munin00:20:290
389236099641,61cyclictest3912190-21users21:00:290
3892361996340,17cyclictest3931991-21sendmail23:00:001
3892360996326,33cyclictest3923523-21latency_hist22:10:010
3892360996326,33cyclictest3923523-21latency_hist22:10:000
389236099632,57cyclictest3901697-21phc2sys-jitter20:00:250
389236099631,55cyclictest0-21swapper/021:15:020
389236099631,4cyclictest3938243-21df23:35:160
389236099631,4cyclictest0-21swapper/023:50:120
3892361996225,29cyclictest3920778-21unixbench_singl21:50:261
3892361996219,38cyclictest0-21swapper/119:10:281
3892361996216,38cyclictest0-21swapper/120:10:251
389236099624,5cyclictest3945817-21cat00:20:010
3892360996227,30cyclictest0-21swapper/022:15:200
389236099622,4cyclictest3928037-21diskstats22:35:180
389236099622,4cyclictest3928037-21diskstats22:35:170
389236099621,59cyclictest3922491-21unixbench_multi22:00:260
389236099621,54cyclictest3909877-21/usr/sbin/munin20:50:120
389236099621,4cyclictest3906800-21meminfo20:30:210
389236099621,3cyclictest3947837-21perl00:30:200
389236099621,3cyclictest3947837-21perl00:30:190
3892361996127,26cyclictest0-21swapper/123:00:281
3892361996121,34cyclictest0-21swapper/100:00:311
389236099612,56cyclictest3904469-21unixbench_singl20:15:270
3892360996118,9cyclictest3934951-21ssh23:15:180
389236099611,58cyclictest0-21swapper/019:30:150
389236099611,58cyclictest0-21swapper/019:30:150
389236099611,57cyclictest3929384-21unixbench_singl22:40:290
3892361996018,35cyclictest0-21swapper/119:30:271
3892361996018,35cyclictest0-21swapper/119:30:271
389236099606,51cyclictest0-21swapper/023:15:000
3892360996031,25cyclictest3933681-21munin-plugin-st23:10:010
389236099602,4cyclictest3930570-21df_inode22:50:170
3892360996023,32cyclictest0-21swapper/021:45:180
389236099601,56cyclictest3893087-21unixbench_singl19:10:290
3892361995923,28cyclictest0-21swapper/120:40:321
389236099591,56cyclictest3900794-21memory19:55:250
3892361995815,35cyclictest0-21swapper/120:25:281
3892361995814,34cyclictest0-21swapper/122:45:281
3892361995813,38cyclictest1660-21snmpd22:19:171
389236099584,14cyclictest3926768-21grep22:25:280
389236099582,52cyclictest0-21swapper/020:25:260
389236099582,3cyclictest3947082-21irqstats00:25:230
3892360995816,7cyclictest0-21swapper/023:45:190
3892360995816,7cyclictest0-21swapper/023:45:190
389236099581,4cyclictest3908501-21memory20:40:270
389236099581,3cyclictest3943450-21sh00:05:220
389236099581,3cyclictest3943450-21sh00:05:220
389236099581,3cyclictest3939046-21apt-get23:40:150
389236099581,3cyclictest3914444-21irqstats21:15:220
389236099581,3cyclictest3894682-21perl19:20:220
3892361995718,31cyclictest0-21swapper/100:15:301
389236199571,4cyclictest0-21swapper/100:35:021
389236199571,4cyclictest0-21swapper/100:35:011
3892361995714,35cyclictest0-21swapper/121:55:261
389236099571,7cyclictest3944514-21phc2sys00:10:250
389236099571,5cyclictest3904888-21df_inode20:20:180
389236099571,53cyclictest0-21swapper/019:50:290
389236099571,3cyclictest3911017-21meminfo20:55:240
389236099571,3cyclictest3911017-21meminfo20:55:240
389236099571,2cyclictest3931343-21apt-get22:55:130
3892361995621,26cyclictest0-21swapper/123:30:271
389236199561,9cyclictest3910602-21latency_hist20:55:011
3892361995613,36cyclictest167450irq/126-8000000.ethernet-tx120:15:261
389236199561,10cyclictest3940309-21/usr/sbin/munin23:45:261
389236199561,10cyclictest3940309-21/usr/sbin/munin23:45:251
389236099562,51cyclictest3919027-21unixbench_singl21:40:290
389236699557,25cyclictest30-21rcuc/223:25:022
389236199557,39cyclictest0-21swapper/123:35:281
3892361995520,28cyclictest0-21swapper/119:50:291
3892361995520,27cyclictest0-21swapper/123:54:591
3892361995512,36cyclictest3913967-21apt-key21:15:001
3892361995512,34cyclictest0-21swapper/119:35:211
389236099552,4cyclictest3949068-21grep00:35:260
3892360995522,30cyclictest3916047-21sh21:25:190
389236099551,4cyclictest3902257-21df_inode20:05:170
389236099551,4cyclictest3899074-21irqstats19:45:230
389236099551,4cyclictest3899074-21irqstats19:45:220
389236099551,3cyclictest3937609-21irqstats23:30:230
389236099551,3cyclictest3917863-21meminfo21:35:240
389236099551,3cyclictest0-21swapper/023:25:120
389236199542,15cyclictest3941563-21apt-get23:55:161
3892361995419,27cyclictest0-21swapper/120:00:291
3892361995416,29cyclictest0-21swapper/122:30:271
3892361995415,32cyclictest0-21swapper/122:10:281
3892361995413,32cyclictest0-21swapper/119:15:191
3892360995426,25cyclictest20850irq/208-8000000.ethernet20:45:180
389236099541,4cyclictest3895648-21memory19:25:240
3892361995330,19cyclictest3925993-21cron22:25:011
389236199532,15cyclictest3912418-21apt-get21:05:141
389236199532,10cyclictest3934603-21cmp23:15:001
3892361995318,28cyclictest0-21swapper/121:25:201
3892361995316,29cyclictest3926835-21munin-plugin-st22:29:591
3892366995238,10cyclictest1283-21cron22:25:002
3892361995221,25cyclictest0-21swapper/123:05:281
3892361995218,28cyclictest0-21swapper/122:00:181
3892361995218,27cyclictest0-21swapper/120:45:181
389236199521,6cyclictest3898382-21/usr/sbin/munin19:40:271
3892361995213,31cyclictest0-21swapper/121:35:011
389236699515,21cyclictest30-21rcuc/220:20:012
389236199517,34cyclictest0-21swapper/123:20:201
389236199516,36cyclictest0-21swapper/120:20:271
389236199515,37cyclictest0-21swapper/122:35:261
389236199515,37cyclictest0-21swapper/122:35:251
3892361995115,27cyclictest0-21swapper/119:25:271
389236099511,48cyclictest0-21swapper/022:20:190
389236199502,11cyclictest3936508-21/usr/sbin/munin23:25:291
3892361995020,22cyclictest0-21swapper/100:10:281
3892361995017,27cyclictest3911321-21grep20:55:281
3892361995017,27cyclictest3911321-21grep20:55:281
3892361995017,26cyclictest1660-21snmpd20:35:291
389236199501,10cyclictest3923502-21wc22:10:011
389236199501,10cyclictest3923502-21wc22:10:011
3892361995010,31cyclictest0-21swapper/121:00:171
389236099501,47cyclictest0-21swapper/021:05:180
389236699491,22cyclictest30-21rcuc/200:05:022
3892361994927,18cyclictest1653-21lldpd00:05:051
3892361994927,18cyclictest1653-21lldpd00:05:051
3892361994917,28cyclictest0-21swapper/100:35:271
3892361994911,31cyclictest0-21swapper/119:55:201
389236099492,26cyclictest3936304-21cron23:25:000
3892366994840,4cyclictest3895143-21apt19:25:012
389236199486,35cyclictest0-21swapper/121:15:291
3892361994817,23cyclictest3898992-21/usr/sbin/munin19:45:191
3892361994817,23cyclictest3898992-21/usr/sbin/munin19:45:191
3892361994812,28cyclictest0-21swapper/122:50:161
3892361994811,29cyclictest0-21swapper/120:05:161
3892366994736,6cyclictest0-21swapper/219:50:212
389236199474,5cyclictest0-21swapper/121:40:281
3892361994722,20cyclictest0-21swapper/120:30:261
389236199471,10cyclictest3894858-21/usr/sbin/munin19:20:281
389236099471,44cyclictest0-21swapper/023:55:110
3892366994636,6cyclictest3927888-21grep22:35:022
389236199463,6cyclictest3939658-21/usr/sbin/munin23:40:281
3892366994529,11cyclictest311ktimers/219:55:132
389236199454,5cyclictest0-21swapper/121:45:241
3892361994512,25cyclictest0-21swapper/100:25:181
389236099458,8cyclictest3892364-21latency_hist19:10:010
3892366994433,7cyclictest0-21swapper/223:44:592
3892366994337,3cyclictest3931984-21sendmail22:59:592
3892366994234,5cyclictest3925035-21unixbench_multi22:15:272
3892366994232,5cyclictest0-21swapper/223:15:012
3892366994227,9cyclictest0-21swapper/200:25:012
389236199421,6cyclictest3929374-21unixbench_multi22:40:301
3892366994128,8cyclictest3929373-21grep22:40:302
389236699409,27cyclictest30-21rcuc/221:10:012
3892366994030,5cyclictest0-21swapper/222:50:282
3892366994026,12cyclictest3894291-21cat19:20:012
3892366994022,12cyclictest311ktimers/200:35:122
3892366994021,15cyclictest311ktimers/200:10:102
3892366994021,12cyclictest311ktimers/220:00:112
3892366993930,5cyclictest0-21swapper/221:55:282
3892366993924,9cyclictest0-21swapper/223:55:292
3892366993826,5cyclictest0-21swapper/221:20:192
3892366993824,9cyclictest0-21swapper/221:25:202
3892366993819,10cyclictest0-21swapper/219:10:022
3892366993816,14cyclictest311ktimers/221:15:112
3892366993727,5cyclictest0-21swapper/220:25:282
3892366993726,7cyclictest3919892-21grep21:45:272
3892366993726,7cyclictest0-21swapper/200:05:312
3892366993726,7cyclictest0-21swapper/200:05:312
3892366993726,5cyclictest0-21swapper/223:00:272
389236699371,6cyclictest0-21swapper/200:35:012
389236699371,6cyclictest0-21swapper/200:35:012
3892366993626,5cyclictest0-21swapper/221:30:272
3892366993625,7cyclictest0-21swapper/222:45:282
3892366993622,10cyclictest311ktimers/219:10:122
389236699361,29cyclictest0-21swapper/220:35:182
389236699352,27cyclictest3939882-21/usr/sbin/munin23:45:252
389236699352,27cyclictest3939882-21/usr/sbin/munin23:45:242
3892366993519,11cyclictest311ktimers/223:35:112
3892366993516,15cyclictest311ktimers/221:50:102
3892366993425,5cyclictest0-21swapper/223:15:292
3892366993424,5cyclictest0-21swapper/219:30:262
3892366993424,5cyclictest0-21swapper/219:30:262
389236699342,3cyclictest0-21swapper/220:10:002
3892366993422,7cyclictest0-21swapper/219:25:202
389236699342,26cyclictest0-21swapper/220:10:182
3892366993419,7cyclictest0-21swapper/220:30:242
3892366993419,11cyclictest0-21swapper/219:40:012
389236199341,10cyclictest3892486-21latency_hist19:10:011
389236699329,4cyclictest8321systemd-network22:05:222
389236699329,4cyclictest8321systemd-network22:05:222
389236699328,5cyclictest8321systemd-network20:23:552
3892366993224,5cyclictest30-21rcuc/223:20:272
3892366993223,6cyclictest3928496-21grep22:35:292
3892366993223,6cyclictest3928496-21grep22:35:292
3892366993123,4cyclictest3933637-21grep23:05:302
3892366993122,6cyclictest3911575-21/usr/sbin/munin21:00:212
3892366993121,6cyclictest0-21swapper/221:40:192
3892366993119,6cyclictest30-21rcuc/223:55:012
389236699311,24cyclictest0-21swapper/222:00:102
3892366993026,2cyclictest0-21swapper/222:25:172
3892366993023,5cyclictest3909035-21/usr/sbin/munin20:45:282
3892366993022,4cyclictest3937906-21grep23:30:282
3892366992921,4cyclictest0-21swapper/219:45:192
3892366992921,4cyclictest0-21swapper/219:45:192
3892366992918,8cyclictest0-21swapper/220:55:182
3892366992918,8cyclictest0-21swapper/220:55:182
389236699290,27cyclictest30-21rcuc/200:15:252
3892366992822,3cyclictest0-21swapper/200:25:252
3892366992820,5cyclictest0-21swapper/222:10:292
3892366992818,7cyclictest3910402-21grep20:50:282
3892366992813,13cyclictest311ktimers/220:40:152
3892366992620,3cyclictest3917762-21sh21:35:202
389236699261,23cyclictest0-21swapper/219:40:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional