You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 04:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon May 25, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3681459998312,15cyclictest3730926-21/usr/sbin/munin23:55:172
3681455997618,14cyclictest3721928-21mailstats23:00:280
3681455997618,14cyclictest3721928-21mailstats23:00:280
3681455997243,24cyclictest20650irq/252-8000000.ethernet21:45:160
3681455997243,24cyclictest20650irq/252-8000000.ethernet21:45:160
368145899711,58cyclictest0-21swapper/120:40:111
368145899701,60cyclictest0-21swapper/119:35:141
3681459996856,9cyclictest311ktimers/221:40:002
368145899681,54cyclictest0-21swapper/100:05:151
368145899671,51cyclictest0-21swapper/121:25:111
368145599673,23cyclictest3710299-21fschecks_time21:55:210
368145599672,62cyclictest3712731-21/usr/sbin/munin22:10:180
368145599671,61cyclictest0-21swapper/019:45:010
368145899661,60cyclictest0-21swapper/120:10:021
368145899661,60cyclictest0-21swapper/120:10:011
368145599664,34cyclictest3685864-21head19:30:280
368145899651,52cyclictest0-21swapper/123:50:111
368145599651,59cyclictest3725855-21/usr/sbin/munin23:25:180
368145599651,2cyclictest0-21swapper/000:15:140
3681458996424,33cyclictest0-21swapper/121:20:281
368145899641,57cyclictest0-21swapper/123:35:001
368145899641,57cyclictest0-21swapper/123:35:001
368145899641,54cyclictest0-21swapper/100:25:121
368145899641,49cyclictest0-21swapper/121:15:151
368145599646,28cyclictest0-21swapper/020:10:010
368145599646,28cyclictest0-21swapper/020:10:010
368145599642,33cyclictest3718215-21/usr/sbin/munin22:40:240
368145599641,60cyclictest3693218-21diskstats20:15:190
368145899631,47cyclictest0-21swapper/121:50:121
3681458996231,26cyclictest0-21swapper/100:00:011
3681458996218,37cyclictest0-21swapper/119:40:271
368145899621,50cyclictest0-21swapper/120:15:131
368145899621,49cyclictest0-21swapper/119:25:151
368145599621,2cyclictest0-21swapper/021:50:140
368145599621,2cyclictest0-21swapper/021:20:110
368145599621,26cyclictest3711904-21/usr/sbin/munin22:05:190
368145899611,52cyclictest0-21swapper/123:05:131
368145899611,52cyclictest0-21swapper/119:50:131
3681458996041,15cyclictest3701398-21munin-plugin-st21:05:011
368145899601,52cyclictest0-21swapper/119:45:111
3681455996023,33cyclictest0-21swapper/023:50:010
368145599601,56cyclictest3686769-21munin-run19:40:000
368145599601,53cyclictest3711052-21diskstats22:00:170
368145599601,51cyclictest0-21swapper/020:20:110
368145599601,2cyclictest0-21swapper/020:00:100
368145899591,51cyclictest0-21swapper/120:20:131
368145899591,36cyclictest0-21swapper/122:00:011
3681455995933,23cyclictest3685066-21sshd19:26:560
3681455995933,21cyclictest0-21swapper/020:45:290
3681455995916,35cyclictest0-21swapper/000:20:050
368145599591,2cyclictest0-21swapper/021:15:120
368145599591,2cyclictest0-21swapper/020:40:140
368145899586,43cyclictest3735629-21grep00:20:271
3681458995827,27cyclictest0-21swapper/122:05:291
368145899581,50cyclictest0-21swapper/119:10:131
368145899581,49cyclictest0-21swapper/123:45:141
368145599584,50cyclictest3738386-21grep00:35:300
368145599583,51cyclictest3720758-21lsblk22:55:180
3681455995822,31cyclictest20650irq/252-8000000.ethernet19:50:020
368145599581,2cyclictest0-21swapper/022:25:120
3681458995731,21cyclictest0-21swapper/120:55:011
3681458995730,21cyclictest0-21swapper/122:35:211
368145899572,46cyclictest3682948-21/usr/sbin/munin19:15:211
3681458995716,33cyclictest0-21swapper/122:15:291
368145599571,2cyclictest0-21swapper/023:40:140
368145599571,2cyclictest0-21swapper/020:25:120
368145599571,2cyclictest0-21swapper/019:15:120
3681459995635,14cyclictest311ktimers/222:40:092
368145899566,42cyclictest0-21swapper/122:10:281
3681458995646,7cyclictest3718661-21latency_hist22:45:011
368145899562,45cyclictest3689686-21cut19:55:201
3681458995620,31cyclictest0-21swapper/120:30:001
3681455995637,16cyclictest0-21swapper/021:30:190
368145599562,50cyclictest3697228-21latency_hist20:40:000
368145599562,45cyclictest3734268-21latency_hist00:15:020
368145599562,45cyclictest3734268-21latency_hist00:15:020
368145599561,2cyclictest0-21swapper/022:30:130
3681458995534,17cyclictest0-21swapper/121:10:191
368145899552,45cyclictest3702346-21grep21:10:001
3681458995522,27cyclictest0-21swapper/121:45:011
3681458995519,29cyclictest0-21swapper/123:25:281
368145899551,47cyclictest0-21swapper/120:55:111
3681458995513,34cyclictest167450irq/126-8000000.ethernet-tx122:25:281
3681455995519,32cyclictest0-21swapper/000:30:280
368145599551,46cyclictest3706741-21/usr/sbin/munin21:35:110
368145599551,2cyclictest0-21swapper/023:55:140
368145599551,2cyclictest0-21swapper/022:35:150
368145999546,31cyclictest311ktimers/223:50:022
3681458995419,26cyclictest0-21swapper/123:00:281
3681458995419,26cyclictest0-21swapper/123:00:271
368145899541,46cyclictest0-21swapper/122:30:151
368145599542,49cyclictest3726723-21sh23:30:210
368145599542,49cyclictest3726723-21sh23:30:200
368145599541,49cyclictest3713921-21/usr/sbin/munin22:15:260
368145599541,2cyclictest0-21swapper/021:05:160
368145599541,28cyclictest3705483-21ptp4l-jitter21:25:260
368145899532,43cyclictest3720719-21/usr/sbin/munin22:55:181
368145899532,43cyclictest3719154-21/usr/sbin/munin22:45:251
368145899532,43cyclictest3708557-21grep21:45:181
368145899532,43cyclictest3708557-21grep21:45:171
3681458995323,26cyclictest0-21swapper/122:55:011
368145899531,44cyclictest3696777-21/usr/sbin/munin20:35:231
368145599532,20cyclictest3689215-21mailstats19:50:290
368145599531,50cyclictest0-21swapper/019:25:010
3681459995242,7cyclictest3715089-21munin-plugin-st22:25:002
368145899523,41cyclictest3724289-21/usr/sbin/munin23:15:221
368145899523,39cyclictest3723333-21fschecks_count23:10:191
368145899522,42cyclictest3737001-21dropbear00:30:171
368145899522,41cyclictest3727726-21/usr/sbin/munin23:35:251
3681458995223,22cyclictest0-21swapper/122:00:271
368145899521,42cyclictest3706950-21/usr/sbin/munin21:35:231
368145899521,42cyclictest3695941-21/usr/sbin/munin20:30:221
368145899521,42cyclictest3695941-21/usr/sbin/munin20:30:221
368145899521,41cyclictest0-21swapper/123:40:131
3681458995211,34cyclictest3690666-21fschecks_count20:00:181
3681455995230,19cyclictest20850irq/208-8000000.ethernet22:20:260
3681455995227,20cyclictest0-21swapper/000:25:180
368145599521,44cyclictest0-21swapper/021:05:020
368145599521,2cyclictest0-21swapper/023:20:120
368145599521,25cyclictest3690201-21awk19:55:290
368145899514,41cyclictest0-21swapper/100:35:311
3681458995117,29cyclictest0-21swapper/119:30:211
368145899511,41cyclictest3734389-21/usr/sbin/munin00:15:191
3681458995112,31cyclictest0-21swapper/122:20:271
368145599512,26cyclictest3682447-21users19:15:020
3681455995122,24cyclictest0-21swapper/023:35:230
3681455995120,26cyclictest0-21swapper/020:50:200
368145599511,2cyclictest0-21swapper/000:00:130
3681459995033,14cyclictest311ktimers/221:10:162
3681459995030,14cyclictest311ktimers/220:10:112
3681459995024,18cyclictest311ktimers/222:35:122
368145899502,41cyclictest3725059-21fschecks_count23:20:191
368145899501,42cyclictest3733463-21/usr/sbin/munin00:10:241
368145899501,42cyclictest3733463-21/usr/sbin/munin00:10:241
368145899501,41cyclictest3705959-21/usr/sbin/munin21:30:171
368145899501,41cyclictest3692294-21/usr/sbin/munin20:10:191
368145599502,43cyclictest3720191-21/usr/sbin/munin22:50:300
368145599501,47cyclictest3730219-21/usr/sbin/munin23:50:200
368145599501,2cyclictest0-21swapper/023:05:130
368145599501,26cyclictest3708048-21wc21:40:270
368145599501,23cyclictest3718844-21apt-get22:45:160
3681459994914,30cyclictest311ktimers/219:40:002
368145899492,40cyclictest3698781-21tail20:45:301
368145899491,39cyclictest0-21swapper/100:00:131
368145599494,40cyclictest3700019-21fschecks_count20:55:200
3681455994918,26cyclictest0-21swapper/020:15:010
368145599491,46cyclictest3724224-21sh23:15:200
3681455994912,33cyclictest0-21swapper/023:10:280
3681459994828,13cyclictest311ktimers/223:35:152
3681459994825,15cyclictest311ktimers/220:05:162
3681459994825,15cyclictest311ktimers/220:05:162
3681459994824,13cyclictest311ktimers/219:30:142
3681459994823,12cyclictest311ktimers/220:30:122
3681459994823,12cyclictest311ktimers/220:30:122
368145599481,43cyclictest3732980-21/usr/sbin/munin00:05:300
3681459994740,4cyclictest3716019-21munin-plugin-st22:30:002
368145899472,39cyclictest3684030-21/usr/sbin/munin19:20:261
368145599472,40cyclictest274-21systemd-journal21:10:200
368145599461,42cyclictest3695902-21/usr/sbin/munin20:30:230
368145599461,42cyclictest3695902-21/usr/sbin/munin20:30:220
3681459994532,8cyclictest0-21swapper/222:55:272
3681459994532,8cyclictest0-21swapper/220:25:272
3681459994527,12cyclictest311ktimers/222:45:112
3681459994526,11cyclictest311ktimers/222:00:122
3681459994525,13cyclictest311ktimers/222:10:152
368145599454,32cyclictest3681467-21latency_hist19:10:010
3681459994429,11cyclictest0-21swapper/221:20:292
368145999435,15cyclictest30-21rcuc/223:15:012
3681459994330,8cyclictest0-21swapper/221:30:292
368145999428,15cyclictest14-21rcu_preempt21:45:012
368145999428,15cyclictest14-21rcu_preempt21:45:012
3681459994231,7cyclictest0-21swapper/200:25:262
3681459994128,9cyclictest0-21swapper/222:15:292
3681459994126,7cyclictest0-21swapper/219:10:292
3681459994126,11cyclictest311ktimers/223:25:112
3681459994124,9cyclictest0-21swapper/222:50:302
3681459994124,10cyclictest311ktimers/219:40:112
3681459994027,8cyclictest14-21rcu_preempt21:00:282
3681459994027,8cyclictest0-21swapper/221:55:282
3681459994027,8cyclictest0-21swapper/220:35:302
368145899401,33cyclictest3681514-21latency_hist19:10:011
368145999396,9cyclictest3721467-21/usr/sbin/munin23:00:202
368145999396,9cyclictest3721467-21/usr/sbin/munin23:00:202
3681459993930,5cyclictest0-21swapper/221:50:292
3681459993927,8cyclictest0-21swapper/200:20:292
3681459993831,4cyclictest14-21rcu_preempt23:40:212
3681459993828,6cyclictest0-21swapper/200:05:312
3681459993727,7cyclictest51-21kcompactd000:35:312
3681459993726,7cyclictest0-21swapper/223:05:272
3681459993722,9cyclictest0-21swapper/220:45:302
3681459993721,12cyclictest311ktimers/220:50:112
3681459993717,16cyclictest311ktimers/221:40:132
3681459993628,5cyclictest51-21kcompactd022:05:302
3681459993627,6cyclictest0-21swapper/222:30:282
3681459993626,6cyclictest3723820-21grep23:10:272
3681459993626,6cyclictest0-21swapper/200:10:292
3681459993626,6cyclictest0-21swapper/200:10:282
3681459993623,8cyclictest0-21swapper/220:40:292
368145999356,5cyclictest14-21rcu_preempt23:30:132
368145999356,5cyclictest14-21rcu_preempt23:30:132
3681459993522,8cyclictest0-21swapper/219:55:202
368145999351,28cyclictest0-21swapper/200:15:182
3681459993427,4cyclictest0-21swapper/200:00:292
3681459993424,7cyclictest0-21swapper/219:45:272
3681459993418,9cyclictest0-21swapper/221:05:292
368145999341,26cyclictest3684444-21/usr/sbin/munin19:25:252
368145999341,12cyclictest0-21swapper/221:00:012
3681459993325,4cyclictest0-21swapper/220:15:292
368145999324,17cyclictest32-21ksoftirqd/200:30:162
3681459993122,6cyclictest0-21swapper/219:15:292
3681459993121,7cyclictest0-21swapper/221:15:272
368145999306,17cyclictest30-21rcuc/219:20:192
3681459992922,5cyclictest14-21rcu_preempt23:20:182
3681459992918,7cyclictest0-21swapper/219:10:012
3681459992821,5cyclictest14-21rcu_preempt20:00:192
3681459992821,3cyclictest0-21swapper/219:50:212
368145999281,14cyclictest3694004-21/usr/sbin/munin20:20:182
3681459992810,9cyclictest3729158-21/usr/sbin/munin23:45:192
3681459992615,7cyclictest0-21swapper/221:25:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional