You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 01:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Jul 30, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3667590999860,34cyclictest311ktimers/209:00:582
366758699833,5cyclictest3717026-21sed11:50:310
366758899741,14cyclictest0-21swapper/109:25:011
3667586996934,27cyclictest3703381-21grep10:30:280
366758699672,6cyclictest3668554-21memory07:15:020
366758699663,5cyclictest3708712-21latency_hist11:05:010
366758699663,5cyclictest3683889-21apt-get08:45:020
366758699662,57cyclictest3693590-21fschecks_time09:35:210
366758699662,57cyclictest3693590-21fschecks_time09:35:210
3667586996617,19cyclictest3669517-21latency_hist07:20:010
366758899651,43cyclictest0-21swapper/111:00:011
366758899651,43cyclictest0-21swapper/111:00:011
366758899641,59cyclictest0-21swapper/107:25:011
3667590996313,15cyclictest3712134-21/usr/sbin/munin11:25:182
366758699634,5cyclictest0-21swapper/007:55:270
3667586996229,30cyclictest3694861-21grep09:40:280
3667588996139,16cyclictest0-21swapper/110:30:001
366758899613,48cyclictest3696299-21meminfo09:50:251
366758899611,38cyclictest0-21swapper/108:10:011
366758699611,56cyclictest3701711-21unixbench_multi10:20:280
366758699602,3cyclictest3683162-21cat08:40:010
3667586996011,45cyclictest0-21swapper/009:15:010
3667588995936,18cyclictest3683822-21grep08:40:291
3667588995927,22cyclictest3710170-21grep11:10:281
3667586995950,4cyclictest0-21swapper/009:00:090
3667586995930,24cyclictest0-21swapper/011:10:280
3667586995927,25cyclictest23850irq/422-mmc111:45:010
3667586995924,32cyclictest3671633-21if_err_eth107:30:220
366758899582,48cyclictest3715605-21apt-get11:45:131
3667586995831,23cyclictest3670682-21sh07:25:190
3667586995828,26cyclictest0-21swapper/008:20:260
3667586995819,36cyclictest3674560-21grep07:45:290
3667586995819,36cyclictest3674560-21grep07:45:280
3667586995819,35cyclictest0-21swapper/009:05:280
3667588995723,28cyclictest0-21swapper/111:20:271
3667588995718,31cyclictest3705179-21munin-plugin-st10:45:011
366758899571,48cyclictest3680717-21apt-get08:25:141
366758899571,48cyclictest3680717-21apt-get08:25:141
3667586995737,15cyclictest20650irq/252-8000000.ethernet10:05:010
366758699572,48cyclictest0-21swapper/010:25:190
366758699571,2cyclictest0-21swapper/009:25:010
3667588995623,25cyclictest0-21swapper/107:15:011
3667588995622,27cyclictest3677035-21grep08:00:281
3667586995625,25cyclictest0-21swapper/007:20:280
3667588995526,23cyclictest0-21swapper/108:55:291
366758899552,45cyclictest3697786-21apt-get10:00:131
3667588995522,27cyclictest0-21swapper/107:45:201
3667588995522,27cyclictest0-21swapper/107:45:201
3667588995520,28cyclictest0-21swapper/110:15:201
3667588995520,28cyclictest0-21swapper/110:15:191
3667588995520,28cyclictest0-21swapper/108:35:281
366758899551,47cyclictest3685020-21/usr/sbin/munin08:50:301
3667586995541,8cyclictest167350irq/118-8000000.ethernet-tx007:35:220
3667588995419,30cyclictest0-21swapper/110:30:191
3667588995418,30cyclictest0-21swapper/110:50:021
3667588995416,32cyclictest0-21swapper/108:30:281
3667588995416,30cyclictest3697522-21unixbench_singl09:55:291
3667588995415,33cyclictest3671997-21head07:30:281
366758899541,33cyclictest0-21swapper/110:40:011
366758699543,11cyclictest3711008-21grep11:15:280
366758699543,10cyclictest3709287-21tail11:05:310
3667586995430,20cyclictest20650irq/252-8000000.ethernet11:45:140
3667586995422,28cyclictest0-21swapper/010:00:000
3667590995342,6cyclictest3715309-21cron11:45:002
366758899533,38cyclictest3687922-21sshd09:00:581
366758899532,43cyclictest3679084-21diskstats08:15:171
3667588995324,22cyclictest3689790-21grep09:10:301
3667588995324,20cyclictest0-21swapper/111:05:001
366758899532,41cyclictest3684182-21/usr/sbin/munin08:45:201
366758899532,41cyclictest3684182-21/usr/sbin/munin08:45:201
366758899531,43cyclictest3721616-21apt-get12:20:141
3667588995314,31cyclictest0-21swapper/110:05:261
3667586995345,5cyclictest0-21swapper/010:10:130
366758699533,6cyclictest0-21swapper/010:50:230
366758699532,7cyclictest3721389-21cron12:20:000
366758699532,12cyclictest3690821-21grep09:20:010
3667586995315,31cyclictest3685657-21latency_hist08:55:010
366758699531,50cyclictest0-21swapper/011:55:280
3667590995236,11cyclictest0-21swapper/212:15:002
366758899523,38cyclictest3714767-21fschecks_count11:40:201
366758899522,43cyclictest3680399-21unixbench_multi08:20:281
3667588995224,23cyclictest0-21swapper/111:05:311
3667588995215,29cyclictest0-21swapper/109:45:231
366758899521,43cyclictest3712137-21apt-get11:25:141
3667588995211,36cyclictest3672880-21sshd07:38:101
3667586995232,16cyclictest20650irq/252-8000000.ethernet09:45:260
3667586995226,23cyclictest3673114-21/usr/sbin/munin07:40:280
366758899513,40cyclictest3720499-21latency_hist12:15:001
3667588995126,22cyclictest1660-21snmpd09:15:111
366758899511,42cyclictest3676172-21grep07:55:291
3667588995113,28cyclictest0-21swapper/109:05:191
3667588995112,34cyclictest1660-21snmpd09:39:111
3667588995112,34cyclictest1660-21snmpd09:39:101
366758899511,11cyclictest3668875-21/usr/sbin/munin07:15:301
3667586995132,15cyclictest20650irq/252-8000000.ethernet09:30:010
3667586995130,17cyclictest20650irq/252-8000000.ethernet11:20:270
3667586995130,16cyclictest3692761-21sh09:30:220
366758699512,10cyclictest3679129-21grep08:15:190
3667586995120,27cyclictest0-21swapper/011:35:250
3667586995120,27cyclictest0-21swapper/011:35:250
3667586995115,33cyclictest3707183-21dropbear10:55:170
3667586995115,33cyclictest3707183-21dropbear10:55:170
366758699511,46cyclictest3720336-21find12:10:290
366758899503,40cyclictest0-21swapper/107:25:281
366758899503,39cyclictest3716559-21fschecks_count11:50:211
366758899503,34cyclictest3695067-21latency_hist09:45:011
366758899502,41cyclictest3713568-21head11:30:291
366758899502,40cyclictest3706294-21diskstats10:50:201
366758899502,40cyclictest3701321-21grep10:20:201
366758899502,40cyclictest3675407-21users07:50:281
366758899501,9cyclictest3719244-21/usr/sbin/munin12:05:231
366758899501,10cyclictest3718445-21meminfo12:00:261
366758699503,7cyclictest0-21swapper/011:30:290
3667586995035,10cyclictest0-21swapper/012:05:010
366758699502,6cyclictest3696117-21grep09:50:200
366758699501,7cyclictest3675479-21latency_hist07:55:000
366758699501,11cyclictest3722431-21latency_hist12:25:010
3667590994941,5cyclictest30-21rcuc/209:45:002
3667590994937,9cyclictest1283-21cron11:10:002
366758899492,39cyclictest3692700-21sh09:30:211
366758899492,38cyclictest3678625-21find08:10:281
3667588994923,23cyclictest167450irq/126-8000000.ethernet-tx110:10:121
3667588994923,22cyclictest0-21swapper/107:40:261
366758899491,39cyclictest3714468-21sendmail11:40:001
366758899491,39cyclictest3714468-21sendmail11:40:001
366758699493,5cyclictest3678709-21grep08:10:290
3667586994929,17cyclictest0-21swapper/008:25:240
3667586994929,17cyclictest0-21swapper/008:25:230
3667586994924,20cyclictest3700936-21cron10:20:000
3667586994924,20cyclictest3700936-21cron10:20:000
366758699492,10cyclictest3682110-21grep08:30:300
3667586994913,33cyclictest0-21swapper/012:35:270
3667586994910,34cyclictest0-21swapper/010:50:010
3667590994836,8cyclictest3680470-21grep08:20:282
366758899482,7cyclictest3667638-21latency_hist07:10:011
366758899481,40cyclictest3691918-21ssh09:25:201
3667586994830,14cyclictest131ktimers/008:05:280
3667586994830,14cyclictest0-21swapper/012:05:200
366758699482,4cyclictest3723480-21fschecks_time12:30:220
3667590994736,6cyclictest0-21swapper/210:35:282
366758899474,35cyclictest3710556-21tune2fs11:15:191
366758899473,38cyclictest3724214-21/usr/sbin/munin12:35:171
3667588994724,19cyclictest0-21swapper/112:25:261
366758899472,39cyclictest3723729-21/usr/sbin/munin12:30:271
366758899472,36cyclictest3717281-21/usr/sbin/munin11:55:161
366758699479,4cyclictest3699176-21grep10:05:290
366758699473,10cyclictest3712196-21dropbear11:25:160
366758699472,10cyclictest3684517-21tail08:45:290
366758699472,10cyclictest3684517-21tail08:45:290
366759099463,33cyclictest30-21rcuc/209:25:012
366758899463,34cyclictest3720747-21apt-get12:15:051
366758699462,9cyclictest3686451-21grep08:55:300
3667586994628,14cyclictest20650irq/252-8000000.ethernet10:40:160
366758699462,10cyclictest3677078-21sed08:00:290
366758699452,5cyclictest3704208-21grep10:35:280
3667586994525,15cyclictest0-21swapper/012:25:180
3667590994431,7cyclictest0-21swapper/210:00:262
3667590994429,8cyclictest0-21swapper/207:20:272
3667590994232,6cyclictest3683893-21munin-plugin-st08:45:002
3667590994228,9cyclictest3683043-21sendmail08:40:002
3667590994226,9cyclictest0-21swapper/207:30:292
3667590994137,2cyclictest0-21swapper/209:50:192
3667590994127,9cyclictest0-21swapper/210:55:172
3667590994127,9cyclictest0-21swapper/210:55:172
366759099403,21cyclictest32-21ksoftirqd/208:05:192
3667590994031,5cyclictest0-21swapper/208:45:312
3667590994031,5cyclictest0-21swapper/208:45:302
366758699401,6cyclictest3667716-21latency_hist07:10:010
3667590993929,5cyclictest3721343-21grep12:15:282
366759099392,4cyclictest0-21swapper/207:20:002
3667590993924,6cyclictest0-21swapper/212:30:292
3667590993828,5cyclictest0-21swapper/212:20:272
3667590993824,9cyclictest0-21swapper/207:25:252
3667590993822,7cyclictest3692362-21grep09:25:272
3667590993729,4cyclictest0-21swapper/208:10:292
3667590993728,5cyclictest0-21swapper/211:55:212
3667590993724,8cyclictest0-21swapper/212:00:312
3667590993723,8cyclictest0-21swapper/207:10:282
3667590993624,8cyclictest3699151-21grep10:05:292
3667590993624,7cyclictest0-21swapper/209:30:292
3667590993623,9cyclictest0-21swapper/211:15:272
3667590993622,8cyclictest0-21swapper/211:30:282
3667590993525,6cyclictest3694049-21grep09:35:292
3667590993525,6cyclictest3694049-21grep09:35:292
3667590993525,5cyclictest0-21swapper/209:10:012
3667590993523,6cyclictest3701697-21grep10:20:282
3667590993428,3cyclictest3686500-21sh09:00:002
3667590993426,4cyclictest3685662-21munin-plugin-st08:55:002
3667590993426,4cyclictest0-21swapper/210:40:262
3667590993424,6cyclictest3724730-21grep12:35:272
3667590993421,8cyclictest3713901-21fschecks_count11:35:182
3667590993421,8cyclictest3713901-21fschecks_count11:35:182
3667590993325,4cyclictest0-21swapper/212:10:002
3667590993324,5cyclictest0-21swapper/208:15:282
3667590993324,5cyclictest0-21swapper/207:50:192
3667590993323,6cyclictest3697469-21grep09:55:292
3667590993321,8cyclictest0-21swapper/210:50:312
3667590993223,5cyclictest3675636-21/usr/sbin/munin07:55:192
3667590993220,6cyclictest0-21swapper/211:20:172
366759099321,4cyclictest0-21swapper/210:30:262
366759099321,25cyclictest0-21swapper/212:25:252
366759099321,25cyclictest0-21swapper/207:42:492
3667590993123,4cyclictest0-21swapper/210:15:192
3667590993123,4cyclictest0-21swapper/210:15:192
3667590993122,7cyclictest3705998-21sshd10:46:112
3667590993022,4cyclictest3709718-21grep11:10:192
3667590993020,6cyclictest3681311-21grep08:25:272
3667590993020,6cyclictest3681311-21grep08:25:272
366759099301,4cyclictest274-21systemd-journal10:10:112
366759099301,26cyclictest3714439-21kworker/u8:3+rpciod11:48:212
366759099301,24cyclictest0-21swapper/211:00:152
366759099301,23cyclictest36764911/usr/sbin/munin08:00:172
3667590992923,4cyclictest14-21rcu_preempt10:25:252
3667590992922,3cyclictest3674074-21fschecks_count07:45:192
3667590992922,3cyclictest3674074-21fschecks_count07:45:192
3667590992918,7cyclictest0-21swapper/208:30:302
3667590992917,8cyclictest0-21swapper/211:55:012
3667590992814,9cyclictest0-21swapper/209:50:012
3667590992812,9cyclictest3690032-21/usr/sbin/munin09:15:182
3667590992617,5cyclictest0-21swapper/209:10:212
366759099251,22cyclictest0-21swapper/207:37:192
366759099237,6cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional