You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 23:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Wed Dec 03, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
373661299791,2cyclictest0-21swapper/011:05:000
373661299767,38cyclictest0-21swapper/007:15:010
3736612996830,31cyclictest0-21swapper/011:30:290
373661799643,12cyclictest3761779-21apt-get09:35:012
3736612996331,27cyclictest0-21swapper/010:00:010
3736616996245,12cyclictest231ktimers/109:45:161
373661299625,3cyclictest3745815-21tune2fs08:00:230
373661299621,2cyclictest0-21swapper/010:05:000
373661299612,5cyclictest3752245-21cat08:40:000
3736612996121,33cyclictest24150irq/422-mmc110:55:250
3736612996037,18cyclictest21250irq/208-8000000.ethernet10:25:270
3736612996015,37cyclictest3750789-21/usr/sbin/munin08:30:150
3736617995911,16cyclictest3792908-21/usr/sbin/munin12:35:202
373661299582,49cyclictest0-21swapper/009:50:230
373661299582,48cyclictest0-21swapper/007:55:260
3736612995817,32cyclictest131ktimers/010:10:280
3736612995817,32cyclictest131ktimers/010:10:280
373661699572,27cyclictest22-21rcuc/109:00:021
3736612995730,24cyclictest21250irq/208-8000000.ethernet09:20:240
3736612995730,24cyclictest21250irq/208-8000000.ethernet09:20:240
3736612995728,26cyclictest21250irq/208-8000000.ethernet11:25:240
3736612995728,25cyclictest21250irq/208-8000000.ethernet12:25:020
373661299562,45cyclictest0-21swapper/012:05:330
3736612995619,33cyclictest3736557-21latency_hist07:10:000
373661299555,12cyclictest3772232-21apt-config10:35:010
3736612995527,24cyclictest21250irq/208-8000000.ethernet10:40:230
3736612995521,25cyclictest0-21swapper/009:20:010
373661299551,2cyclictest0-21swapper/007:30:010
373661299542,10cyclictest3742475-21grep07:40:200
3736612995419,26cyclictest0-21swapper/011:35:160
373661299541,7cyclictest3757114-21ps09:05:260
373661799533,18cyclictest30-21rcuc/210:15:022
373661799533,18cyclictest30-21rcuc/210:15:022
373661299535,2cyclictest0-21swapper/012:00:020
373661299533,43cyclictest3755556-21sed08:55:300
373661299532,4cyclictest3750016-21tune2fs08:25:190
373661299532,12cyclictest0-21swapper/010:10:000
373661299531,5cyclictest3744722-21latency_hist07:55:010
373661299531,4cyclictest0-21swapper/010:40:010
373661299527,37cyclictest3792437-21grep12:30:270
373661299524,6cyclictest3786166-21fschecks_time11:55:210
3736612995222,27cyclictest3790851-21apt-get12:25:050
373661299521,44cyclictest0-21swapper/011:45:010
373661299512,38cyclictest0-21swapper/012:10:220
373661299511,9cyclictest3737929-21munin-node07:15:060
373661299511,12cyclictest3774376-21meminfo10:45:250
373661299505,39cyclictest0-21swapper/011:05:280
3736612995028,19cyclictest21250irq/208-8000000.ethernet11:45:190
3736612995027,19cyclictest0-21swapper/008:20:000
373661299501,8cyclictest3775170-21/usr/sbin/munin10:50:230
373661299501,8cyclictest3747421-21/usr/sbin/munin08:10:180
373661299501,8cyclictest3747421-21/usr/sbin/munin08:10:180
373661299501,7cyclictest3780474-21/usr/sbin/munin11:20:300
373661299501,7cyclictest3780474-21/usr/sbin/munin11:20:300
373661299501,7cyclictest3741985-21grep07:35:320
373661299501,5cyclictest3739389-21sed07:20:300
373661299501,4cyclictest3754320-21fw_packets08:50:220
373661799491,2cyclictest0-21swapper/211:40:012
3736616994939,6cyclictest3780570-21grep11:20:311
3736616994939,6cyclictest3780570-21grep11:20:311
3736616994931,12cyclictest0-21swapper/111:40:271
373661299498,37cyclictest0-21swapper/009:30:260
373661299491,46cyclictest0-21swapper/009:35:230
373661299491,40cyclictest3741414-21latency_hist07:35:020
3736617994836,7cyclictest3787433-21grep12:00:282
3736616994828,16cyclictest231ktimers/112:05:201
373661299483,3cyclictest3760475-21/usr/sbin/munin09:25:220
373661299482,8cyclictest3749633-21head08:20:310
373661299481,8cyclictest3753455-21/usr/sbin/munin08:45:210
373661299481,6cyclictest3752779-21/usr/sbin/munin08:40:250
373661299481,5cyclictest3779295-21fschecks_time11:15:230
3736617994733,8cyclictest3742827-21grep07:40:292
373661799471,39cyclictest0-21swapper/210:40:292
373661699478,12cyclictest24-21ksoftirqd/109:40:011
373661699475,20cyclictest22-21rcuc/109:10:011
373661699475,20cyclictest22-21rcuc/109:10:011
3736616994740,5cyclictest231ktimers/110:35:011
3736616994738,5cyclictest3767769-21grep10:05:291
3736616994734,7cyclictest3776394-21latency_hist11:00:001
3736616994730,11cyclictest0-21swapper/109:25:281
3736616994726,15cyclictest231ktimers/107:40:111
373661299472,5cyclictest3763265-21phc2sys09:40:270
373661299472,4cyclictest3789358-21/usr/sbin/munin12:15:160
373661299471,9cyclictest3743212-21/usr/sbin/munin07:45:180
373661299471,7cyclictest3769436-21tail10:15:270
373661299471,4cyclictest3763885-21cut09:45:200
373661299471,10cyclictest3778880-21unixbench_singl11:10:280
3736617994631,9cyclictest0-21swapper/212:25:012
373661299464,4cyclictest0-21swapper/008:05:200
373661299462,6cyclictest3757586-21apt-get09:10:170
373661299462,6cyclictest3757586-21apt-get09:10:170
373661299461,3cyclictest3793132-21if_err_eth112:35:230
3736617994532,8cyclictest0-21swapper/210:00:302
3736617994530,10cyclictest0-21swapper/211:25:282
3736617994529,10cyclictest0-21swapper/212:05:262
3736617994529,10cyclictest0-21swapper/210:00:012
3736617994528,10cyclictest3786620-21sendmail12:00:012
373661299452,10cyclictest3785326-21tune2fs11:50:210
373661299451,9cyclictest3769876-21/usr/sbin/munin10:20:190
3736617994436,4cyclictest3765243-21munin-plugin-st09:54:592
3736617994435,5cyclictest3777244-21cron11:05:002
3736616994433,5cyclictest3738564-21head07:15:311
3736616994433,4cyclictest168350irq/126-8000000.ethernet-tx110:35:151
3736616994429,9cyclictest0-21swapper/107:45:291
3736616994424,14cyclictest231ktimers/110:40:131
373661299442,4cyclictest3756051-21grep09:00:210
3736617994333,6cyclictest0-21swapper/209:49:592
3736617994330,8cyclictest3756484-21grep09:00:282
3736617994328,9cyclictest0-21swapper/212:10:212
3736617994328,10cyclictest0-21swapper/211:50:212
3736617994310,15cyclictest0-21swapper/208:10:002
3736616994335,5cyclictest3745825-21sshd08:00:241
3736616994331,9cyclictest3781089-21sh11:25:221
3736616994329,9cyclictest14-21rcu_preempt09:35:011
3736617994234,4cyclictest0-21swapper/211:20:002
3736617994230,9cyclictest3745466-21sendmail08:00:002
3736616994234,4cyclictest168350irq/126-8000000.ethernet-tx109:50:211
3736616994231,6cyclictest0-21swapper/107:15:021
3736616994230,7cyclictest0-21swapper/111:30:281
3736616994227,9cyclictest0-21swapper/112:15:291
3736617994131,6cyclictest0-21swapper/211:45:302
3736617994130,7cyclictest3737400-21grep07:10:282
3736617994129,7cyclictest3751299-21grep08:30:292
3736616994129,7cyclictest3758996-21grep09:15:281
3736616994126,9cyclictest0-21swapper/111:15:231
3736616994125,7cyclictest0-21swapper/109:05:281
3736617994030,6cyclictest0-21swapper/209:35:312
3736617994026,10cyclictest0-21swapper/210:15:282
3736616994032,5cyclictest168350irq/126-8000000.ethernet-tx110:10:151
3736616994032,5cyclictest168350irq/126-8000000.ethernet-tx110:10:151
3736616994028,8cyclictest0-21swapper/111:10:271
3736616994025,8cyclictest0-21swapper/111:55:291
3736616994021,11cyclictest0-21swapper/108:10:271
3736616994021,11cyclictest0-21swapper/108:10:271
3736616994018,7cyclictest0-21swapper/108:50:201
3736617993928,6cyclictest0-21swapper/211:20:302
3736617993928,6cyclictest0-21swapper/211:20:302
3736617993927,7cyclictest3775475-21grep10:50:282
3736617993921,10cyclictest0-21swapper/209:20:272
3736617993921,10cyclictest0-21swapper/209:20:272
3736616993930,4cyclictest0-21swapper/108:30:281
3736616993927,6cyclictest0-21swapper/108:20:301
3736616993926,7cyclictest0-21swapper/112:30:261
3736616993924,8cyclictest3766926-21grep10:00:291
3736616993922,11cyclictest0-21swapper/111:00:211
3736617993828,5cyclictest0-21swapper/209:10:182
3736617993828,5cyclictest0-21swapper/209:10:182
3736617993826,7cyclictest3740372-21unixbench_singl07:25:292
373661799382,5cyclictest0-21swapper/210:35:002
373661799381,30cyclictest3778031-21grep11:05:292
3736616993830,5cyclictest22-21rcuc/110:55:011
373661699382,8cyclictest3744240-21irqstats07:50:231
3736616993825,8cyclictest3752117-21grep08:35:291
373661799375,15cyclictest3772373-21/usr/sbin/munin10:35:192
3736617993727,7cyclictest0-21swapper/208:45:012
3736617993724,6cyclictest3776325-21grep10:55:282
3736616993728,5cyclictest168350irq/126-8000000.ethernet-tx112:35:291
3736616993726,5cyclictest0-21swapper/107:30:211
3736616993724,7cyclictest0-21swapper/107:25:221
3736616993722,8cyclictest0-21swapper/110:45:281
373661799361,32cyclictest3741137-21unixbench_multi07:30:292
373661799361,29cyclictest0-21swapper/211:40:192
3736616993629,4cyclictest24-21ksoftirqd/107:10:011
3736616993626,6cyclictest3784729-21tail11:45:271
3736616993616,12cyclictest0-21swapper/110:20:011
373661699361,2cyclictest0-21swapper/108:45:021
3736617993525,6cyclictest0-21swapper/209:40:292
3736617993524,8cyclictest0-21swapper/209:00:012
3736617993520,10cyclictest311ktimers/208:15:122
373661799351,6cyclictest30-21rcuc/210:45:292
3736616993520,12cyclictest231ktimers/109:55:151
3736616993520,11cyclictest0-21swapper/112:10:281
373661699351,7cyclictest3762929-21apt-get09:40:121
373661699351,4cyclictest0-21swapper/111:05:241
3736616993513,15cyclictest3770608-21/usr/sbin/munin10:25:191
373661699351,27cyclictest0-21swapper/112:00:201
3736617993425,5cyclictest0-21swapper/212:19:592
3736617993418,10cyclictest0-21swapper/211:30:262
3736616993424,5cyclictest0-21swapper/108:05:291
3736616993419,8cyclictest0-21swapper/108:25:201
3736616993418,10cyclictest231ktimers/108:45:121
3736616993416,8cyclictest0-21swapper/109:20:261
3736616993416,8cyclictest0-21swapper/109:20:251
3736616993413,15cyclictest231ktimers/107:55:131
3736617993323,6cyclictest0-21swapper/208:50:292
373661799332,27cyclictest3792601-21unixbench_multi12:30:292
373661799331,29cyclictest0-21swapper/210:25:282
3736616993324,6cyclictest3785675-21grep11:50:291
3736616993320,8cyclictest0-21swapper/110:20:281
3736616993317,11cyclictest22-21rcuc/112:20:191
3736617993225,4cyclictest168450irq/134-8000000.ethernet-tx207:50:222
3736617993224,4cyclictest0-21swapper/207:20:212
3736617993221,7cyclictest0-21swapper/211:10:292
373661799321,25cyclictest0-21swapper/207:15:202
373661699321,5cyclictest231ktimers/108:20:001
373661699321,2cyclictest0-21swapper/107:25:021
373661699321,24cyclictest0-21swapper/111:35:161
3736617993125,4cyclictest0-21swapper/212:25:192
3736617993123,4cyclictest0-21swapper/208:10:212
3736617993123,4cyclictest0-21swapper/208:10:212
373661799311,27cyclictest3750188-21cut08:25:242
373661699311,8cyclictest0-21swapper/109:05:011
373661699311,25cyclictest0-21swapper/107:35:141
3736617993021,6cyclictest311ktimers/210:05:252
3736617993021,6cyclictest0-21swapper/207:45:302
3736617992921,4cyclictest0-21swapper/208:45:202
3736617992919,5cyclictest0-21swapper/207:10:012
373661799291,4cyclictest0-21swapper/208:35:242
373661799289,14cyclictest311ktimers/208:20:142
3736617992823,3cyclictest0-21swapper/207:35:202
3736617992818,6cyclictest3760882-21cat09:30:012
3736617992817,6cyclictest0-21swapper/210:20:202
3736616992818,6cyclictest0-21swapper/112:30:011
373661799279,15cyclictest30-21rcuc/208:00:162
3736617992719,4cyclictest0-21swapper/209:05:252
3736617992715,6cyclictest311ktimers/209:15:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional