You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 17:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Thu Mar 19, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35069769920130,2008cyclictest35133122sleep307:14:563
35069769919651,1960cyclictest38748822sleep311:25:023
35069769919651,1960cyclictest38748822sleep311:25:013
35069769915671,1554cyclictest3796843-21sleep10:35:003
3506976993720,369cyclictest3734672-21turbostat09:59:553
3506976992980,294cyclictest3968123-21turbostat12:29:553
3506976992281,224cyclictest3866854-21turbostat11:24:553
3506976992113,6cyclictest3929157-21sleep12:00:003
350697699187,8cyclictest3960276-21turbostat12:20:013
39228352170,8sleep23923966-21cut11:55:172
350697699171,12cyclictest3617310-21taskset08:30:193
350697699171,11cyclictest37659902sleep310:15:113
3506976991613,1cyclictest0-21swapper/312:12:143
3506976991613,1cyclictest0-21swapper/312:05:193
3506976991613,1cyclictest0-21swapper/308:15:153
350697699161,12cyclictest3936902-21taskset12:04:553
350697699161,12cyclictest3541038-21taskset07:34:573
350697699161,11cyclictest3963665-21taskset12:20:163
350697699161,11cyclictest3836579-21taskset11:00:143
350697699161,11cyclictest3670222-21taskset09:10:263
39220742150,11sleep13922834-21sed11:55:161
37745512151,1sleep30-21swapper/310:20:163
350697699155,7cyclictest37574202sleep310:08:293
350697699155,7cyclictest3534513-21taskset07:28:233
3506976991513,0cyclictest0-21swapper/311:35:003
3506976991513,0cyclictest0-21swapper/308:25:473
3506976991512,1cyclictest0-21swapper/309:18:473
3506976991512,1cyclictest0-21swapper/308:44:403
3506976991512,1cyclictest0-21swapper/308:23:573
3506976991512,1cyclictest0-21swapper/307:17:433
350697699151,11cyclictest3897665-21taskset11:39:043
350697699151,11cyclictest3826892-21taskset10:51:533
350697699151,11cyclictest3687909-21taskset09:25:013
350697699151,11cyclictest3553579-21taskset07:40:353
350697699151,10cyclictest3915261-21taskset11:50:163
350697699151,10cyclictest3851570-21taskset11:10:053
350697699151,10cyclictest3849788-21taskset11:05:373
350697699151,10cyclictest3758642-21taskset10:10:133
350697699151,10cyclictest3572821-21taskset07:55:263
350697699150,11cyclictest3788120-21taskset10:27:183
350697699150,11cyclictest3586228-21taskset08:10:023
39527512142,5sleep23952786-21apt-get12:15:112
39075822140,5sleep13909361-21cut11:45:171
36642902141,9sleep03664314-21apt-get09:10:110
350697699144,7cyclictest38049712sleep310:40:103
350697699141,9cyclictest3828239-21taskset10:55:053
350697699141,9cyclictest36958432sleep309:30:113
350697699141,9cyclictest36447732sleep308:55:143
350697699141,9cyclictest3578625-21taskset08:00:193
3506976991411,1cyclictest0-21swapper/312:37:043
3506976991411,1cyclictest0-21swapper/309:42:493
3506976991411,1cyclictest0-21swapper/307:45:313
350697699141,10cyclictest3982146-21taskset12:30:383
350697699141,10cyclictest3865388-21taskset11:15:463
350697699141,10cyclictest3813075-21taskset10:45:143
350697699141,10cyclictest3748350-21taskset10:00:273
350697699141,10cyclictest3733978-21taskset09:53:043
350697699141,10cyclictest3725547-21taskset09:46:143
350697699141,10cyclictest3710523-21taskset09:37:533
350697699141,10cyclictest3687115-21taskset09:23:243
350697699141,10cyclictest3657197-21taskset09:01:103
350697699141,10cyclictest3624519-21taskset08:35:323
350697699141,10cyclictest3585648-21taskset08:05:493
350697699141,10cyclictest3566680-21taskset07:53:453
350697699141,10cyclictest3528127-21taskset07:23:353
350697699140,11cyclictest3913338-21taskset11:49:313
350697699140,11cyclictest3631655-21taskset08:45:033
38429772130,4sleep23842981-21ssh11:03:232
36148032131,5sleep13616816-21kthreadcore08:30:181
36052212131,8sleep13605222-21cron08:25:001
350697699133,7cyclictest35413472sleep307:35:143
350697699133,7cyclictest35413472sleep307:35:143
350697699131,9cyclictest38983182sleep311:40:103
350697699131,9cyclictest3644172-21taskset08:51:083
350697699130,5cyclictest0-21swapper/310:35:163
350697699130,10cyclictest3657757-21taskset09:05:113
39066582121,9sleep00-21swapper/011:45:160
37037332121,8sleep23703737-21ssh09:35:042
36879812121,7sleep13687983-21apt-get09:25:131
38205682112,5sleep03820562-21apt-get10:50:130
37487962111,7sleep13748801-21ssh10:01:051
36190182111,3sleep20-21swapper/208:35:162
39680472100,7sleep23663983-21diskmemload12:24:532
39600312101,2sleep00-21swapper/012:19:250
39372732102,4sleep13937268-21apt-get12:05:111
39361412101,6sleep23936145-21ssh12:02:432
39057522101,5sleep03905805-21munin-run11:45:010
38827382100,2sleep10-21swapper/111:30:091
38127722101,5sleep03812765-21apt-get10:45:120
37665852101,2sleep10-21swapper/110:15:181
37037762101,5sleep13703809-21apt-get09:35:101
36933712101,5sleep03693405-21ntpq09:25:240
36801402101,6sleep03680098-21/usr/sbin/munin09:20:130
36795872100,1sleep20-21swapper/209:19:272
36775632100,6sleep13677606-21ntpq09:15:211
36563922101,5sleep13656532-21ntpq09:00:221
36304482101,5sleep23630489-21ntpq08:40:212
35681842100,7sleep03569330-21cut07:55:160
35288562101,5sleep03528990-21sed07:25:170
35007272101,4sleep00-21swapper/007:05:110
3983962291,4sleep13983959-21apt-get12:35:111
3968441291,4sleep03968435-21apt-get12:25:110
3951346290,6sleep13951352-21ssh12:11:481
3890538291,4sleep13890560-21apt-get11:35:101
3874617291,5sleep13874639-21apt11:25:011
3850361290,6sleep13850367-21ssh11:07:201
3837574291,6sleep03839338-21cut11:00:160
3773233291,6sleep23773237-21ssh10:19:322
3727148290,5sleep13727185-21apt-get09:50:111
3701223290,5sleep13701269-21ntpq09:30:211
3672192291,4sleep03672188-21apt-get09:15:120
3663019291,5sleep10-21swapper/109:05:221
3625596290,6sleep13626376-21sed08:40:161
3586240291,4sleep03586273-21apt-get08:10:130
3546575291,4sleep03546616-21ntpq07:35:230
3546575291,4sleep03546616-21ntpq07:35:230
3522157291,4sleep03522160-21apt-get07:20:110
3502645291,5sleep23504585-21tr07:05:172
3976189281,2sleep20-21swapper/212:30:102
3974963280,5sleep23974969-21ssh12:27:252
3974575280,5sleep13974579-21ssh12:26:121
3952441281,4sleep03952469-21munin-run12:15:000
3921873281,4sleep03922073-21basename11:55:150
3918968281,4sleep23919066-21ntpq11:50:202
3876183280,5sleep23877249-21cut11:25:182
3876183280,5sleep23877249-21cut11:25:172
3867192281,3sleep23867187-21apt-get11:20:112
3859391280,5sleep13859539-21/usr/sbin/munin11:15:131
3859381281,3sleep03859384-21apt-get11:15:120
3849177281,4sleep03849218-21ntpq11:05:210
3833501281,4sleep13833556-21ntpq10:55:201
3814220281,4sleep13815306-21ssh10:45:171
3803641280,2sleep13803647-21ssh10:36:591
3802415281,4sleep23802465-21ntpq10:35:192
3774163281,4sleep23774550-21sed10:20:152
3773246280,6sleep03773252-21ssh10:19:340
3733871280,2sleep03733873-21ssh09:52:470
3686332280,5sleep13686334-21ssh09:21:071
3685525281,4sleep23685576-21ntpq09:20:232
3671460280,5sleep13671466-21ssh09:13:491
3650858280,6sleep03650860-21sshd-auth08:58:440
3591424281,4sleep13591461-21ntpq08:10:221
3580036280,4sleep03580236-21hddtemp_smartct08:05:140
3579839281,3sleep13579872-21apt-get08:05:111
3569332280,5sleep13571287-21cut07:55:181
3560700281,4sleep13560697-21apt-get07:50:121
3515898281,4sleep13516016-21grep07:15:151
3500928281,4sleep30-21swapper/307:05:143
3990628270,5sleep03990630-21ssh12:37:500
3985409270,5sleep23986893-21kthreadcore12:35:162
3982512271,3sleep00-21swapper/012:31:500
3943357270,4sleep03943363-21ssh12:06:110
3934698270,4sleep03934760-21ntpq12:00:200
3894405271,3sleep03895619-21memory11:35:170
3891542270,4sleep23892554-21kthreadcore11:35:152
3888065270,4sleep03888111-21ntpq11:30:200
3880099271,3sleep13880247-21ldconfig11:25:201
3880099271,3sleep13880247-21ldconfig11:25:201
3874890270,1sleep00-21swapper/011:25:030
3874890270,1sleep00-21swapper/011:25:030
3872513270,4sleep03872561-21ntpq11:20:220
3861338270,5sleep23863159-21kthreadcore11:15:182
3858548270,4sleep03858554-21ssh11:13:320
3851267271,3sleep23851271-21ssh11:09:582
3842179270,4sleep13842185-21ssh11:01:091
3825832270,4sleep23825879-21ntp_states10:50:232
3811023270,2sleep23811029-21ssh10:40:542
3804603270,4sleep03804605-21ssh10:39:510
3794666270,4sleep13794719-21ntpq10:30:211
3788821270,1sleep00-21swapper/010:29:160
3788378270,2sleep23788384-21ssh10:28:012
3779131272,2sleep10-21swapper/110:20:221
3750500271,3sleep23750502-21apt-get10:05:112
3749990271,3sleep03749996-21ssh10:04:330
3740090271,3sleep03740214-21ntpq09:55:190
3737370270,5sleep23739259-21kthreadcore09:55:172
3727188270,4sleep23727194-21ssh09:50:112
3725759271,4sleep23725763-21ssh09:46:502
3719416271,2sleep13719411-21apt-get09:45:131
3703193270,4sleep03703199-21ssh09:34:210
3655202270,4sleep03656391-21memory09:00:210
3616817271,3sleep23612113-21/usr/sbin/munin08:30:192
3612103271,3sleep03611839-21apt-get08:30:050
3591468270,4sleep20-21swapper/208:10:222
3578758271,4sleep23578880-21/usr/sbin/munin08:00:232
3554212270,1sleep20-21swapper/207:45:032
3547999270,3sleep23548198-21hddtemp_smartct07:40:142
3540687270,1sleep20-21swapper/207:30:282
3513316271,4sleep23513336-21munin-run07:15:012
3982993260,4sleep10-21swapper/112:33:111
3965816260,3sleep13965916-21ssh12:20:191
3952485260,1sleep10-21swapper/112:15:011
3938761260,4sleep23940512-21tr12:05:152
3935020262,2sleep13566826-21kworker/1:0-events12:00:251
3919113260,3sleep03919161-21ntpq11:50:220
3912905260,3sleep23912911-21ssh11:48:192
3905348260,1sleep10-21swapper/111:43:501
3889024260,1sleep20-21swapper/211:31:262
3857156261,3sleep23857382-21ssh11:10:252
3852616261,3sleep13853617-21kthreadcore11:10:161
3833833260,3sleep23834074-21grep10:55:252
3828682260,3sleep03828978-21cut10:55:160
3822028261,3sleep13823715-21kthreadcore10:50:181
3811515260,1sleep00-21swapper/010:42:150
3806457261,2sleep10-21swapper/110:40:171
3795816260,1sleep00-21swapper/010:32:020
3795636260,1sleep20-21swapper/210:31:302
3782261260,3sleep13783161-21kthreadcore10:25:161
3779077260,3sleep03779129-21ntp_offset10:20:210
3765173260,4sleep13765178-21diskmemload10:13:371
3763446260,3sleep03763496-21ld10:10:190
3756355260,1sleep10-21swapper/110:05:261
3750661260,3sleep03750714-21fschecks_count10:05:140
3749305260,1sleep20-21swapper/210:02:322
3718146260,1sleep10-21swapper/109:42:201
3712948261,3sleep23713335-21kthreadcore09:40:172
3710854260,1sleep00-21swapper/009:38:540
3695039260,1sleep20-21swapper/209:28:422
3666229260,3sleep23668058-21tr09:10:182
3662972260,2sleep00-21swapper/009:05:210
3652706261,3sleep20-21swapper/209:00:182
3644925261,2sleep10-21swapper/108:55:161
3631702261,2sleep00-21swapper/008:45:120
3622006260,3sleep13623745-21latency08:35:201
3611636260,3sleep23611644-21apt-get08:29:022
3605488261,2sleep00-21swapper/008:25:110
3605129260,1sleep20-21swapper/208:23:502
3594122260,3sleep03595689-21grep08:15:170
3585005261,2sleep20-21swapper/208:05:202
3575985260,3sleep03577964-21kthreadcore08:00:170
3554211260,3sleep13554003-21appstreamcli07:45:021
3553694260,1sleep10-21swapper/107:42:021
3548781260,4sleep03549539-21kthreadcore07:40:160
3547338260,1sleep20-21swapper/207:37:462
3547338260,1sleep20-21swapper/207:37:452
3541705260,3sleep13541940-21sed07:35:171
3541705260,3sleep13541940-21sed07:35:161
3524462260,3sleep23526420-21cut07:20:172
3513751260,3sleep03514622-21kthreadcore07:15:020
3507191260,3sleep13507266-21cpuspeed_turbos07:10:151
3507166260,2sleep00-21swapper/007:10:130
3501710261,2sleep10-21swapper/107:05:161
3950294250,3sleep23950338-21ntpq12:10:212
3913799251,1sleep10-21swapper/111:50:101
3905637250,3sleep20-21swapper/211:44:382
3819193250,3sleep20-21swapper/210:46:592
3763547251,2sleep20-21swapper/210:10:212
3740878250,2sleep1331ktimers/109:55:321
3725458250,1sleep00-21swapper/009:46:000
3711583250,2sleep03711624-21ssh09:40:110
3701957250,3sleep20-21swapper/209:30:542
3644737250,2sleep20-21swapper/208:55:132
3641208251,2sleep00-21swapper/008:50:180
3638236250,2sleep20-21swapper/208:50:122
3637042251,1sleep20-21swapper/208:45:232
3610680250,3sleep13610725-21awk08:25:201
3599108250,2sleep03599141-21apt-get08:20:100
3598672250,1sleep10-21swapper/108:18:031
3598479250,3sleep20-21swapper/208:15:392
3565205250,3sleep03565673-21memory07:50:190
3535376250,2sleep10-21swapper/107:30:151
3527518250,2sleep10-21swapper/107:20:241
3960350240,2sleep03960347-21appstreamcli12:20:010
3663063240,2sleep20-21swapper/209:05:232
3643625240,2sleep10-21swapper/108:50:231
3633125240,1sleep10-21swapper/108:45:171
3631377240,2sleep03521538-21kworker/0:0+kacpid08:44:440
3620155240,2sleep00-21swapper/008:35:190
3579437240,3sleep10-21swapper/108:03:151
3562120240,2sleep23563190-21cut07:50:172
3559408240,1sleep00-21swapper/007:45:220
3528996240,2sleep10-21swapper/107:25:171
3567034230,1sleep20-21swapper/207:55:072
3534905230,1sleep00-21swapper/007:30:100
3528545230,1sleep20-21swapper/207:25:142
3515703230,1sleep20-21swapper/207:15:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional