You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-11 - 16:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Tue Nov 11, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
403590821060,2sleep134-21ksoftirqd/123:05:191
41460432400,1chrt0-21swapper/200:15:212
3698267992218,1cyclictest0-21swapper/321:45:003
3698267992118,1cyclictest0-21swapper/300:40:013
3698267991916,1cyclictest0-21swapper/321:40:003
3698267991916,1cyclictest0-21swapper/300:05:383
3698267991815,1cyclictest0-21swapper/322:20:143
3698267991714,1cyclictest0-21swapper/322:45:203
3698267991613,1cyclictest0-21swapper/323:35:003
3698267991613,1cyclictest0-21swapper/323:20:003
3698267991613,1cyclictest0-21swapper/322:50:193
3698267991613,1cyclictest0-21swapper/321:50:003
3698267991613,1cyclictest0-21swapper/321:49:593
3698267991613,1cyclictest0-21swapper/320:45:013
3698267991613,1cyclictest0-21swapper/320:30:013
3698267991613,1cyclictest0-21swapper/319:45:173
3698267991613,1cyclictest0-21swapper/300:30:193
3698267991513,1cyclictest0-21swapper/322:36:573
3698267991512,1cyclictest0-21swapper/323:25:003
3698267991512,1cyclictest0-21swapper/322:55:163
3698267991512,1cyclictest0-21swapper/320:57:003
3698267991512,1cyclictest0-21swapper/319:10:173
3698267991510,2cyclictest3911501-21turbostat21:54:553
39114752141,6sleep03911982-21appstreamcli21:50:010
369826799146,5cyclictest4119419-21turbostat00:04:553
3698267991411,1cyclictest0-21swapper/322:25:223
3698267991411,1cyclictest0-21swapper/321:56:583
3698267991411,1cyclictest0-21swapper/320:50:013
3698267991411,1cyclictest0-21swapper/320:10:013
3698267991411,1cyclictest0-21swapper/319:30:203
3698267991411,1cyclictest0-21swapper/300:18:413
41038292131,2sleep04103865-21apt-get23:50:160
39038532130,3sleep03903894-21apt-get21:45:160
39038532130,3sleep03903894-21apt-get21:45:160
369826799137,3cyclictest4111424-21turbostat23:59:553
369826799137,3cyclictest0-21swapper/300:26:163
369826799131,9cyclictest4102088-21taskset23:46:493
369826799131,9cyclictest3861909-21taskset21:15:323
3698267991311,1cyclictest0-21swapper/322:09:093
3698267991311,1cyclictest0-21swapper/321:05:003
3698267991310,1cyclictest0-21swapper/321:20:193
3698267991310,1cyclictest0-21swapper/320:20:183
3698267991310,1cyclictest0-21swapper/319:40:213
39191912120,4sleep23919199-21ssh21:53:562
369826799129,1cyclictest0-21swapper/322:15:203
369826799129,1cyclictest0-21swapper/322:00:163
369826799129,1cyclictest0-21swapper/321:25:093
369826799129,1cyclictest0-21swapper/320:50:173
369826799129,1cyclictest0-21swapper/300:10:223
369826799122,7cyclictest3848363-21taskset21:10:113
369826799122,7cyclictest38069892sleep320:35:183
369826799121,8cyclictest4070214-21taskset23:27:203
369826799121,8cyclictest4042400-21taskset23:10:183
369826799121,8cyclictest4032773-21taskset23:05:173
369826799121,8cyclictest3981630-21taskset22:31:273
369826799121,8cyclictest3951415-21turbostat22:15:003
369826799121,8cyclictest3886220-21taskset21:31:393
369826799121,8cyclictest3842285-21taskset21:05:133
369826799121,8cyclictest3767938-21taskset20:04:393
369826799121,8cyclictest3761664-21taskset19:58:143
369826799121,8cyclictest3755186-21taskset19:52:013
369826799121,8cyclictest3724454-21taskset19:26:283
369826799121,8cyclictest3718474-21taskset19:22:563
369826799121,8cyclictest3707010-21taskset19:15:183
3698267991210,1cyclictest0-21swapper/323:41:133
369826799120,9cyclictest3804878-21taskset20:32:403
36977802120,2sleep30-21swapper/319:05:423
41736042110,3sleep14173612-21ssh00:31:361
38298302111,5sleep03829852-21apt-get20:55:150
369826799118,1cyclictest0-21swapper/300:20:163
369826799113,6cyclictest3785732-21taskset20:15:213
369826799111,8cyclictest3991705-21taskset22:40:043
369826799111,7cyclictest4103727-21taskset23:50:013
369826799111,7cyclictest4085168-21taskset23:35:233
369826799110,8cyclictest3780172-21taskset20:11:173
369826799110,4cyclictest37366152sleep319:35:263
41425192101,6sleep14142527-21ssh00:13:211
41422292100,1sleep20-21swapper/200:12:382
38735102101,2sleep00-21swapper/021:25:200
38111592101,5sleep11-21systemd20:40:011
369826799101,7cyclictest4023958-21chrt23:00:163
174698100,5rtkit-daemon3840284-21cut21:00:202
174698100,2rtkit-daemon275-21plymouthd20:15:152
4016785293,4sleep14017867-21kthreadcore22:55:181
3910564291,6sleep23910572-21ssh21:47:582
3910564291,6sleep23910572-21ssh21:47:582
3780908290,2sleep00-21swapper/020:15:150
3749563291,4sleep23749596-21apt-get19:50:172
3717785290,5sleep13717834-21ps19:20:221
3703627291,6sleep23703785-21sed19:10:252
17469890,5rtkit-daemon4049463-21kthreadcore23:15:182
17469890,5rtkit-daemon3886582-21ssh21:32:332
17469890,5rtkit-daemon3847995-21diskmemload00:00:462
17469890,4rtkit-daemon771-21snmpd21:11:022
17469890,4rtkit-daemon4023624-21apt-get23:00:142
17469890,4rtkit-daemon3942776-21ssh22:08:222
17469890,2rtkit-daemon275-21plymouthd23:36:092
4133744280,2sleep0275-21plymouthd00:06:270
4102744281,5sleep10-21swapper/123:48:201
4093507280,6sleep04093515-21ssh23:40:290
3983963281,4sleep03984008-21fschecks_count22:35:170
3983779281,3sleep23983812-21apt-get22:35:152
3951952281,4sleep03952157-21hddtemp_smartct22:15:180
3943487281,4sleep03943506-21/usr/sbin/munin22:10:010
3817344281,4sleep03817364-21turbostat.cron20:45:010
3805512280,6sleep03805712-21hddtemp_smartct20:35:140
3770047281,5sleep00-21swapper/020:05:170
3755419282,3sleep10-21swapper/119:55:011
3698118281,3sleep13698178-21munin-run19:10:001
17469880,4rtkit-daemon774-21ntpd19:40:252
17469880,4rtkit-daemon774-21ntpd00:09:142
17469880,4rtkit-daemon771-21snmpd20:37:522
17469880,4rtkit-daemon4042650-21cut23:10:182
17469880,4rtkit-daemon3925895-21ssh21:56:012
17469880,4rtkit-daemon3891248-21grep21:35:192
17469880,4rtkit-daemon3815866-21cut20:40:192
17469880,4rtkit-daemon3725183-21df_inode19:30:172
17469880,4rtkit-daemon3704492-21munin-node23:52:382
17469880,4rtkit-daemon3704492-21munin-node22:47:272
17469880,4rtkit-daemon3704492-21munin-node19:37:202
17469880,4rtkit-daemon3646-21packagekitd21:09:262
17469880,4rtkit-daemon3646-21packagekitd19:06:462
17469880,4rtkit-daemon275-21plymouthd23:31:442
17469880,4rtkit-daemon1798-21sendmail-mta23:29:512
17469880,4rtkit-daemon1-21systemd23:43:042
17469880,4rtkit-daemon1-21systemd22:50:192
17469880,4rtkit-daemon1-21systemd22:15:162
17469880,4rtkit-daemon1-21systemd22:13:592
17469880,4rtkit-daemon1-21systemd20:11:372
17469880,4rtkit-daemon1-21systemd19:59:132
17469880,4rtkit-daemon1-21systemd00:25:562
17469880,4rtkit-daemon0-21swapper/000:35:070
17469880,3rtkit-daemon512-21systemd-logind00:31:580
17469880,3rtkit-daemon4118199-21sh23:57:172
17469880,3rtkit-daemon275-21plymouthd20:46:202
4167474271,3sleep24167513-21apt-get00:30:132
4140910270,4sleep04141139-21/usr/sbin/munin00:10:230
4085316271,3sleep04085505-21users23:35:250
4071948271,3sleep04071985-21apt-get23:30:120
4069550270,1sleep00-21swapper/023:25:470
4046717270,1sleep00-21swapper/023:14:050
4030823270,1sleep00-21swapper/023:04:110
4013830270,4sleep10-21swapper/122:51:411
4006099270,1sleep00-21swapper/022:47:120
3999007270,1sleep00-21swapper/022:44:110
3998277270,1sleep10-21swapper/122:42:321
3981357270,5sleep0275-21plymouthd22:30:440
3975503271,4sleep13975509-21ssh22:30:091
3966242270,1sleep00-21swapper/022:22:390
3934827270,1sleep00-21swapper/022:03:220
3927162270,1sleep00-21swapper/021:58:580
3902934270,1sleep00-21swapper/021:43:400
3887980271,3sleep13888142-21diskstats21:35:151
3885829270,1sleep00-21swapper/021:30:490
3872299271,3sleep13872445-21tail21:25:171
3870112270,1sleep10-21swapper/121:21:081
3855169270,1sleep00-21swapper/021:13:140
3823734270,4sleep03823860-21grep20:50:140
3785483270,5sleep13785633-21needreboot20:15:201
3780134270,1sleep00-21swapper/020:10:460
3756881270,5sleep03757805-21cut19:55:200
3736684270,1sleep00-21swapper/019:36:200
3731575270,5sleep13732438-21cut19:35:171
3719072270,4sleep03719114-21grep19:25:140
3718891271,3sleep23718924-21apt-get19:25:112
17469870,4rtkit-daemon3704492-21munin-node23:20:232
17469870,3rtkit-daemon774-21ntpd22:55:022
17469870,3rtkit-daemon774-21ntpd20:55:242
17469870,3rtkit-daemon774-21ntpd20:20:212
17469870,3rtkit-daemon774-21ntpd20:05:492
17469870,3rtkit-daemon551-21gmain00:20:552
17469870,3rtkit-daemon3872093-21/usr/sbin/munin21:25:262
17469870,3rtkit-daemon3827927-21kthreadcore20:50:192
17469870,3rtkit-daemon3704492-21munin-node22:40:432
17469870,3rtkit-daemon3704492-21munin-node19:15:572
17469870,3rtkit-daemon364-21systemd-journal20:25:012
17469870,3rtkit-daemon275-21plymouthd19:45:592
17469870,3rtkit-daemon1798-21sendmail-mta22:31:112
17469870,3rtkit-daemon1-21systemd23:05:162
17469870,3rtkit-daemon1-21systemd22:27:442
17469870,3rtkit-daemon1-21systemd22:20:472
17469870,3rtkit-daemon1-21systemd22:02:062
17469870,3rtkit-daemon1-21systemd21:41:382
17469870,3rtkit-daemon1-21systemd21:20:262
17469870,3rtkit-daemon1-21systemd21:15:442
17469870,3rtkit-daemon1-21systemd20:30:102
17469870,3rtkit-daemon1-21systemd20:00:082
17469870,3rtkit-daemon1-21systemd00:29:060
17469870,2rtkit-daemon275-21plymouthd23:47:202
17469870,2rtkit-daemon275-21plymouthd19:21:242
4166161260,1sleep10-21swapper/100:27:441
4157416260,1sleep00-21swapper/000:20:530
4150432261,2sleep0171ktimers/000:18:090
4133877260,4sleep14133882-21sh00:06:441
4125857260,4sleep14125863-21ssh00:01:311
4125362260,4sleep0275-21plymouthd00:00:250
4087918260,4sleep14087986-21cpuspeed_turbos23:40:151
4063777261,3sleep14063792-21grep23:25:161
4061131260,1sleep00-21swapper/023:20:300
4053244260,1sleep00-21swapper/023:15:410
4047462260,3sleep10-21swapper/123:15:141
4039465261,2sleep14039502-21apt-get23:10:131
4031439260,1sleep00-21swapper/023:05:070
4021920260,1sleep00-21swapper/022:57:010
4014948260,1sleep00-21swapper/022:54:170
3967633261,3sleep13967782-21df22:25:161
3966660260,1sleep10-21swapper/122:23:361
3951729261,2sleep13951771-21apt-get22:15:151
3949588260,1sleep00-21swapper/022:10:490
3935846260,3sleep13935870-21apt-get22:05:131
3910866260,1sleep10-21swapper/121:48:381
3910866260,1sleep10-21swapper/121:48:381
3898298260,3sleep13900315-21cut21:40:201
3864265261,3sleep03864428-21diskstats21:20:140
3863848260,4sleep13863919-21munin-run21:20:001
3862778260,4sleep00-21swapper/021:17:310
3842528260,3sleep13843142-21sed21:05:171
3835946260,1sleep00-21swapper/021:00:030
3825742260,4sleep13827759-21kthreadcore20:50:191
3823240260,1sleep00-21swapper/020:47:290
3804781260,1sleep00-21swapper/020:31:260
3792441260,1sleep00-21swapper/020:20:440
3780337260,1sleep10-21swapper/120:13:241
3761629260,1sleep10-21swapper/119:57:491
3755096260,1sleep00-21swapper/019:50:500
3748991260,1sleep00-21swapper/019:46:020
3743616260,3sleep13743816-21smartctl19:45:151
3724994261,2sleep03725027-21apt-get19:30:150
3724047260,4sleep13724277-21awk19:25:231
3712128260,1sleep00-21swapper/019:15:280
3704107260,1sleep10-21swapper/119:12:211
3699833261,3sleep00-21swapper/019:10:190
4175559251,2sleep10-21swapper/100:35:161
4152018250,3sleep14152698-21irqrtprio00:20:181
4072895251,2sleep10-21swapper/123:30:171
4061295250,3sleep14061303-21ssh23:20:511
4025031251,2sleep14026594-21kthreadcore23:00:191
4006507250,3sleep14006515-21ssh22:48:091
3967580250,3sleep00-21swapper/022:25:110
3944020251,2sleep10-21swapper/122:10:141
3935537251,2sleep10-21swapper/122:05:011
3911983251,2sleep10-21swapper/121:50:021
3894541250,3sleep00-21swapper/021:37:340
3854706250,1sleep10-21swapper/121:12:071
3841527250,1sleep10-21swapper/121:00:411
3831223250,3sleep13833151-21kthreadcore20:55:201
3800528250,2sleep10-21swapper/120:30:191
3798684250,3sleep00-21swapper/020:27:210
3767638250,3sleep00-21swapper/020:00:490
3762082250,2sleep10-21swapper/120:00:121
3738623251,2sleep10-21swapper/119:40:181
3708488251,2sleep10-21swapper/119:15:201
4175683240,2sleep24175840-21if_err_eno200:35:182
4144939240,2sleep10-21swapper/100:15:211
4112626240,2sleep10-21swapper/123:55:171
4112147240,2sleep00-21swapper/023:55:160
4110686240,2sleep14103525-21kworker/u8:0+rpciod23:53:161
4096922240,2sleep00-21swapper/023:45:190
4080625240,2sleep10-21swapper/123:35:181
3984011240,2sleep1275-21plymouthd22:35:181
3882357240,2sleep13884441-21kthreadcore21:30:171
3847795240,3sleep00-21swapper/021:07:370
3798613240,2sleep1275-21plymouthd20:26:261
3742893240,3sleep00-21swapper/019:41:370
3725933241,2sleep10-21swapper/119:30:201
3697837240,2sleep00-21swapper/019:06:260
3924287230,1sleep10-21swapper/121:55:191
3817593230,1sleep10-21swapper/120:45:051
3811427230,1sleep10-21swapper/120:40:051
3786855230,1sleep10-21swapper/120:20:051
3768215230,1sleep10-21swapper/120:05:061
3712765230,1sleep00-21swapper/019:20:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional