You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 13:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Nov 23, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3335851992623,1cyclictest0-21swapper/321:05:013
3335851992118,1cyclictest0-21swapper/323:00:003
3335851991916,1cyclictest0-21swapper/322:40:183
3335851991916,1cyclictest0-21swapper/300:30:173
3335851991915,1cyclictest0-21swapper/322:35:183
3335851991915,1cyclictest0-21swapper/320:40:023
333585199191,14cyclictest3787872-21taskset00:15:123
3335851991815,1cyclictest0-21swapper/323:25:173
3335851991815,1cyclictest0-21swapper/321:50:173
3335851991815,1cyclictest0-21swapper/320:45:003
3335851991815,1cyclictest0-21swapper/320:35:003
3335851991815,1cyclictest0-21swapper/300:30:003
333585199181,13cyclictest3747499-21taskset23:50:123
333585199181,13cyclictest3715165-21taskset23:30:133
333585199181,13cyclictest3609418-21turbostat22:25:013
333585199181,13cyclictest3469853-21turbostat20:54:593
333585199181,13cyclictest3388134-21turbostat19:50:003
333585199181,12cyclictest3755422-21taskset23:55:013
333585199181,12cyclictest3755422-21taskset23:55:003
333585199177,7cyclictest3771370-21turbostat00:05:003
3335851991714,1cyclictest0-21swapper/321:25:573
3335851991714,1cyclictest0-21swapper/321:20:253
3335851991714,1cyclictest0-21swapper/320:05:203
3335851991714,1cyclictest0-21swapper/319:25:213
3335851991713,1cyclictest0-21swapper/323:50:003
3335851991713,1cyclictest0-21swapper/323:10:163
3335851991712,3cyclictest3690388-21turbostat23:19:553
333585199171,13cyclictest3674043-21taskset23:04:233
333585199171,13cyclictest3625709-21taskset22:34:373
333585199171,13cyclictest3585533-21taskset22:10:103
333585199170,13cyclictest3617788-21turbostat22:30:003
333585199170,13cyclictest3438304-21taskset20:27:393
333585199167,6cyclictest34191822sleep320:12:163
333585199166,7cyclictest37290692sleep323:35:343
3335851991614,1cyclictest0-21swapper/322:05:153
3335851991613,1cyclictest0-21swapper/321:55:163
3335851991613,1cyclictest0-21swapper/321:15:193
3335851991613,1cyclictest0-21swapper/300:35:173
333585199161,12cyclictest3803065-21taskset00:23:553
333585199161,12cyclictest3785642-21taskset00:10:393
333585199161,12cyclictest3777985-21chrt00:06:353
333585199161,12cyclictest3680580-21taskset23:05:483
333585199161,12cyclictest3648382-21taskset22:46:083
333585199161,12cyclictest3597286-21taskset22:15:183
333585199161,12cyclictest3575230-21taskset22:00:283
333585199161,12cyclictest3551097-21chrt21:46:043
333585199161,12cyclictest3551097-21chrt21:46:043
333585199161,12cyclictest3537315-21taskset21:40:153
333585199161,12cyclictest3527364-21chrt21:31:553
333585199161,12cyclictest3475857-21taskset20:56:393
333585199161,12cyclictest3400269-21taskset19:55:283
333585199161,12cyclictest3374735-21taskset19:35:293
333585199161,12cyclictest3356455-21chrt19:21:143
333585199160,12cyclictest3706515-21taskset23:24:553
36114402150,12sleep03613334-21cut22:25:190
333585199156,6cyclictest34575512sleep320:45:033
3335851991512,1cyclictest0-21swapper/321:05:183
3335851991512,1cyclictest0-21swapper/320:20:193
333585199151,12cyclictest3657355-21taskset22:53:133
333585199151,12cyclictest3425558-21chrt20:18:293
333585199151,11cyclictest3731292-21taskset23:40:113
333585199151,11cyclictest3528990-21chrt21:35:063
333585199151,11cyclictest3406933-21turbostat20:05:003
333585199151,11cyclictest3394029-21chrt19:50:483
333585199151,11cyclictest3369016-21taskset19:31:403
333585199151,11cyclictest3341735-21taskset19:10:323
333585199150,12cyclictest3488976-21taskset21:10:073
333585199150,12cyclictest3381808-21chrt19:44:433
333585199150,12cyclictest3381808-21chrt19:44:423
333585199150,12cyclictest3344472-21chrt19:15:133
36909162141,4sleep03691116-21hddtemp_smartct23:15:150
147598140,9rtkit-daemon3782972-21grep00:10:191
147598130,8rtkit-daemon3618303-21df_inode22:30:140
147598130,2rtkit-daemon214-21plymouthd23:57:262
147598130,2rtkit-daemon214-21plymouthd23:57:262
36738722120,9sleep10-21swapper/123:04:021
33633982120,1sleep20-21swapper/219:30:142
147598120,7rtkit-daemon3463859-21apt-get20:50:141
38105462110,8sleep13810552-21ssh00:27:331
37449212110,8sleep03745138-21users23:45:250
37157082110,8sleep23716600-21cat23:30:172
36583972111,2sleep1171rcu_preempt22:55:131
36576602110,8sleep03657668-21ssh22:54:030
35204662110,7sleep23520472-21ssh21:29:372
33960532110,8sleep23397035-21cut19:55:212
33683852111,7sleep13368441-21ntp_states19:30:221
33297722111,5sleep30-21swapper/319:05:123
147598110,7rtkit-daemon474-21systemd-logind21:56:422
147598110,7rtkit-daemon3794908-21ssh00:18:401
147598110,7rtkit-daemon3607977-21sh22:21:420
147598110,4rtkit-daemon3372333-21cut19:35:181
147598110,3rtkit-daemon214-21plymouthd23:50:412
37947512101,6sleep20-21swapper/200:18:212
37155272100,7sleep13715706-21cut23:30:161
37046472100,7sleep13704653-21ssh23:20:381
36811242103,4sleep23648081-21kworker/u16:3+xprtiod23:07:042
36161182100,7sleep23616126-21ssh22:26:082
35142102100,7sleep03515267-21cat21:25:190
34384892101,5sleep03438503-21munin-run20:30:000
33767802104,3sleep03377816-21kthreadcore19:40:200
33767802104,3sleep03377816-21kthreadcore19:40:190
33298092100,7sleep03329963-21df19:05:140
147598100,6rtkit-daemon730-21ntpd21:33:331
147598100,6rtkit-daemon515-21gmain20:44:131
147598100,6rtkit-daemon3487820-21grep21:05:211
147598100,6rtkit-daemon295-21systemd-journal20:02:331
147598100,6rtkit-daemon1540-21sendmail-mta23:21:232
147598100,6rtkit-daemon1540-21sendmail-mta22:10:032
147598100,6rtkit-daemon1540-21sendmail-mta22:02:032
147598100,5rtkit-daemon3518982-21ssh21:26:001
147598100,4rtkit-daemon3648454-21ssh22:46:262
147598100,3rtkit-daemon476-21wpa_supplicant22:50:041
3781114290,6sleep03782231-21kthreadcore00:10:180
3765725291,5sleep13767692-21tr00:00:211
3595318290,6sleep23597284-21cut22:15:182
3585550291,3sleep13585587-21apt-get22:10:121
3575702290,2sleep13575710-21ssh22:01:391
3457565291,4sleep23457598-21apt-get20:45:132
3456616291,5sleep23456820-21sed20:40:242
3445016291,4sleep03445049-21apt-get20:35:130
3363698290,6sleep03364207-21cut19:30:170
3350744291,4sleep13350777-21apt-get19:20:121
14759890,6rtkit-daemon720-21snmpd23:28:032
14759890,6rtkit-daemon1540-21sendmail-mta20:47:421
14759890,5rtkit-daemon3545156-21apt-get21:45:142
14759890,5rtkit-daemon3545156-21apt-get21:45:132
14759890,5rtkit-daemon214-21plymouthd00:05:521
14759890,4rtkit-daemon476-21wpa_supplicant23:38:460
14759890,4rtkit-daemon3505182-21df_inode21:20:141
14759890,2rtkit-daemon214-21plymouthd22:37:002
14759890,2rtkit-daemon214-21plymouthd19:06:521
14759890,1rtkit-daemon0-21swapper/119:15:461
3826663282,1sleep0171rcu_preempt00:37:430
3818021280,1sleep20-21swapper/200:31:242
3813351280,5sleep13815249-21cut00:30:191
3737771281,5sleep23737779-21ssh23:42:032
3732260280,5sleep13733385-21kthreadcore23:40:181
3729565280,5sleep23729573-21ssh23:36:452
3691117280,5sleep13691475-21irqcore23:15:161
3664221280,1sleep20-21swapper/222:55:262
3625354281,1sleep10-21swapper/122:33:521
3560080280,5sleep03488699-21diskmemload21:53:170
3505024281,4sleep03505173-21df21:20:130
3504285281,1sleep20-21swapper/221:19:072
3489019281,3sleep03489056-21apt-get21:10:120
3488553280,1sleep00-21swapper/021:08:230
3426818280,5sleep03427740-21grep20:20:180
3406184280,5sleep20-21swapper/220:00:252
3352145283,2sleep2421rcuc/219:20:172
14759880,5rtkit-daemon3488699-21diskmemload23:48:172
14759880,4rtkit-daemon720-21snmpd20:10:151
14759880,4rtkit-daemon388321-21kworker/1:0+events21:02:581
14759880,4rtkit-daemon3798870-21cut00:20:211
14759880,4rtkit-daemon3769606-21sh00:00:492
14759880,4rtkit-daemon3342246-21munin-node19:43:071
14759880,4rtkit-daemon3342246-21munin-node19:43:071
14759880,4rtkit-daemon1540-21sendmail-mta22:05:172
14759880,4rtkit-daemon1-21systemd20:39:381
14759880,4rtkit-daemon1-21systemd19:10:381
14759880,4rtkit-daemon1-21systemd00:34:530
14759880,4rtkit-daemon0-21swapper/119:51:281
14759880,3rtkit-daemon3356733-21kworker/u16:3+events_power_efficient20:07:101
14759880,3rtkit-daemon214-21plymouthd21:41:002
14759880,1rtkit-daemon0-21swapper/022:18:520
3819929270,1sleep20-21swapper/200:35:122
3810961270,1sleep00-21swapper/000:28:370
3731295271,3sleep03731327-21apt-get23:40:120
3714230270,5sleep03488699-21diskmemload23:29:140
3699790271,3sleep03700891-21kthreadcore23:20:170
3689260270,1sleep20-21swapper/223:12:242
3632541270,5sleep03488699-21diskmemload22:36:570
3618521270,4sleep23619066-21sed22:30:172
3577128270,1sleep00-21swapper/022:04:540
3566286270,4sleep13566366-21/usr/sbin/munin21:55:211
3566010270,5sleep00-21swapper/021:55:200
3550892270,2sleep0171rcu_preempt21:45:390
3550892270,2sleep0171rcu_preempt21:45:380
3527950270,4sleep03527958-21ssh21:33:160
3527590270,4sleep23527598-21ssh21:32:302
3502123270,1sleep10-21swapper/121:15:221
3482687271,3sleep23482720-21apt-get21:05:132
3419662270,3sleep13419694-21apt-get20:15:161
3413794270,5sleep03414269-21sed20:10:170
3388022270,1sleep20-21swapper/219:48:472
3373371270,4sleep03374521-21memory19:35:260
3344630270,4sleep03344824-21grep19:15:160
3337896271,4sleep23339904-21cut19:10:202
14759870,4rtkit-daemon729-21lldpd21:10:381
14759870,4rtkit-daemon720-21snmpd23:10:461
14759870,4rtkit-daemon720-21snmpd21:39:032
14759870,4rtkit-daemon456-21avahi-daemon19:56:061
14759870,4rtkit-daemon456-21avahi-daemon19:25:101
14759870,4rtkit-daemon214-21plymouthd20:25:491
14759870,3rtkit-daemon730-21ntpd19:45:161
14759870,3rtkit-daemon720-21snmpd23:16:092
14759870,3rtkit-daemon3810247-21ssh00:26:542
14759870,3rtkit-daemon3682028-21ssh23:09:161
14759870,3rtkit-daemon3649040-21ssh22:47:481
14759870,3rtkit-daemon22110-21packagekitd20:20:321
14759870,3rtkit-daemon1-21systemd22:41:142
14759870,3rtkit-daemon1-21systemd20:30:191
14759870,2rtkit-daemon214-21plymouthd23:32:230
14759870,2rtkit-daemon214-21plymouthd20:55:121
14759870,1rtkit-daemon1474-21rtkit-daemon21:52:302
3801737260,1sleep20-21swapper/200:20:422
3786656260,1sleep20-21swapper/200:13:092
3777933260,4sleep00-21swapper/000:06:280
3777542260,3sleep23777550-21ssh00:05:382
3770313260,1sleep00-21swapper/000:02:330
3761974260,1sleep00-21swapper/023:57:040
3761974260,1sleep00-21swapper/023:57:030
3753825260,1sleep10-21swapper/123:51:551
3739420260,3sleep13739569-21df23:45:131
3729426261,3sleep1331ktimers/123:36:281
3713200260,1sleep10-21swapper/123:26:461
3681073260,1sleep00-21swapper/023:06:570
3673669260,1sleep00-21swapper/023:03:380
3658722260,3sleep03658878-21/usr/sbin/munin22:55:150
3656808260,1sleep20-21swapper/222:51:572
3648435260,1sleep00-21swapper/022:46:230
3641745260,1sleep00-21swapper/022:44:250
3617269260,3sleep13617277-21ssh22:28:521
3608432260,3sleep23608440-21ssh22:22:472
3600106260,1sleep10-21swapper/122:17:131
3583945260,1sleep00-21swapper/022:07:020
3560546260,1sleep10-21swapper/121:54:261
3552002260,1sleep10-21swapper/121:48:091
3552002260,1sleep10-21swapper/121:48:081
3538469261,3sleep13539543-21kthreadcore21:40:181
3535703260,3sleep03535711-21ssh21:37:380
3511386260,1sleep20-21swapper/221:21:572
3503765260,1sleep00-21swapper/021:18:020
3494820261,2sleep20-21swapper/221:10:432
3482203260,1sleep00-21swapper/021:02:110
3482195260,1sleep20-21swapper/221:02:052
3475972260,1sleep20-21swapper/220:58:072
3470568260,4sleep03471494-21kernelversion20:55:170
3463822260,1sleep20-21swapper/220:50:112
3457558260,1sleep00-21swapper/020:45:070
3450826260,1sleep20-21swapper/220:37:322
3444536260,1sleep20-21swapper/220:32:152
3444431260,1sleep00-21swapper/020:30:530
3419697260,3sleep23419852-21diskstats20:15:172
3412867260,1sleep20-21swapper/220:06:352
3395038261,2sleep00-21swapper/019:55:190
3387195260,3sleep03387272-21ntp_states19:45:210
3356682260,1sleep00-21swapper/019:24:080
3342051260,1sleep00-21swapper/019:14:340
3335399260,1sleep20-21swapper/219:05:552
14759860,3rtkit-daemon730-21ntpd21:35:201
3826767250,3sleep10-21swapper/100:37:551
3795851250,2sleep00-21swapper/000:20:160
3761646250,3sleep10-21swapper/123:56:201
3761646250,3sleep10-21swapper/123:56:201
3754041250,3sleep00-21swapper/023:52:220
3682894250,3sleep03682925-21/usr/sbin/munin23:10:150
3671988250,2sleep20-21swapper/223:00:222
3631996250,3sleep10-21swapper/122:35:381
3601630250,3sleep10-21swapper/122:20:101
3592067250,3sleep00-21swapper/022:12:150
3583503251,1sleep10-21swapper/122:05:591
3451335250,3sleep03451487-21df_inode20:40:150
3415175251,2sleep20-21swapper/220:10:192
3362905250,3sleep00-21swapper/019:28:170
3358032250,3sleep23359168-21cut19:25:192
3350408250,3sleep20-21swapper/219:19:182
3787814240,2sleep0214-21plymouthd00:15:100
3635656240,2sleep10-21swapper/122:40:171
3543222240,2sleep03488699-21diskmemload21:41:250
3469211240,2sleep03469456-21uptime20:50:250
3425027240,2sleep00-21swapper/020:15:260
3406692240,1sleep00-21swapper/020:02:150
3389407240,2sleep00-21swapper/019:50:170
3374673240,2sleep20-21swapper/219:35:292
3432271230,1sleep20-21swapper/220:25:022
3426213230,1sleep20-21swapper/220:20:082
3407156230,1sleep00-21swapper/020:05:050
3388367230,1sleep20-21swapper/219:50:072
3375612230,1sleep20-21swapper/219:40:012
3375612230,1sleep20-21swapper/219:40:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional