You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 22:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Nov 17, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3483674992522,1cyclictest0-21swapper/312:35:003
3483674992522,1cyclictest0-21swapper/309:30:003
3483674992421,1cyclictest0-21swapper/312:00:003
3483674992320,1cyclictest0-21swapper/307:15:023
3483674992311,9cyclictest3883673-21sleep11:45:003
36917452220,2sleep00-21swapper/009:45:150
348367499211,15cyclictest3707332-21turbostat09:55:003
348367499211,14cyclictest3963590-21taskset12:35:003
348367499209,7cyclictest35982762sleep308:40:133
3483674992018,1cyclictest0-21swapper/311:10:003
348367499199,6cyclictest39502602sleep312:25:203
3483674991916,1cyclictest0-21swapper/311:10:143
3483674991916,1cyclictest0-21swapper/310:35:003
3483674991916,1cyclictest0-21swapper/309:40:193
3483674991916,1cyclictest0-21swapper/309:35:233
3483674991916,1cyclictest0-21swapper/308:30:013
3483674991912,3cyclictest36291952sleep309:05:153
3483674991816,1cyclictest0-21swapper/310:50:013
3483674991815,1cyclictest0-21swapper/310:20:163
348367499181,14cyclictest3849817-21taskset11:20:313
348367499181,13cyclictest3812855-21taskset11:00:193
348367499181,13cyclictest3616560-21turbostat08:55:003
348367499177,7cyclictest38107202sleep310:58:273
348367499176,8cyclictest3542087-21sleep07:59:563
3483674991714,1cyclictest0-21swapper/312:05:203
3483674991714,1cyclictest0-21swapper/311:15:203
3483674991714,1cyclictest0-21swapper/307:30:013
348367499171,13cyclictest3864852-21taskset11:30:213
348367499171,13cyclictest3786713-21chrt10:43:193
348367499171,12cyclictest3852274-21taskset11:25:153
348367499171,12cyclictest3738942-21taskset10:14:013
348367499171,12cyclictest3725809-21taskset10:05:203
348367499171,12cyclictest3653176-21chrt09:20:203
348367499171,12cyclictest3648977-21taskset09:15:233
348367499171,12cyclictest3554961-21taskset08:05:153
348367499170,8cyclictest3542234-21taskset07:55:003
348367499170,13cyclictest3573125-21chrt08:19:213
38366822160,1sleep00-21swapper/011:15:200
348367499165,8cyclictest3670216-21taskset09:30:183
3483674991613,1cyclictest0-21swapper/310:35:233
3483674991613,1cyclictest0-21swapper/310:00:203
3483674991613,1cyclictest0-21swapper/308:50:013
348367499161,12cyclictest3924053-21chrt12:10:153
348367499161,12cyclictest3892275-21chrt11:50:153
348367499161,12cyclictest3883935-21chrt11:45:063
348367499161,12cyclictest3761514-21taskset10:25:493
348367499161,12cyclictest3713715-21taskset09:56:143
348367499161,12cyclictest3642133-21taskset09:12:103
348367499161,12cyclictest3597678-21taskset08:36:193
348367499161,12cyclictest3597678-21taskset08:36:193
348367499161,12cyclictest3504543-21taskset07:24:353
348367499161,12cyclictest3497558-21chrt07:15:213
348367499161,11cyclictest3549976-21taskset08:00:173
348367499161,11cyclictest3511015-21taskset07:30:083
348367499160,13cyclictest3744899-21taskset10:15:273
348367499160,13cyclictest3698763-21chrt09:48:453
348367499160,13cyclictest3524066-21chrt07:40:183
3483674991512,1cyclictest0-21swapper/312:15:153
3483674991512,1cyclictest0-21swapper/312:00:553
348367499151,12cyclictest3801748-21chrt10:51:123
348367499151,11cyclictest3939804-21taskset12:20:013
348367499151,11cyclictest3628877-21taskset09:04:173
348367499151,11cyclictest3616799-21taskset08:55:123
348367499151,11cyclictest3573456-21taskset08:20:133
348367499151,11cyclictest3566263-21taskset08:10:233
348367499151,11cyclictest3535664-21taskset07:47:193
348367499151,11cyclictest3523101-21taskset07:36:253
348367499150,12cyclictest3868886-21chrt11:35:173
37788982140,6sleep03635129-21diskmemload10:38:520
348367499140,11cyclictest3585845-21taskset08:30:103
39220262130,9sleep13922032-21ssh12:06:341
37416092131,4sleep13743558-21grep10:15:221
39309342120,9sleep13930942-21ssh12:13:431
39292122120,8sleep03929491-21unixbench_singl12:10:260
35302062121,8sleep13529949-21/usr/sbin/munin07:45:181
147598120,8rtkit-daemon1540-21sendmail-mta09:14:131
39703832117,1sleep20-21swapper/212:37:202
38998922110,2sleep20-21swapper/211:55:132
38822902110,8sleep23882298-21ssh11:41:462
36577932110,8sleep23657801-21ssh09:21:212
36230312111,5sleep13623064-21apt-get09:00:151
36121842110,8sleep23614148-21cut08:50:182
35976582110,8sleep03597659-21sshd08:36:060
35976582110,8sleep03597659-21sshd08:36:050
35672902110,8sleep03567441-21df08:15:180
147598110,6rtkit-daemon3483667-21cyclictest09:27:140
147598110,5rtkit-daemon515-21gmain11:17:412
147598110,4rtkit-daemon3761536-21ssh10:25:510
147598110,1rtkit-daemon0-21swapper/012:16:540
39052312104,4sleep13835404-21kworker/u16:0+nfsiod11:55:241
38817062100,3sleep13881730-21ssh11:40:241
37527072100,7sleep03752816-21/usr/sbin/munin10:20:210
37406052100,7sleep03741608-21cut10:15:200
35363122106,2sleep23536363-21fschecks_count07:50:152
35048382101,5sleep13504871-21apt-get07:25:141
34776972101,3sleep30-21swapper/307:05:123
147598100,6rtkit-daemon3649491-21sh09:15:350
147598100,6rtkit-daemon3635129-21diskmemload12:30:421
147598100,6rtkit-daemon3490020-21munin-node07:59:250
147598100,6rtkit-daemon214-21plymouthd12:09:490
147598100,6rtkit-daemon1540-21sendmail-mta09:42:270
147598100,5rtkit-daemon3623223-21diskstats09:00:170
147598100,3rtkit-daemon3802740-21ssh10:53:290
147598100,3rtkit-daemon3635129-21diskmemload11:46:560
3954365290,2sleep10-21swapper/112:27:211
3938299290,6sleep23938307-21ssh12:17:052
3938031291,6sleep13938038-21sh12:16:311
3897660290,6sleep03897667-21sh11:50:330
3890225290,6sleep13635129-21diskmemload11:46:471
3869810290,6sleep03871761-21kthreadcore11:35:200
3867340290,6sleep23867348-21ssh11:34:162
3795925290,6sleep13796011-21fschecks_time10:50:161
3720946292,4sleep13622434-21kworker/u16:3+nfsiod10:00:261
3554402290,5sleep03554471-21apt-config08:05:000
14759890,6rtkit-daemon1540-21sendmail-mta12:05:582
14759890,5rtkit-daemon3833813-21ssh11:10:572
14759890,5rtkit-daemon3587092-21cut08:30:180
14759890,5rtkit-daemon214-21plymouthd12:24:570
14759890,5rtkit-daemon214-21plymouthd07:33:190
14759890,4rtkit-daemon476-21wpa_supplicant07:35:180
14759890,4rtkit-daemon3714888-21ssh09:59:011
14759890,4rtkit-daemon3699948-21grep09:50:151
14759890,4rtkit-daemon3652138-21idleruntime09:20:190
14759890,3rtkit-daemon3970632-21ssh12:37:511
14759890,3rtkit-daemon3817728-21ssh11:01:100
14759890,2rtkit-daemon214-21plymouthd08:05:250
3947127280,6sleep23850057-21kworker/u16:2+rpciod12:24:062
3914761280,5sleep13914765-21ssh12:03:171
3793608280,1sleep10-21swapper/110:45:501
3779194280,6sleep13779202-21ssh10:39:291
3755340280,5sleep23755373-21dump-pmu-power10:25:002
3729841281,2sleep10-21swapper/110:06:281
3723390281,4sleep23723582-21latency_hist10:05:002
3722830280,6sleep03722838-21ssh10:03:420
3699299280,1sleep20-21swapper/209:49:532
3690864280,1sleep10-21swapper/109:43:511
3649695285,1sleep10-21swapper/109:16:021
3593358281,5sleep10-21swapper/108:35:191
3593358281,5sleep10-21swapper/108:35:181
3585515286,1sleep03477238-21kworker/0:0+kacpid08:29:040
3561409280,2sleep0171rcu_preempt08:10:180
3542319281,3sleep13542352-21apt-get07:55:161
3510691280,1sleep00-21swapper/007:29:060
14759880,4rtkit-daemon720-21snmpd08:40:420
14759880,4rtkit-daemon720-21snmpd07:41:040
14759880,4rtkit-daemon720-21snmpd07:06:302
14759880,4rtkit-daemon456-21avahi-daemon11:25:402
14759880,4rtkit-daemon3640344-21cut09:10:200
14759880,4rtkit-daemon3634088-21memory09:05:200
14759880,4rtkit-daemon3490020-21munin-node09:31:010
14759880,4rtkit-daemon214-21plymouthd12:25:250
14759880,4rtkit-daemon214-21plymouthd11:30:100
14759880,4rtkit-daemon214-21plymouthd11:22:062
14759880,4rtkit-daemon1-21systemd09:36:330
14759880,3rtkit-daemon730-21ntpd10:12:261
14759880,3rtkit-daemon214-21plymouthd10:31:490
3955863271,3sleep23955895-21apt-get12:30:152
3867459271,4sleep13867467-21ssh11:34:311
3849863270,1sleep10-21swapper/111:20:371
3830727270,4sleep03832802-21cut11:10:180
3825019270,4sleep03825241-21sed11:05:250
3818000272,3sleep13770473-21kworker/u16:0+xprtiod11:01:461
3817165270,4sleep23817413-21unixbench_singl11:00:272
3784852271,3sleep03784931-21ntp_states10:40:210
3782896270,5sleep23784692-21latency10:40:182
3779661272,3sleep1214-21plymouthd10:40:021
3763660270,4sleep23682985-21kworker/u16:1+rpciod10:30:122
3733258270,5sleep23735190-21kthreadcore10:10:212
3732023270,4sleep03732356-21sed10:10:190
3730860271,1sleep23641690-21kworker/u16:4-rpciod10:08:542
3705850271,3sleep03705858-21ssh09:51:310
3676150271,3sleep10-21swapper/109:35:171
3666821270,5sleep10-21swapper/109:28:401
3603558274,1sleep1321rcuc/108:40:231
3535606270,1sleep20-21swapper/207:46:352
3498672271,3sleep13498705-21apt-get07:20:141
3491237270,4sleep03492277-21munin-node07:15:030
14759870,4rtkit-daemon720-21snmpd11:50:152
14759870,4rtkit-daemon720-21snmpd07:20:222
14759870,4rtkit-daemon720-21snmpd07:10:102
14759870,4rtkit-daemon515-21gmain07:50:210
14759870,4rtkit-daemon1-21systemd11:28:550
14759870,3rtkit-daemon730-21ntpd10:45:190
14759870,3rtkit-daemon3697780-21ssh09:46:261
14759870,3rtkit-daemon3621912-21ntp_states08:55:210
14759870,3rtkit-daemon3490020-21munin-node11:05:372
14759870,3rtkit-daemon214-21plymouthd11:41:030
14759870,3rtkit-daemon214-21plymouthd08:48:160
14759870,3rtkit-daemon214-21plymouthd08:20:390
14759870,3rtkit-daemon214-21plymouthd07:15:232
14759870,3rtkit-daemon1-21systemd12:01:042
14759870,3rtkit-daemon1-21systemd10:55:140
14759870,3rtkit-daemon1-21systemd08:50:280
14759870,3rtkit-daemon1-21systemd07:46:490
14759870,2rtkit-daemon214-21plymouthd10:18:182
14759870,1rtkit-daemon0-21swapper/007:23:460
3962534260,1sleep00-21swapper/012:32:460
3954824260,4sleep20-21swapper/212:28:262
3946435260,3sleep13946443-21ssh12:22:291
3930879260,1sleep20-21swapper/212:13:362
3914734260,4sleep03914736-21ssh12:03:080
3907180261,3sleep00-21swapper/011:59:150
3893378261,2sleep10-21swapper/111:50:181
3884021260,3sleep23884181-21df_inode11:45:152
3875649260,3sleep13875792-21cat11:40:011
3875263260,1sleep20-21swapper/211:39:052
3857899260,4sleep13762097-21kworker/u16:3+rpciod11:25:461
3844125260,2sleep00-21swapper/011:20:120
3843491260,1sleep10-21swapper/111:19:251
3834403260,1sleep10-21swapper/111:12:201
3810919260,1sleep10-21swapper/110:58:531
3809595260,1sleep20-21swapper/210:55:492
3801809260,1sleep20-21swapper/210:51:212
3793929260,1sleep20-21swapper/210:46:402
3779374260,1sleep20-21swapper/210:39:582
3761984260,1sleep20-21swapper/210:26:492
3754630260,1sleep10-21swapper/110:23:221
3713598260,1sleep20-21swapper/209:55:542
3688916263,1sleep20-21swapper/209:40:242
3682897260,1sleep20-21swapper/209:38:512
3673459260,1sleep20-21swapper/209:30:262
3667758260,2sleep10-21swapper/109:30:131
3665192260,1sleep20-21swapper/209:25:242
3658560260,1sleep10-21swapper/109:23:041
3650294260,3sleep23650302-21ssh09:17:272
3635552260,3sleep23635131-21apt-get09:10:022
3634895260,1sleep20-21swapper/209:07:052
3620241260,3sleep23621688-21sort08:55:202
3604000260,1sleep20-21swapper/208:43:092
3591596260,1sleep20-21swapper/208:32:432
3570210261,3sleep1214-21plymouthd08:15:231
3566809260,1sleep20-21swapper/208:12:432
3554909260,1sleep20-21swapper/208:05:032
3547989260,1sleep20-21swapper/207:57:012
3541739260,1sleep10-21swapper/107:50:541
3523797260,3sleep13523952-21diskstats07:40:161
3523121260,1sleep10-21swapper/107:36:411
3516938260,3sleep23516949-21apt-get07:35:002
3516905260,1sleep20-21swapper/207:34:372
3516092261,2sleep10-21swapper/107:30:221
3492418260,3sleep13492451-21apt-get07:15:121
3489680260,1sleep10-21swapper/107:13:241
3482674260,3sleep03482703-21ntp_states07:05:210
3477884261,2sleep10-21swapper/107:05:141
3727818250,3sleep03728734-21ls10:05:230
3708604250,2sleep0221rcuc/009:55:210
3706663252,2sleep23483667-21cyclictest09:53:302
3631940250,3sleep10-21swapper/109:05:201
3616837250,2sleep13616992-21diskstats08:55:141
3611271250,2sleep10-21swapper/108:50:171
3610178250,1sleep10-21swapper/108:48:021
3592220251,2sleep20-21swapper/208:35:162
3592220251,2sleep20-21swapper/208:35:152
3585848250,2sleep10-21swapper/108:30:141
3584685250,3sleep23584743-21ntp_states08:25:212
3574780250,2sleep10-21swapper/108:20:211
3573156250,3sleep20-21swapper/208:19:452
3559789250,2sleep10-21swapper/108:05:221
3548809250,2sleep10-21swapper/108:00:161
3548499250,2sleep20-21swapper/208:00:132
3489607250,3sleep00-21swapper/007:12:260
3819675240,2sleep13819683-21ssh11:05:101
3770619240,2sleep1214-21plymouthd10:33:161
3760870240,2sleep13760920-21ps10:25:231
3624353240,2sleep20-21swapper/209:00:202
3610276240,2sleep2214-21plymouthd08:49:192
3579665240,2sleep13579667-21acpi08:25:121
3578583240,2sleep2214-21plymouthd08:20:252
3561975240,2sleep10-21swapper/108:10:181
3506158241,1sleep20-21swapper/207:25:192
3963797230,1sleep00-21swapper/012:35:020
3528915230,1sleep20-21swapper/207:40:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional