You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 19:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Thu Nov 27, 2025 12:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
412413421400,1sleep10-21swapper/110:15:191
3865278992622,1cyclictest0-21swapper/309:25:023
3865278992421,1cyclictest0-21swapper/307:35:003
3865278992219,1cyclictest0-21swapper/311:05:223
3865278992118,1cyclictest0-21swapper/312:25:143
386527899201,13cyclictest3929652-21taskset08:00:003
386527899199,6cyclictest842562sleep311:52:443
386527899192,13cyclictest4064599-21turbostat09:40:003
3865278991917,1cyclictest0-21swapper/311:20:013
3865278991916,1cyclictest0-21swapper/310:55:353
3865278991916,1cyclictest0-21swapper/310:50:153
3865278991916,1cyclictest0-21swapper/308:50:143
3865278991915,1cyclictest0-21swapper/310:05:003
386527899190,14cyclictest3904885-21sleep07:40:003
40951222180,8sleep14095126-21ssh09:56:421
386527899181,8cyclictest4048709-21taskset09:30:013
3865278991815,1cyclictest0-21swapper/311:55:203
3865278991815,1cyclictest0-21swapper/309:55:123
386527899181,14cyclictest39223-21turbostat11:25:013
386527899181,13cyclictest4074122-21taskset09:45:153
386527899181,12cyclictest4152738-21taskset10:35:013
386527899181,12cyclictest3960837-21taskset08:25:023
386527899177,7cyclictest469312sleep311:29:203
3865278991715,1cyclictest0-21swapper/312:20:003
3865278991714,1cyclictest0-21swapper/311:45:003
3865278991713,1cyclictest0-21swapper/310:15:183
3865278991713,1cyclictest0-21swapper/307:50:003
386527899171,13cyclictest5561-21taskset11:01:383
386527899171,12cyclictest55574-21taskset11:35:123
386527899171,12cyclictest4171757-21taskset10:45:193
386527899171,12cyclictest4080819-21taskset09:50:003
386527899171,12cyclictest4064871-21taskset09:40:063
386527899171,12cyclictest116093-21taskset12:12:273
386527899169,5cyclictest3985403-21turbostat08:49:553
386527899166,7cyclictest217792sleep311:12:183
3865278991613,1cyclictest0-21swapper/312:30:223
3865278991613,1cyclictest0-21swapper/312:05:173
3865278991613,1cyclictest0-21swapper/310:30:173
3865278991613,1cyclictest0-21swapper/310:12:483
3865278991613,1cyclictest0-21swapper/309:35:003
386527899161,12cyclictest93514-21taskset12:00:013
386527899161,12cyclictest75495-21chrt11:45:263
386527899161,12cyclictest4168047-21chrt10:43:223
386527899161,12cyclictest4135870-21taskset10:23:353
386527899161,12cyclictest4110164-21chrt10:05:233
386527899161,12cyclictest4031048-21taskset09:17:183
386527899161,12cyclictest4023258-21taskset09:12:453
386527899161,12cyclictest4004364-21chrt09:00:113
386527899161,12cyclictest4003778-21taskset08:58:153
386527899161,12cyclictest3967032-21chrt08:30:093
386527899161,12cyclictest3947971-21taskset08:12:423
386527899161,12cyclictest3941878-21taskset08:08:343
386527899161,12cyclictest3935267-21chrt08:00:203
386527899161,12cyclictest3923363-21taskset07:54:083
386527899161,12cyclictest3874863-21taskset07:15:163
147598160,5rtkit-daemon720-21snmpd12:21:302
386527899156,6cyclictest40160022sleep309:06:053
3865278991513,1cyclictest0-21swapper/312:20:153
386527899151,11cyclictest53508-21taskset11:31:033
386527899151,11cyclictest4142972-21chrt10:26:283
386527899151,11cyclictest3985043-21taskset08:40:393
386527899151,11cyclictest3978801-21taskset08:35:313
386527899151,11cyclictest3910728-21taskset07:40:293
386527899151,11cyclictest3891945-21taskset07:25:303
386527899151,11cyclictest3885816-21taskset07:20:573
386527899151,11cyclictest3865454-21taskset07:10:033
386527899151,11cyclictest149494-21chrt12:35:073
386527899150,12cyclictest3960253-21chrt08:20:403
386527899150,12cyclictest3954218-21chrt08:18:073
41864512131,9sleep24188327-21cut10:55:172
41610642130,9sleep14161072-21ssh10:40:061
147598130,9rtkit-daemon4071873-21ssh09:43:280
41211292121,8sleep24121310-21sed10:15:172
39568012121,8sleep23958846-21tr08:20:162
39200802120,8sleep13922181-21kthreadcore07:50:211
147598120,8rtkit-daemon3948632-21fschecks_count08:15:140
147598120,8rtkit-daemon3871716-21munin-node09:50:130
147598120,5rtkit-daemon52794-21ssh11:30:210
1473332120,8sleep2147339-21ssh12:30:442
41587632111,7sleep24158769-21ssh10:35:572
38651552110,1sleep30-21swapper/307:10:013
38617542111,6sleep13863861-21kthreadcore07:05:211
229612112,5sleep2214-21plymouthd11:15:002
147598110,7rtkit-daemon474-21systemd-logind07:06:420
147598110,7rtkit-daemon4144467-21runrttasks10:29:550
147598110,7rtkit-daemon3871716-21munin-node12:16:360
147598110,6rtkit-daemon4193184-21apt-get11:00:132
147598110,4rtkit-daemon4126658-21ssh10:15:460
41775672100,3sleep24178501-21grep10:50:172
41741062100,7sleep14174218-21ntp_kernel_pll_10:45:221
41517652100,7sleep04151773-21ssh10:33:150
40546312100,1sleep10-21swapper/109:30:321
40042272101,7sleep20-21swapper/209:00:112
317962100,7sleep131948-21awk11:20:161
147598100,7rtkit-daemon1540-21sendmail-mta11:07:322
147598100,6rtkit-daemon720-21snmpd11:36:540
147598100,6rtkit-daemon313-21systemd-udevd09:19:421
147598100,5rtkit-daemon476-21wpa_supplicant10:39:250
147598100,5rtkit-daemon3885442-21python307:20:230
63587291,4sleep163621-21apt-get11:40:121
55532291,4sleep255567-21apt-get11:35:122
54134291,5sleep254141-21diskmemload11:32:322
4185505290,5sleep14186448-21grep10:55:161
4185350290,2sleep04185504-21sed10:55:150
4135314290,6sleep24135322-21ssh10:22:182
4111614295,2sleep10-21swapper/110:07:511
3961034292,4sleep23961132-21uniq08:25:142
3943118292,4sleep03944056-21cut08:10:160
3936084291,5sleep03936117-21apt-get08:05:120
36604291,5sleep236726-21ntpq11:20:212
31503291,6sleep0240-21jbd2/sda2-811:20:070
26328290,6sleep028207-21cat11:15:180
149520291,4sleep2149557-21apt-get12:35:112
14759890,6rtkit-daemon313-21systemd-udevd09:49:430
14759890,5rtkit-daemon3986934-21sed08:45:192
14759890,5rtkit-daemon3879195-21processes07:15:210
14759890,5rtkit-daemon214-21plymouthd11:45:132
14759890,5rtkit-daemon109073-21ssh12:09:410
14759890,4rtkit-daemon3905699-21irqcore07:40:170
14759890,4rtkit-daemon3895209-21grep07:30:160
14759890,3rtkit-daemon4097675-21cut10:00:151
14759890,1rtkit-daemon0-21swapper/008:27:420
141476291,4sleep0141513-21apt-get12:30:120
92803282,4sleep169630-21kworker/u16:1+xprtiod11:59:041
4136207280,5sleep14136215-21ssh10:24:221
4086683281,5sleep24086690-21diskmemload09:50:442
4041319280,5sleep24041609-21irqcore09:25:162
4040938280,2sleep14040946-21ssh09:25:071
4040100281,4sleep14040104-21ssh09:24:191
4016647281,4sleep24016780-21tr09:10:142
4004191281,3sleep14004224-21apt-get09:00:111
39536281,3sleep239575-21apt-get11:25:142
3929881281,3sleep03929905-21apt-get08:00:100
3892113280,1sleep20-21swapper/207:27:382
22668280,2sleep10-21swapper/111:14:151
14759880,4rtkit-daemon93003-21ssh11:59:290
14759880,4rtkit-daemon85052-21runrttasks11:54:340
14759880,4rtkit-daemon456-21avahi-daemon10:20:070
14759880,4rtkit-daemon3997061-21sensors08:50:232
14759880,4rtkit-daemon3974174-21irqrtprio08:35:132
14759880,4rtkit-daemon3955959-21irqstats08:20:140
14759880,4rtkit-daemon29335-21ssh11:16:181
14759880,4rtkit-daemon214-21plymouthd11:51:172
14759880,1rtkit-daemon0-21swapper/007:50:370
14759880,1rtkit-daemon0-21swapper/007:49:520
140156281,4sleep0140160-21ssh12:27:400
116507281,4sleep1116515-21ssh12:13:261
76589270,1sleep10-21swapper/111:48:311
69550270,1sleep00-21swapper/011:43:440
4182773270,4sleep14182779-21ssh10:50:361
4161125271,3sleep00-21swapper/010:40:130
4150592274,1sleep20-21swapper/210:30:402
4141890270,4sleep14141972-21ssh10:25:181
4104537270,1sleep00-21swapper/010:04:570
4095144270,4sleep04095152-21ssh09:56:440
4080858271,3sleep14080897-21apt-get09:50:111
4073239270,5sleep24074120-21irqrtprio09:45:152
4062729271,3sleep14062737-21ssh09:35:411
4056903270,4sleep2214-21plymouthd09:35:102
4049042270,5sleep00-21swapper/009:30:150
4039847270,5sleep04039855-21ssh09:23:450
4035472270,4sleep24037584-21tr09:20:202
4024543270,5sleep04024598-21cpuspeed_turbos09:15:120
4022505270,5sleep04016318-21diskmemload09:11:030
4003775270,1sleep00-21swapper/008:58:130
3967034270,3sleep03967067-21apt-get08:30:120
3950967270,4sleep13953076-21cut08:15:191
3928906270,1sleep10-21swapper/107:55:221
3904098270,4sleep13904314-21users07:35:221
3887714270,4sleep03889061-21grep07:25:160
3859497270,4sleep23859645-21/usr/sbin/munin07:05:182
23296271,3sleep223331-21apt-get11:15:122
15525270,4sleep015657-21hddtemp_smartct11:10:130
14759870,4rtkit-daemon730-21ntpd11:40:142
14759870,4rtkit-daemon720-21snmpd12:25:272
14759870,4rtkit-daemon3871716-21munin-node10:50:090
14759870,4rtkit-daemon1-21systemd09:07:062
14759870,4rtkit-daemon1-21systemd08:34:292
14759870,3rtkit-daemon730-21ntpd10:11:120
14759870,3rtkit-daemon4169140-21apt-get10:45:140
14759870,3rtkit-daemon3871716-21munin-node10:08:182
14759870,3rtkit-daemon3871716-21munin-node07:55:370
14759870,3rtkit-daemon3865657-21diskstats07:10:150
14759870,3rtkit-daemon295-21systemd-journal07:36:330
14759870,3rtkit-daemon214-21plymouthd12:10:190
14759870,3rtkit-daemon214-21plymouthd12:02:270
14759870,3rtkit-daemon214-21plymouthd11:25:490
14759870,3rtkit-daemon214-21plymouthd09:30:172
14759870,3rtkit-daemon1-21systemd09:39:060
14759870,3rtkit-daemon1-21systemd09:15:122
14759870,3rtkit-daemon1-21systemd08:40:072
125877271,3sleep0214-21plymouthd12:20:160
99324260,4sleep20-21swapper/212:00:332
99284260,1sleep10-21swapper/112:00:281
8675260,3sleep010398-21cut11:05:170
84150260,1sleep10-21swapper/111:52:301
75791260,1sleep00-21swapper/011:46:440
61799260,1sleep10-21swapper/111:36:441
51393261,3sleep152534-21memory11:30:181
4807260,3sleep14966-21users11:00:251
4175765260,4sleep24175772-21sh10:47:512
4152823260,3sleep14152856-21apt-get10:35:121
4142741260,1sleep20-21swapper/210:25:552
4102629260,1sleep20-21swapper/210:00:342
4088868260,4sleep20-21swapper/209:55:092
4079728260,3sleep10-21swapper/109:48:081
4071219261,3sleep24071221-21ssh09:41:552
4046196260,3sleep04046269-21processes09:25:220
4023269260,4sleep14023276-21sh09:12:491
4016254260,1sleep10-21swapper/109:09:201
4011480260,3sleep04012651-21cut09:05:140
4010077260,1sleep00-21swapper/009:04:270
4003594260,1sleep10-21swapper/108:55:531
3997492260,1sleep00-21swapper/008:51:400
3991818260,1sleep10-21swapper/108:50:081
3991223260,1sleep00-21swapper/008:45:340
3985644260,2sleep13985677-21apt-get08:45:151
3979681260,1sleep10-21swapper/108:40:141
3954673260,3sleep13954730-21sort08:20:111
3948407260,1sleep20-21swapper/208:15:122
3944058260,2sleep10-21swapper/108:10:171
3935826261,3sleep13935827-21cron08:05:001
3906474260,3sleep10-21swapper/107:40:191
3898753260,3sleep23898775-21apt-get07:35:112
3898331260,1sleep20-21swapper/207:33:042
3892117260,1sleep10-21swapper/107:27:411
3885518260,3sleep13885762-21users07:20:251
3872194260,4sleep13871716-21munin-node07:15:031
3870584260,3sleep13870667-21/usr/sbin/munin07:10:221
154920261,2sleep1155114-21ssh12:35:221
14759860,3rtkit-daemon456-21avahi-daemon12:18:172
14759860,3rtkit-daemon3871716-21munin-node10:06:010
14759860,3rtkit-daemon1-21systemd08:56:122
14759860,2rtkit-daemon0-21swapper/111:25:081
147330261,3sleep1147332-21ssh12:30:431
140646260,4sleep1140652-21ssh12:28:491
132307260,3sleep1132311-21ssh12:22:571
108599260,1sleep20-21swapper/212:08:342
107390260,3sleep1107398-21ssh12:05:451
85528250,2sleep20-21swapper/211:55:132
6806250,3sleep00-21swapper/011:04:320
4161037250,2sleep24160531-21apt-get10:40:022
4149882250,2sleep10-21swapper/110:30:191
4066222250,2sleep10-21swapper/109:40:181
3978461251,2sleep00-21swapper/008:35:200
3973221250,2sleep10-21swapper/108:35:091
3972924250,1sleep10-21swapper/108:34:291
3966777250,3sleep13966948-21grep08:30:001
3947953250,1sleep20-21swapper/208:12:302
3936263250,2sleep20-21swapper/208:05:132
3933573250,3sleep23934786-21memory08:00:162
3923689250,2sleep20-21swapper/207:55:112
3923216250,1sleep20-21swapper/207:52:152
3914035250,3sleep23916167-21grep07:45:172
3910967250,3sleep20-21swapper/207:43:342
3892735250,2sleep10-21swapper/107:30:141
3886096250,3sleep20-21swapper/207:24:332
155749250,3sleep00-21swapper/012:36:340
116706250,3sleep20-21swapper/212:13:512
4112816240,2sleep14112824-21ssh10:10:071
3982141240,2sleep00-21swapper/008:40:180
3912661240,2sleep10-21swapper/107:45:161
3874341240,2sleep20-21swapper/207:15:162
13257240,2sleep113265-21ssh11:05:541
120495240,2sleep1122465-21ssh12:15:191
4112858230,1sleep2214-21plymouthd10:10:122
3936120230,1sleep10-21swapper/108:05:131
3865453230,1sleep20-21swapper/207:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional