You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 05:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 22, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4111750992723,1cyclictest0-21swapper/323:00:003
4111750992623,1cyclictest0-21swapper/323:34:593
4111750992623,1cyclictest0-21swapper/323:20:153
4111750992623,1cyclictest0-21swapper/300:25:013
4111750992623,1cyclictest0-21swapper/300:25:003
4111750992523,1cyclictest0-21swapper/322:30:173
4111750992218,1cyclictest0-21swapper/321:25:013
4111750992118,1cyclictest0-21swapper/322:05:003
4111750992118,1cyclictest0-21swapper/319:15:003
4111750992017,1cyclictest0-21swapper/323:55:003
411175099199,6cyclictest754932sleep321:12:243
4111750991916,1cyclictest0-21swapper/322:40:003
4111750991916,1cyclictest0-21swapper/321:45:003
4111750991916,1cyclictest0-21swapper/319:30:003
411175099191,15cyclictest62559-21turbostat21:09:553
411175099191,13cyclictest31288-21taskset20:39:573
1072972190,10sleep2107305-21ssh21:31:582
411175099188,6cyclictest3403042sleep323:58:543
4111750991815,1cyclictest0-21swapper/300:35:193
411175099181,13cyclictest76991-21taskset21:15:143
411175099181,13cyclictest381783-21taskset00:25:023
411175099181,13cyclictest381783-21taskset00:25:023
411175099181,13cyclictest229152-21chrt22:50:173
411175099180,6cyclictest188466-21turbostat22:25:003
4111750991714,1cyclictest0-21swapper/322:05:173
411175099171,13cyclictest274968-21chrt23:15:543
411175099171,12cyclictest4162883-21taskset19:45:223
411175099171,12cyclictest290694-21taskset23:25:283
4111750991613,1cyclictest0-21swapper/323:35:243
4111750991613,1cyclictest0-21swapper/322:25:193
4111750991613,1cyclictest0-21swapper/322:14:253
4111750991613,1cyclictest0-21swapper/321:45:223
4111750991612,1cyclictest0-21swapper/320:30:233
411175099161,12cyclictest62359-21chrt21:02:493
411175099161,12cyclictest56048-21taskset20:56:273
411175099161,12cyclictest43898-21taskset20:49:183
411175099161,12cyclictest4182092-21taskset20:05:023
411175099161,12cyclictest4132059-21taskset19:21:103
411175099161,12cyclictest356427-21taskset00:07:593
411175099161,12cyclictest341312-21taskset00:00:023
411175099161,12cyclictest245360-21chrt23:00:143
411175099161,12cyclictest212918-21taskset22:40:153
411175099161,12cyclictest17903-21taskset20:25:183
411175099161,11cyclictest389865-21taskset00:30:073
411175099161,11cyclictest371430-21taskset00:15:403
411175099161,11cyclictest266873-21taskset23:10:283
411175099160,13cyclictest148144-21chrt21:59:123
411175099160,12cyclictest36857-21chrt20:40:203
411175099160,12cyclictest314740-21chrt23:40:423
147598160,4rtkit-daemon83603-21ssh21:17:431
411175099155,6cyclictest981022sleep321:25:213
4111750991512,1cyclictest0-21swapper/322:45:213
411175099151,12cyclictest6484-21chrt20:18:373
411175099151,12cyclictest4125925-21taskset19:17:053
411175099151,12cyclictest364291-21chrt00:12:363
411175099151,12cyclictest322817-21chrt23:45:593
411175099151,12cyclictest12733-21taskset20:24:253
411175099151,11cyclictest49237-21taskset20:50:183
411175099151,11cyclictest4193995-21taskset20:11:353
411175099151,11cyclictest4175598-21taskset19:59:293
411175099151,11cyclictest4156777-21chrt19:40:503
411175099151,11cyclictest253091-21taskset23:05:033
411175099151,11cyclictest172750-21taskset22:15:023
411175099151,11cyclictest140416-21taskset21:54:463
411175099151,11cyclictest106817-21taskset21:30:493
411175099150,12cyclictest4163534-21taskset19:50:043
411175099150,12cyclictest108888-21chrt21:35:023
411175099150,11cyclictest4148958-21taskset19:35:163
41105802151,10sleep14105723-21/usr/sbin/munin19:05:181
4111750991413,1cyclictest0-21swapper/320:00:423
411175099141,10cyclictest4138748-21taskset19:30:043
3557432140,11sleep2355751-21ssh00:06:182
2859642143,8sleep2287076-21kthreadcore23:25:202
147598140,9rtkit-daemon373940-21fschecks_time00:20:142
147598140,9rtkit-daemon373940-21fschecks_time00:20:142
147598140,5rtkit-daemon729-21lldpd00:39:131
2608272131,9sleep1260835-21ssh23:10:001
1176122130,4sleep2118570-21cut21:40:152
3872162120,9sleep1387436-21grep00:25:221
3872162120,9sleep1387436-21grep00:25:211
256952121,8sleep025781-21interrupts20:35:170
2097282120,8sleep1209898-21awk22:35:201
1576972125,1sleep2171rcu_preempt22:05:162
147598120,8rtkit-daemon720-21snmpd19:54:361
147598120,8rtkit-daemon4118047-21munin-node21:10:131
3728062110,8sleep0372814-21ssh00:18:520
3720762110,8sleep1372082-21ssh00:17:111
1947382110,8sleep2194744-21ssh22:26:042
147598110,7rtkit-daemon323890-21ssh23:48:311
147598110,7rtkit-daemon276264-21ssh23:18:510
147598110,7rtkit-daemon10059-21kthreadcore20:20:201
41624482100,7sleep04162523-21find19:45:210
4042302100,1sleep00-21swapper/000:36:580
3820332100,7sleep0382087-21fschecks_count00:25:130
3820332100,7sleep0382087-21fschecks_count00:25:120
3569372100,8sleep0356944-21sh00:09:050
3250972100,2sleep1325134-21apt-get23:50:111
3143432101,6sleep20-21swapper/223:40:252
2361782100,1sleep1236184-21ssh22:54:041
1640452101,6sleep0164053-21ssh22:08:580
147598100,6rtkit-daemon56603-21/usr/sbin/munin21:00:211
147598100,6rtkit-daemon4170384-21irqcore19:55:161
147598100,6rtkit-daemon324520-21cron23:54:552
147598100,6rtkit-daemon313-21systemd-udevd20:11:421
147598100,6rtkit-daemon264478-21kthreadcore23:10:220
147598100,5rtkit-daemon245529-21hddtemp_smartct23:00:160
147598100,4rtkit-daemon292597-21ssh23:29:510
147598100,1rtkit-daemon0-21swapper/222:10:542
1116972107,1sleep00-21swapper/021:35:210
4152501290,6sleep24153919-21kthreadcore19:40:222
4138760291,4sleep04138793-21apt-get19:30:130
307021290,7sleep1307027-21ssh23:36:121
293182290,6sleep0293245-21fschecks_count23:30:150
285379290,7sleep1285963-21sed23:25:181
277121290,6sleep0277249-21grep23:20:120
237195291,4sleep1237219-21apt-get22:55:121
210058291,5sleep0210198-21timerandwakeup22:35:230
179741291,2sleep20-21swapper/222:18:182
14759890,6rtkit-daemon720-21snmpd22:33:490
14759890,6rtkit-daemon1540-21sendmail-mta19:35:361
14759890,6rtkit-daemon0-21swapper/223:55:302
14759890,5rtkit-daemon214-21plymouthd20:58:271
14759890,5rtkit-daemon172543-21kworker/0:2+kacpid22:55:120
14759890,4rtkit-daemon30492-21grep20:35:231
14759890,4rtkit-daemon15427-21tr20:25:161
14759890,3rtkit-daemon214-21plymouthd20:15:241
14759890,2rtkit-daemon214-21plymouthd22:45:050
14759890,2rtkit-daemon214-21plymouthd19:19:270
14759890,1rtkit-daemon0-21swapper/222:03:382
14759890,1rtkit-daemon0-21swapper/023:37:260
13034291,5sleep00-21swapper/020:25:110
116532290,7sleep2116540-21ssh21:39:482
100214290,6sleep1100222-21ssh21:29:051
4182141281,4sleep24182298-21/usr/sbin/munin20:05:152
4169451281,4sleep24169468-21munin-run19:55:002
38001281,4sleep238034-21apt-get20:45:132
341220280,1sleep20-21swapper/200:00:022
338299281,4sleep1338426-21python323:55:191
323253280,1sleep00-21swapper/023:47:050
267832280,6sleep1267840-21ssh23:12:471
245192281,3sleep1245231-21apt-get23:00:131
220797281,4sleep2220940-21df22:45:152
220753281,3sleep1220792-21apt-get22:45:141
195819280,1sleep00-21swapper/022:28:380
163957280,2sleep1163965-21ssh22:08:471
14759880,5rtkit-daemon1540-21sendmail-mta19:12:580
14759880,4rtkit-daemon99666-21ssh21:27:480
14759880,4rtkit-daemon515-21gmain19:06:310
14759880,4rtkit-daemon515-21gmain00:15:072
14759880,4rtkit-daemon4144649-21runrttasks19:34:301
14759880,4rtkit-daemon4118047-21munin-node20:48:121
14759880,4rtkit-daemon4118047-21munin-node19:21:501
14759880,4rtkit-daemon393858-21cut00:30:181
14759880,4rtkit-daemon364667-21ssh00:13:221
14759880,4rtkit-daemon214-21plymouthd21:05:161
14759880,4rtkit-daemon187528-21ssh22:22:510
14759880,4rtkit-daemon147464-21ssh21:57:350
14759880,4rtkit-daemon1-21systemd23:41:011
14759880,4rtkit-daemon1-21systemd21:20:431
14759880,3rtkit-daemon214-21plymouthd19:45:511
14759880,2rtkit-daemon0-21swapper/022:50:020
14759880,1rtkit-daemon0-21swapper/120:31:011
14759880,1rtkit-daemon0-21swapper/021:30:480
140149281,5sleep1140155-21ssh21:54:051
130390281,4sleep0130583-21users21:45:220
76960270,4sleep20-21swapper/221:15:142
4187453271,3sleep04187688-21users20:05:250
4164038270,5sleep00-21swapper/019:50:170
4137950270,4sleep14138135-21users19:25:251
4117881271,3sleep10-21swapper/119:15:011
404953270,5sleep2404961-21ssh00:38:412
396849270,5sleep2355451-21kworker/u16:2+rpciod00:33:232
381834271,3sleep2381873-21apt-get00:25:112
381834271,3sleep2381873-21apt-get00:25:102
380063270,4sleep0380071-21ssh00:22:160
380063270,4sleep0380071-21ssh00:22:150
357985272,2sleep20-21swapper/200:10:162
346847270,4sleep0347099-21users00:00:230
334084270,4sleep0335255-21grep23:55:140
331761270,1sleep0214-21plymouthd23:52:430
324196270,5sleep2324205-21ssh23:49:112
315401270,1sleep00-21swapper/023:42:210
300105270,5sleep10-21swapper/123:33:471
298972270,5sleep20-21swapper/223:31:082
282394270,4sleep2282540-21timerandwakeup23:20:222
261551272,3sleep2262107-21irqcore23:10:202
245236270,5sleep2245359-21cut23:00:142
219468271,4sleep1154809-21kworker/u16:0+nfsiod22:42:541
205675270,5sleep2421rcuc/222:35:172
187268274,1sleep10-21swapper/122:22:191
187054270,5sleep2187062-21ssh22:21:522
14759870,4rtkit-daemon720-21snmpd23:05:330
14759870,4rtkit-daemon720-21snmpd21:59:252
14759870,4rtkit-daemon515-21gmain20:00:151
14759870,4rtkit-daemon4118047-21munin-node19:42:431
14759870,4rtkit-daemon0-21swapper/120:40:041
14759870,4rtkit-daemon0-21swapper/100:03:581
14759870,3rtkit-daemon720-21snmpd20:05:491
14759870,3rtkit-daemon4118047-21munin-node21:40:490
14759870,3rtkit-daemon4118047-21munin-node20:51:081
14759870,3rtkit-daemon214-21plymouthd00:05:131
14759870,3rtkit-daemon1-21systemd22:42:290
14759870,3rtkit-daemon1-21systemd21:50:200
132819270,4sleep219009-21kworker/2:0+mm_percpu_wq21:50:052
11961271,3sleep212086-21sshd20:20:242
100046270,4sleep2100053-21sh21:28:372
85881260,4sleep086987-21grep21:20:170
74865260,1sleep00-21swapper/021:10:560
68624260,1sleep20-21swapper/221:08:492
68597260,1sleep00-21swapper/021:08:270
6322260,1sleep00-21swapper/020:16:340
62508260,1sleep00-21swapper/021:04:430
6246260,1sleep20-21swapper/220:15:372
56259260,1sleep20-21swapper/220:59:122
51600261,2sleep00-21swapper/020:55:170
44203260,1sleep00-21swapper/020:50:090
4194088260,1sleep20-21swapper/220:12:472
4181733260,1sleep00-21swapper/020:03:350
4170678260,3sleep24171838-21kthreadcore19:55:162
4162637260,3sleep24162882-21awk19:45:222
4156888260,1sleep00-21swapper/019:42:150
4149863260,3sleep04150024-21ntpq19:35:180
4133495260,4sleep24134430-21grep19:25:182
4125879260,1sleep10-21swapper/119:16:321
4117526260,1sleep20-21swapper/219:10:282
41117509964,1cyclictest0-21swapper/319:10:013
4106544261,2sleep20-21swapper/219:05:152
396906260,4sleep0396913-21sh00:33:330
37236260,1sleep20-21swapper/220:41:562
357691260,3sleep0357853-21diskstats00:10:130
31987261,3sleep032925-21kthreadcore20:40:150
30444261,2sleep20-21swapper/220:35:232
279232261,2sleep10-21swapper/123:20:171
24868260,1sleep00-21swapper/020:31:420
243296260,1sleep20-21swapper/222:56:212
235128260,1sleep2235136-21ssh22:51:362
201788260,3sleep1214-21plymouthd22:30:201
198088262,2sleep2431ktimers/222:30:172
188699260,1sleep10-21swapper/122:25:021
172829261,3sleep00-21swapper/022:15:120
171869260,1sleep00-21swapper/022:13:320
164798261,1sleep10-21swapper/122:10:131
150182261,2sleep10-21swapper/122:00:181
14759860,2rtkit-daemon4126845-21ps19:20:180
14759860,2rtkit-daemon214-21plymouthd00:24:311
14759860,2rtkit-daemon214-21plymouthd00:24:301
145485260,3sleep1145970-21sed21:55:211
132537260,3sleep1132650-21sed21:50:011
130738260,1sleep20-21swapper/221:45:492
116851260,1sleep1214-21plymouthd21:40:021
114321260,1sleep10-21swapper/121:35:261
91694250,3sleep20-21swapper/221:22:482
82905251,2sleep0214-21plymouthd21:16:020
43676250,3sleep00-21swapper/020:46:270
4181643250,3sleep20-21swapper/220:02:252
4174947251,2sleep00-21swapper/019:55:230
4146907251,2sleep20-21swapper/219:35:162
4117919250,2sleep24118379-21irqstats19:15:012
306935250,3sleep2306942-21diskmemload23:36:012
270254251,2sleep1271397-21cut23:15:171
260643250,3sleep20-21swapper/223:09:372
23237250,3sleep20-21swapper/220:30:182
18213250,3sleep2214-21plymouthd20:25:222
179482250,3sleep10-21swapper/122:17:451
148824250,2sleep00-21swapper/022:00:140
70634240,2sleep20-21swapper/221:10:192
6873240,1sleep00-21swapper/020:20:140
62279240,2sleep2214-21plymouthd21:01:492
49857240,1sleep20-21swapper/220:51:272
4193960240,2sleep00-21swapper/020:11:090
4132818240,2sleep0214-21plymouthd19:25:160
274959240,2sleep2274967-21ssh23:15:542
215078240,2sleep2217124-21kthreadcore22:40:192
4138948230,1sleep20-21swapper/219:30:162
4126423230,1sleep20-21swapper/219:20:062
100657230,1sleep10-21swapper/121:30:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional