You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 16:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Nov 16, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81788992825,1cyclictest0-21swapper/312:30:003
81788992522,1cyclictest0-21swapper/308:25:243
8178899241,9cyclictest525917-21turbostat12:10:013
81788992320,1cyclictest0-21swapper/311:20:173
81788992118,1cyclictest0-21swapper/309:50:003
81788991916,1cyclictest0-21swapper/312:30:203
81788991916,1cyclictest0-21swapper/310:31:343
8178899191,13cyclictest109151-21chrt07:30:143
81788991815,1cyclictest0-21swapper/311:45:243
81788991815,1cyclictest0-21swapper/310:55:003
81788991815,1cyclictest0-21swapper/309:25:193
81788991815,1cyclictest0-21swapper/308:55:183
81788991815,1cyclictest0-21swapper/307:10:153
8178899181,14cyclictest91993-21taskset07:15:203
8178899181,13cyclictest274501-21chrt09:32:443
8178899181,13cyclictest248847-21taskset09:15:223
8178899181,13cyclictest191116-21turbostat08:35:013
8178899181,13cyclictest143595-21taskset07:55:193
8178899181,13cyclictest108018-21chrt07:25:213
81788991810,5cyclictest172009-21turbostat08:20:003
81788991810,5cyclictest172009-21turbostat08:20:003
8178899180,15cyclictest542022-21turbostat12:24:553
81788991715,1cyclictest0-21swapper/310:55:013
81788991714,1cyclictest0-21swapper/311:55:193
81788991714,1cyclictest0-21swapper/309:44:333
81788991714,1cyclictest0-21swapper/309:40:003
8178899171,12cyclictest443605-21taskset11:15:593
8178899171,12cyclictest178276-21taskset08:25:013
8178899171,12cyclictest165586-21chrt08:13:183
8178899171,12cyclictest134610-21chrt07:50:153
8178899170,13cyclictest475954-21chrt11:36:113
8178899170,13cyclictest437225-21chrt11:14:553
81788991613,1cyclictest0-21swapper/309:10:223
81788991613,1cyclictest0-21swapper/308:10:003
81788991613,1cyclictest0-21swapper/308:00:263
8178899161,12cyclictest540440-21taskset12:16:243
8178899161,12cyclictest468878-21taskset11:33:283
8178899161,12cyclictest453742-21taskset11:25:093
8178899161,12cyclictest422776-21taskset11:05:173
8178899161,12cyclictest419313-21chrt11:01:053
8178899161,12cyclictest391334-21taskset10:45:193
8178899161,12cyclictest386705-21taskset10:41:013
8178899161,12cyclictest363545-21taskset10:28:193
8178899161,12cyclictest340562-21taskset10:15:163
8178899161,12cyclictest338018-21chrt10:10:283
8178899161,12cyclictest324426-21chrt10:05:143
8178899161,12cyclictest306522-21taskset09:52:093
8178899161,12cyclictest228746-21chrt09:02:033
8178899161,12cyclictest209874-21taskset08:49:213
8178899161,12cyclictest203656-21chrt08:44:403
8178899161,12cyclictest197087-21taskset08:36:143
8178899160,13cyclictest477862-21chrt11:40:043
8178899160,13cyclictest378359-21taskset10:35:293
8178899160,12cyclictest322183-21chrt10:01:073
8178899155,7cyclictest526279-21taskset12:10:133
81788991512,1cyclictest0-21swapper/312:35:193
81788991512,1cyclictest0-21swapper/312:35:193
81788991512,1cyclictest0-21swapper/309:20:193
8178899151,12cyclictest517034-21taskset12:03:003
8178899151,12cyclictest235001-21chrt09:07:133
8178899151,11cyclictest499340-21taskset11:50:223
8178899151,11cyclictest308103-21taskset09:55:133
8178899151,11cyclictest133817-21taskset07:46:053
8178899151,11cyclictest127478-21taskset07:40:293
8178899150,12cyclictest349813-21chrt10:20:173
8178899150,12cyclictest211847-21chrt08:50:173
8178899150,12cyclictest121013-21taskset07:35:273
8178899145,7cyclictest966652sleep307:20:133
4217202141,10sleep1421858-21sed11:05:161
3807012141,4sleep2380738-21apt-get10:40:132
147598140,9rtkit-daemon88144-21munin-node09:25:170
1345592141,10sleep2134607-21cut07:50:142
4850942130,1sleep2235228-21diskmemload11:43:362
4452792131,10sleep0445282-21sh11:19:460
4049492130,3sleep0221rcuc/010:55:020
147598130,1rtkit-daemon0-21swapper/210:23:562
1296482130,2sleep00-21swapper/007:45:190
5087442120,9sleep0508752-21ssh11:57:250
4995402120,8sleep1499799-21unixbench_singl11:50:251
3567582121,8sleep0356955-21/usr/sbin/munin10:25:170
3509532120,9sleep0352996-21grep10:20:190
3461372120,3sleep1346144-21sh10:15:401
2289242125,2sleep0151ktimers/009:04:210
2243982120,9sleep2226097-21cut09:00:182
147598120,8rtkit-daemon429648-21cpu11:10:142
147598120,8rtkit-daemon274067-21ssh09:31:440
756972111,5sleep075730-21apt-get07:05:120
5720642111,7sleep1572115-21wc12:35:261
5720642111,7sleep1572115-21wc12:35:251
5255952110,2sleep2525603-21ssh12:09:142
4793722113,5sleep1480864-21kthreadcore11:40:191
4709342110,2sleep20-21swapper/211:35:192
4671502111,7sleep0467263-21/usr/sbin/munin11:30:240
2575962111,7sleep1257593-21ssh09:20:531
1836492111,7sleep0183985-21ntp_states08:25:220
147598110,7rtkit-daemon570075-21kthreadcore12:35:222
147598110,7rtkit-daemon570075-21kthreadcore12:35:212
147598110,7rtkit-daemon541604-21ssh12:19:062
147598110,7rtkit-daemon313-21systemd-udevd12:29:422
147598110,4rtkit-daemon214-21plymouthd10:34:032
821382100,7sleep182254-21fw_packets07:10:151
5659812100,1sleep00-21swapper/012:33:520
5335442100,7sleep2533552-21ssh12:13:582
4614112100,1sleep0461407-21sh11:29:560
4394962100,7sleep2441466-21kthreadcore11:15:192
147598100,7rtkit-daemon22110-21packagekitd10:56:332
147598100,6rtkit-daemon1540-21sendmail-mta10:47:362
147598100,6rtkit-daemon1540-21sendmail-mta08:17:120
147598100,6rtkit-daemon1540-21sendmail-mta08:17:120
147598100,5rtkit-daemon345543-21ntp_states10:15:240
147598100,5rtkit-daemon235228-21diskmemload09:20:290
147598100,2rtkit-daemon403304-21ssh10:52:081
567392290,6sleep0568323-21kthreadcore12:35:200
567392290,6sleep0568323-21kthreadcore12:35:200
556740291,5sleep0556747-21sh12:26:420
538184291,5sleep0539370-21memory12:15:200
504895290,6sleep2506971-21cut11:55:202
450718290,7sleep2450840-21ssh11:20:212
379033290,1sleep20-21swapper/210:37:012
332716290,6sleep0333230-21irqrtprio10:10:170
291568290,1sleep10-21swapper/109:44:551
275815290,7sleep2275906-21cut09:35:132
274492290,6sleep2274500-21ssh09:32:442
242441291,5sleep10-21swapper/109:13:041
237036295,2sleep00-21swapper/009:10:180
213555291,5sleep0215351-21/usr/sbin/munin08:50:190
210445291,4sleep2210478-21apt-get08:50:132
194388290,2sleep00-21swapper/008:35:210
159684291,4sleep2159214-21apt-get08:10:012
14759890,6rtkit-daemon214-21plymouthd12:30:182
14759890,6rtkit-daemon214-21plymouthd07:26:490
14759890,5rtkit-daemon720-21snmpd08:14:440
14759890,5rtkit-daemon476-21wpa_supplicant12:11:591
14759890,5rtkit-daemon425-21rpcbind12:12:400
14759890,5rtkit-daemon327234-21kthreadcore10:05:200
14759890,5rtkit-daemon298330-21ssh09:46:582
14759890,4rtkit-daemon720-21snmpd11:41:110
14759890,4rtkit-daemon234849-21sed09:05:270
14759890,3rtkit-daemon730-21ntpd07:17:391
14759890,2rtkit-daemon214-21plymouthd12:20:352
115535290,6sleep0115564-21/usr/sbin/munin07:35:170
508691280,1sleep10-21swapper/111:57:191
486004281,3sleep1486039-21apt-get11:45:131
405168281,3sleep0405203-21apt-get10:55:140
361579281,4sleep134-21ksoftirqd/110:25:221
310344280,5sleep0312407-21cut09:55:190
216712281,3sleep1216745-21apt-get08:55:141
184849281,4sleep1184883-21basename08:30:001
14759880,5rtkit-daemon729-21lldpd08:07:450
14759880,4rtkit-daemon88144-21munin-node11:46:300
14759880,4rtkit-daemon88144-21munin-node11:00:482
14759880,4rtkit-daemon720-21snmpd11:25:172
14759880,4rtkit-daemon720-21snmpd07:43:430
14759880,4rtkit-daemon525763-21ssh12:09:341
14759880,4rtkit-daemon362029-21ssh10:25:262
14759880,4rtkit-daemon347846-21ssh10:19:382
14759880,4rtkit-daemon295-21systemd-journal11:31:132
14759880,4rtkit-daemon214-21plymouthd12:00:541
14759880,4rtkit-daemon214-21plymouthd08:30:100
14759880,4rtkit-daemon150104-21cut08:00:200
14759880,4rtkit-daemon1-21systemd09:55:172
14759880,4rtkit-daemon1-21systemd09:41:420
14759880,4rtkit-daemon1-21systemd07:06:121
14759880,3rtkit-daemon720-21snmpd07:50:580
14759880,2rtkit-daemon1301676-21kworker/2:0+events11:05:152
14759880,1rtkit-daemon0-21swapper/109:49:461
14759880,1rtkit-daemon0-21swapper/009:38:530
14759880,1rtkit-daemon0-21swapper/007:31:350
90520271,4sleep090720-21hddtemp_smartct07:15:180
817889975,1cyclictest0-21swapper/307:10:023
78091271,3sleep278708-21kthreadcore07:05:182
564150270,4sleep1564263-21find12:30:251
549378270,1sleep00-21swapper/012:23:270
500280270,1sleep20-21swapper/211:51:302
493241270,1sleep20-21swapper/211:48:532
435080271,4sleep0435288-21/usr/sbin/munin11:10:240
370604270,1sleep10-21swapper/110:31:021
330952270,1sleep20-21swapper/210:07:432
330945270,1sleep1171rcu_preempt10:07:421
290695271,3sleep2265742-21kworker/u16:4+xprtiod09:42:552
275485270,4sleep1275617-21cat09:35:011
266360270,5sleep2720-21snmpd09:27:352
251618271,4sleep2251626-21ssh09:20:102
184074271,3sleep2184141-21unattended-upgr08:25:242
152018271,3sleep2152074-21ntp_states08:00:242
14759870,4rtkit-daemon88144-21munin-node10:01:370
14759870,4rtkit-daemon720-21snmpd07:20:241
14759870,3rtkit-daemon81778-21cyclictest08:24:090
14759870,3rtkit-daemon307717-21ssh09:54:582
14759870,3rtkit-daemon235228-21diskmemload10:50:482
14759870,3rtkit-daemon214-21plymouthd09:51:261
14759870,3rtkit-daemon214-21plymouthd09:16:060
14759870,3rtkit-daemon214-21plymouthd08:56:030
14759870,3rtkit-daemon1-21systemd11:37:290
14759870,3rtkit-daemon1-21systemd09:45:170
14759870,3rtkit-daemon1-21systemd08:46:310
14759870,1rtkit-daemon0-21swapper/008:40:090
145946271,3sleep014-21ksoftirqd/007:55:260
121866271,3sleep2121946-21cpuspeed_turbos07:40:172
114883270,1sleep10-21swapper/107:32:191
558125260,1sleep1214-21plymouthd12:29:561
548678260,1sleep10-21swapper/112:21:471
540774260,3sleep1540782-21ssh12:17:061
518288260,3sleep0518387-21cut12:05:140
516169260,1sleep00-21swapper/012:00:580
469907260,2sleep10-21swapper/111:35:141
462224260,3sleep1462863-21sed11:30:171
454784260,4sleep1455838-21grep11:25:201
453229260,1sleep10-21swapper/111:24:361
436038260,1sleep10-21swapper/111:12:111
420188260,1sleep00-21swapper/011:03:120
396512260,1sleep10-21swapper/110:49:581
387193260,1sleep00-21swapper/010:42:070
372652260,3sleep0372813-21df_inode10:35:140
371018260,1sleep00-21swapper/010:32:010
339972260,4sleep2340181-21cat10:15:002
339363260,1sleep10-21swapper/110:13:351
314347260,3sleep1314355-21ssh09:56:401
300018260,3sleep0300176-21df_inode09:50:140
248653260,3sleep1248786-21ntpq09:15:201
235004260,1sleep10-21swapper/109:07:151
234639260,4sleep2234856-21users09:05:282
222514260,1sleep20-21swapper/208:57:272
202852260,1sleep20-21swapper/208:40:272
177461260,4sleep244-21ksoftirqd/208:20:242
171907260,1sleep10-21swapper/108:18:591
171907260,1sleep10-21swapper/108:18:581
158938260,1sleep20-21swapper/208:06:412
128489260,3sleep2128759-21cut07:45:172
127832260,3sleep1127879-21munin-run07:45:001
121241260,1sleep10-21swapper/107:36:061
114884260,1sleep20-21swapper/207:32:202
103252260,4sleep1103806-21ps07:25:161
102509260,1sleep00-21swapper/007:24:000
87107250,2sleep00-21swapper/007:10:220
81938250,3sleep20-21swapper/207:10:032
514567250,3sleep2214-21plymouthd12:00:202
450927250,3sleep0451008-21sh11:20:220
445003250,3sleep10-21swapper/111:19:111
429044251,2sleep01-21systemd11:10:000
419235250,3sleep1419243-21ssh11:00:571
395771251,2sleep0388338-21kworker/u16:0-flush-0:4010:48:160
387528250,3sleep10-21swapper/110:42:521
379423251,2sleep1331ktimers/110:37:591
355090250,3sleep1720-21snmpd10:22:331
316582250,3sleep2214-21plymouthd10:00:172
276190250,2sleep1276831-21sed09:35:161
265010250,3sleep1265029-21ntp_states09:25:381
228062250,3sleep1228133-21ntp_states09:00:211
209779250,4sleep10-21swapper/108:48:081
191354250,2sleep20-21swapper/208:35:142
191006250,3sleep10-21swapper/108:33:571
190752250,3sleep20-21swapper/208:30:412
173671250,3sleep10-21swapper/108:20:181
165542250,3sleep10-21swapper/108:12:451
153175250,2sleep10-21swapper/108:05:171
147304250,2sleep10-21swapper/108:00:191
146351250,3sleep10-21swapper/107:56:301
140659250,3sleep2140811-21df_inode07:55:152
135735250,2sleep10-21swapper/107:50:171
120768250,3sleep20-21swapper/207:35:272
91061240,2sleep20-21swapper/207:15:202
500634240,2sleep0214-21plymouthd11:52:240
412171240,2sleep1412179-21ssh10:58:191
316375240,2sleep1316581-21smartctl10:00:161
249614240,2sleep2249622-21ssh09:16:012
242355240,2sleep2242363-21ssh09:12:532
216367240,3sleep10-21swapper/108:53:561
209811240,2sleep2214-21plymouthd08:48:322
197125240,2sleep10-21swapper/108:36:451
168961240,2sleep20-21swapper/208:15:192
168961240,2sleep20-21swapper/208:15:182
133815240,2sleep1214-21plymouthd07:46:041
103813240,1sleep20-21swapper/207:25:172
96629230,1sleep20-21swapper/207:20:132
197648230,1sleep10-21swapper/108:40:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional