You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 11:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Fri Dec 19, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
274883991811,5cyclictest0-21swapper/323:30:123
274883991410,1cyclictest0-21swapper/320:30:133
27488399140,12cyclictest0-21swapper/320:25:123
27488399131,11cyclictest0-21swapper/322:10:013
27488399130,1cyclictest0-21swapper/319:10:123
27488399130,11cyclictest0-21swapper/322:15:133
27488399130,11cyclictest0-21swapper/319:15:113
27488399120,1cyclictest0-21swapper/321:00:123
27488399120,11cyclictest0-21swapper/323:45:133
27488399120,11cyclictest0-21swapper/323:20:213
27488399120,11cyclictest0-21swapper/320:20:203
27488399120,11cyclictest0-21swapper/300:25:223
274883991111,0cyclictest0-21swapper/321:15:113
274883991110,0cyclictest0-21swapper/300:00:153
27488399110,9cyclictest0-21swapper/321:50:123
27488399110,1cyclictest0-21swapper/320:00:213
27488399110,10cyclictest0-21swapper/322:40:203
27488399110,0cyclictest0-21swapper/323:25:123
27488399110,0cyclictest0-21swapper/322:40:013
27488399110,0cyclictest0-21swapper/321:25:193
27488399110,0cyclictest0-21swapper/319:39:563
27488399109,0cyclictest0-21swapper/300:35:193
27488399106,0cyclictest0-21swapper/322:20:123
274883991010,0cyclictest0-21swapper/322:50:123
274883991010,0cyclictest0-21swapper/320:50:213
274883991010,0cyclictest0-21swapper/320:45:113
27488399100,9cyclictest0-21swapper/300:20:183
27488399100,10cyclictest0-21swapper/319:45:123
27488399100,0cyclictest0-21swapper/323:15:123
2748839999,0cyclictest0-21swapper/322:27:023
2748839999,0cyclictest0-21swapper/321:30:193
2748839999,0cyclictest0-21swapper/321:10:133
2748839999,0cyclictest0-21swapper/320:10:133
2748839999,0cyclictest0-21swapper/319:30:003
2748839999,0cyclictest0-21swapper/300:10:223
2748839998,1cyclictest0-21swapper/321:55:123
2748839998,0cyclictest0-21swapper/320:35:183
2748839998,0cyclictest0-21swapper/319:55:123
2748839990,9cyclictest0-21swapper/323:10:163
2748839990,8cyclictest0-21swapper/320:55:223
2748839990,0cyclictest0-21swapper/320:15:183
2748839988,0cyclictest0-21swapper/323:00:183
2748839988,0cyclictest0-21swapper/321:45:203
2748839988,0cyclictest0-21swapper/321:40:153
2748839988,0cyclictest0-21swapper/319:40:123
2748839988,0cyclictest0-21swapper/319:20:103
273042281,4sleep30-21swapper/319:05:143
2748839977,0cyclictest0-21swapper/323:50:193
2748839977,0cyclictest0-21swapper/322:45:193
2748839977,0cyclictest0-21swapper/320:40:213
2748839976,0cyclictest0-21swapper/323:55:193
14039870,3rtkit-daemon622-21wpa_supplicant19:07:532
2748839961,4cyclictest0-21swapper/319:31:513
2748839960,6cyclictest0-21swapper/321:35:163
2748839960,5cyclictest0-21swapper/323:40:003
2748839960,5cyclictest0-21swapper/322:55:213
2748839955,0cyclictest0-21swapper/321:05:203
2748839955,0cyclictest0-21swapper/300:31:103
2748839955,0cyclictest0-21swapper/300:15:163
2748839954,0cyclictest0-21swapper/322:00:143
2748839951,2cyclictest0-21swapper/323:05:143
2748839950,4cyclictest0-21swapper/321:20:023
2748839950,4cyclictest0-21swapper/320:05:173
14039850,3rtkit-daemon766-21snmpd22:22:551
355150240,1sleep2355176-21apt-get22:30:132
318218240,2sleep2318244-21apt-get21:00:122
2748839944,0cyclictest0-21swapper/322:07:003
2748839943,0cyclictest0-21swapper/319:50:023
2748839940,3cyclictest386455-21chrt23:40:343
2748839940,3cyclictest0-21swapper/322:30:033
2748839940,3cyclictest0-21swapper/300:05:163
274556241,0sleep00-21swapper/019:08:070
274360242,1sleep10-21swapper/119:05:351
14039840,3rtkit-daemon766-21snmpd22:33:181
14039840,2rtkit-daemon772-21lldpd23:33:461
14039840,2rtkit-daemon772-21lldpd21:23:582
14039840,2rtkit-daemon376461-21find23:20:131
14039840,2rtkit-daemon1410-21sendmail-mta22:59:221
14039840,2rtkit-daemon1410-21sendmail-mta20:05:162
14039840,2rtkit-daemon1-21systemd22:51:361
14039840,2rtkit-daemon1-21systemd22:19:081
14039840,2rtkit-daemon1-21systemd00:04:111
308689230,2sleep2308901-21cpuspeed_turbos20:35:142
14039830,2rtkit-daemon769-21ntpd21:40:012
14039830,2rtkit-daemon766-21snmpd22:40:451
14039830,2rtkit-daemon766-21snmpd00:32:081
14039830,2rtkit-daemon418-21systemd-journal23:55:111
14039830,2rtkit-daemon418-21systemd-journal23:05:501
14039830,2rtkit-daemon1-21systemd23:41:071
14039830,1rtkit-daemon769-21ntpd19:57:022
14039830,1rtkit-daemon769-21ntpd00:29:171
14039830,1rtkit-daemon766-21snmpd23:50:081
14039830,1rtkit-daemon766-21snmpd21:33:342
14039830,1rtkit-daemon766-21snmpd19:50:002
14039830,1rtkit-daemon691-21gmain00:10:451
14039830,1rtkit-daemon622-21wpa_supplicant23:16:061
14039830,1rtkit-daemon615-21rsyslogd20:30:302
14039830,1rtkit-daemon615-21rsyslogd19:40:292
14039830,1rtkit-daemon608-21NetworkManager19:29:182
14039830,1rtkit-daemon328-21plymouthd22:03:472
14039830,1rtkit-daemon328-21plymouthd21:55:272
14039830,1rtkit-daemon328-21plymouthd21:54:292
14039830,1rtkit-daemon328-21plymouthd19:20:212
14039830,1rtkit-daemon328-21plymouthd00:15:201
14039830,1rtkit-daemon276878-21munin-node21:46:172
14039830,1rtkit-daemon259560-21munin-node19:12:202
14039830,1rtkit-daemon1410-21sendmail-mta23:10:121
14039830,1rtkit-daemon1410-21sendmail-mta22:36:161
14039830,1rtkit-daemon1-21systemd23:45:221
14039830,1rtkit-daemon1-21systemd23:29:141
14039830,1rtkit-daemon1-21systemd22:45:521
14039830,1rtkit-daemon1-21systemd22:26:201
14039830,1rtkit-daemon1-21systemd22:06:402
14039830,1rtkit-daemon1-21systemd21:38:592
14039830,1rtkit-daemon1-21systemd21:13:162
14039830,1rtkit-daemon1-21systemd20:00:202
14039830,1rtkit-daemon1-21systemd19:32:112
14039830,0rtkit-daemon0-21swapper/221:28:112
14039830,0rtkit-daemon0-21swapper/221:09:412
14039830,0rtkit-daemon0-21swapper/123:37:181
404064220,1sleep2404126-21munin-run00:25:002
395021220,1sleep2395025-21ssh00:01:522
391123220,1sleep00-21swapper/023:54:460
389066220,1sleep0389100-21munin-run23:50:000
383770220,0sleep00-21swapper/023:35:200
372239220,0sleep00-21swapper/023:10:150
366369220,1sleep0366487-21sort22:55:180
365609221,1sleep0357081-21kworker/0:1+events22:54:330
357803220,1sleep20-21swapper/222:35:182
351753220,1sleep0351926-21smartctl22:20:190
342968220,1sleep1343034-21if_err_eno122:00:141
335550220,1sleep00-21swapper/021:41:240
332983220,1sleep0333130-21threads21:35:210
330528220,0sleep00-21swapper/021:30:150
330105220,1sleep1330131-21apt-get21:30:121
329854220,1sleep1329868-21munin-run21:30:001
327576220,0sleep00-21swapper/021:22:110
325454220,0sleep00-21swapper/021:16:270
308088220,0sleep00-21swapper/020:34:490
302082220,1sleep1302413-21latency_hist20:20:011
301213220,1sleep0301385-21python320:15:190
293541220,1sleep1293713-21python319:55:191
287101220,1sleep0287295-21/usr/sbin/munin19:40:130
283345220,1sleep0283592-21diskstats19:30:120
276430220,0sleep00-21swapper/019:11:440
14039820,1rtkit-daemon769-21ntpd20:45:112
14039820,1rtkit-daemon769-21ntpd20:10:192
14039820,1rtkit-daemon769-21ntpd19:50:412
14039820,1rtkit-daemon766-21snmpd20:50:222
14039820,1rtkit-daemon1-21systemd20:56:072
14039820,1rtkit-daemon1-21systemd19:15:082
14039820,1rtkit-daemon1-21systemd00:20:041
14039820,0rtkit-daemon766-21snmpd20:40:092
14039820,0rtkit-daemon766-21snmpd20:25:272
14039820,0rtkit-daemon328-21plymouthd21:15:252
14039820,0rtkit-daemon328-21plymouthd19:35:122
14039820,0rtkit-daemon328-21plymouthd00:35:421
14039820,0rtkit-daemon0-21swapper/222:11:162
14039820,0rtkit-daemon0-21swapper/220:20:022
14039820,0rtkit-daemon0-21swapper/220:15:242
14039820,0rtkit-daemon0-21swapper/123:01:161
14039820,0rtkit-daemon0-21swapper/100:05:181
410081210,0sleep20-21swapper/200:35:212
409206210,0sleep00-21swapper/000:35:150
406839210,0sleep00-21swapper/000:30:160
406680210,0sleep20-21swapper/200:30:132
405477210,0sleep00-21swapper/000:25:180
405202210,0sleep20-21swapper/200:25:162
402269210,0sleep00-21swapper/000:20:140
401378210,0sleep20-21swapper/200:17:252
401244210,0sleep00-21swapper/000:16:150
397847210,0sleep20-21swapper/200:10:152
397743210,0sleep00-21swapper/000:10:130
395680210,0sleep00-21swapper/000:05:180
393929210,0sleep00-21swapper/000:00:170
392762210,0sleep00-21swapper/023:55:450
390717210,0sleep20-21swapper/223:51:102
387410210,0sleep20-21swapper/223:45:152
386100210,0sleep00-21swapper/023:40:200
384052210,0sleep20-21swapper/223:35:222
380914210,0sleep00-21swapper/023:30:150
380677210,0sleep20-21swapper/223:30:132
379351210,0sleep00-21swapper/023:25:200
379067210,0sleep20-21swapper/223:25:172
376975210,0sleep00-21swapper/023:20:180
376886210,0sleep20-21swapper/223:20:172
374330210,0sleep20-21swapper/223:15:122
374110210,0sleep00-21swapper/023:15:020
372393210,0sleep20-21swapper/223:10:162
370136210,0sleep20-21swapper/223:05:112
369884210,0sleep00-21swapper/023:05:010
368024210,0sleep00-21swapper/023:00:050
366016210,0sleep20-21swapper/222:55:162
365314210,0sleep20-21swapper/222:51:592
362174210,0sleep00-21swapper/022:45:170
361820210,0sleep2362034-21cpuspeed_turbos22:45:142
356502210,0sleep00-21swapper/022:30:480
354397210,0sleep20-21swapper/222:25:452
351476210,0sleep2351677-21sed22:20:172
349693210,0sleep00-21swapper/022:15:190
348287210,1sleep1766-21snmpd22:12:311
346161210,0sleep10-21swapper/122:07:191
346083210,1sleep00-21swapper/022:06:390
342260210,0sleep00-21swapper/022:00:010
340780210,0sleep10-21swapper/121:55:141
340506210,0sleep00-21swapper/021:55:130
338321210,0sleep00-21swapper/021:50:140
338311210,0sleep10-21swapper/121:50:111
337333210,0sleep00-21swapper/021:45:200
336871210,0sleep10-21swapper/121:45:171
335329210,0sleep10-21swapper/121:40:211
331836210,0sleep10-21swapper/121:35:021
327060210,0sleep10-21swapper/121:20:201
324050210,0sleep10-21swapper/121:15:111
323352210,0sleep00-21swapper/021:10:230
322043210,0sleep10-21swapper/121:10:121
320155210,0sleep00-21swapper/021:05:140
319082210,0sleep10-21swapper/121:00:191
318373210,0sleep00-21swapper/021:00:140
316903210,0sleep00-21swapper/020:55:180
314811210,0sleep00-21swapper/020:50:170
314377210,0sleep10-21swapper/120:50:141
312451210,1sleep00-21swapper/020:45:060
311529210,0sleep00-21swapper/020:40:200
310553210,0sleep10-21swapper/120:40:131
308106210,0sleep10-21swapper/120:35:011
304525210,0sleep00-21swapper/020:25:110
303361210,0sleep00-21swapper/020:20:190
299474210,0sleep10-21swapper/120:10:201
299301210,0sleep0299473-21python320:10:190
297629210,0sleep10-21swapper/120:05:201
296856210,0sleep00-21swapper/020:05:150
294936210,0sleep00-21swapper/020:00:140
290865210,0sleep10-21swapper/119:50:151
290835210,0sleep00-21swapper/019:50:140
289821210,0sleep10-21swapper/119:45:181
289688210,0sleep00-21swapper/019:45:170
288540210,0sleep10-21swapper/119:43:181
286390210,0sleep10-21swapper/119:35:341
285084210,0sleep00-21swapper/019:35:130
283593210,0sleep10-21swapper/119:30:131
282439210,0sleep00-21swapper/019:25:210
281289210,0sleep10-21swapper/119:25:131
279770210,0sleep10-21swapper/119:20:131
279563210,0sleep00-21swapper/019:20:120
276686210,0sleep10-21swapper/119:15:001
275024210,0sleep10-21swapper/119:10:131
14039810,0rtkit-daemon0-21swapper/222:15:032
395623200,0sleep20-21swapper/200:05:032
391392200,0sleep20-21swapper/223:55:032
385103200,0sleep20-21swapper/223:40:022
368021200,0sleep20-21swapper/223:00:032
359611200,0sleep00-21swapper/022:40:040
359169200,0sleep20-21swapper/222:40:032
357230200,0sleep00-21swapper/022:35:040
353030200,0sleep00-21swapper/022:25:030
346711200,0sleep00-21swapper/022:10:020
328088200,0sleep00-21swapper/021:25:040
320116200,0sleep10-21swapper/121:05:031
316270200,0sleep10-21swapper/120:55:031
312447200,0sleep10-21swapper/120:45:021
308604200,0sleep00-21swapper/020:35:040
306190200,0sleep10-21swapper/120:30:021
304277200,0sleep10-21swapper/120:25:001
302603200,0sleep10-21swapper/120:20:041
294666200,0sleep10-21swapper/120:00:031
292730200,0sleep00-21swapper/019:55:020
277385200,0sleep00-21swapper/019:15:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional