You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Fri May 02, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3021104991311,1cyclictest0-21swapper/321:05:143
302110499130,12cyclictest0-21swapper/321:20:183
3021104991211,0cyclictest0-21swapper/319:55:153
302110499121,10cyclictest0-21swapper/300:20:013
302110499120,1cyclictest0-21swapper/322:30:143
302110499120,11cyclictest0-21swapper/323:25:133
302110499120,11cyclictest0-21swapper/323:04:563
302110499120,11cyclictest0-21swapper/322:03:373
302110499120,11cyclictest0-21swapper/300:35:203
302110499119,1cyclictest0-21swapper/320:00:153
3021104991111,0cyclictest0-21swapper/322:50:153
3021104991111,0cyclictest0-21swapper/322:20:133
3021104991110,1cyclictest0-21swapper/322:35:133
3021104991110,0cyclictest0-21swapper/323:40:133
3021104991110,0cyclictest0-21swapper/321:43:103
3021104991110,0cyclictest0-21swapper/300:05:143
302110499110,8cyclictest0-21swapper/319:30:123
302110499110,11cyclictest0-21swapper/320:05:233
302110499110,10cyclictest0-21swapper/300:30:013
302110499110,0cyclictest0-21swapper/323:30:153
302110499110,0cyclictest0-21swapper/322:05:013
302110499110,0cyclictest0-21swapper/319:35:123
302110499109,0cyclictest0-21swapper/319:21:113
3021104991010,0cyclictest0-21swapper/323:10:203
3021104991010,0cyclictest0-21swapper/322:40:183
3021104991010,0cyclictest0-21swapper/320:15:153
3021104991010,0cyclictest0-21swapper/320:10:163
302110499100,0cyclictest0-21swapper/323:50:183
302110499100,0cyclictest0-21swapper/322:15:203
302110499100,0cyclictest0-21swapper/300:30:143
30200122101,5sleep30-21swapper/319:05:193
30211049999,0cyclictest0-21swapper/323:20:203
30211049999,0cyclictest0-21swapper/323:05:143
30211049999,0cyclictest0-21swapper/322:11:203
30211049999,0cyclictest0-21swapper/320:40:263
30211049999,0cyclictest0-21swapper/319:15:133
30211049998,1cyclictest0-21swapper/320:55:013
30211049998,0cyclictest0-21swapper/323:55:123
30211049998,0cyclictest0-21swapper/323:45:163
30211049998,0cyclictest0-21swapper/323:35:133
30211049998,0cyclictest0-21swapper/320:30:133
30211049988,0cyclictest0-21swapper/322:55:133
30211049988,0cyclictest0-21swapper/321:26:443
30211049988,0cyclictest0-21swapper/321:15:203
30211049988,0cyclictest0-21swapper/320:45:173
30211049988,0cyclictest0-21swapper/319:10:143
30211049988,0cyclictest0-21swapper/300:02:113
30211049987,0cyclictest0-21swapper/321:57:023
30211049987,0cyclictest0-21swapper/321:45:153
30211049980,7cyclictest0-21swapper/321:50:203
30211049980,7cyclictest0-21swapper/300:20:223
30211049977,0cyclictest0-21swapper/323:16:423
30211049977,0cyclictest0-21swapper/322:25:183
30211049977,0cyclictest0-21swapper/320:21:103
30211049977,0cyclictest0-21swapper/319:45:173
30211049966,0cyclictest0-21swapper/321:35:153
30211049963,1cyclictest0-21swapper/320:40:013
30211049955,0cyclictest0-21swapper/322:45:213
30211049955,0cyclictest0-21swapper/300:11:453
30211049954,0cyclictest0-21swapper/320:28:333
30211049954,0cyclictest0-21swapper/319:53:273
30211049950,4cyclictest0-21swapper/319:40:253
30211049950,3cyclictest0-21swapper/321:00:173
30211049950,0cyclictest0-21swapper/321:35:013
13989850,2rtkit-daemon3097565-21apt-get22:20:131
13989850,2rtkit-daemon1399-21sendmail-mta19:05:221
13989850,0rtkit-daemon0-21swapper/122:40:331
30211049944,0cyclictest0-21swapper/319:25:593
30211049941,2cyclictest0-21swapper/320:55:173
30211049940,3cyclictest3068194-21taskset21:10:023
30211049940,3cyclictest3068194-21taskset21:10:023
3020764242,1sleep20-21swapper/219:07:542
3020112241,1sleep00-21swapper/019:05:200
13989840,2rtkit-daemon3103449-21ssh22:34:111
13989840,2rtkit-daemon1-21systemd22:27:361
13989840,2rtkit-daemon1-21systemd21:55:481
13989840,0rtkit-daemon0-21swapper/120:51:481
3155786230,2sleep23155790-21ssh00:37:352
3122625230,1sleep23122651-21apt-get23:20:142
3086918230,2sleep23086989-21/usr/sbin/munin21:55:172
3080245230,1sleep13080271-21apt-get21:40:151
3030283230,2sleep23029383-21/usr/sbin/munin19:30:202
13989830,2rtkit-daemon765-21lldpd22:06:001
13989830,2rtkit-daemon760-21snmpd00:07:361
13989830,2rtkit-daemon613-21systemd-logind23:38:511
13989830,2rtkit-daemon579-21rpcbind19:26:041
13989830,2rtkit-daemon436-21systemd-udevd22:47:501
13989830,2rtkit-daemon3067968-21diskmemload00:33:571
13989830,2rtkit-daemon1-21systemd23:16:001
13989830,1rtkit-daemon762-21ntpd19:55:541
13989830,1rtkit-daemon614-21wpa_supplicant23:41:201
13989830,1rtkit-daemon417-21systemd-journal23:32:531
13989830,1rtkit-daemon331-21plymouthd23:49:571
13989830,1rtkit-daemon331-21plymouthd21:18:261
13989830,1rtkit-daemon331-21plymouthd21:05:011
13989830,1rtkit-daemon331-21plymouthd20:35:151
13989830,1rtkit-daemon3093724-21ls22:10:131
13989830,1rtkit-daemon3023113-21munin-node00:15:451
13989830,1rtkit-daemon1-21systemd23:55:221
13989830,1rtkit-daemon1-21systemd23:12:121
13989830,1rtkit-daemon1-21systemd23:08:361
13989830,1rtkit-daemon1-21systemd23:02:001
13989830,1rtkit-daemon1-21systemd22:57:181
13989830,1rtkit-daemon1-21systemd22:54:481
13989830,1rtkit-daemon1-21systemd22:00:371
13989830,1rtkit-daemon1-21systemd21:46:211
13989830,1rtkit-daemon1-21systemd21:38:141
13989830,1rtkit-daemon1-21systemd19:37:161
13989830,1rtkit-daemon1-21systemd00:28:571
13989830,0rtkit-daemon0-21swapper/121:52:231
3153623220,0sleep00-21swapper/000:31:530
3146106220,1sleep03146307-21/usr/sbin/munin00:15:160
3139792220,1sleep23139874-21irqstats00:00:172
3138745220,2sleep23138746-21sh23:57:122
3126859220,1sleep03126990-21grep23:30:170
3113977220,1sleep23114125-21latency_hist23:00:002
3102513220,1sleep03102683-21python322:30:210
3097537220,1sleep00-21swapper/022:20:120
3096227220,1sleep03096400-21python322:15:200
3095958220,1sleep23096165-21sed22:15:172
3090529220,1sleep23090573-21unattended-upgr22:03:372
3085452220,1sleep03085702-21users21:50:220
3041141220,0sleep00-21swapper/020:00:110
3033850220,1sleep23033999-21ntp_states19:40:242
3030000220,1sleep03030152-21ntpq19:30:180
13989820,1rtkit-daemon765-21lldpd21:25:011
13989820,1rtkit-daemon765-21lldpd20:05:411
13989820,1rtkit-daemon760-21snmpd22:35:191
13989820,1rtkit-daemon760-21snmpd20:44:301
13989820,1rtkit-daemon760-21snmpd20:30:111
13989820,1rtkit-daemon760-21snmpd20:00:341
13989820,1rtkit-daemon760-21snmpd00:20:461
13989820,1rtkit-daemon6926-21packagekitd23:25:101
13989820,1rtkit-daemon6926-21packagekitd20:25:201
13989820,1rtkit-daemon684-21gmain19:50:051
13989820,1rtkit-daemon684-21gmain19:10:131
13989820,1rtkit-daemon614-21wpa_supplicant21:00:131
13989820,1rtkit-daemon331-21plymouthd20:15:071
13989820,1rtkit-daemon331-21plymouthd20:10:131
13989820,1rtkit-daemon331-21plymouthd19:30:381
13989820,1rtkit-daemon1-21systemd22:15:531
13989820,1rtkit-daemon1-21systemd21:20:501
13989820,1rtkit-daemon1-21systemd20:55:211
13989820,1rtkit-daemon1-21systemd19:20:291
13989820,0rtkit-daemon1397-21rtkit-daemon20:46:021
13989820,0rtkit-daemon0-21swapper/123:50:221
13989820,0rtkit-daemon0-21swapper/123:21:331
13989820,0rtkit-daemon0-21swapper/121:30:111
13989820,0rtkit-daemon0-21swapper/121:10:291
13989820,0rtkit-daemon0-21swapper/121:10:291
13989820,0rtkit-daemon0-21swapper/120:20:031
13989820,0rtkit-daemon0-21swapper/119:45:191
13989820,0rtkit-daemon0-21swapper/119:40:201
13989820,0rtkit-daemon0-21swapper/119:15:251
13989820,0rtkit-daemon0-21swapper/100:35:171
13989820,0rtkit-daemon0-21swapper/100:10:041
13989820,0rtkit-daemon0-21swapper/100:01:131
3155132210,0sleep00-21swapper/000:35:210
3152182210,0sleep20-21swapper/200:30:142
3151618210,0sleep20-21swapper/200:27:342
3150047210,0sleep00-21swapper/000:25:040
3148763210,0sleep20-21swapper/200:20:222
3147980210,0sleep00-21swapper/000:20:120
3145615210,0sleep20-21swapper/200:15:022
3145210210,0sleep20-21swapper/200:11:252
3144537210,0sleep00-21swapper/000:10:190
3141869210,0sleep20-21swapper/200:05:172
3141500210,0sleep00-21swapper/000:05:140
3140006210,0sleep00-21swapper/000:00:190
3137356210,0sleep00-21swapper/023:55:140
3136964210,0sleep20-21swapper/223:54:562
3136566210,0sleep00-21swapper/023:51:220
3134470210,1sleep00-21swapper/023:46:140
3133071210,0sleep20-21swapper/223:45:162
3132319210,0sleep20-21swapper/223:40:392
3130706210,0sleep00-21swapper/023:40:010
3130230210,1sleep00-21swapper/023:35:490
3128968210,0sleep20-21swapper/223:35:152
3128556210,0sleep20-21swapper/223:34:272
3125672210,0sleep00-21swapper/023:25:200
3124744210,0sleep20-21swapper/223:25:142
3124408210,0sleep00-21swapper/023:24:400
3120510210,0sleep20-21swapper/223:15:142
3120497210,1sleep00-21swapper/023:15:080
3118928210,0sleep20-21swapper/223:10:172
3118585210,0sleep00-21swapper/023:10:150
3117848210,0sleep00-21swapper/023:07:110
3117246210,0sleep20-21swapper/223:05:212
3114264210,0sleep00-21swapper/023:00:150
3112802210,0sleep00-21swapper/022:55:180
3111465210,1sleep00-21swapper/022:51:100
3110066210,0sleep20-21swapper/222:50:122
3108820210,0sleep20-21swapper/222:45:202
3107258210,0sleep00-21swapper/022:40:490
3106837210,0sleep23107035-21/usr/sbin/munin22:40:192
3103980210,0sleep20-21swapper/222:35:152
3103539210,0sleep00-21swapper/022:35:010
3102231210,0sleep20-21swapper/222:30:192
3100666210,0sleep20-21swapper/222:25:232
3099749210,0sleep00-21swapper/022:25:170
3098588210,0sleep20-21swapper/222:20:222
3093526210,0sleep20-21swapper/222:10:142
3093336210,0sleep00-21swapper/022:10:120
3092866210,1sleep00-21swapper/022:08:030
3091251210,0sleep20-21swapper/222:05:092
3088956210,0sleep00-21swapper/022:00:150
3087171210,0sleep00-21swapper/021:55:190
3084140210,0sleep20-21swapper/221:49:562
3083944210,1sleep00-21swapper/021:48:100
3080502210,0sleep00-21swapper/021:40:180
3080274210,0sleep20-21swapper/221:40:162
3078706210,0sleep20-21swapper/221:35:192
3077971210,0sleep00-21swapper/021:35:010
3077654210,0sleep20-21swapper/221:31:472
3076234210,0sleep00-21swapper/021:30:170
3075088210,0sleep20-21swapper/221:25:232
3074796210,0sleep00-21swapper/021:25:210
3073691210,1sleep00-21swapper/021:21:480
3070657210,0sleep00-21swapper/021:15:160
3070000210,0sleep20-21swapper/221:15:022
3069956210,0sleep00-21swapper/021:14:560
3069956210,0sleep00-21swapper/021:14:560
3067959210,0sleep20-21swapper/221:10:022
3067959210,0sleep20-21swapper/221:10:012
3066390210,1sleep00-21swapper/021:05:150
3066048210,0sleep20-21swapper/221:05:012
3064029210,0sleep20-21swapper/220:58:532
3062696210,0sleep00-21swapper/020:55:190
3061262210,0sleep20-21swapper/220:50:212
3060551210,1sleep00-21swapper/020:50:150
3056840210,0sleep20-21swapper/220:40:202
3056737210,0sleep00-21swapper/020:40:180
3055223210,0sleep20-21swapper/220:35:152
3054551210,0sleep00-21swapper/020:35:020
3053739210,0sleep20-21swapper/220:30:192
3051266210,0sleep00-21swapper/020:25:170
3050489210,1sleep00-21swapper/020:21:570
3047817210,0sleep00-21swapper/020:15:200
3047565210,0sleep20-21swapper/220:15:182
3043853210,0sleep20-21swapper/220:05:222
3038703210,0sleep20-21swapper/219:55:002
3037473210,0sleep20-21swapper/219:50:172
3036770210,1sleep00-21swapper/019:49:430
3033227210,1sleep00-21swapper/019:40:140
3032089210,0sleep00-21swapper/019:35:180
3031292210,0sleep20-21swapper/219:35:122
3028863210,1sleep00-21swapper/019:26:330
3025563210,0sleep03025608-21aten_r1power_cu19:20:130
3025148210,0sleep20-21swapper/219:18:112
3022907210,0sleep00-21swapper/019:15:010
3022690210,1sleep00-21swapper/019:12:130
3021778210,0sleep20-21swapper/219:10:182
3114241200,0sleep20-21swapper/223:00:052
3107963200,0sleep00-21swapper/022:45:020
3084387200,0sleep20-21swapper/221:50:042
3072233200,0sleep20-21swapper/221:20:022
3064375200,0sleep00-21swapper/021:00:030
3064118200,0sleep20-21swapper/221:00:012
3058626200,0sleep20-21swapper/220:45:042
3058624200,0sleep00-21swapper/020:45:020
3052639200,0sleep00-21swapper/020:30:010
3050963200,0sleep20-21swapper/220:25:032
3049053200,0sleep20-21swapper/220:20:032
3044952200,0sleep00-21swapper/020:10:040
3044949200,0sleep20-21swapper/220:10:022
3043041200,0sleep00-21swapper/020:05:040
3040875200,0sleep20-21swapper/220:00:012
3039200200,0sleep00-21swapper/019:55:030
3037030200,0sleep00-21swapper/019:50:030
3035121200,0sleep20-21swapper/219:45:052
3027457200,0sleep20-21swapper/219:25:032
3025548200,0sleep20-21swapper/219:20:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional