You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 14:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Fri May 09, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317246199130,9cyclictest0-21swapper/307:20:133
317246199130,12cyclictest0-21swapper/308:45:133
3172461991210,0cyclictest0-21swapper/309:05:213
317246199120,11cyclictest0-21swapper/312:35:013
317246199120,11cyclictest0-21swapper/309:40:183
317246199120,11cyclictest0-21swapper/309:20:173
317246199120,11cyclictest0-21swapper/307:25:193
317246199119,1cyclictest0-21swapper/311:25:103
3172461991110,0cyclictest0-21swapper/308:05:133
3172461991110,0cyclictest0-21swapper/307:50:123
317246199110,8cyclictest0-21swapper/311:10:203
317246199110,10cyclictest0-21swapper/307:35:203
317246199110,0cyclictest0-21swapper/311:00:153
317246199110,0cyclictest0-21swapper/308:35:133
317246199110,0cyclictest0-21swapper/308:25:013
317246199109,0cyclictest0-21swapper/309:58:383
3172461991010,0cyclictest0-21swapper/312:35:193
3172461991010,0cyclictest0-21swapper/311:50:013
3172461991010,0cyclictest0-21swapper/310:25:223
3172461991010,0cyclictest0-21swapper/308:00:123
3172461991010,0cyclictest0-21swapper/307:45:113
317246199100,9cyclictest0-21swapper/312:15:183
317246199100,9cyclictest0-21swapper/310:55:193
317246199100,9cyclictest0-21swapper/308:55:013
317246199100,0cyclictest0-21swapper/312:10:213
317246199100,0cyclictest0-21swapper/311:45:203
317246199100,0cyclictest0-21swapper/310:30:183
3201008293,3sleep03201080-21cat08:20:140
31724619999,0cyclictest0-21swapper/311:35:153
31724619999,0cyclictest0-21swapper/308:40:203
31724619999,0cyclictest0-21swapper/307:30:193
31724619999,0cyclictest0-21swapper/307:20:013
31724619998,0cyclictest0-21swapper/311:34:193
31724619998,0cyclictest0-21swapper/311:20:193
31724619998,0cyclictest0-21swapper/310:20:003
31724619998,0cyclictest0-21swapper/310:05:123
31724619990,8cyclictest0-21swapper/310:40:013
31724619990,8cyclictest0-21swapper/308:15:173
31724619990,8cyclictest0-21swapper/308:00:013
31724619988,0cyclictest0-21swapper/312:25:123
31724619988,0cyclictest0-21swapper/311:43:173
31724619988,0cyclictest0-21swapper/310:10:203
31724619988,0cyclictest0-21swapper/309:50:013
31724619988,0cyclictest0-21swapper/309:25:093
31724619988,0cyclictest0-21swapper/309:00:123
31724619988,0cyclictest0-21swapper/307:40:013
31724619987,0cyclictest0-21swapper/307:10:163
31724619986,1cyclictest0-21swapper/309:45:123
31724619980,7cyclictest0-21swapper/308:30:133
31724619980,7cyclictest0-21swapper/308:30:133
31724619980,0cyclictest0-21swapper/312:05:013
31724619980,0cyclictest0-21swapper/310:45:223
3171411281,5sleep30-21swapper/307:05:243
31724619977,0cyclictest0-21swapper/311:55:233
31724619977,0cyclictest0-21swapper/311:05:193
31724619977,0cyclictest0-21swapper/309:10:193
31724619976,0cyclictest0-21swapper/309:00:013
31724619970,7cyclictest0-21swapper/310:45:013
31724619966,0cyclictest0-21swapper/312:06:223
31724619966,0cyclictest0-21swapper/311:15:123
31724619965,0cyclictest0-21swapper/310:21:073
31724619961,2cyclictest0-21swapper/312:20:133
31724619950,5cyclictest0-21swapper/309:40:003
13989850,3rtkit-daemon3259528-21apt-config10:45:022
13989850,3rtkit-daemon0-21swapper/209:15:162
13989850,2rtkit-daemon0-21swapper/207:07:252
31724619944,0cyclictest0-21swapper/310:50:203
31724619944,0cyclictest0-21swapper/309:18:373
31724619944,0cyclictest0-21swapper/308:25:133
31724619940,3cyclictest3229163-21chrt09:31:283
31724619940,3cyclictest3196772-21chrt08:10:113
31724619940,2cyclictest0-21swapper/310:00:133
3171203241,1sleep10-21swapper/107:05:221
13989840,2rtkit-daemon614-21wpa_supplicant10:14:412
13989840,2rtkit-daemon436-21systemd-udevd12:31:502
13989840,1rtkit-daemon614-21wpa_supplicant09:50:502
13989840,1rtkit-daemon3246401-21apt-get10:15:012
3261796230,1sleep23261822-21apt-get10:50:132
3196743230,1sleep23196769-21apt-get08:10:112
3186316231,2sleep0760-21snmpd07:40:310
3170631231,1sleep00-21swapper/007:05:130
13989830,2rtkit-daemon760-21snmpd12:06:172
13989830,2rtkit-daemon6926-21packagekitd09:47:302
13989830,2rtkit-daemon3295550-21cpuspeed_turbos12:10:172
13989830,2rtkit-daemon1399-21sendmail-mta08:36:152
13989830,2rtkit-daemon1-21systemd11:38:082
13989830,2rtkit-daemon1-21systemd10:01:542
13989830,2rtkit-daemon1-21systemd09:34:042
13989830,1rtkit-daemon760-21snmpd07:39:572
13989830,1rtkit-daemon6926-21packagekitd11:26:202
13989830,1rtkit-daemon614-21wpa_supplicant11:13:542
13989830,1rtkit-daemon331-21plymouthd12:20:142
13989830,1rtkit-daemon331-21plymouthd11:46:402
13989830,1rtkit-daemon331-21plymouthd10:22:482
13989830,1rtkit-daemon331-21plymouthd09:40:112
13989830,1rtkit-daemon331-21plymouthd08:29:562
13989830,1rtkit-daemon3180761-21apt-get07:30:132
13989830,1rtkit-daemon3174515-21munin-node11:42:102
13989830,1rtkit-daemon3174515-21munin-node11:06:382
13989830,1rtkit-daemon3174515-21munin-node11:03:482
13989830,1rtkit-daemon3174515-21munin-node09:59:022
13989830,1rtkit-daemon3174515-21munin-node09:23:352
13989830,1rtkit-daemon1-21systemd12:36:302
13989830,1rtkit-daemon1-21systemd12:00:322
13989830,1rtkit-daemon1-21systemd08:46:242
13989830,1rtkit-daemon1-21systemd08:31:252
13989830,1rtkit-daemon1-21systemd08:31:252
13989830,0rtkit-daemon0-21swapper/211:50:202
13989830,0rtkit-daemon0-21swapper/210:33:562
3303967220,1sleep13304101-21cpu12:30:151
3297330220,1sleep00-21swapper/012:15:130
3294702220,1sleep00-21swapper/012:07:280
3293594220,1sleep13293676-21irqstats12:05:161
3289750220,1sleep13289828-21ps11:55:201
3289617220,1sleep03289747-21ntp_states11:55:190
3256822220,0sleep00-21swapper/010:37:300
3246249220,0sleep00-21swapper/010:13:490
3231935220,1sleep03232200-21diskstats09:40:150
3227854220,1sleep00-21swapper/009:30:140
3224576220,1sleep13223754-21/usr/sbin/munin09:20:191
3222507220,1sleep13222626-21sendmail_mailqu09:15:181
3218601220,0sleep00-21swapper/009:05:210
3215903220,1sleep00-21swapper/009:00:120
3202618220,1sleep13202902-21expr08:25:151
3174064220,1sleep03174065-21sshd07:12:220
13989820,1rtkit-daemon760-21snmpd11:55:252
13989820,1rtkit-daemon760-21snmpd11:30:032
13989820,1rtkit-daemon760-21snmpd09:06:012
13989820,1rtkit-daemon760-21snmpd08:55:572
13989820,1rtkit-daemon760-21snmpd07:50:352
13989820,1rtkit-daemon760-21snmpd07:22:312
13989820,1rtkit-daemon684-21gmain08:15:042
13989820,1rtkit-daemon614-21wpa_supplicant09:02:472
13989820,1rtkit-daemon614-21wpa_supplicant07:15:422
13989820,1rtkit-daemon417-21systemd-journal08:50:452
13989820,1rtkit-daemon331-21plymouthd10:55:112
13989820,1rtkit-daemon331-21plymouthd09:10:162
13989820,1rtkit-daemon3251890-21awk10:25:202
13989820,1rtkit-daemon3226470-21strings09:25:152
13989820,1rtkit-daemon3174515-21munin-node08:20:042
13989820,1rtkit-daemon3174515-21munin-node08:00:072
13989820,1rtkit-daemon1399-21sendmail-mta07:40:032
13989820,1rtkit-daemon1-21systemd09:37:002
13989820,1rtkit-daemon1-21systemd08:41:132
13989820,1rtkit-daemon1-21systemd08:06:032
13989820,1rtkit-daemon1-21systemd07:10:032
13989820,0rtkit-daemon331-21plymouthd12:25:372
13989820,0rtkit-daemon331-21plymouthd11:20:072
13989820,0rtkit-daemon331-21plymouthd07:45:022
13989820,0rtkit-daemon0-21swapper/212:15:022
13989820,0rtkit-daemon0-21swapper/211:15:502
13989820,0rtkit-daemon0-21swapper/210:40:132
13989820,0rtkit-daemon0-21swapper/210:35:092
13989820,0rtkit-daemon0-21swapper/210:05:152
13989820,0rtkit-daemon0-21swapper/207:55:052
13989820,0rtkit-daemon0-21swapper/207:25:202
3306573210,0sleep00-21swapper/012:35:180
3306091210,0sleep10-21swapper/112:35:151
3303620210,0sleep00-21swapper/012:30:020
3302566210,1sleep10-21swapper/112:25:181
3301813210,0sleep00-21swapper/012:25:130
3301174210,0sleep00-21swapper/012:24:130
3299437210,0sleep10-21swapper/112:20:141
3298077210,1sleep13298175-21awk12:15:181
3295229210,1sleep00-21swapper/012:10:040
3294991210,0sleep10-21swapper/112:10:011
3291702210,0sleep00-21swapper/012:00:200
3291201210,0sleep10-21swapper/112:00:171
3288475210,0sleep10-21swapper/111:52:561
3287501210,0sleep00-21swapper/011:50:190
3286356210,0sleep10-21swapper/111:47:361
3285059210,0sleep00-21swapper/011:45:190
3283674210,0sleep00-21swapper/011:40:180
3283226210,1sleep13283418-21strings11:40:151
3282408210,0sleep00-21swapper/011:39:460
3281804210,0sleep10-21swapper/111:35:231
3280060210,1sleep10-21swapper/111:32:271
3279820210,0sleep00-21swapper/011:30:220
3276435210,0sleep10-21swapper/111:25:101
3276425210,0sleep00-21swapper/011:25:090
3275398210,0sleep00-21swapper/011:20:210
3272239210,0sleep00-21swapper/011:15:130
3272023210,0sleep10-21swapper/111:15:021
3271472210,0sleep10-21swapper/111:10:301
3270309210,0sleep00-21swapper/011:10:170
3269007210,0sleep00-21swapper/011:05:200
3267342210,1sleep00-21swapper/011:00:480
3265969210,0sleep10-21swapper/111:00:051
3265374210,0sleep00-21swapper/010:57:040
3263875210,0sleep10-21swapper/110:55:131
3263176210,0sleep10-21swapper/110:51:001
3261923210,0sleep00-21swapper/010:50:150
3259694210,1sleep10-21swapper/110:45:031
3259518210,0sleep0331-21plymouthd10:45:030
3257996210,0sleep10-21swapper/110:40:161
3257378210,0sleep00-21swapper/010:40:110
3256059210,0sleep10-21swapper/110:35:191
3253377210,0sleep10-21swapper/110:30:151
3253283210,0sleep00-21swapper/010:30:140
3252516210,0sleep00-21swapper/010:26:220
3251105210,0sleep10-21swapper/110:25:151
3249636210,0sleep10-21swapper/110:20:181
3248738210,0sleep00-21swapper/010:20:010
3247525210,0sleep10-21swapper/110:15:181
3247360210,0sleep00-21swapper/010:15:170
3243051210,0sleep00-21swapper/010:05:150
3242219210,0sleep10-21swapper/110:05:011
3241555210,0sleep10-21swapper/110:00:211
3240378210,0sleep00-21swapper/010:00:080
3238701210,0sleep00-21swapper/009:55:160
3238282210,0sleep10-21swapper/109:55:131
3236196210,0sleep00-21swapper/009:50:110
3235356210,0sleep10-21swapper/109:47:081
3234220210,0sleep00-21swapper/009:45:150
3231764210,0sleep10-21swapper/109:40:121
3231131210,0sleep10-21swapper/109:36:241
3229205210,0sleep10-21swapper/109:31:591
3225789210,0sleep10-21swapper/109:25:111
3225760210,0sleep00-21swapper/009:25:090
3223845210,0sleep00-21swapper/009:20:140
3220493210,0sleep10-21swapper/109:10:171
3220343210,0sleep00-21swapper/009:10:170
3216613210,0sleep10-21swapper/109:00:171
3214587210,0sleep00-21swapper/008:55:160
3214154210,0sleep10-21swapper/108:55:131
3212777210,0sleep00-21swapper/008:50:200
3208278210,0sleep00-21swapper/008:40:150
3207796210,0sleep10-21swapper/108:37:401
3204561210,0sleep10-21swapper/108:30:151
3204561210,0sleep10-21swapper/108:30:141
3204437210,0sleep00-21swapper/008:30:140
3204437210,0sleep00-21swapper/008:30:140
3204029210,0sleep00-21swapper/008:28:220
3200585210,0sleep10-21swapper/108:20:111
3199074210,0sleep10-21swapper/108:15:151
3198407210,0sleep00-21swapper/008:15:020
3197531210,0sleep00-21swapper/008:10:170
3197169210,1sleep13196744-21/usr/sbin/munin08:10:141
3196032210,0sleep00-21swapper/008:05:210
3195546210,0sleep10-21swapper/108:05:181
3194209210,0sleep00-21swapper/008:00:210
3192035210,0sleep10-21swapper/107:55:161
3191279210,0sleep00-21swapper/007:55:120
3189087210,0sleep00-21swapper/007:50:120
3188841210,0sleep10-21swapper/107:50:011
3187690210,0sleep00-21swapper/007:45:160
3186670210,0sleep10-21swapper/107:45:011
3184406210,0sleep00-21swapper/007:39:110
3183010210,0sleep10-21swapper/107:35:161
3182388210,0sleep10-21swapper/107:34:561
3182347210,1sleep00-21swapper/007:34:230
3179621210,0sleep10-21swapper/107:25:201
3177100210,0sleep10-21swapper/107:20:151
3177018210,0sleep00-21swapper/007:20:140
3174920210,0sleep00-21swapper/007:15:020
3173288210,0sleep10-21swapper/107:10:191
3274327200,0sleep10-21swapper/111:20:021
3267817200,0sleep10-21swapper/111:05:011
3244536200,0sleep10-21swapper/110:10:021
3236183200,0sleep10-21swapper/109:50:041
3229721200,0sleep00-21swapper/009:35:020
3221718200,0sleep00-21swapper/009:15:050
3217565200,0sleep10-21swapper/109:05:021
3212054200,0sleep10-21swapper/108:50:051
3210144200,0sleep10-21swapper/108:45:041
3210143200,0sleep00-21swapper/008:45:030
3208236200,0sleep10-21swapper/108:40:041
3206303200,0sleep00-21swapper/008:35:030
3192659200,0sleep10-21swapper/108:00:021
3187168200,0sleep10-21swapper/107:45:051
3178811200,0sleep00-21swapper/007:25:030
3174968200,0sleep10-21swapper/107:15:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional