You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-26 - 15:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue Sep 26, 2023 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130612207191,11sleep10-21swapper/107:07:201
129932197180,12sleep00-21swapper/007:06:260
131572188171,12sleep20-21swapper/207:08:342
110452182166,11sleep30-21swapper/307:05:053
325102450,0sleep30-21swapper/311:38:453
112692170,0sleep011271-21grep11:25:240
67282110,0sleep30-21swapper/312:01:543
9750280,0sleep10-21swapper/111:44:511
134389980,4cyclictest4361-21perf07:55:000
134389980,4cyclictest28993-21tr10:00:000
134519965,1cyclictest40-21ksoftirqd/308:40:173
134519960,5cyclictest0-21swapper/311:00:183
134519960,5cyclictest0-21swapper/309:25:203
134519960,5cyclictest0-21swapper/309:15:013
134519960,1cyclictest3361-21memory08:55:243
134389963,3cyclictest0-21swapper/010:09:200
134389962,3cyclictest20831-21ntp_states12:10:230
134389960,0cyclictest0-21swapper/010:30:200
134519955,0cyclictest40-21ksoftirqd/312:20:173
134519955,0cyclictest40-21ksoftirqd/312:00:003
134519955,0cyclictest40-21ksoftirqd/310:15:183
134519955,0cyclictest40-21ksoftirqd/307:40:173
134519953,2cyclictest40-21ksoftirqd/308:05:013
134519950,5cyclictest16796-21ssh11:10:003
134519950,5cyclictest0-21swapper/311:32:593
134519950,5cyclictest0-21swapper/311:13:043
134519950,4cyclictest28891-21diskstats12:35:203
134519950,4cyclictest15803-21munin-run07:15:003
134519950,4cyclictest0-21swapper/312:10:183
134519950,4cyclictest0-21swapper/310:50:183
134519950,4cyclictest0-21swapper/310:20:193
134519950,0cyclictest0-21swapper/310:04:053
134479955,0cyclictest24627-21kworker/2:211:10:392
134479950,5cyclictest0-21swapper/210:10:372
134479950,5cyclictest0-21swapper/209:37:182
134479950,5cyclictest0-21swapper/208:35:202
134429950,5cyclictest0-21swapper/111:53:281
134429950,5cyclictest0-21swapper/110:56:271
134389952,3cyclictest22600-21ssh09:16:570
134389952,3cyclictest0-21swapper/011:56:310
134389952,3cyclictest0-21swapper/011:43:230
134389951,2cyclictest0-21swapper/008:05:160
134389950,5cyclictest0-21swapper/012:17:590
134389950,5cyclictest0-21swapper/010:52:080
134389950,5cyclictest0-21swapper/010:45:240
134389950,5cyclictest0-21swapper/010:43:090
134389950,5cyclictest0-21swapper/010:20:280
134389950,5cyclictest0-21swapper/009:50:160
134389950,5cyclictest0-21swapper/009:46:010
134389950,5cyclictest0-21swapper/009:43:360
134389950,5cyclictest0-21swapper/009:39:120
134389950,5cyclictest0-21swapper/009:23:040
134389950,5cyclictest0-21swapper/009:05:200
134389950,4cyclictest11643-21ps09:10:280
134389950,4cyclictest0-21swapper/011:15:170
134389950,4cyclictest0-21swapper/007:35:180
134389950,2cyclictest29337-21perf08:45:000
134389950,0cyclictest24381-21ssh10:55:010
134389950,0cyclictest17508-21sh12:08:560
134389950,0cyclictest0-21swapper/010:25:280
134389950,0cyclictest0-21swapper/010:15:200
134519944,0cyclictest40-21ksoftirqd/312:20:003
134519944,0cyclictest40-21ksoftirqd/311:45:003
134519944,0cyclictest40-21ksoftirqd/311:15:173
134519944,0cyclictest40-21ksoftirqd/310:40:183
134519944,0cyclictest40-21ksoftirqd/310:30:203
134519944,0cyclictest40-21ksoftirqd/309:45:193
134519944,0cyclictest40-21ksoftirqd/309:20:263
134519944,0cyclictest40-21ksoftirqd/309:10:203
134519944,0cyclictest40-21ksoftirqd/309:05:003
134519944,0cyclictest40-21ksoftirqd/308:35:003
134519944,0cyclictest40-21ksoftirqd/308:20:003
134519944,0cyclictest40-21ksoftirqd/307:50:193
134519944,0cyclictest40-21ksoftirqd/307:30:003
134519944,0cyclictest0-21swapper/311:49:523
134519944,0cyclictest0-21swapper/311:25:163
134519943,1cyclictest18780-21sshd11:50:163
134519943,1cyclictest12158-21diskstats09:30:203
134519941,3cyclictest22044-21sed09:35:293
134519940,4cyclictest28308-21ssh09:59:313
134519940,4cyclictest0-21swapper/312:25:193
134519940,4cyclictest0-21swapper/311:22:303
134519940,4cyclictest0-21swapper/310:55:173
134519940,4cyclictest0-21swapper/310:49:563
134519940,4cyclictest0-21swapper/310:25:193
134519940,4cyclictest0-21swapper/310:13:113
134519940,4cyclictest0-21swapper/310:05:573
134519940,4cyclictest0-21swapper/309:05:183
134519940,4cyclictest0-21swapper/308:50:183
134519940,4cyclictest0-21swapper/307:20:183
134519940,3cyclictest9629-21cat08:05:013
134519940,3cyclictest24837-21irqstats10:35:213
134519940,3cyclictest12217-21/usr/sbin/munin08:10:313
134519940,3cyclictest0-21swapper/308:35:193
134519940,3cyclictest0-21swapper/307:30:213
134519940,0cyclictest0-21swapper/312:30:193
134479944,0cyclictest24627-21kworker/2:209:07:312
134479944,0cyclictest24627-21kworker/2:207:49:082
134479944,0cyclictest0-21swapper/212:24:552
134479944,0cyclictest0-21swapper/212:05:512
134479944,0cyclictest0-21swapper/210:21:592
134479944,0cyclictest0-21swapper/210:18:112
134479944,0cyclictest0-21swapper/209:33:412
134479944,0cyclictest0-21swapper/209:21:182
134479944,0cyclictest0-21swapper/209:17:392
134479944,0cyclictest0-21swapper/208:09:342
134479943,1cyclictest25536-21memory07:30:282
134479941,3cyclictest509-21nscd12:25:252
134479940,4cyclictest2031-21ntp_kernel_pll_11:00:242
134479940,4cyclictest17308-21gltestperf10:50:222
134479940,4cyclictest11498-21ntp_states09:10:272
134479940,4cyclictest0-21swapper/212:30:202
134479940,4cyclictest0-21swapper/212:10:172
134479940,4cyclictest0-21swapper/212:00:202
134479940,4cyclictest0-21swapper/211:37:292
134479940,4cyclictest0-21swapper/211:20:282
134479940,4cyclictest0-21swapper/210:48:182
134479940,4cyclictest0-21swapper/209:40:182
134479940,4cyclictest0-21swapper/209:25:212
134479940,4cyclictest0-21swapper/208:55:252
134479940,4cyclictest0-21swapper/208:10:212
134479940,3cyclictest9813-21sh11:25:112
134479940,3cyclictest29793-21chrt10:38:382
134479940,3cyclictest2635-21df07:50:212
134479940,3cyclictest19006-21ssh11:30:242
134479940,3cyclictest17116-21date08:20:002
134479940,3cyclictest16728-21ssh11:09:572
134479940,3cyclictest16248-21munin-node07:15:012
134479940,3cyclictest12561-21users11:45:302
134479940,3cyclictest0-21swapper/210:40:222
134479940,2cyclictest0-21swapper/210:25:042
134479940,1cyclictest5877-21tr10:05:212
134479940,1cyclictest27428-21df07:35:192
134479940,0cyclictest0-21swapper/212:38:272
134479940,0cyclictest0-21swapper/210:30:162
134429944,0cyclictest0-21swapper/112:09:371
134429944,0cyclictest0-21swapper/112:04:141
134429944,0cyclictest0-21swapper/111:58:521
134429944,0cyclictest0-21swapper/110:54:061
134429944,0cyclictest0-21swapper/110:15:241
134429944,0cyclictest0-21swapper/109:57:131
134429944,0cyclictest0-21swapper/107:10:011
134429941,2cyclictest0-21swapper/112:15:161
134429941,2cyclictest0-21swapper/111:30:211
134429941,2cyclictest0-21swapper/111:25:191
134429941,2cyclictest0-21swapper/109:00:181
134429941,2cyclictest0-21swapper/108:25:161
134429941,1cyclictest0-21swapper/109:45:191
134429940,4cyclictest0-21swapper/112:35:311
134429940,4cyclictest0-21swapper/112:15:001
134429940,4cyclictest0-21swapper/111:48:051
134429940,4cyclictest0-21swapper/111:14:551
134429940,4cyclictest0-21swapper/107:54:071
134429940,4cyclictest0-21swapper/107:44:391
134429940,0cyclictest0-21swapper/110:42:371
134389944,0cyclictest0-21swapper/011:35:470
134389944,0cyclictest0-21swapper/011:20:200
134389944,0cyclictest0-21swapper/011:00:240
134389943,1cyclictest580-21sed08:50:210
134389943,1cyclictest18224-21idleruntime-cro11:50:000
134389942,1cyclictest0-21swapper/008:29:560
134389942,1cyclictest0-21swapper/008:00:190
134389941,2cyclictest0-21swapper/011:10:150
134389940,4cyclictest29577-21apt-get07:40:010
134389940,4cyclictest0-21swapper/012:27:180
134389940,4cyclictest0-21swapper/012:02:310
134389940,4cyclictest0-21swapper/011:50:160
134389940,4cyclictest0-21swapper/009:30:180
134389940,4cyclictest0-21swapper/009:00:350
134389940,4cyclictest0-21swapper/007:20:180
134389940,4cyclictest0-21swapper/007:14:320
134389940,3cyclictest2979-21ssh09:25:090
134389940,3cyclictest2751-21ssh10:03:080
134389940,3cyclictest25342-21cat07:30:270
134389940,3cyclictest17707-21df08:20:200
134389940,1cyclictest24203-21latency_hist07:30:000
134389940,0cyclictest0-21swapper/011:05:050
134389940,0cyclictest0-21swapper/010:14:090
134389940,0cyclictest0-21swapper/008:55:190
22913230,0sleep10-21swapper/109:17:111
134519933,0cyclictest40-21ksoftirqd/307:15:003
134519930,3cyclictest9464-21diskmemload09:40:093
134519930,3cyclictest32073-21dpkg07:45:183
134519930,3cyclictest27751-21smartctl07:35:223
134519930,3cyclictest0-21swapper/312:05:113
134519930,3cyclictest0-21swapper/309:50:103
134519930,3cyclictest0-21swapper/308:45:013
134519930,3cyclictest0-21swapper/308:25:173
134519930,3cyclictest0-21swapper/308:20:183
134519930,3cyclictest0-21swapper/307:55:193
134479932,1cyclictest29353-21dpkg10:00:012
134479931,1cyclictest0-21swapper/211:55:182
134479931,1cyclictest0-21swapper/207:10:192
134479930,3cyclictest31788-21apt-get08:50:022
134479930,3cyclictest30550-21irqstats08:45:262
134479930,3cyclictest27675-21apt-get12:15:172
134479930,3cyclictest23251-21ntpq07:25:272
134479930,3cyclictest22341-21cut08:30:222
134479930,3cyclictest20998-21sh09:55:122
134479930,3cyclictest20178-21df_inode08:25:182
134479930,3cyclictest0-21swapper/211:50:132
134479930,3cyclictest0-21swapper/211:15:192
134479930,3cyclictest0-21swapper/210:55:052
134479930,3cyclictest0-21swapper/209:50:102
134479930,3cyclictest0-21swapper/209:00:092
134479930,3cyclictest0-21swapper/208:40:082
134479930,3cyclictest0-21swapper/208:20:182
134479930,3cyclictest0-21swapper/207:55:002
134479930,3cyclictest0-21swapper/207:40:012
134479930,3cyclictest0-21swapper/207:20:162
134479930,1cyclictest2818-21df_inode11:40:192
134479930,1cyclictest0-21swapper/209:45:192
134479930,0cyclictest0-21swapper/208:00:052
134429933,0cyclictest0-21swapper/108:44:281
134429933,0cyclictest0-21swapper/108:14:201
134429933,0cyclictest0-21swapper/107:45:231
134429931,2cyclictest0-21swapper/110:35:171
134429931,1cyclictest0-21swapper/112:25:201
134429931,1cyclictest0-21swapper/112:20:171
134429931,1cyclictest0-21swapper/111:20:191
134429931,1cyclictest0-21swapper/111:05:191
134429931,1cyclictest0-21swapper/111:00:181
134429931,1cyclictest0-21swapper/110:45:191
134429931,1cyclictest0-21swapper/110:20:191
134429931,1cyclictest0-21swapper/110:10:191
134429931,1cyclictest0-21swapper/110:00:201
134429931,1cyclictest0-21swapper/109:35:201
134429931,1cyclictest0-21swapper/109:30:191
134429931,1cyclictest0-21swapper/108:55:181
134429931,1cyclictest0-21swapper/108:50:171
134429931,1cyclictest0-21swapper/108:45:201
134429931,1cyclictest0-21swapper/108:15:211
134429931,1cyclictest0-21swapper/107:55:191
134429931,1cyclictest0-21swapper/107:35:181
134429931,1cyclictest0-21swapper/107:20:191
134429930,2cyclictest25510-21chrt12:33:111
134429930,2cyclictest0-21swapper/110:08:511
134429930,2cyclictest0-21swapper/108:20:181
134389932,1cyclictest18033-21ssh11:30:110
134389931,1cyclictest3266-21mktemp12:20:010
134389931,1cyclictest0-21swapper/007:45:190
134389930,3cyclictest21243-21irqstats12:30:260
134389930,3cyclictest0-21swapper/012:35:180
134389930,3cyclictest0-21swapper/010:35:020
134389930,3cyclictest0-21swapper/008:45:200
134389930,3cyclictest0-21swapper/008:35:010
134389930,3cyclictest0-21swapper/008:30:210
134389930,3cyclictest0-21swapper/008:15:200
134389930,3cyclictest0-21swapper/008:10:200
134389930,3cyclictest0-21swapper/007:55:190
134389930,3cyclictest0-21swapper/007:15:190
134429921,1cyclictest0-21swapper/111:35:151
134429921,1cyclictest0-21swapper/109:50:191
134429921,1cyclictest0-21swapper/108:35:201
134429921,0cyclictest0-21swapper/108:00:191
134429920,1cyclictest9206-21chrt09:06:581
134429920,1cyclictest254702sleep111:15:041
134429920,1cyclictest0-21swapper/110:30:021
134429920,1cyclictest0-21swapper/110:26:141
134429920,1cyclictest0-21swapper/109:40:191
134429920,1cyclictest0-21swapper/109:25:201
134429920,1cyclictest0-21swapper/109:20:171
134429920,1cyclictest0-21swapper/109:10:211
134429920,1cyclictest0-21swapper/108:30:211
134429920,1cyclictest0-21swapper/108:05:021
134429920,1cyclictest0-21swapper/107:30:211
134429920,1cyclictest0-21swapper/107:25:191
134429920,1cyclictest0-21swapper/107:15:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional