You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 00:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Wed Apr 24, 2024 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
155642208192,11sleep10-21swapper/107:07:151
135492197180,12sleep30-21swapper/307:05:063
155932187170,12sleep00-21swapper/007:07:380
15498211295,12sleep20-21swapper/207:06:252
228502430,0sleep322849-21df_inode11:15:103
126242430,0sleep00-21swapper/012:06:230
243472360,0sleep11596999cyclictest09:39:531
123292110,0sleep20-21swapper/212:25:242
162982100,0sleep30-21swapper/310:51:403
16872280,1sleep1211ktimersoftd/111:11:051
159649982,3cyclictest2300-21munin-run12:40:000
159649981,3cyclictest3361-21awk09:05:010
31552270,0sleep10-21swapper/110:02:391
159649971,3cyclictest5879-21perf08:05:010
159649960,5cyclictest0-21swapper/011:45:120
159649960,3cyclictest31405-21awk09:25:000
7299250,0sleep10-21swapper/112:03:481
4243250,0sleep10-21swapper/109:27:321
159829955,0cyclictest57250irq/125-eth010:25:143
159829955,0cyclictest0-21swapper/309:26:453
159829952,2cyclictest22767-21ssh09:38:393
159829950,5cyclictest0-21swapper/311:53:083
159829950,5cyclictest0-21swapper/311:25:563
159829950,4cyclictest6790-21df09:10:143
159829950,4cyclictest28578-21apt-get08:50:123
159829950,4cyclictest26806-21apt-get12:35:103
159829950,4cyclictest0-21swapper/312:10:083
159779952,3cyclictest13330-21cat08:20:002
159779951,2cyclictest0-21swapper/210:05:132
159779950,5cyclictest0-21swapper/210:56:482
159779950,5cyclictest0-21swapper/207:55:032
159779950,4cyclictest7340-21diskstats11:25:122
159779950,4cyclictest0-21swapper/207:50:112
159779950,0cyclictest11804-21sh11:08:452
159699951,2cyclictest0-21swapper/108:55:121
159699950,5cyclictest0-21swapper/110:35:001
159649955,0cyclictest3602-21snmpd11:36:430
159649950,5cyclictest0-21swapper/012:23:090
159649950,5cyclictest0-21swapper/010:25:440
159649950,5cyclictest0-21swapper/009:31:100
159649950,4cyclictest23785-21expr08:40:120
159649950,4cyclictest20462-21df07:20:090
159649950,4cyclictest0-21swapper/010:20:090
159649950,4cyclictest0-21swapper/009:35:120
159649950,4cyclictest0-21swapper/007:55:110
159829944,0cyclictest0-21swapper/312:01:083
159829944,0cyclictest0-21swapper/308:42:133
159829943,1cyclictest4356-21tail09:05:173
159829943,1cyclictest0-21swapper/311:45:123
159829941,3cyclictest3602-21snmpd09:19:303
159829941,3cyclictest30933-21cut11:00:203
159829941,2cyclictest0-21swapper/308:20:123
159829940,4cyclictest19792-21apt-get10:15:113
159829940,4cyclictest17231-1kworker/3:1H12:34:073
159829940,4cyclictest0-21swapper/312:20:143
159829940,4cyclictest0-21swapper/312:07:023
159829940,4cyclictest0-21swapper/311:56:033
159829940,4cyclictest0-21swapper/311:40:103
159829940,4cyclictest0-21swapper/311:35:083
159829940,4cyclictest0-21swapper/311:31:053
159829940,4cyclictest0-21swapper/310:55:133
159829940,4cyclictest0-21swapper/310:45:213
159829940,4cyclictest0-21swapper/310:08:063
159829940,4cyclictest0-21swapper/310:00:133
159829940,4cyclictest0-21swapper/309:59:163
159829940,4cyclictest0-21swapper/309:41:353
159829940,4cyclictest0-21swapper/307:10:123
159829940,3cyclictest5890-21cstates11:05:143
159829940,3cyclictest502-21irqbalance12:19:213
159829940,3cyclictest3620-21dpkg08:00:093
159829940,3cyclictest2964-21users09:00:293
159829940,3cyclictest27962-21/usr/sbin/munin10:40:123
159829940,3cyclictest22341-21cat07:25:003
159829940,3cyclictest18473-21apt08:30:133
159829940,3cyclictest11025-21ntp_states09:50:213
159829940,3cyclictest10019-21users09:30:253
159829940,1cyclictest28264-21/usr/sbin/munin10:20:213
159829940,1cyclictest11058-21/usr/sbin/munin10:10:223
159779944,0cyclictest0-21swapper/212:03:452
159779944,0cyclictest0-21swapper/211:36:322
159779944,0cyclictest0-21swapper/209:35:022
159779944,0cyclictest0-21swapper/209:16:252
159779944,0cyclictest0-21swapper/207:25:402
159779941,3cyclictest25746-21ssh09:59:452
159779941,2cyclictest0-21swapper/210:25:132
159779940,4cyclictest8818-21hddtemp_smartct09:30:152
159779940,4cyclictest27175-21ssh09:40:262
159779940,4cyclictest17531-21python08:25:262
159779940,4cyclictest13881-21apt-get11:10:112
159779940,4cyclictest0-21swapper/212:20:142
159779940,4cyclictest0-21swapper/211:48:052
159779940,4cyclictest0-21swapper/211:20:102
159779940,4cyclictest0-21swapper/211:00:092
159779940,4cyclictest0-21swapper/210:52:362
159779940,4cyclictest0-21swapper/210:35:172
159779940,4cyclictest0-21swapper/210:33:072
159779940,4cyclictest0-21swapper/210:10:122
159779940,4cyclictest0-21swapper/210:01:092
159779940,4cyclictest0-21swapper/209:45:052
159779940,4cyclictest0-21swapper/209:25:132
159779940,4cyclictest0-21swapper/209:20:132
159779940,4cyclictest0-21swapper/209:13:332
159779940,4cyclictest0-21swapper/208:40:092
159779940,4cyclictest0-21swapper/208:20:112
159779940,4cyclictest0-21swapper/208:08:192
159779940,3cyclictest723-21grep11:40:162
159779940,3cyclictest4028-21ssh10:45:142
159779940,3cyclictest3565-21taskset09:05:032
159779940,3cyclictest32080-21ls08:55:192
159779940,3cyclictest31034-21wc07:50:012
159779940,3cyclictest26030-21apt-config08:45:012
159779940,3cyclictest26030-21apt-config08:45:002
159779940,3cyclictest19202-21perl08:30:172
159779940,3cyclictest11714-21/usr/sbin/munin09:50:262
159779940,3cyclictest0-21swapper/212:30:142
159779940,3cyclictest0-21swapper/211:15:012
159779940,1cyclictest29815-21sed10:40:252
159699944,0cyclictest0-21swapper/110:24:321
159699944,0cyclictest0-21swapper/109:43:121
159699941,2cyclictest0-21swapper/112:35:111
159699941,2cyclictest0-21swapper/112:30:131
159699941,2cyclictest0-21swapper/109:00:121
159699941,2cyclictest0-21swapper/107:50:111
159699941,2cyclictest0-21swapper/107:45:081
159699941,1cyclictest0-21swapper/110:45:141
159699940,4cyclictest0-21swapper/112:07:071
159699940,2cyclictest0-21swapper/112:25:091
159699940,2cyclictest0-21swapper/108:35:111
159699940,0cyclictest0-21swapper/111:31:451
159699940,0cyclictest0-21swapper/111:15:021
159649944,0cyclictest3-21ksoftirqd/011:00:100
159649944,0cyclictest0-21swapper/007:10:260
159649942,1cyclictest8564-21aten2_r5power_c08:10:120
159649942,1cyclictest24661-21latency_hist07:30:010
159649942,1cyclictest17330-21df11:50:200
159649942,1cyclictest0-21swapper/009:19:570
159649940,4cyclictest3076-21cpuspeed_turbos10:05:160
159649940,4cyclictest0-21swapper/012:29:260
159649940,4cyclictest0-21swapper/012:10:090
159649940,4cyclictest0-21swapper/011:40:330
159649940,4cyclictest0-21swapper/011:30:080
159649940,4cyclictest0-21swapper/011:12:510
159649940,4cyclictest0-21swapper/010:55:070
159649940,4cyclictest0-21swapper/010:40:120
159649940,4cyclictest0-21swapper/010:32:230
159649940,4cyclictest0-21swapper/010:14:270
159649940,4cyclictest0-21swapper/010:00:140
159649940,4cyclictest0-21swapper/009:55:100
159649940,4cyclictest0-21swapper/009:47:340
159649940,4cyclictest0-21swapper/009:40:110
159649940,4cyclictest0-21swapper/009:10:110
159649940,4cyclictest0-21swapper/009:05:020
159649940,3cyclictest7113-21gunzip11:05:220
159649940,3cyclictest6582-21latency_hist11:25:010
159649940,3cyclictest22207-21ssh10:15:380
159649940,3cyclictest22133-21rm11:15:000
159649940,3cyclictest19580-21grep10:35:080
159649940,3cyclictest19001-21df08:30:150
159649940,3cyclictest13794-21expr08:20:140
159649940,3cyclictest0-21swapper/011:55:090
159649940,1cyclictest28391-21munin-run07:45:000
159649940,1cyclictest25279-21munin-run07:35:010
26652230,0sleep10-21swapper/110:58:121
18346230,0sleep10-21swapper/109:16:351
159829932,1cyclictest3602-21snmpd10:35:033
159829932,1cyclictest3602-21snmpd07:30:143
159829932,1cyclictest31180-21cpu08:55:133
159829932,1cyclictest23099-21ssh09:20:023
159829932,1cyclictest11123-21aten2_r5power_v08:15:103
159829931,1cyclictest3602-21snmpd11:10:073
159829930,3cyclictest31260-21grep07:50:113
159829930,3cyclictest18784-21cat07:15:003
159829930,3cyclictest12686-21sh10:30:053
159829930,3cyclictest0-21swapper/312:25:103
159829930,3cyclictest0-21swapper/311:20:083
159829930,3cyclictest0-21swapper/309:45:063
159829930,3cyclictest0-21swapper/308:45:013
159829930,3cyclictest0-21swapper/308:45:013
159829930,3cyclictest0-21swapper/308:35:103
159829930,3cyclictest0-21swapper/308:25:053
159829930,3cyclictest0-21swapper/308:10:053
159829930,3cyclictest0-21swapper/308:05:103
159829930,3cyclictest0-21swapper/307:55:113
159829930,3cyclictest0-21swapper/307:45:063
159829930,3cyclictest0-21swapper/307:41:143
159829930,3cyclictest0-21swapper/307:35:013
159829930,3cyclictest0-21swapper/307:25:103
159779932,1cyclictest17537-21ssh12:10:072
159779930,3cyclictest26646-21ssh12:35:022
159779930,3cyclictest25778-21ssh12:15:022
159779930,3cyclictest24862-21ssh11:55:032
159779930,3cyclictest18577-21uname07:15:012
159779930,3cyclictest16713-21ssh11:50:132
159779930,3cyclictest0-21swapper/212:05:022
159779930,3cyclictest0-21swapper/211:30:022
159779930,3cyclictest0-21swapper/210:20:022
159779930,3cyclictest0-21swapper/210:15:012
159779930,3cyclictest0-21swapper/209:00:122
159779930,3cyclictest0-21swapper/208:50:122
159779930,3cyclictest0-21swapper/208:35:022
159779930,3cyclictest0-21swapper/208:10:122
159779930,3cyclictest0-21swapper/208:00:092
159779930,3cyclictest0-21swapper/207:41:312
159779930,3cyclictest0-21swapper/207:35:072
159779930,3cyclictest0-21swapper/207:31:132
159779930,3cyclictest0-21swapper/207:20:012
159779930,3cyclictest0-21swapper/207:10:122
159699933,0cyclictest0-21swapper/112:10:191
159699933,0cyclictest0-21swapper/109:47:081
159699931,1cyclictest0-21swapper/111:45:121
159699931,1cyclictest0-21swapper/111:40:111
159699931,1cyclictest0-21swapper/111:35:151
159699931,1cyclictest0-21swapper/111:20:111
159699931,1cyclictest0-21swapper/111:05:111
159699931,1cyclictest0-21swapper/110:25:131
159699931,1cyclictest0-21swapper/110:05:141
159699931,1cyclictest0-21swapper/108:40:101
159699931,1cyclictest0-21swapper/108:20:121
159699931,1cyclictest0-21swapper/108:10:121
159699931,1cyclictest0-21swapper/107:25:101
159699931,1cyclictest0-21swapper/107:20:081
159699930,3cyclictest0-21swapper/108:52:161
159699930,3cyclictest0-21swapper/107:41:501
159699930,2cyclictest0-21swapper/112:15:111
159699930,2cyclictest0-21swapper/110:50:021
159699930,2cyclictest0-21swapper/110:40:111
159699930,2cyclictest0-21swapper/110:15:101
159699930,1cyclictest0-21swapper/112:20:131
159699930,1cyclictest0-21swapper/107:10:101
159649930,3cyclictest28578-21apt-get08:50:120
159649930,3cyclictest18621-21grep07:15:000
159649930,3cyclictest0-21swapper/012:30:050
159649930,3cyclictest0-21swapper/012:15:040
159649930,3cyclictest0-21swapper/012:00:100
159649930,3cyclictest0-21swapper/011:25:100
159649930,3cyclictest0-21swapper/010:45:120
159649930,3cyclictest0-21swapper/009:50:020
159649930,3cyclictest0-21swapper/009:25:130
159649930,3cyclictest0-21swapper/008:55:100
159649930,3cyclictest0-21swapper/008:45:130
159649930,3cyclictest0-21swapper/008:45:130
159649930,3cyclictest0-21swapper/008:35:100
159649930,3cyclictest0-21swapper/008:25:130
159649930,3cyclictest0-21swapper/008:15:100
159649930,3cyclictest0-21swapper/008:05:090
159649930,3cyclictest0-21swapper/007:50:110
159649930,3cyclictest0-21swapper/007:45:060
159649930,3cyclictest0-21swapper/007:35:070
159649930,2cyclictest548-21in:imuxsock10:50:010
159699921,1cyclictest0-21swapper/111:55:081
159699921,1cyclictest0-21swapper/109:55:111
159699921,1cyclictest0-21swapper/109:05:141
159699921,1cyclictest0-21swapper/108:30:121
159699921,1cyclictest0-21swapper/108:00:081
159699920,2cyclictest24954-21taskset07:31:061
159699920,1cyclictest19475-21chrt07:17:251
159699920,1cyclictest11018-21chrt08:15:051
159699920,1cyclictest0-21swapper/111:50:131
159699920,1cyclictest0-21swapper/111:25:091
159699920,1cyclictest0-21swapper/111:00:091
159699920,1cyclictest0-21swapper/110:30:011
159699920,1cyclictest0-21swapper/110:10:061
159699920,1cyclictest0-21swapper/109:50:121
159699920,1cyclictest0-21swapper/109:30:101
159699920,1cyclictest0-21swapper/109:20:011
159699920,1cyclictest0-21swapper/109:10:111
159699920,1cyclictest0-21swapper/108:45:021
159699920,1cyclictest0-21swapper/108:45:011
159699920,1cyclictest0-21swapper/108:25:121
159699920,1cyclictest0-21swapper/108:05:091
159699920,1cyclictest0-21swapper/107:55:111
159699920,1cyclictest0-21swapper/107:35:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional