You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-31 - 11:18

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Wed May 31, 2023 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26392204193,8sleep10-21swapper/119:07:241
5992198181,12sleep30-21swapper/319:05:053
27102197182,11sleep00-21swapper/019:08:180
27692179161,13sleep20-21swapper/219:09:062
175992450,0sleep10-21swapper/100:12:381
275892440,0sleep10-21swapper/121:00:281
30309971,3cyclictest15846-21sendmail-msp20:40:010
30309970,3cyclictest20347-21munin-run22:20:010
30499964,1cyclictest57250irq/125-eth023:45:013
30309960,5cyclictest0-21swapper/022:05:170
30309960,3cyclictest13570-21sh19:30:010
30309960,3cyclictest10706-21munin-run23:50:000
30309960,1cyclictest7753-21grep00:25:310
32232250,0sleep00-21swapper/023:24:120
30499955,0cyclictest5571-21kworker/3:222:10:263
30499955,0cyclictest5571-21kworker/3:221:48:023
30499955,0cyclictest5571-21kworker/3:221:25:383
30499955,0cyclictest5571-21kworker/3:221:03:133
30499955,0cyclictest5571-21kworker/3:220:52:013
30499955,0cyclictest5571-21kworker/3:220:07:153
30499955,0cyclictest5571-21kworker/3:200:24:453
30499955,0cyclictest0-21swapper/322:50:243
30499954,1cyclictest0-21swapper/322:09:323
30499950,5cyclictest0-21swapper/323:40:203
30499950,5cyclictest0-21swapper/323:31:363
30499950,5cyclictest0-21swapper/322:31:353
30499950,5cyclictest0-21swapper/321:50:553
30419950,5cyclictest0-21swapper/222:15:202
30419950,0cyclictest0-21swapper/222:12:052
30419950,0cyclictest0-21swapper/221:42:502
30369951,2cyclictest0-21swapper/123:45:171
30369950,5cyclictest0-21swapper/122:46:021
30369950,5cyclictest0-21swapper/121:44:301
30369950,5cyclictest0-21swapper/120:34:551
30309955,0cyclictest0-21swapper/000:07:370
30309950,5cyclictest0-21swapper/022:39:270
30309950,5cyclictest0-21swapper/022:20:230
30309950,4cyclictest0-21swapper/021:30:180
30309950,4cyclictest0-21swapper/021:10:010
30309950,4cyclictest0-21swapper/000:35:170
30499943,1cyclictest23781-21tr22:40:283
30499942,2cyclictest57250irq/125-eth022:39:133
30499942,2cyclictest11523-21tr23:50:183
30499942,1cyclictest30906-21ntpq22:25:303
30499942,1cyclictest12613-21ssh21:36:353
30499941,2cyclictest0-21swapper/319:10:163
30499941,1cyclictest0-21swapper/323:00:193
30499941,1cyclictest0-21swapper/319:30:203
30499941,1cyclictest0-21swapper/319:15:203
30499940,4cyclictest24205-21perl20:55:233
30499940,4cyclictest13021-21df22:15:223
30499940,4cyclictest0-21swapper/323:57:433
30499940,4cyclictest0-21swapper/323:35:063
30499940,4cyclictest0-21swapper/323:20:173
30499940,4cyclictest0-21swapper/323:15:193
30499940,4cyclictest0-21swapper/323:07:103
30499940,4cyclictest0-21swapper/322:20:193
30499940,4cyclictest0-21swapper/322:00:163
30499940,4cyclictest0-21swapper/321:55:283
30499940,4cyclictest0-21swapper/321:10:173
30499940,4cyclictest0-21swapper/320:31:333
30499940,4cyclictest0-21swapper/300:25:183
30499940,4cyclictest0-21swapper/300:10:203
30499940,4cyclictest0-21swapper/300:05:173
30499940,4cyclictest0-21swapper/300:00:203
30499940,3cyclictest4838-21ssh21:32:093
30499940,3cyclictest28697-21expr21:05:173
30499940,3cyclictest25430-21ssh00:17:083
30499940,3cyclictest23615-21grep19:50:003
30499940,3cyclictest2037-21diskstats23:25:233
30499940,3cyclictest18841-21grep20:45:183
30499940,3cyclictest15059-21ssh22:55:013
30499940,3cyclictest14674-21memory20:35:253
30499940,3cyclictest11093-21apt-get19:25:003
30499940,3cyclictest10947-21sh23:10:503
30499940,3cyclictest0-21swapper/320:10:023
30499940,1cyclictest28676-21/usr/sbin/munin20:00:213
30499940,1cyclictest16071-21/usr/sbin/munin20:40:303
30419944,0cyclictest6637-21ssh00:05:442
30419944,0cyclictest0-21swapper/223:43:372
30419944,0cyclictest0-21swapper/223:13:382
30419944,0cyclictest0-21swapper/221:10:332
30419944,0cyclictest0-21swapper/220:28:372
30419942,1cyclictest759-21snmpd21:46:542
30419942,1cyclictest0-21swapper/223:15:192
30419941,3cyclictest759-21snmpd00:25:522
30419940,4cyclictest32154-21ssh23:05:072
30419940,4cyclictest22021-21perl00:15:242
30419940,4cyclictest0-21swapper/223:50:182
30419940,4cyclictest0-21swapper/222:54:392
30419940,4cyclictest0-21swapper/222:48:082
30419940,4cyclictest0-21swapper/222:31:342
30419940,4cyclictest0-21swapper/222:20:192
30419940,4cyclictest0-21swapper/221:55:282
30419940,4cyclictest0-21swapper/221:50:172
30419940,4cyclictest0-21swapper/221:30:192
30419940,4cyclictest0-21swapper/221:25:222
30419940,4cyclictest0-21swapper/221:15:192
30419940,4cyclictest0-21swapper/221:00:142
30419940,4cyclictest0-21swapper/220:35:452
30419940,4cyclictest0-21swapper/220:22:562
30419940,4cyclictest0-21swapper/220:05:162
30419940,4cyclictest0-21swapper/219:58:032
30419940,4cyclictest0-21swapper/219:10:382
30419940,4cyclictest0-21swapper/200:20:112
30419940,4cyclictest0-21swapper/200:10:202
30419940,4cyclictest0-21swapper/200:00:202
30419940,3cyclictest9185-21ssh21:35:212
30419940,3cyclictest8052-21ssh23:47:592
30419940,3cyclictest29120-21rm22:25:042
30419940,3cyclictest28384-21ssh22:05:192
30419940,3cyclictest16023-21diskstats22:55:232
30419940,3cyclictest11344-21apt-get19:25:212
30419940,3cyclictest11300-21head23:30:242
30419940,0cyclictest0-21swapper/222:43:232
30419940,0cyclictest0-21swapper/222:03:312
30419940,0cyclictest0-21swapper/221:05:362
30419940,0cyclictest0-21swapper/220:48:342
30369944,0cyclictest0-21swapper/123:42:471
30369944,0cyclictest0-21swapper/123:35:391
30369944,0cyclictest0-21swapper/122:33:321
30369944,0cyclictest0-21swapper/121:12:031
30369942,1cyclictest0-21swapper/100:30:171
30369941,2cyclictest0-21swapper/120:00:181
30369941,2cyclictest0-21swapper/119:50:181
30369941,2cyclictest0-21swapper/119:15:201
30369941,2cyclictest0-21swapper/100:05:181
30369941,1cyclictest0-21swapper/122:50:191
30369941,1cyclictest0-21swapper/122:20:181
30369940,4cyclictest0-21swapper/123:50:391
30369940,4cyclictest0-21swapper/122:00:131
30369940,4cyclictest0-21swapper/121:51:371
30369940,4cyclictest0-21swapper/121:29:391
30369940,4cyclictest0-21swapper/100:26:531
30369940,0cyclictest0-21swapper/123:17:551
30309944,0cyclictest0-21swapper/022:56:280
30309944,0cyclictest0-21swapper/022:10:120
30309941,3cyclictest17900-21ls21:20:330
30309940,4cyclictest0-21swapper/023:02:260
30309940,4cyclictest0-21swapper/022:50:180
30309940,4cyclictest0-21swapper/022:25:190
30309940,4cyclictest0-21swapper/021:56:320
30309940,4cyclictest0-21swapper/021:45:200
30309940,4cyclictest0-21swapper/021:39:490
30309940,4cyclictest0-21swapper/021:29:360
30309940,4cyclictest0-21swapper/021:15:200
30309940,4cyclictest0-21swapper/000:01:410
30309940,3cyclictest7174-21irqstats20:20:310
30309940,3cyclictest5989-21users19:15:000
30309940,3cyclictest28667-21grep23:40:260
30309940,3cyclictest23041-21grep22:40:230
30309940,3cyclictest22201-21hddtemp_smartct00:15:240
30309940,3cyclictest21005-21latency_hist19:45:010
30309940,3cyclictest17559-21ntp_states19:35:310
30309940,3cyclictest12944-21sh00:10:210
30309940,3cyclictest11225-21/usr/sbin/munin23:50:220
30309940,3cyclictest11111-21apt-get20:30:180
30309940,3cyclictest0-21swapper/023:13:560
30309940,3cyclictest0-21swapper/020:10:000
30309940,3cyclictest0-21swapper/020:00:180
30309940,0cyclictest0-21swapper/023:09:520
23867240,0sleep10-21swapper/123:00:161
30499932,1cyclictest3885-21tr20:15:193
30499931,2cyclictest57250irq/125-eth000:30:093
30499931,1cyclictest0-21swapper/321:15:203
30499931,1cyclictest0-21swapper/319:55:203
30499930,3cyclictest22102-21apt-get00:34:593
30499930,3cyclictest0-21swapper/322:45:203
30499930,3cyclictest0-21swapper/321:40:063
30499930,3cyclictest0-21swapper/321:20:153
30499930,3cyclictest0-21swapper/320:25:183
30499930,3cyclictest0-21swapper/320:20:193
30499930,3cyclictest0-21swapper/319:50:173
30499930,3cyclictest0-21swapper/319:35:223
30499930,3cyclictest0-21swapper/319:20:183
30499930,0cyclictest0-21swapper/319:40:213
30419933,0cyclictest0-21swapper/219:50:132
30419932,1cyclictest25141-21ssh23:20:062
30419932,1cyclictest23861-21ssh23:00:142
30419931,1cyclictest0-21swapper/220:50:122
30419930,3cyclictest6006-21cut19:15:012
30419930,3cyclictest28413-21apt-get20:00:012
30419930,3cyclictest19951-21ssh23:55:242
30419930,3cyclictest0-21swapper/223:35:052
30419930,3cyclictest0-21swapper/223:25:192
30419930,3cyclictest0-21swapper/222:35:082
30419930,3cyclictest0-21swapper/221:20:182
30419930,3cyclictest0-21swapper/220:55:272
30419930,3cyclictest0-21swapper/220:40:032
30419930,3cyclictest0-21swapper/220:30:272
30419930,3cyclictest0-21swapper/220:15:182
30419930,3cyclictest0-21swapper/220:10:152
30419930,3cyclictest0-21swapper/219:45:052
30419930,3cyclictest0-21swapper/219:40:032
30419930,3cyclictest0-21swapper/219:35:222
30419930,3cyclictest0-21swapper/219:30:192
30419930,3cyclictest0-21swapper/219:20:182
30419930,3cyclictest0-21swapper/200:35:002
30419930,3cyclictest0-21swapper/200:30:122
30369933,0cyclictest0-21swapper/121:59:291
30369933,0cyclictest0-21swapper/120:59:141
30369932,0cyclictest0-21swapper/123:07:121
30369931,2cyclictest0-21swapper/122:15:191
30369931,2cyclictest0-21swapper/119:25:211
30369931,1cyclictest0-21swapper/123:55:251
30369931,1cyclictest0-21swapper/123:30:171
30369931,1cyclictest0-21swapper/123:25:191
30369931,1cyclictest0-21swapper/123:20:181
30369931,1cyclictest0-21swapper/122:40:181
30369931,1cyclictest0-21swapper/122:25:201
30369931,1cyclictest0-21swapper/122:10:231
30369931,1cyclictest0-21swapper/122:05:171
30369931,1cyclictest0-21swapper/121:35:211
30369931,1cyclictest0-21swapper/121:20:201
30369931,1cyclictest0-21swapper/120:10:151
30369931,1cyclictest0-21swapper/119:40:181
30369931,1cyclictest0-21swapper/119:30:201
30369931,1cyclictest0-21swapper/100:35:191
30369931,1cyclictest0-21swapper/100:20:171
30369931,1cyclictest0-21swapper/100:15:181
30369931,1cyclictest0-21swapper/100:00:181
30369930,3cyclictest0-21swapper/121:06:231
30369930,3cyclictest0-21swapper/119:37:361
30369930,2cyclictest208592sleep122:58:081
30369930,2cyclictest20453-21chrt20:46:071
30369930,0cyclictest0-21swapper/120:51:231
30369930,0cyclictest0-21swapper/120:43:311
30309933,0cyclictest0-21swapper/021:40:050
30309932,1cyclictest29713-21tr00:20:170
30309931,1cyclictest0-21swapper/019:30:200
30309930,3cyclictest0-21swapper/023:55:200
30309930,3cyclictest0-21swapper/023:35:190
30309930,3cyclictest0-21swapper/023:25:190
30309930,3cyclictest0-21swapper/023:15:040
30309930,3cyclictest0-21swapper/022:45:080
30309930,3cyclictest0-21swapper/022:30:190
30309930,3cyclictest0-21swapper/022:00:000
30309930,3cyclictest0-21swapper/021:50:210
30309930,3cyclictest0-21swapper/021:05:140
30309930,3cyclictest0-21swapper/021:00:140
30309930,3cyclictest0-21swapper/020:55:180
30309930,3cyclictest0-21swapper/020:50:040
30309930,3cyclictest0-21swapper/020:45:170
30309930,3cyclictest0-21swapper/020:40:150
30309930,3cyclictest0-21swapper/020:25:180
30309930,3cyclictest0-21swapper/020:15:170
30309930,3cyclictest0-21swapper/020:05:160
30309930,3cyclictest0-21swapper/019:55:050
30309930,3cyclictest0-21swapper/019:50:170
30309930,3cyclictest0-21swapper/019:45:190
30309930,3cyclictest0-21swapper/019:20:180
30309930,3cyclictest0-21swapper/019:10:200
30309930,3cyclictest0-21swapper/000:30:180
30309930,2cyclictest759-21snmpd23:30:070
30091230,0sleep10-21swapper/121:46:571
13912230,0sleep10-21swapper/123:13:081
30369921,1cyclictest0-21swapper/121:30:191
30369921,1cyclictest0-21swapper/120:35:191
30369921,1cyclictest0-21swapper/120:25:181
30369921,1cyclictest0-21swapper/119:20:191
30369921,0cyclictest0-21swapper/122:35:191
30369920,2cyclictest5651-21taskset20:16:531
30369920,2cyclictest23192-21taskset19:46:351
30369920,1cyclictest0-21swapper/121:15:271
30369920,1cyclictest0-21swapper/120:20:191
30369920,1cyclictest0-21swapper/120:05:161
30369920,1cyclictest0-21swapper/119:55:201
30369920,1cyclictest0-21swapper/119:10:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional