You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-06 - 04:31

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Tue Jun 06, 2023 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189992229212,13sleep00-21swapper/019:06:260
192662202187,10sleep10-21swapper/119:09:521
191392200184,11sleep30-21swapper/319:08:133
191282131114,12sleep20-21swapper/219:08:042
259712480,0sleep20-21swapper/222:47:302
201042470,0sleep30-21swapper/321:49:433
127252430,0sleep10-21swapper/120:00:151
59092410,0sleep10-21swapper/123:13:011
218002390,0sleep20-21swapper/221:50:222
49552100,0sleep231-21ksoftirqd/220:50:002
194579970,6cyclictest0-21swapper/000:28:060
194709961,4cyclictest0-21swapper/319:25:013
194669964,1cyclictest0-21swapper/221:15:162
194669960,6cyclictest0-21swapper/221:30:202
194669960,5cyclictest0-21swapper/200:10:182
194709955,0cyclictest14677-21diskmemload00:16:333
194709955,0cyclictest0-21swapper/321:51:113
194709955,0cyclictest0-21swapper/319:15:213
194709953,1cyclictest15204-21ssh23:00:183
194709951,2cyclictest0-21swapper/323:50:163
194709951,2cyclictest0-21swapper/320:00:143
194709951,0cyclictest0-21swapper/323:45:163
194709950,5cyclictest0-21swapper/323:10:203
194709950,5cyclictest0-21swapper/322:48:573
194709950,5cyclictest0-21swapper/322:44:003
194709950,5cyclictest0-21swapper/322:28:273
194709950,5cyclictest0-21swapper/321:31:343
194709950,0cyclictest0-21swapper/300:21:033
194669950,5cyclictest0-21swapper/221:26:022
194669950,4cyclictest0-21swapper/222:40:182
194619951,2cyclictest0-21swapper/123:35:181
194619951,2cyclictest0-21swapper/123:25:181
194619951,2cyclictest0-21swapper/123:25:181
194619951,2cyclictest0-21swapper/120:25:201
194619951,2cyclictest0-21swapper/120:20:161
194619951,2cyclictest0-21swapper/119:10:131
194619950,5cyclictest0-21swapper/123:18:081
194619950,5cyclictest0-21swapper/121:30:021
194619950,0cyclictest0-21swapper/121:58:151
194579955,0cyclictest0-21swapper/022:13:390
194579955,0cyclictest0-21swapper/021:32:550
194579950,5cyclictest0-21swapper/022:45:310
194579950,5cyclictest0-21swapper/021:41:210
194579950,4cyclictest23119-21cron00:00:000
194579950,4cyclictest0-21swapper/022:30:190
194579950,4cyclictest0-21swapper/021:15:160
194579950,4cyclictest0-21swapper/019:55:130
194579950,0cyclictest0-21swapper/021:00:010
29442240,0sleep20-21swapper/221:35:442
194709944,0cyclictest22023-21kworker/3:220:55:093
194709944,0cyclictest22023-21kworker/3:220:43:583
194709944,0cyclictest22023-21kworker/3:219:36:463
194709944,0cyclictest0-21swapper/321:15:243
194709943,1cyclictest40-21ksoftirqd/323:40:013
194709942,1cyclictest8207-21ssh22:37:253
194709941,2cyclictest0-21swapper/320:45:163
194709941,1cyclictest0-21swapper/322:10:193
194709941,1cyclictest0-21swapper/320:30:153
194709940,4cyclictest0-21swapper/323:25:193
194709940,4cyclictest0-21swapper/323:25:193
194709940,4cyclictest0-21swapper/323:23:293
194709940,4cyclictest0-21swapper/322:56:323
194709940,4cyclictest0-21swapper/322:51:473
194709940,4cyclictest0-21swapper/322:20:173
194709940,4cyclictest0-21swapper/322:05:183
194709940,4cyclictest0-21swapper/321:55:173
194709940,4cyclictest0-21swapper/321:40:173
194709940,4cyclictest0-21swapper/321:35:183
194709940,4cyclictest0-21swapper/321:29:063
194709940,4cyclictest0-21swapper/321:00:503
194709940,4cyclictest0-21swapper/320:21:153
194709940,4cyclictest0-21swapper/320:15:113
194709940,4cyclictest0-21swapper/319:55:133
194709940,4cyclictest0-21swapper/319:46:033
194709940,4cyclictest0-21swapper/300:35:173
194709940,4cyclictest0-21swapper/300:25:173
194709940,3cyclictest7426-21hddtemp_smartct22:00:273
194709940,3cyclictest414-21/usr/sbin/munin22:15:203
194709940,3cyclictest32289-21rm00:05:053
194709940,3cyclictest3218-21expr19:40:163
194709940,3cyclictest30245-21apt-get19:30:153
194709940,3cyclictest24580-21df23:05:193
194709940,3cyclictest19565-21/usr/sbin/munin19:10:173
194709940,3cyclictest15601-21ssh23:55:223
194709940,3cyclictest13100-21memory00:30:293
194709940,3cyclictest0-21swapper/320:50:123
194709940,1cyclictest10258-21cat00:10:253
194669944,0cyclictest0-21swapper/223:23:442
194669944,0cyclictest0-21swapper/223:09:552
194669944,0cyclictest0-21swapper/222:25:062
194669944,0cyclictest0-21swapper/221:21:492
194669944,0cyclictest0-21swapper/200:26:442
194669943,1cyclictest8736-21cron22:20:012
194669942,2cyclictest291rcuc/223:40:202
194669941,3cyclictest759-21snmpd23:50:162
194669941,2cyclictest0-21swapper/222:35:182
194669940,4cyclictest17470-21sh00:15:052
194669940,4cyclictest15206-21apt-get23:00:182
194669940,4cyclictest0-21swapper/223:37:052
194669940,4cyclictest0-21swapper/223:33:032
194669940,4cyclictest0-21swapper/222:50:162
194669940,4cyclictest0-21swapper/221:46:302
194669940,4cyclictest0-21swapper/221:10:152
194669940,4cyclictest0-21swapper/221:00:142
194669940,4cyclictest0-21swapper/219:55:212
194669940,4cyclictest0-21swapper/219:25:172
194669940,4cyclictest0-21swapper/219:15:012
194669940,4cyclictest0-21swapper/219:10:132
194669940,4cyclictest0-21swapper/200:05:192
194669940,4cyclictest0-21swapper/200:00:192
194669940,3cyclictest8996-21/usr/sbin/munin20:55:212
194669940,3cyclictest7417-21cat20:55:002
194669940,3cyclictest30985-21perl19:30:192
194669940,3cyclictest30960-21if_eth420:35:172
194669940,3cyclictest18458-21hddtemp_smartct20:10:152
194669940,3cyclictest18458-21hddtemp_smartct20:10:152
194669940,3cyclictest16051-21irqstats23:55:252
194669940,3cyclictest0-21swapper/222:30:192
194669940,3cyclictest0-21swapper/222:00:232
194669940,3cyclictest0-21swapper/200:20:172
194669940,1cyclictest8406-21sed22:55:292
194669940,1cyclictest15154-21/usr/sbin/munin20:05:222
194669940,0cyclictest0-21swapper/223:10:392
194669940,0cyclictest0-21swapper/222:10:592
194619944,0cyclictest0-21swapper/122:55:441
194619944,0cyclictest0-21swapper/122:43:391
194619944,0cyclictest0-21swapper/122:36:311
194619944,0cyclictest0-21swapper/122:29:231
194619944,0cyclictest0-21swapper/122:22:591
194619944,0cyclictest0-21swapper/122:17:201
194619944,0cyclictest0-21swapper/121:44:081
194619941,2cyclictest0-21swapper/123:45:011
194619941,2cyclictest0-21swapper/123:20:191
194619941,2cyclictest0-21swapper/121:05:131
194619941,2cyclictest0-21swapper/120:40:111
194619941,2cyclictest0-21swapper/120:15:121
194619941,2cyclictest0-21swapper/100:10:181
194619941,1cyclictest0-21swapper/120:35:131
194619941,1cyclictest0-21swapper/119:55:131
194619940,4cyclictest0-21swapper/123:58:451
194619940,4cyclictest0-21swapper/122:02:281
194619940,4cyclictest0-21swapper/100:28:071
194619940,2cyclictest0-21swapper/121:20:201
194619940,0cyclictest0-21swapper/121:49:051
194579944,0cyclictest0-21swapper/022:08:430
194579944,0cyclictest0-21swapper/021:57:310
194579944,0cyclictest0-21swapper/020:26:330
194579941,3cyclictest759-21snmpd21:26:490
194579941,1cyclictest0-21swapper/020:10:130
194579941,1cyclictest0-21swapper/020:10:120
194579940,4cyclictest18402-21ssh22:43:240
194579940,4cyclictest0-21swapper/023:33:390
194579940,4cyclictest0-21swapper/022:20:170
194579940,4cyclictest0-21swapper/021:52:510
194579940,4cyclictest0-21swapper/019:45:150
194579940,4cyclictest0-21swapper/019:15:000
194579940,4cyclictest0-21swapper/000:35:170
194579940,4cyclictest0-21swapper/000:30:470
194579940,4cyclictest0-21swapper/000:20:060
194579940,4cyclictest0-21swapper/000:18:210
194579940,3cyclictest8895-21ssh23:15:010
194579940,3cyclictest450-21ssh21:20:140
194579940,3cyclictest32703-21expr20:40:140
194579940,3cyclictest31503-21/usr/sbin/munin19:30:220
194579940,3cyclictest29954-21ssh22:50:170
194579940,3cyclictest29401-21ssh23:45:010
194579940,3cyclictest27555-21ssh23:43:500
194579940,3cyclictest27536-21apt-get20:30:150
194579940,3cyclictest26806-21ssh00:01:120
194579940,3cyclictest26804-21ssh21:35:070
194579940,3cyclictest22873-21cut19:15:150
194579940,3cyclictest20933-21smartctl20:15:150
194579940,3cyclictest19578-21ssh21:49:200
194579940,3cyclictest14856-21wc21:10:010
194579940,3cyclictest11902-21ssh23:53:140
194579940,3cyclictest11708-21ssh22:02:530
194579940,3cyclictest0-21swapper/022:35:170
194579940,3cyclictest0-21swapper/022:25:190
194579940,1cyclictest16801-21sed20:05:260
194579940,0cyclictest0-21swapper/022:18:360
194579940,0cyclictest0-21swapper/020:56:310
194579940,0cyclictest0-21swapper/000:13:500
13328240,0sleep00-21swapper/022:59:050
27142230,0sleep1201rcuc/100:01:281
194709931,1cyclictest759-21snmpd23:30:013
194709931,1cyclictest0-21swapper/320:05:163
194709930,3cyclictest8093-21cstates19:50:143
194709930,3cyclictest30617-21grep20:35:153
194709930,3cyclictest14677-21diskmemload00:00:163
194709930,3cyclictest0-21swapper/323:40:053
194709930,3cyclictest0-21swapper/323:15:173
194709930,3cyclictest0-21swapper/322:30:223
194709930,3cyclictest0-21swapper/321:20:183
194709930,3cyclictest0-21swapper/321:10:113
194709930,3cyclictest0-21swapper/321:05:133
194709930,3cyclictest0-21swapper/320:25:193
194709930,3cyclictest0-21swapper/320:10:123
194709930,3cyclictest0-21swapper/320:10:123
194709930,3cyclictest0-21swapper/319:20:073
194669932,1cyclictest32710-21taskset22:15:092
194669932,1cyclictest2779-21/usr/sbin/munin19:40:172
194669931,2cyclictest0-21swapper/221:55:032
194669930,3cyclictest9249-21apt-get23:15:172
194669930,3cyclictest25071-21apt-get20:25:192
194669930,3cyclictest20099-21apt-get20:15:112
194669930,3cyclictest13209-21df_inode20:00:162
194669930,3cyclictest0-21swapper/223:45:062
194669930,3cyclictest0-21swapper/223:25:222
194669930,3cyclictest0-21swapper/223:25:222
194669930,3cyclictest0-21swapper/221:40:172
194669930,3cyclictest0-21swapper/220:40:112
194669930,3cyclictest0-21swapper/220:30:142
194669930,3cyclictest0-21swapper/220:20:152
194669930,3cyclictest0-21swapper/219:50:122
194669930,3cyclictest0-21swapper/219:45:162
194669930,3cyclictest0-21swapper/219:35:012
194669930,3cyclictest0-21swapper/219:20:152
194669930,3cyclictest0-21swapper/200:30:192
194669930,1cyclictest12435-21/usr/sbin/munin21:05:172
194669930,1cyclictest0-21swapper/222:05:062
194669930,1cyclictest0-21swapper/200:35:122
194619933,0cyclictest0-21swapper/121:39:121
194619933,0cyclictest0-21swapper/121:25:051
194619933,0cyclictest0-21swapper/120:30:571
194619932,1cyclictest207542chrt23:03:031
194619932,1cyclictest0-21swapper/123:50:161
194619932,1cyclictest0-21swapper/121:00:141
194619931,1cyclictest0-21swapper/123:05:171
194619931,1cyclictest0-21swapper/120:45:151
194619931,1cyclictest0-21swapper/120:10:121
194619931,1cyclictest0-21swapper/120:10:121
194619931,1cyclictest0-21swapper/120:05:161
194619931,1cyclictest0-21swapper/119:35:001
194619930,3cyclictest0-21swapper/119:22:161
194619930,2cyclictest8928-21chrt23:33:061
194619930,2cyclictest7152sleep100:23:511
194619930,2cyclictest26329-21taskset21:15:341
194619930,2cyclictest0-21swapper/121:50:181
194619930,2cyclictest0-21swapper/121:10:151
194619930,2cyclictest0-21swapper/120:50:121
194619930,2cyclictest0-21swapper/119:40:151
194619930,2cyclictest0-21swapper/100:35:171
194619930,2cyclictest0-21swapper/100:30:191
194619930,2cyclictest0-21swapper/100:05:191
194619930,1cyclictest0-21swapper/122:10:341
194619930,1cyclictest0-21swapper/122:05:181
194579932,1cyclictest26635-21ssh23:25:040
194579932,1cyclictest26635-21ssh23:25:040
194579931,0cyclictest0-21swapper/020:20:160
194579930,3cyclictest481-21grep19:35:220
194579930,3cyclictest2154-21python23:10:270
194579930,3cyclictest151982sleep023:00:170
194579930,3cyclictest0-21swapper/023:35:170
194579930,3cyclictest0-21swapper/023:20:020
194579930,3cyclictest0-21swapper/023:05:170
194579930,3cyclictest0-21swapper/021:10:140
194579930,3cyclictest0-21swapper/020:50:120
194579930,3cyclictest0-21swapper/020:45:150
194579930,3cyclictest0-21swapper/020:35:130
194579930,3cyclictest0-21swapper/019:50:120
194579930,3cyclictest0-21swapper/019:40:140
194579930,3cyclictest0-21swapper/019:25:170
194579930,3cyclictest0-21swapper/019:20:160
194579930,2cyclictest32398-21sh00:05:100
194579930,1cyclictest0-21swapper/020:00:140
194619921,1cyclictest0-21swapper/122:45:121
194619921,1cyclictest0-21swapper/119:45:161
194619921,1cyclictest0-21swapper/119:35:191
194619920,1cyclictest22793-21chrt19:15:071
194619920,1cyclictest0-21swapper/123:40:161
194619920,1cyclictest0-21swapper/122:50:071
194619920,1cyclictest0-21swapper/122:30:191
194619920,1cyclictest0-21swapper/120:55:141
194619920,1cyclictest0-21swapper/119:50:121
194619920,1cyclictest0-21swapper/119:25:011
194619920,1cyclictest0-21swapper/100:15:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional