You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 13:24

x86 Intel Core i5-6440EQ @2700 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Jun 27, 2022 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117272234220,10sleep10-21swapper/119:09:051
117312198180,13sleep00-21swapper/019:09:080
117362189172,13sleep30-21swapper/319:09:103
116982182166,12sleep20-21swapper/219:08:412
244422510,0sleep10-21swapper/122:57:051
132102450,0sleep00-21swapper/020:15:130
1197499120,11cyclictest3919-21apt-get22:45:120
276912110,0sleep10-21swapper/100:18:041
1197499110,6cyclictest20427-21grep22:55:120
1197499110,5cyclictest4347-21apt-get23:05:130
1197499100,9cyclictest5434-21apt-get23:45:120
1197499100,9cyclictest18004-21apt-get20:25:110
1197499100,5cyclictest19183-21hostname22:15:230
119749991,5cyclictest7014-21nscd22:52:320
119749990,8cyclictest30565-21apt-get00:20:110
119749990,8cyclictest10557-21apt-get20:10:110
119749990,8cyclictest1021-21munin-run21:45:010
119749990,8cyclictest0-21swapper/023:00:120
119749990,7cyclictest25113-21taskset19:34:060
119749990,6cyclictest740-21snmpd22:24:180
119749990,6cyclictest5933-21df20:00:110
119749990,6cyclictest26205-21ssh23:18:040
119749990,6cyclictest13223-21fschecks_count23:10:140
119749990,5cyclictest27894-21ssh22:40:060
119749990,5cyclictest27087-21ssh23:38:220
119749990,5cyclictest26368-21ssh22:00:070
119749990,5cyclictest2514-21taskset19:53:050
119749990,5cyclictest2385-21taskset20:56:390
119749982,5cyclictest29946-21expr23:20:140
119749980,7cyclictest9719-21tune2fs21:30:140
119749980,7cyclictest726-21runrttasks21:50:130
119749980,7cyclictest6357-21ssh00:25:110
119749980,7cyclictest5931-21apt-get00:05:120
119749980,7cyclictest31011-21rm00:00:140
119749980,7cyclictest26858-21ssh21:20:220
119749980,7cyclictest25433-21apt-get20:40:110
119749980,7cyclictest22821-21apt-get00:35:100
119749980,7cyclictest22292-21apt-get00:15:100
119749980,7cyclictest20298-21perl22:35:150
119749980,7cyclictest17193-21fschecks_time21:15:150
119749980,7cyclictest15540-21apt-get20:20:160
119749980,7cyclictest1451-21apt-get21:45:120
119749980,7cyclictest14104-21/usr/sbin/munin00:10:150
119749980,7cyclictest13106-21ssh23:30:120
119749980,7cyclictest11219-21apt-get22:30:120
119749980,7cyclictest10638-21apt-get22:10:120
119749980,6cyclictest4092-21grep21:00:160
119749980,5cyclictest9074-21if_eth121:10:150
119749980,5cyclictest7634-21diskmemload00:30:130
119749980,5cyclictest7518-21ssh23:25:520
119749980,5cyclictest7353-21taskset21:06:350
119749980,5cyclictest649-21ssh21:25:110
119749980,5cyclictest32547-21taskset20:54:210
119749980,5cyclictest32511-21ssh23:41:050
119749980,5cyclictest29837-21chrt20:46:150
119749980,5cyclictest2882-21ssh22:25:050
119749980,5cyclictest27475-21taskset19:37:410
119749980,5cyclictest24807-21chrt20:35:250
119749980,5cyclictest2393-21ssh22:05:150
119749980,5cyclictest226352sleep020:34:130
119749980,5cyclictest22377-21taskset19:25:420
119749980,5cyclictest21557-21ssh21:37:080
119749980,5cyclictest20418-21ssh21:55:290
119749980,5cyclictest20017-21chrt19:22:040
119749980,5cyclictest19632-21ssh23:53:310
119749980,5cyclictest15319-21chrt19:15:080
119749980,5cyclictest14240-21chrt19:14:040
119749970,6cyclictest3739-21expr19:55:140
119749970,6cyclictest26912-21ssh23:57:490
119749970,5cyclictest30123-21taskset19:44:420
119749960,6cyclictest8073-21apt-get20:05:000
119749960,6cyclictest30396-21apt-get19:45:110
4714250,0sleep10-21swapper/123:44:491
119909955,0cyclictest12593-21kworker/3:221:31:303
119909955,0cyclictest0-21swapper/321:50:043
119909951,3cyclictest740-21snmpd22:45:013
119909950,5cyclictest0-21swapper/322:51:103
119909950,5cyclictest0-21swapper/322:32:163
119909950,4cyclictest7634-21diskmemload00:05:123
119909950,4cyclictest5926-21hddtemp_smartct23:25:213
119909950,4cyclictest0-21swapper/321:15:123
119909950,4cyclictest0-21swapper/300:00:123
119909950,3cyclictest0-21swapper/320:45:143
119909950,0cyclictest25571-21ssh23:37:093
119859950,5cyclictest0-21swapper/223:32:022
119859950,5cyclictest0-21swapper/222:57:412
119859950,5cyclictest0-21swapper/221:17:182
119859950,5cyclictest0-21swapper/220:05:012
119859950,4cyclictest31436-21ssh22:22:112
119859950,1cyclictest0-21swapper/200:35:112
119819950,5cyclictest0-21swapper/122:00:041
119819950,5cyclictest0-21swapper/121:38:581
119819950,5cyclictest0-21swapper/100:26:431
119819950,5cyclictest0-21swapper/100:10:001
119909944,0cyclictest12593-21kworker/3:222:05:043
119909944,0cyclictest12593-21kworker/3:221:20:193
119909944,0cyclictest0-21swapper/323:51:253
119909941,3cyclictest740-21snmpd20:00:303
119909940,4cyclictest32560-21seq23:02:003
119909940,4cyclictest0-21swapper/323:40:113
119909940,4cyclictest0-21swapper/323:22:283
119909940,4cyclictest0-21swapper/323:15:113
119909940,4cyclictest0-21swapper/322:10:123
119909940,4cyclictest0-21swapper/321:56:473
119909940,4cyclictest0-21swapper/321:25:183
119909940,4cyclictest0-21swapper/321:10:113
119909940,4cyclictest0-21swapper/321:00:113
119909940,4cyclictest0-21swapper/319:20:123
119909940,4cyclictest0-21swapper/300:20:113
119909940,3cyclictest6361-21ssh00:25:123
119909940,3cyclictest4898-21df23:05:143
119909940,3cyclictest472-21dbus-daemon19:35:183
119909940,3cyclictest30412-21ssh22:40:403
119909940,3cyclictest27892-21perl22:20:133
119909940,3cyclictest26565-21hddtemp_smartct21:40:163
119909940,3cyclictest25099-21ssh00:15:593
119909940,3cyclictest24230-21ntp_states19:30:193
119909940,3cyclictest23465-21df_inode20:35:123
119909940,3cyclictest21732-21ssh23:55:043
119909940,3cyclictest20857-21df_inode22:55:123
119909940,3cyclictest20777-21tr20:30:123
119909940,3cyclictest20492-21apt19:25:113
119909940,3cyclictest20060-21df22:35:143
119909940,3cyclictest17314-21/usr/sbin/munin21:35:183
119909940,3cyclictest15064-21rm23:10:433
119909940,3cyclictest14682-21diskstats00:10:123
119909940,3cyclictest13391-21sed23:50:003
119909940,3cyclictest12980-21ssh23:30:053
119909940,3cyclictest0-21swapper/320:55:103
119909940,3cyclictest0-21swapper/320:25:123
119909940,1cyclictest19155-21aten2_r5power_e22:15:243
119909940,1cyclictest16656-21cut19:15:183
119859944,0cyclictest0-21swapper/223:39:362
119859944,0cyclictest0-21swapper/223:25:112
119859944,0cyclictest0-21swapper/222:37:282
119859944,0cyclictest0-21swapper/221:43:552
119859944,0cyclictest0-21swapper/200:06:052
119859944,0cyclictest0-21swapper/200:01:172
119859943,1cyclictest9299-21cron21:50:012
119859943,1cyclictest26327-21kworker/2:019:44:202
119859942,2cyclictest26327-21kworker/2:023:16:042
119859942,1cyclictest740-21snmpd22:50:112
119859942,1cyclictest740-21snmpd22:33:342
119859942,1cyclictest740-21snmpd22:16:082
119859942,1cyclictest740-21snmpd22:12:172
119859942,1cyclictest740-21snmpd19:50:062
119859942,1cyclictest29600-21/usr/sbin/munin23:40:182
119859941,2cyclictest740-21snmpd21:10:042
119859940,4cyclictest14251-21diskstats23:50:132
119859940,4cyclictest0-21swapper/223:00:112
119859940,4cyclictest0-21swapper/222:40:022
119859940,4cyclictest0-21swapper/222:05:172
119859940,4cyclictest0-21swapper/221:55:122
119859940,4cyclictest0-21swapper/221:20:122
119859940,4cyclictest0-21swapper/220:00:112
119859940,4cyclictest0-21swapper/200:30:122
119859940,4cyclictest0-21swapper/200:20:102
119859940,4cyclictest0-21swapper/200:10:102
119859940,3cyclictest7421-21ssh21:29:072
119859940,3cyclictest6012-21sh23:45:132
119859940,3cyclictest4132-21ssh23:05:022
119859940,3cyclictest2911-21/usr/sbin/munin21:00:192
119859940,3cyclictest22941-21apt20:35:102
119859940,2cyclictest0-21swapper/200:15:092
119859940,1cyclictest27902-21/usr/sbin/munin20:45:202
119859940,1cyclictest27147-21df22:00:192
119819944,0cyclictest0-21swapper/123:08:351
119819944,0cyclictest0-21swapper/122:35:421
119819944,0cyclictest0-21swapper/122:33:491
119819944,0cyclictest0-21swapper/122:26:151
119819944,0cyclictest0-21swapper/121:22:481
119819944,0cyclictest0-21swapper/121:13:291
119819944,0cyclictest0-21swapper/100:35:011
119819944,0cyclictest0-21swapper/100:00:571
119819941,2cyclictest0-21swapper/121:45:111
119819940,4cyclictest0-21swapper/123:53:321
119819940,4cyclictest0-21swapper/123:45:241
119819940,4cyclictest0-21swapper/122:47:471
119819940,4cyclictest0-21swapper/122:24:221
119819940,4cyclictest0-21swapper/120:03:381
119819940,0cyclictest0-21swapper/123:30:151
119909932,1cyclictest740-21snmpd20:10:303
119909932,1cyclictest13341-21grep20:15:133
119909930,3cyclictest25431-21apt20:40:113
119909930,3cyclictest1270-21hddtemp_smartct19:50:143
119909930,3cyclictest12089-21apt-get19:10:103
119909930,3cyclictest0-21swapper/322:25:123
119909930,3cyclictest0-21swapper/322:00:163
119909930,3cyclictest0-21swapper/321:45:123
119909930,3cyclictest0-21swapper/321:05:113
119909930,3cyclictest0-21swapper/320:50:113
119909930,3cyclictest0-21swapper/320:05:103
119909930,3cyclictest0-21swapper/319:45:113
119909930,3cyclictest0-21swapper/319:40:103
119909930,3cyclictest0-21swapper/300:35:103
119909930,3cyclictest0-21swapper/300:30:063
119909930,2cyclictest15516-21seq20:20:013
119909930,0cyclictest0-21swapper/319:56:523
119859933,0cyclictest0-21swapper/220:20:162
119859932,1cyclictest740-21snmpd19:25:162
119859932,1cyclictest740-21snmpd00:25:142
119859932,1cyclictest54250irq/130-eth023:20:102
119859932,1cyclictest17325-21aten2_r5power_c21:35:112
119859932,1cyclictest15188-21sendmail_mailqu19:15:012
119859931,2cyclictest12472-21sh23:10:062
119859931,1cyclictest388-21apt-get20:55:112
119859931,1cyclictest0-21swapper/220:40:102
119859931,1cyclictest0-21swapper/219:30:132
119859930,3cyclictest9580-21diskstats21:30:132
119859930,3cyclictest54250irq/130-eth019:10:102
119859930,3cyclictest5394-21/usr/sbin/munin21:05:132
119859930,3cyclictest22423-21df23:55:122
119859930,3cyclictest21195-21perl20:30:142
119859930,3cyclictest0-21swapper/222:45:132
119859930,3cyclictest0-21swapper/222:25:112
119859930,3cyclictest0-21swapper/220:50:012
119859930,3cyclictest0-21swapper/220:25:122
119859930,3cyclictest0-21swapper/220:15:112
119859930,3cyclictest0-21swapper/220:10:102
119859930,3cyclictest0-21swapper/219:55:112
119859930,3cyclictest0-21swapper/219:45:102
119859930,3cyclictest0-21swapper/219:35:142
119859930,3cyclictest0-21swapper/219:20:012
119859930,0cyclictest9741-21apt-get21:50:122
119819933,0cyclictest0-21swapper/122:14:181
119819933,0cyclictest0-21swapper/121:50:451
119819933,0cyclictest0-21swapper/121:32:081
119819933,0cyclictest0-21swapper/120:55:261
119819933,0cyclictest0-21swapper/119:15:551
119819931,1cyclictest0-21swapper/123:38:371
119819931,1cyclictest0-21swapper/123:25:181
119819931,1cyclictest0-21swapper/122:40:011
119819931,1cyclictest0-21swapper/122:15:221
119819931,1cyclictest0-21swapper/121:55:121
119819931,1cyclictest0-21swapper/121:25:191
119819931,1cyclictest0-21swapper/121:15:111
119819931,1cyclictest0-21swapper/120:50:101
119819931,1cyclictest0-21swapper/120:20:151
119819931,1cyclictest0-21swapper/120:15:111
119819931,1cyclictest0-21swapper/119:55:101
119819931,1cyclictest0-21swapper/119:30:111
119819931,1cyclictest0-21swapper/119:25:101
119819931,1cyclictest0-21swapper/119:10:111
119819931,1cyclictest0-21swapper/100:30:111
119819931,1cyclictest0-21swapper/100:20:101
119819931,1cyclictest0-21swapper/100:10:111
119819930,3cyclictest0-21swapper/120:14:161
119819930,3cyclictest0-21swapper/119:44:001
119819930,3cyclictest0-21swapper/119:37:541
119819930,2cyclictest275212sleep123:58:171
119819930,2cyclictest0-21swapper/123:15:121
119819930,2cyclictest0-21swapper/122:05:171
119819930,2cyclictest0-21swapper/119:20:111
119819921,1cyclictest0-21swapper/121:40:121
119819921,1cyclictest0-21swapper/120:45:131
119819920,1cyclictest29043-21chrt23:20:111
119819920,1cyclictest13057-21chrt23:10:131
119819920,1cyclictest0-21swapper/123:00:121
119819920,1cyclictest0-21swapper/122:50:121
119819920,1cyclictest0-21swapper/121:05:121
119819920,1cyclictest0-21swapper/121:00:111
119819920,1cyclictest0-21swapper/120:40:111
119819920,1cyclictest0-21swapper/120:35:111
119819920,1cyclictest0-21swapper/120:30:111
119819920,1cyclictest0-21swapper/120:25:111
119819920,1cyclictest0-21swapper/119:50:101
119819920,1cyclictest0-21swapper/119:45:111
119819910,1cyclictest0-21swapper/120:05:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional