You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 19:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Sat Apr 20, 2024 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
216512204187,12sleep10-21swapper/107:05:021
237712201186,10sleep00-21swapper/007:08:430
238412182166,11sleep30-21swapper/307:09:393
238592181164,13sleep20-21swapper/207:09:502
137312150,0sleep10-21swapper/109:00:121
240489991,4cyclictest24082-21munin-run11:50:000
240489982,3cyclictest2968-21munin-run08:40:010
27908260,0sleep20-21swapper/212:30:522
240489960,6cyclictest0-21swapper/012:01:350
240489960,3cyclictest6782-21sendmail-msp11:00:000
240629950,5cyclictest0-21swapper/310:45:093
240629950,5cyclictest0-21swapper/310:12:553
240629950,4cyclictest0-21swapper/310:50:013
240629950,4cyclictest0-21swapper/307:25:113
240589955,0cyclictest0-21swapper/210:44:062
240589950,5cyclictest0-21swapper/212:07:382
240589950,5cyclictest0-21swapper/211:30:102
240589950,4cyclictest3698-21ssh09:40:122
240589950,4cyclictest21291-21perl08:10:182
240589950,4cyclictest0-21swapper/210:05:122
240589950,0cyclictest0-21swapper/212:13:182
240589950,0cyclictest0-21swapper/209:29:272
240539954,1cyclictest0-21swapper/109:37:521
240539951,2cyclictest0-21swapper/111:00:091
240539950,5cyclictest0-21swapper/111:54:031
240539950,0cyclictest0-21swapper/111:47:301
240489954,1cyclictest30313-21sh11:53:250
240489950,5cyclictest0-21swapper/012:30:060
240489950,5cyclictest0-21swapper/011:55:280
240489950,4cyclictest26487-21chrt10:32:110
240489950,1cyclictest26413-21perf07:15:000
240629944,0cyclictest0-21swapper/312:20:143
240629944,0cyclictest0-21swapper/311:10:073
240629944,0cyclictest0-21swapper/310:19:123
240629942,1cyclictest3602-21snmpd11:44:483
240629942,1cyclictest30007-21grep07:20:103
240629941,3cyclictest7587-21tail10:40:173
240629941,3cyclictest21862-21sh11:28:373
240629940,4cyclictest7049-21ntp_states10:20:223
240629940,4cyclictest333-21ntp_states10:55:233
240629940,4cyclictest0-21swapper/312:15:163
240629940,4cyclictest0-21swapper/311:58:273
240629940,4cyclictest0-21swapper/311:53:483
240629940,4cyclictest0-21swapper/310:36:103
240629940,4cyclictest0-21swapper/309:42:123
240629940,4cyclictest0-21swapper/308:40:003
240629940,4cyclictest0-21swapper/307:15:123
240629940,3cyclictest8354-21grep11:20:133
240629940,3cyclictest4596-21ssh10:00:103
240629940,3cyclictest2934-21df_inode07:30:123
240629940,3cyclictest28455-21sh09:55:013
240629940,3cyclictest27143-21/usr/sbin/munin12:30:243
240629940,3cyclictest26643-21sed07:15:013
240629940,3cyclictest25807-21grep12:10:173
240629940,3cyclictest25285-21apt-get08:20:003
240629940,3cyclictest19177-21sh09:30:043
240629940,3cyclictest17369-21ssh12:05:153
240629940,3cyclictest16966-21date12:25:013
240629940,3cyclictest16483-21irqstats11:05:173
240629940,3cyclictest15834-21cut09:05:113
240629940,3cyclictest13306-21/usr/sbin/munin09:00:153
240629940,3cyclictest12814-21sed07:55:003
240629940,3cyclictest11968-21sh09:45:103
240629940,3cyclictest11583-21diskstats09:25:133
240629940,3cyclictest10418-21find12:00:333
240629940,1cyclictest7106-21/usr/sbin/munin11:00:163
240629940,1cyclictest28958-21users09:15:263
240629940,1cyclictest28958-21users09:15:263
240629940,1cyclictest20318-21/usr/sbin/munin09:50:193
240629940,1cyclictest1243-21ntp_states11:35:213
240589942,2cyclictest30652-21kworker/2:111:19:582
240589942,2cyclictest13563-21kworker/2:210:55:142
240589942,2cyclictest13563-21kworker/2:210:28:262
240589942,1cyclictest0-21swapper/212:25:102
240589942,1cyclictest0-21swapper/211:25:102
240589941,2cyclictest0-21swapper/211:35:122
240589941,2cyclictest0-21swapper/210:45:092
240589941,2cyclictest0-21swapper/207:40:092
240589940,4cyclictest16225-21apt-get11:45:102
240589940,4cyclictest0-21swapper/212:22:302
240589940,4cyclictest0-21swapper/211:53:552
240589940,4cyclictest0-21swapper/211:14:182
240589940,4cyclictest0-21swapper/211:05:102
240589940,4cyclictest0-21swapper/211:00:082
240589940,4cyclictest0-21swapper/210:30:132
240589940,4cyclictest0-21swapper/210:20:142
240589940,4cyclictest0-21swapper/210:10:082
240589940,4cyclictest0-21swapper/210:03:512
240589940,4cyclictest0-21swapper/209:30:122
240589940,4cyclictest0-21swapper/209:11:522
240589940,4cyclictest0-21swapper/207:10:112
240589940,3cyclictest9887-21irqstats12:00:272
240589940,3cyclictest928-21irqstats07:25:192
240589940,3cyclictest8070-21ssh09:22:592
240589940,3cyclictest623-21rm12:15:032
240589940,3cyclictest3602-21snmpd10:35:112
240589940,3cyclictest32643-21ssh09:37:402
240589940,3cyclictest28867-21tune2fs08:25:162
240589940,3cyclictest23655-21perl10:50:122
240589940,3cyclictest2174-21memory12:35:182
240589940,3cyclictest2174-21memory12:35:182
240589940,3cyclictest21127-21perl09:50:142
240589940,3cyclictest12765-21perl09:45:152
240589940,3cyclictest11024-21ssh11:41:092
240539944,0cyclictest0-21swapper/111:58:071
240539944,0cyclictest0-21swapper/110:24:161
240539941,2cyclictest0-21swapper/112:20:101
240539941,2cyclictest0-21swapper/112:15:121
240539941,2cyclictest0-21swapper/112:10:131
240539941,2cyclictest0-21swapper/111:15:121
240539941,2cyclictest0-21swapper/110:25:091
240539941,2cyclictest0-21swapper/110:15:101
240539941,2cyclictest0-21swapper/110:00:101
240539941,2cyclictest0-21swapper/109:45:121
240539941,2cyclictest0-21swapper/109:40:131
240539941,2cyclictest0-21swapper/109:10:091
240539941,2cyclictest0-21swapper/107:15:111
240539941,1cyclictest0-21swapper/109:20:111
240539941,1cyclictest0-21swapper/109:05:091
240539940,3cyclictest0-21swapper/109:25:101
240539940,2cyclictest0-21swapper/112:35:111
240539940,2cyclictest0-21swapper/112:35:101
240539940,0cyclictest0-21swapper/110:54:241
240539940,0cyclictest0-21swapper/109:50:391
240489944,0cyclictest0-21swapper/012:12:540
240489944,0cyclictest0-21swapper/010:47:300
240489944,0cyclictest0-21swapper/010:38:560
240489944,0cyclictest0-21swapper/007:55:040
240489942,1cyclictest0-21swapper/008:45:090
240489940,4cyclictest31299-21idleruntime-cro11:15:010
240489940,4cyclictest0-21swapper/012:35:100
240489940,4cyclictest0-21swapper/012:35:100
240489940,4cyclictest0-21swapper/012:15:110
240489940,4cyclictest0-21swapper/010:53:540
240489940,4cyclictest0-21swapper/010:10:390
240489940,4cyclictest0-21swapper/010:08:230
240489940,4cyclictest0-21swapper/010:00:100
240489940,4cyclictest0-21swapper/009:58:450
240489940,4cyclictest0-21swapper/009:19:070
240489940,4cyclictest0-21swapper/009:19:070
240489940,4cyclictest0-21swapper/009:11:160
240489940,4cyclictest0-21swapper/007:43:000
240489940,3cyclictest8037-21ssh11:40:090
240489940,3cyclictest7119-21ssh11:00:090
240489940,3cyclictest7055-21ntp_states10:20:210
240489940,3cyclictest4461-21perl09:40:140
240489940,3cyclictest32365-21apt-get07:25:110
240489940,3cyclictest32170-21ssh11:35:090
240489940,3cyclictest29643-21latency_hist07:20:000
240489940,3cyclictest25646-21gpg-connect-age08:20:000
240489940,3cyclictest23027-21apt08:15:100
240489940,3cyclictest21837-21ntp_states08:10:230
240489940,3cyclictest17141-21/usr/sbin/munin12:25:120
240489940,3cyclictest16825-21apt-get12:05:120
240489940,3cyclictest16249-21expr11:25:130
240489940,3cyclictest15355-21/usr/sbin/munin11:05:130
240489940,3cyclictest13811-21apt-get10:25:080
240489940,3cyclictest13116-21users09:25:250
240489940,3cyclictest12012-21ssh09:45:130
240489940,3cyclictest11332-21df08:55:150
240489940,3cyclictest0-21swapper/009:35:130
240489940,3cyclictest0-21swapper/007:35:100
240489940,0cyclictest0-21swapper/011:23:000
240489940,0cyclictest0-21swapper/010:17:410
18651240,0sleep10-21swapper/111:26:031
240629932,1cyclictest5654-21head07:35:143
240629932,1cyclictest18106-21hostname08:05:113
240629931,2cyclictest57250irq/125-eth011:15:023
240629931,1cyclictest0-21swapper/310:30:133
240629930,3cyclictest23831-21date11:30:013
240629930,3cyclictest12835-21rm10:05:083
240629930,3cyclictest1227-21df08:35:103
240629930,3cyclictest0-21swapper/312:35:033
240629930,3cyclictest0-21swapper/312:35:033
240629930,3cyclictest0-21swapper/311:45:083
240629930,3cyclictest0-21swapper/310:25:023
240629930,3cyclictest0-21swapper/309:35:033
240629930,3cyclictest0-21swapper/309:20:023
240629930,3cyclictest0-21swapper/309:10:023
240629930,3cyclictest0-21swapper/308:55:053
240629930,3cyclictest0-21swapper/308:45:123
240629930,3cyclictest0-21swapper/308:30:133
240629930,3cyclictest0-21swapper/308:25:013
240629930,3cyclictest0-21swapper/308:15:103
240629930,3cyclictest0-21swapper/308:10:193
240629930,3cyclictest0-21swapper/308:00:123
240629930,3cyclictest0-21swapper/307:55:003
240629930,3cyclictest0-21swapper/307:45:113
240629930,3cyclictest0-21swapper/307:40:103
240629930,0cyclictest0-21swapper/308:50:123
240589932,1cyclictest3602-21snmpd07:20:022
240589931,2cyclictest3602-21snmpd11:20:032
240589930,3cyclictest9835-21apt-get07:45:112
240589930,3cyclictest28646-21ssh09:55:102
240589930,3cyclictest27193-21cat07:15:012
240589930,3cyclictest0-21swapper/211:55:102
240589930,3cyclictest0-21swapper/210:15:012
240589930,3cyclictest0-21swapper/209:15:022
240589930,3cyclictest0-21swapper/209:15:012
240589930,3cyclictest0-21swapper/209:05:022
240589930,3cyclictest0-21swapper/209:00:102
240589930,3cyclictest0-21swapper/208:55:122
240589930,3cyclictest0-21swapper/208:50:092
240589930,3cyclictest0-21swapper/208:45:102
240589930,3cyclictest0-21swapper/208:40:012
240589930,3cyclictest0-21swapper/208:35:042
240589930,3cyclictest0-21swapper/208:30:122
240589930,3cyclictest0-21swapper/208:20:012
240589930,3cyclictest0-21swapper/208:15:112
240589930,3cyclictest0-21swapper/208:05:102
240589930,3cyclictest0-21swapper/208:00:002
240589930,3cyclictest0-21swapper/207:55:082
240589930,3cyclictest0-21swapper/207:52:202
240589930,3cyclictest0-21swapper/207:35:092
240589930,3cyclictest0-21swapper/207:30:082
240539933,0cyclictest0-21swapper/111:20:181
240539933,0cyclictest0-21swapper/107:52:211
240539933,0cyclictest0-21swapper/107:23:411
240539931,2cyclictest0-21swapper/109:30:111
240539931,2cyclictest0-21swapper/107:35:101
240539931,1cyclictest0-21swapper/112:05:121
240539931,1cyclictest0-21swapper/112:00:201
240539931,1cyclictest0-21swapper/111:35:111
240539931,1cyclictest0-21swapper/111:30:101
240539931,1cyclictest0-21swapper/111:10:101
240539931,1cyclictest0-21swapper/110:45:081
240539931,1cyclictest0-21swapper/110:05:121
240539931,1cyclictest0-21swapper/109:15:121
240539931,1cyclictest0-21swapper/109:15:121
240539931,1cyclictest0-21swapper/108:50:111
240539931,1cyclictest0-21swapper/108:45:101
240539931,1cyclictest0-21swapper/108:20:121
240539931,1cyclictest0-21swapper/108:00:021
240539931,1cyclictest0-21swapper/107:45:101
240539930,2cyclictest0-21swapper/110:40:091
240539930,2cyclictest0-21swapper/110:10:101
240539930,2cyclictest0-21swapper/109:55:091
240539930,2cyclictest0-21swapper/108:55:131
240539930,2cyclictest0-21swapper/108:30:121
240539930,2cyclictest0-21swapper/108:10:091
240539930,2cyclictest0-21swapper/108:05:101
240539930,1cyclictest0-21swapper/108:35:071
240489933,0cyclictest0-21swapper/007:54:200
240489931,1cyclictest0-21swapper/008:50:090
240489930,3cyclictest18022-21diskmemload11:30:080
240489930,3cyclictest13465-21cpu09:00:120
240489930,3cyclictest0-21swapper/012:20:030
240489930,3cyclictest0-21swapper/011:15:050
240489930,3cyclictest0-21swapper/010:40:100
240489930,3cyclictest0-21swapper/009:20:040
240489930,3cyclictest0-21swapper/009:05:100
240489930,3cyclictest0-21swapper/008:40:100
240489930,3cyclictest0-21swapper/008:30:130
240489930,3cyclictest0-21swapper/008:25:130
240489930,3cyclictest0-21swapper/008:05:110
240489930,3cyclictest0-21swapper/008:00:010
240489930,3cyclictest0-21swapper/007:45:010
240489930,3cyclictest0-21swapper/007:20:090
240489930,2cyclictest20115-21ssh09:50:010
240489930,2cyclictest19305-21/usr/sbin/munin09:30:130
240489930,2cyclictest0-21swapper/007:30:090
240539921,1cyclictest0-21swapper/112:30:091
240539921,1cyclictest0-21swapper/110:35:091
240539921,1cyclictest0-21swapper/108:25:131
240539921,1cyclictest0-21swapper/107:40:091
240539921,1cyclictest0-21swapper/107:30:111
240539921,1cyclictest0-21swapper/107:10:101
240539920,2cyclictest32354-21taskset07:25:051
240539920,1cyclictest7984-21chrt11:40:061
240539920,1cyclictest0-21swapper/112:25:101
240539920,1cyclictest0-21swapper/111:05:101
240539920,1cyclictest0-21swapper/110:55:141
240539920,1cyclictest0-21swapper/110:30:141
240539920,1cyclictest0-21swapper/108:40:011
240539920,1cyclictest0-21swapper/108:15:101
240539920,1cyclictest0-21swapper/107:55:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional