You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 00:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Fri Apr 26, 2024 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135142206191,11sleep10-21swapper/107:10:001
131722203187,11sleep00-21swapper/007:05:370
112842186171,11sleep30-21swapper/307:05:053
112882182164,13sleep20-21swapper/207:05:082
8582450,0sleep20-21swapper/210:41:212
76662430,0sleep20-21swapper/212:03:212
26267290,0sleep20-21swapper/210:18:282
24169290,0sleep00-21swapper/012:32:340
137019983,4cyclictest24249-21munin-run07:30:010
137069970,6cyclictest0-21swapper/212:35:102
28067250,1sleep328087-21ssh10:57:533
137119955,0cyclictest0-21swapper/311:54:523
137119950,5cyclictest0-21swapper/312:31:403
137119950,5cyclictest0-21swapper/312:12:013
137119950,5cyclictest0-21swapper/311:37:503
137119950,5cyclictest0-21swapper/310:40:393
137119950,5cyclictest0-21swapper/310:26:413
137119950,5cyclictest0-21swapper/310:05:083
137119950,4cyclictest24989-21df07:30:123
137119950,4cyclictest1031-21apt-get09:25:143
137119950,4cyclictest0-21swapper/309:30:133
137119950,4cyclictest0-21swapper/309:20:123
137119950,4cyclictest0-21swapper/308:10:083
137069954,1cyclictest0-21swapper/209:46:092
137069950,5cyclictest0-21swapper/212:19:472
137069950,5cyclictest0-21swapper/210:00:432
137069950,4cyclictest0-21swapper/209:23:532
137029952,2cyclictest0-21swapper/111:45:101
137029951,2cyclictest0-21swapper/112:35:101
137029951,2cyclictest0-21swapper/112:00:121
137029951,2cyclictest0-21swapper/110:40:101
137029951,2cyclictest0-21swapper/110:05:131
137029951,2cyclictest0-21swapper/108:40:121
137029951,2cyclictest0-21swapper/107:35:111
137029950,5cyclictest0-21swapper/112:32:201
137029950,5cyclictest0-21swapper/112:10:581
137029950,5cyclictest0-21swapper/111:36:381
137019950,5cyclictest0-21swapper/012:28:260
137019950,4cyclictest0-21swapper/012:00:110
137019950,4cyclictest0-21swapper/011:20:080
137019950,4cyclictest0-21swapper/011:05:110
12201250,1sleep00-21swapper/010:29:300
4673240,0sleep20-21swapper/209:26:412
137119944,0cyclictest15002-21kworker/3:208:49:083
137119944,0cyclictest0-21swapper/311:01:543
137119944,0cyclictest0-21swapper/308:05:233
137119942,1cyclictest8319-21ssh12:03:523
137119941,3cyclictest3602-21snmpd10:00:473
137119941,3cyclictest0-21swapper/308:30:083
137119941,2cyclictest0-21swapper/312:05:083
137119941,2cyclictest0-21swapper/309:50:123
137119941,2cyclictest0-21swapper/308:55:123
137119941,2cyclictest0-21swapper/308:50:093
137119941,2cyclictest0-21swapper/307:35:123
137119941,2cyclictest0-21swapper/307:10:123
137119940,4cyclictest7659-21diskmemload11:25:103
137119940,4cyclictest0-21swapper/312:35:093
137119940,4cyclictest0-21swapper/312:25:103
137119940,4cyclictest0-21swapper/312:20:123
137119940,4cyclictest0-21swapper/312:16:343
137119940,4cyclictest0-21swapper/311:55:103
137119940,4cyclictest0-21swapper/311:45:223
137119940,4cyclictest0-21swapper/311:31:593
137119940,4cyclictest0-21swapper/311:31:593
137119940,4cyclictest0-21swapper/311:21:413
137119940,4cyclictest0-21swapper/311:07:483
137119940,4cyclictest0-21swapper/310:35:113
137119940,4cyclictest0-21swapper/310:15:593
137119940,4cyclictest0-21swapper/310:10:093
137119940,4cyclictest0-21swapper/309:55:093
137119940,4cyclictest0-21swapper/309:42:573
137119940,4cyclictest0-21swapper/309:15:483
137119940,4cyclictest0-21swapper/309:10:093
137119940,4cyclictest0-21swapper/308:15:093
137119940,3cyclictest23415-21ssh09:38:103
137119940,3cyclictest21384-21users07:20:243
137119940,3cyclictest19511-21cat07:20:003
137119940,3cyclictest18392-21ssh10:51:513
137119940,3cyclictest16922-21ssh11:10:213
137119940,3cyclictest0-21swapper/308:20:113
137119940,3cyclictest0-21swapper/307:25:113
137119940,1cyclictest14001-21tune2fs10:30:143
137069944,0cyclictest0-21swapper/211:41:242
137069944,0cyclictest0-21swapper/211:37:192
137069944,0cyclictest0-21swapper/211:25:062
137069944,0cyclictest0-21swapper/209:00:102
137069944,0cyclictest0-21swapper/208:57:072
137069944,0cyclictest0-21swapper/207:30:492
137069943,1cyclictest5248-21cpuspeed_turbos10:25:122
137069943,1cyclictest2868-21/usr/sbin/munin12:20:152
137069943,1cyclictest24856-21sed10:55:222
137069943,1cyclictest14321-21/usr/sbin/munin08:15:122
137069941,3cyclictest3602-21snmpd12:14:512
137069940,4cyclictest14102-21perf08:15:012
137069940,4cyclictest0-21swapper/212:27:272
137069940,4cyclictest0-21swapper/212:09:292
137069940,4cyclictest0-21swapper/211:55:102
137069940,4cyclictest0-21swapper/211:33:152
137069940,4cyclictest0-21swapper/211:33:142
137069940,4cyclictest0-21swapper/211:10:132
137069940,4cyclictest0-21swapper/210:52:012
137069940,4cyclictest0-21swapper/210:35:242
137069940,4cyclictest0-21swapper/210:20:102
137069940,4cyclictest0-21swapper/210:05:132
137069940,4cyclictest0-21swapper/209:40:112
137069940,4cyclictest0-21swapper/209:35:142
137069940,3cyclictest7735-21hddtemp_smartct08:00:132
137069940,3cyclictest30210-21head07:40:142
137069940,3cyclictest25200-21cut08:40:012
137069940,3cyclictest23332-21ssh09:57:062
137069940,3cyclictest20244-21dpkg08:30:012
137069940,3cyclictest16270-21munin-node07:15:012
137069940,3cyclictest13151-21memory10:10:162
137069940,3cyclictest12445-21sh09:50:242
137069940,3cyclictest0-21swapper/212:30:012
137069940,2cyclictest17326-21ssh09:35:002
137069940,1cyclictest9375-21/usr/sbin/munin11:45:182
137069940,1cyclictest30409-21/usr/sbin/munin08:50:172
137069940,1cyclictest14355-21irqstats10:30:172
137029944,0cyclictest0-21swapper/110:04:231
137029944,0cyclictest0-21swapper/109:50:321
137029941,2cyclictest0-21swapper/111:55:091
137029941,2cyclictest0-21swapper/111:25:111
137029941,2cyclictest0-21swapper/111:15:101
137029941,2cyclictest0-21swapper/110:30:111
137029941,2cyclictest0-21swapper/109:20:121
137029941,2cyclictest0-21swapper/109:05:121
137029941,2cyclictest0-21swapper/109:00:081
137029941,2cyclictest0-21swapper/108:10:101
137029941,2cyclictest0-21swapper/107:55:121
137029941,2cyclictest0-21swapper/107:30:101
137029941,2cyclictest0-21swapper/107:15:121
137029940,4cyclictest0-21swapper/112:18:231
137029940,4cyclictest0-21swapper/109:39:041
137029940,4cyclictest0-21swapper/109:29:001
137029940,2cyclictest0-21swapper/112:05:091
137029940,2cyclictest0-21swapper/111:40:151
137029940,1cyclictest0-21swapper/109:10:101
137029940,0cyclictest0-21swapper/111:08:331
137019944,0cyclictest0-21swapper/011:31:590
137019944,0cyclictest0-21swapper/011:31:590
137019944,0cyclictest0-21swapper/010:31:000
137019944,0cyclictest0-21swapper/010:02:290
137019944,0cyclictest0-21swapper/008:05:210
137019941,3cyclictest24637-21rm09:58:060
137019940,4cyclictest30095-21ssh11:57:000
137019940,4cyclictest0-21swapper/012:15:090
137019940,4cyclictest0-21swapper/011:50:420
137019940,4cyclictest0-21swapper/011:40:130
137019940,4cyclictest0-21swapper/011:28:290
137019940,4cyclictest0-21swapper/010:15:330
137019940,4cyclictest0-21swapper/010:05:130
137019940,4cyclictest0-21swapper/009:50:120
137019940,4cyclictest0-21swapper/009:45:120
137019940,4cyclictest0-21swapper/009:35:130
137019940,4cyclictest0-21swapper/009:34:080
137019940,4cyclictest0-21swapper/009:25:140
137019940,3cyclictest7659-21diskmemload10:40:050
137019940,3cyclictest4183-21latency_hist07:55:010
137019940,3cyclictest32651-21latency_hist08:55:000
137019940,3cyclictest29434-21df_inode10:20:130
137019940,3cyclictest26145-21ssh09:40:080
137019940,3cyclictest26016-21perl08:40:160
137019940,3cyclictest25483-21ntp_states11:15:200
137019940,3cyclictest23607-21ssh10:35:280
137019940,3cyclictest21587-21/usr/sbin/munin08:30:170
137019940,3cyclictest20036-21cut10:15:010
137019940,3cyclictest18762-21seq12:10:120
137019940,3cyclictest17341-21df08:20:140
137019940,3cyclictest1702-21ssh11:01:010
137019940,3cyclictest16533-21ssh09:15:110
137019940,3cyclictest14135-21ssh11:47:290
137019940,3cyclictest10008-21apt-config12:04:590
137019940,3cyclictest0-21swapper/011:10:130
137019940,3cyclictest0-21swapper/009:20:120
137019940,3cyclictest0-21swapper/009:10:090
137019940,3cyclictest0-21swapper/009:05:110
137019940,3cyclictest0-21swapper/007:45:110
137119932,1cyclictest29203-21tr10:20:123
137119932,1cyclictest25273-21apt08:40:113
137119932,1cyclictest220-21systemd-journal10:45:013
137119930,3cyclictest7659-21diskmemload09:45:093
137119930,3cyclictest23871-21memory08:35:153
137119930,3cyclictest0-21swapper/311:40:133
137119930,3cyclictest0-21swapper/311:15:023
137119930,3cyclictest0-21swapper/309:05:023
137119930,3cyclictest0-21swapper/309:00:093
137119930,3cyclictest0-21swapper/308:25:013
137119930,3cyclictest0-21swapper/308:00:093
137119930,3cyclictest0-21swapper/307:55:023
137119930,3cyclictest0-21swapper/307:50:113
137119930,3cyclictest0-21swapper/307:45:003
137119930,3cyclictest0-21swapper/307:40:103
137069931,2cyclictest57250irq/125-eth010:45:052
137069931,1cyclictest3602-21snmpd08:45:102
137069930,3cyclictest8619-21df09:10:122
137069930,3cyclictest4934-21df07:55:142
137069930,3cyclictest2474-21diskstats07:50:122
137069930,3cyclictest18585-21grep11:50:162
137069930,3cyclictest0-21swapper/211:20:092
137069930,3cyclictest0-21swapper/211:05:102
137069930,3cyclictest0-21swapper/209:15:122
137069930,3cyclictest0-21swapper/209:05:122
137069930,3cyclictest0-21swapper/208:40:122
137069930,3cyclictest0-21swapper/208:25:012
137069930,3cyclictest0-21swapper/208:20:062
137069930,3cyclictest0-21swapper/208:05:092
137069930,3cyclictest0-21swapper/207:35:122
137069930,3cyclictest0-21swapper/207:25:202
137069930,3cyclictest0-21swapper/207:20:012
137069930,3cyclictest0-21swapper/207:10:122
137069930,1cyclictest31899-21/usr/sbin/munin07:45:162
137069930,1cyclictest31232-21ssh11:00:092
137069930,0cyclictest0-21swapper/211:15:132
137029933,0cyclictest0-21swapper/110:50:121
137029933,0cyclictest0-21swapper/110:12:051
137029931,1cyclictest0-21swapper/111:35:011
137029931,1cyclictest0-21swapper/111:35:001
137029931,1cyclictest0-21swapper/111:20:091
137029931,1cyclictest0-21swapper/111:10:121
137029931,1cyclictest0-21swapper/110:45:111
137029931,1cyclictest0-21swapper/110:25:101
137029931,1cyclictest0-21swapper/110:20:011
137029931,1cyclictest0-21swapper/109:45:121
137029931,1cyclictest0-21swapper/109:40:111
137029931,1cyclictest0-21swapper/109:30:121
137029931,1cyclictest0-21swapper/108:25:021
137029931,1cyclictest0-21swapper/108:20:111
137029931,1cyclictest0-21swapper/108:05:081
137029931,1cyclictest0-21swapper/108:00:081
137029931,1cyclictest0-21swapper/107:50:111
137029931,1cyclictest0-21swapper/107:45:121
137029931,1cyclictest0-21swapper/107:40:091
137029931,1cyclictest0-21swapper/107:25:111
137029931,1cyclictest0-21swapper/107:20:091
137029931,1cyclictest0-21swapper/107:10:121
137029930,3cyclictest0-21swapper/108:38:141
137029930,3cyclictest0-21swapper/108:19:271
137029930,2cyclictest27730-21chrt08:45:031
137029930,2cyclictest25312-21chrt10:55:431
137029930,2cyclictest0-21swapper/111:00:111
137029930,2cyclictest0-21swapper/110:35:111
137029930,2cyclictest0-21swapper/109:15:131
137019933,0cyclictest0-21swapper/008:15:050
137019932,1cyclictest3602-21snmpd08:45:040
137019932,1cyclictest3602-21snmpd08:35:000
137019932,1cyclictest3602-21snmpd08:27:160
137019932,1cyclictest28175-21ssh12:35:110
137019930,3cyclictest5814-21apt-config10:45:010
137019930,3cyclictest3718-21expr12:20:170
137019930,3cyclictest0-21swapper/011:35:100
137019930,3cyclictest0-21swapper/010:55:010
137019930,3cyclictest0-21swapper/010:50:020
137019930,3cyclictest0-21swapper/009:00:090
137019930,3cyclictest0-21swapper/008:55:120
137019930,3cyclictest0-21swapper/008:10:080
137019930,3cyclictest0-21swapper/008:00:090
137019930,3cyclictest0-21swapper/007:55:120
137019930,3cyclictest0-21swapper/007:40:090
137019930,3cyclictest0-21swapper/007:35:120
137019930,3cyclictest0-21swapper/007:30:100
137019930,3cyclictest0-21swapper/007:20:090
137019930,3cyclictest0-21swapper/007:15:060
137019930,3cyclictest0-21swapper/007:10:110
137029921,1cyclictest0-21swapper/108:55:111
137029920,1cyclictest17705-21chrt11:50:071
137029920,1cyclictest0-21swapper/112:25:091
137029920,1cyclictest0-21swapper/112:20:231
137029920,1cyclictest0-21swapper/110:15:111
137029920,1cyclictest0-21swapper/109:55:081
137029920,1cyclictest0-21swapper/108:50:011
137029920,1cyclictest0-21swapper/108:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional