You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-10 - 21:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Thu Oct 10, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40412810,0sleep10-21swapper/107:35:001
59492770,1sleep15945-21sshd09:19:511
45032610,0sleep10-21swapper/109:50:031
60452550,1sleep36034-21lspci10:06:473
21012540,2sleep1241ktimersoftd/111:26:031
317742530,1sleep031768-21sshd12:16:490
70802510,0sleep10-21swapper/109:26:361
63462510,2sleep32568499cyclictest11:46:373
63462510,2sleep32568499cyclictest11:46:363
44922510,0sleep30-21swapper/310:46:243
221292510,0sleep20-21swapper/211:08:512
166072510,0sleep00-21swapper/012:21:350
129192510,1sleep212921-21bash11:50:202
321152490,1sleep032111-21lspci09:49:350
307982490,0sleep00-21swapper/011:55:110
132312490,0sleep20-21swapper/210:17:122
169282480,0sleep10-21swapper/110:34:181
84482460,0sleep20-21swapper/210:00:372
84482460,0sleep20-21swapper/210:00:372
103792460,0sleep00-21swapper/010:57:230
173682450,2sleep32568499cyclictest10:20:493
111202390,1sleep211119-21bash12:14:552
305452370,0sleep10-21swapper/110:22:111
209152350,0sleep30-21swapper/310:27:463
255252309,7sleep10-21swapper/107:09:261
255072308,7sleep30-21swapper/307:09:123
252992309,7sleep20-21swapper/207:06:352
254232297,7sleep00-21swapper/007:08:090
20022290,13sleep375550irq/24-eno1-rx-11:19:413
226572260,2sleep32568499cyclictest10:41:213
220852240,2sleep22568399cyclictest09:28:132
168332190,0sleep30-21swapper/310:54:413
75092180,1sleep3391rcuc/309:30:153
258002180,1sleep025788-21sshd12:34:520
2568299187,3cyclictest25-21ksoftirqd/109:24:471
25683991716,0cyclictest12616-21lspci09:30:432
2568299175,3cyclictest25-21ksoftirqd/110:37:301
25682991713,1cyclictest25-21ksoftirqd/111:41:301
14722170,0sleep00-21swapper/012:04:480
70352160,1sleep07032-21lspci09:43:450
2568299166,1cyclictest25-21ksoftirqd/110:15:131
25682991616,0cyclictest523-40kipmi007:44:381
174912160,0sleep30-21swapper/310:17:413
113432160,0sleep011240-21sshd11:00:470
81872150,1sleep28185-21bash09:43:512
4692150,1sleep0111rcuc/011:39:250
25683991514,0cyclictest18423-21lspci10:30:382
2568299157,1cyclictest25-21ksoftirqd/110:05:001
2568299157,1cyclictest25-21ksoftirqd/110:05:001
2568299155,2cyclictest25-21ksoftirqd/109:12:351
2568299155,1cyclictest25-21ksoftirqd/111:00:301
25682991515,0cyclictest8068-21kworker/1:107:48:391
2568299150,0cyclictest0-21swapper/110:46:511
242082150,0sleep3401ktimersoftd/312:28:263
194692150,0sleep10-21swapper/112:12:381
157802150,0sleep00-21swapper/012:12:170
92562140,0sleep10-21swapper/111:14:061
31492140,0sleep03123-21sshd09:53:180
25683991413,0cyclictest6498-21lspci12:32:572
25683991413,0cyclictest31029-21lspci10:25:232
25683991413,0cyclictest28216-21lspci09:56:012
2568299145,3cyclictest25-21ksoftirqd/112:22:021
2568299145,1cyclictest25-21ksoftirqd/111:54:511
2568299145,1cyclictest25-21ksoftirqd/109:58:021
2568299143,3cyclictest684-21polkitd10:59:191
2568299143,3cyclictest25-21ksoftirqd/112:38:431
2568299143,3cyclictest25-21ksoftirqd/111:17:421
2568299143,2cyclictest25-21ksoftirqd/109:47:121
2568299143,1cyclictest25-21ksoftirqd/112:15:211
2568299142,3cyclictest21847-21sshd10:27:521
25682991414,0cyclictest28440-21kworker/1:208:46:011
25682991414,0cyclictest20291-21kworker/1:008:18:181
124462140,0sleep10-21swapper/109:34:051
277942130,0sleep30-21swapper/309:49:093
25683991310,2cyclictest2265-21sshd11:03:082
2568299135,1cyclictest25-21ksoftirqd/111:20:321
2568299134,2cyclictest25-21ksoftirqd/112:07:281
2568299134,2cyclictest25-21ksoftirqd/112:02:461
2568299134,1cyclictest25-21ksoftirqd/112:27:471
2568299133,2cyclictest25-21ksoftirqd/112:31:521
2568299133,1cyclictest25-21ksoftirqd/110:50:051
2568299132,3cyclictest25-21ksoftirqd/109:44:471
2568299132,1cyclictest25-21ksoftirqd/110:05:341
25682991313,0cyclictest8068-21kworker/1:108:02:311
25682991313,0cyclictest30236-21kworker/1:207:38:361
25682991313,0cyclictest24363-21kworker/1:108:25:231
25682991313,0cyclictest23220-21kworker/1:007:10:421
25682991313,0cyclictest20291-21kworker/1:008:21:251
207352130,0sleep20-21swapper/211:34:512
191882130,0sleep20-21swapper/212:15:392
183152130,0sleep20-21swapper/212:37:102
183062130,0sleep20-21swapper/212:27:532
157072130,0sleep00-21swapper/011:24:150
25684991210,1cyclictest0-21swapper/311:56:213
2568499120,1cyclictest28115-21sshd10:59:123
2568499120,11cyclictest28451-21lspci11:02:313
2568499120,11cyclictest0-21swapper/312:17:523
2568499120,11cyclictest0-21swapper/309:25:513
25683991211,0cyclictest3435-21lspci11:42:592
25683991210,1cyclictest700-21gdbus10:24:582
2568299125,1cyclictest25-21ksoftirqd/111:55:181
2568299123,3cyclictest25-21ksoftirqd/111:46:151
2568299123,3cyclictest25-21ksoftirqd/111:46:141
2568299123,2cyclictest684-21polkitd11:36:011
2568299122,1cyclictest25-21ksoftirqd/111:06:331
2568299122,1cyclictest25-21ksoftirqd/110:41:061
2568299121,3cyclictest25-21ksoftirqd/109:38:041
2568299121,2cyclictest11622-21ps11:30:231
25682991212,0cyclictest8068-21kworker/1:107:55:351
25682991212,0cyclictest8068-21kworker/1:107:54:021
25682991212,0cyclictest30236-21kworker/1:207:26:181
25682991212,0cyclictest27645-21kworker/1:107:19:011
25682991212,0cyclictest2192-21kworker/1:008:58:001
25682991212,0cyclictest16220-21kworker/1:308:05:491
25682991211,0cyclictest2192-21kworker/1:009:08:231
25682991210,1cyclictest25-21ksoftirqd/110:11:391
25681991210,1cyclictest24917-21lspci11:09:060
2568199120,11cyclictest18959-21lspci12:27:570
2568199120,11cyclictest0-21swapper/011:29:460
226532120,0sleep20-21swapper/212:22:082
2568499119,1cyclictest16443-21sshd09:51:113
25684991110,0cyclictest0-21swapper/309:39:313
2568499110,10cyclictest0-21swapper/312:32:323
2568499110,10cyclictest0-21swapper/312:22:213
2568499110,10cyclictest0-21swapper/312:13:213
2568499110,0cyclictest0-21swapper/312:04:513
2568399119,1cyclictest33-21ksoftirqd/211:46:062
2568399119,1cyclictest33-21ksoftirqd/211:46:052
2568399114,1cyclictest33-21ksoftirqd/212:00:572
2568399113,2cyclictest33-21ksoftirqd/209:14:242
2568399112,1cyclictest33-21ksoftirqd/210:56:412
2568399111,1cyclictest33-21ksoftirqd/211:27:122
25683991110,0cyclictest9849-21lspci11:17:162
25683991110,0cyclictest20549-21lspci11:21:292
2568399110,10cyclictest0-21swapper/211:39:282
2568399110,10cyclictest0-21swapper/209:50:082
2568399110,0cyclictest4707-21bash10:13:082
2568399110,0cyclictest0-21swapper/209:48:292
25682991111,0cyclictest24363-21kworker/1:108:33:541
25682991111,0cyclictest2192-21kworker/1:009:01:271
25682991111,0cyclictest16220-21kworker/1:308:11:211
25681991110,0cyclictest0-21swapper/011:12:270
2568199110,10cyclictest0-21swapper/011:48:560
2568199110,10cyclictest0-21swapper/011:48:560
2568199110,10cyclictest0-21swapper/011:34:160
2568199110,10cyclictest0-21swapper/011:15:460
2568199110,0cyclictest0-21swapper/012:07:360
2568499109,0cyclictest0-21swapper/311:36:013
2568499109,0cyclictest0-21swapper/309:10:213
2568499108,1cyclictest30958-21sshd11:22:313
2568499100,0cyclictest0-21swapper/312:07:423
2568499100,0cyclictest0-21swapper/311:27:013
2568499100,0cyclictest0-21swapper/310:14:113
2568399109,0cyclictest0-21swapper/211:56:592
2568399109,0cyclictest0-21swapper/210:36:182
2568399103,1cyclictest684-21polkitd10:43:312
2568399102,2cyclictest33-21ksoftirqd/209:20:312
2568399102,1cyclictest33-21ksoftirqd/209:36:152
2568399101,2cyclictest131rcu_sched10:51:222
2568399101,1cyclictest33-21ksoftirqd/210:45:422
2568399100,2cyclictest376-21lspci10:06:142
2568399100,1cyclictest33-21ksoftirqd/211:12:572
2568399100,0cyclictest0-21swapper/212:05:302
25682991010,0cyclictest30236-21kworker/1:207:21:151
25682991010,0cyclictest28440-21kworker/1:208:42:241
2568199109,0cyclictest0-21swapper/010:31:370
2568199109,0cyclictest0-21swapper/010:02:170
2568199109,0cyclictest0-21swapper/010:02:160
2568199109,0cyclictest0-21swapper/009:21:070
2568199100,0cyclictest0-21swapper/010:38:260
157532100,0sleep30-21swapper/312:39:593
256849998,0cyclictest0-21swapper/308:15:213
256849998,0cyclictest0-21swapper/307:45:313
256849997,1cyclictest23732-21sshd09:18:213
256849997,1cyclictest19617-21sshd09:24:413
256849990,0cyclictest0-21swapper/308:28:323
256839992,1cyclictest131rcu_sched09:17:342
256819998,0cyclictest0-21swapper/010:41:160
256819998,0cyclictest0-21swapper/010:28:460
256819998,0cyclictest0-21swapper/009:57:460
256819997,1cyclictest9-21ksoftirqd/010:05:210
256819997,1cyclictest9-21ksoftirqd/009:35:140
256819997,1cyclictest6012-21lspci11:43:160
256819997,1cyclictest27869-21lspci09:11:570
256819996,1cyclictest9-21ksoftirqd/009:17:050
11612290,1sleep3391rcuc/311:33:563
256849987,0cyclictest0-21swapper/311:53:323
256849987,0cyclictest0-21swapper/310:31:413
256849987,0cyclictest0-21swapper/310:00:413
256849987,0cyclictest0-21swapper/310:00:413
256849986,1cyclictest41-21ksoftirqd/311:41:303
256849986,1cyclictest12422-21kworker/u8:109:44:593
256849986,1cyclictest11351-21lspci11:07:423
256849985,2cyclictest649-21avahi-daemon10:36:433
256839987,0cyclictest17299-21snmpd08:58:262
256839987,0cyclictest0-21swapper/208:01:592
256819986,2cyclictest885-21kworker/0:411:50:020
256819986,1cyclictest9-21ksoftirqd/012:35:010
256819986,1cyclictest5766-21lspci10:16:240
256819985,2cyclictest649-21avahi-daemon10:10:580
256819981,1cyclictest618-13audispd10:53:210
256819980,1cyclictest15130-21grep10:20:360
256819980,1cyclictest131rcu_sched10:46:580
256849976,0cyclictest0-21swapper/309:05:423
256849975,1cyclictest24421-21grep09:55:343
256849975,1cyclictest13536-21lspci11:11:173
256829977,0cyclictest28440-21kworker/1:208:35:271
256829977,0cyclictest2192-21kworker/1:008:52:371
256819975,1cyclictest9-21ksoftirqd/009:30:200
256819970,1cyclictest648-21systemd-logind09:25:260
256849964,1cyclictest657-21grep08:45:123
256849963,2cyclictest17299-21snmpd08:58:403
256849963,2cyclictest17299-21snmpd07:37:453
256849960,5cyclictest0-21swapper/308:42:323
256849960,5cyclictest0-21swapper/308:37:013
256849960,5cyclictest0-21swapper/308:21:413
256839963,2cyclictest17299-21snmpd08:52:012
256839963,2cyclictest17299-21snmpd08:12:272
256839963,2cyclictest17299-21snmpd07:57:112
256819965,0cyclictest0-21swapper/008:52:160
256819965,0cyclictest0-21swapper/008:06:270
256819965,0cyclictest0-21swapper/007:58:360
256819964,1cyclictest17299-21snmpd07:50:270
256819963,2cyclictest17299-21snmpd09:00:520
256819962,3cyclictest4036-21perf07:35:000
256819960,5cyclictest0-21swapper/008:28:260
256819960,5cyclictest0-21swapper/007:40:560
256849953,1cyclictest27129-21mii-tool08:30:133
256849953,1cyclictest19000-21cat08:10:143
256849953,1cyclictest17299-21snmpd08:50:323
256849953,1cyclictest17299-21snmpd08:00:033
256849953,1cyclictest17299-21snmpd07:56:533
256849953,1cyclictest17299-21snmpd07:42:053
256849953,1cyclictest17299-21snmpd07:31:013
256849953,1cyclictest17299-21snmpd07:13:563
256849953,1cyclictest16959-21cat08:05:133
256849953,1cyclictest10850-21cat07:50:133
256849952,2cyclictest29161-21cut07:15:143
256849952,2cyclictest17299-21snmpd07:25:043
256849950,2cyclictest6781-21df09:00:103
256839953,1cyclictest684-21polkitd07:45:002
256839953,1cyclictest33-21ksoftirqd/208:35:002
256839953,1cyclictest32759-21/usr/sbin/munin08:45:122
256839953,1cyclictest32013-21grep08:40:212
256839953,1cyclictest28437-21mii-tool07:15:002
256839953,1cyclictest17299-21snmpd09:01:342
256839953,1cyclictest17299-21snmpd08:21:272
256839953,1cyclictest17299-21snmpd08:16:552
256839953,1cyclictest17299-21snmpd07:50:332
256839953,1cyclictest17299-21snmpd07:40:442
256839953,1cyclictest17299-21snmpd07:25:402
256839953,1cyclictest17299-21snmpd07:21:162
256839953,1cyclictest17299-21snmpd07:11:592
256839952,2cyclictest17299-21snmpd09:07:572
256839950,1cyclictest24612-21/usr/sbin/munin08:25:182
256839950,1cyclictest16469-21/usr/sbin/munin08:05:202
256839950,0cyclictest0-21swapper/207:35:092
256819954,0cyclictest0-21swapper/008:40:360
256819954,0cyclictest0-21swapper/008:15:170
256819953,1cyclictest9055-21cat09:05:130
256819953,1cyclictest649-21avahi-daemon08:32:050
256819953,1cyclictest24402-21basename08:25:000
256819953,1cyclictest17299-21snmpd08:35:330
256819953,1cyclictest17299-21snmpd08:11:240
256819953,1cyclictest17299-21snmpd07:35:100
256819953,1cyclictest17299-21snmpd07:22:100
256819953,1cyclictest14916-21cat08:00:130
256819953,1cyclictest1109-21ntpd08:55:180
256819952,2cyclictest8961-21cat07:45:140
256819952,2cyclictest17299-21snmpd07:15:010
256819952,2cyclictest1640-21sshd07:25:580
256849940,1cyclictest30492-21sshd07:20:093
256839942,1cyclictest29245-21grep08:35:152
256839940,3cyclictest2366-21/usr/sbin/munin07:30:102
256819944,0cyclictest25570-21kworker/0:007:10:380
256819944,0cyclictest24362-21kworker/0:208:45:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional