You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Sat Jul 27, 2024 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324322750,1sleep232429-21sshd21:43:192
153912610,1sleep10-21swapper/122:57:281
317432600,0sleep30-21swapper/300:27:173
94702550,0sleep10-21swapper/100:07:301
179662550,0sleep00-21swapper/021:44:540
242962540,1sleep31643099cyclictest22:52:383
216472540,0sleep3401ktimersoftd/321:20:063
192012530,1sleep20-21swapper/221:36:352
151812530,0sleep00-21swapper/022:57:270
295372510,0sleep30-21swapper/322:19:263
6022500,0sleep00-21swapper/000:40:010
307792500,0sleep10-21swapper/123:49:271
290392500,0sleep30-21swapper/322:39:003
250822500,1sleep2311rcuc/221:28:462
204042500,0sleep30-21swapper/321:39:323
165502500,0sleep10-21swapper/100:28:561
151342500,0sleep2311rcuc/223:34:022
32942490,0sleep20-21swapper/223:24:372
212642490,0sleep20-21swapper/223:48:362
39642480,0sleep20-21swapper/200:33:502
290552480,0sleep30-21swapper/321:56:593
280942480,0sleep20-21swapper/221:56:532
146362480,0sleep20-21swapper/222:32:062
63822470,0sleep10-21swapper/122:22:591
250332470,0sleep10-21swapper/123:43:181
205212450,0sleep30-21swapper/300:38:483
117992450,1sleep0646-21dbus-daemon22:51:310
205982440,1sleep125-21ksoftirqd/121:25:331
145872410,2sleep31643099cyclictest21:19:293
267962390,0sleep30-21swapper/321:28:553
67522380,0sleep30-21swapper/321:13:133
161742287,7sleep30-21swapper/319:08:253
1621822210,7sleep00-21swapper/019:08:590
159582224,6sleep20-21swapper/219:05:402
159872209,7sleep10-21swapper/119:06:031
196462180,0sleep00-21swapper/022:01:440
176762180,1sleep317668-21sshd23:28:393
98112170,10sleep375550irq/24-eno1-rx-22:48:323
267342170,0sleep30-21swapper/300:23:543
193872170,0sleep30-21swapper/321:33:523
65672160,0sleep00-21swapper/000:19:050
63962160,0sleep36399-21bash21:49:303
325082160,0sleep00-21swapper/022:05:370
236112160,2sleep11641699cyclictest21:36:581
231412160,1sleep223128-21sshd22:13:162
146212160,0sleep30-21swapper/323:03:033
101822160,0sleep00-21swapper/000:34:280
1642199150,14cyclictest649-21avahi-daemon00:18:142
1641099150,1cyclictest19804-21bash23:31:350
164062150,1sleep0648-21systemd-logind21:30:430
146092150,0sleep314575-21sshd23:33:593
36662140,0sleep30-21swapper/323:07:443
292042140,0sleep20-21swapper/223:38:022
285282140,0sleep30-21swapper/322:30:263
133162140,0sleep20-21swapper/223:17:002
264852130,0sleep00-21swapper/023:18:100
16410991311,1cyclictest0-21swapper/021:39:450
177222120,0sleep10-21swapper/121:14:111
16430991210,1cyclictest0-21swapper/323:48:333
1643099120,11cyclictest4429-21cp23:58:233
1643099120,11cyclictest0-21swapper/300:03:323
1643099120,0cyclictest0-21swapper/322:25:023
16421991210,1cyclictest0-21swapper/222:54:232
1642199120,1cyclictest1884-21lspci22:45:022
1642199120,11cyclictest9793-21systemd-cgroups00:37:442
1641699120,11cyclictest646-21dbus-daemon22:47:301
1641699120,11cyclictest22824-21lspci21:53:411
16410991210,1cyclictest646-21dbus-daemon22:21:050
16410991210,1cyclictest21189-21sshd23:00:440
1641099120,1cyclictest1371-21grepconf.sh21:12:450
1641099120,11cyclictest18952-21sshd00:26:050
1643099110,10cyclictest0-21swapper/320:55:123
1642199119,1cyclictest30946-21lspci23:52:132
16421991110,0cyclictest0-21swapper/223:08:532
1641699110,1cyclictest0-21swapper/121:45:311
1641699110,10cyclictest0-21swapper/123:19:011
1641699110,10cyclictest0-21swapper/123:02:501
1641699110,10cyclictest0-21swapper/121:59:301
1641699110,10cyclictest0-21swapper/121:34:101
1641699110,10cyclictest0-21swapper/100:36:421
1641699110,10cyclictest0-21swapper/100:17:111
1641699110,0cyclictest0-21swapper/123:34:111
16410991110,0cyclictest3580-21sshd21:49:140
16410991110,0cyclictest0-21swapper/023:44:250
16410991110,0cyclictest0-21swapper/022:48:250
1641099110,10cyclictest0-21swapper/023:49:050
145082110,1sleep1700-21gdbus00:34:571
1643099109,0cyclictest0-21swapper/323:15:233
1643099109,0cyclictest0-21swapper/322:23:323
1643099109,0cyclictest0-21swapper/320:50:113
1643099109,0cyclictest0-21swapper/300:19:133
1643099109,0cyclictest0-21swapper/300:12:533
1643099109,0cyclictest0-21swapper/300:09:133
1643099100,0cyclictest0-21swapper/323:14:523
1643099100,0cyclictest0-21swapper/319:45:123
1642199109,0cyclictest0-21swapper/223:42:232
1642199109,0cyclictest0-21swapper/222:44:332
1642199109,0cyclictest0-21swapper/221:52:132
1642199109,0cyclictest0-21swapper/221:33:432
1642199109,0cyclictest0-21swapper/219:30:232
1642199109,0cyclictest0-21swapper/200:28:132
1642199108,1cyclictest8539-21lspci23:25:032
1642199100,0cyclictest0-21swapper/222:04:532
1642199100,0cyclictest0-21swapper/200:11:542
1641699109,0cyclictest0-21swapper/122:18:111
1641699108,1cyclictest4932-21lspci22:00:261
1641699108,1cyclictest0-21swapper/100:00:321
1641699100,0cyclictest0-21swapper/122:06:511
1641699100,0cyclictest0-21swapper/120:40:001
1641699100,0cyclictest0-21swapper/100:20:221
1641699100,0cyclictest0-21swapper/100:14:021
1641099109,0cyclictest0-21swapper/023:59:250
1641099109,0cyclictest0-21swapper/019:45:240
6503290,1sleep26505-21sshd22:20:122
19394290,0sleep00-21swapper/022:40:530
164309998,0cyclictest0-21swapper/320:16:323
164309997,1cyclictest31425-21sshd23:43:533
164309997,1cyclictest0-21swapper/300:32:233
164309995,3cyclictest649-21avahi-daemon23:50:583
164169998,0cyclictest0-21swapper/119:32:211
164169997,1cyclictest646-21dbus-daemon23:53:451
164169997,1cyclictest19466-21sshd21:42:111
164109998,0cyclictest0-21swapper/023:54:140
164109998,0cyclictest0-21swapper/020:15:140
164109997,2cyclictest19444-21kworker/0:023:08:180
164109997,1cyclictest15461-21lspci21:19:350
164109996,2cyclictest29566-21sshd00:12:120
164109996,2cyclictest17544-21kworker/0:122:38:190
164309987,0cyclictest0-21swapper/321:43:013
164309986,1cyclictest23673-21lspci22:44:083
164309986,1cyclictest17299-21snmpd19:25:563
164309986,1cyclictest14346-21lspci22:12:293
164309986,1cyclictest10049-21lspci22:00:543
164309985,2cyclictest700-21gdbus22:05:433
164219986,1cyclictest998-21sshd23:04:442
164219986,1cyclictest6670-21lspci22:59:352
164219986,1cyclictest30298-21lspci00:21:122
164219986,1cyclictest20463-21sshd21:47:532
164219986,1cyclictest19690-21lspci23:56:522
164219985,2cyclictest649-21avahi-daemon22:38:242
164219985,2cyclictest12706-21sshd23:14:092
164219985,1cyclictest19304-21sshd00:02:312
164219984,3cyclictest646-21dbus-daemon22:06:322
164219984,2cyclictest3661-21sshd00:09:562
164219984,2cyclictest25704-21sshd22:19:052
164169987,0cyclictest0-21swapper/123:55:221
164169987,0cyclictest0-21swapper/123:35:111
164169987,0cyclictest0-21swapper/120:31:211
164169986,1cyclictest7838-21kworker/1:122:25:181
164169986,1cyclictest6457-21sshd22:11:471
164169986,1cyclictest26381-21lspci22:41:311
164169986,1cyclictest19526-21kworker/1:223:29:591
164169986,1cyclictest15458-21lspci21:19:351
164169986,1cyclictest13642-21lspci23:08:371
164169986,1cyclictest0-21swapper/123:20:011
164169985,2cyclictest700-21gdbus22:52:091
164169985,2cyclictest649-21avahi-daemon22:35:311
164109987,0cyclictest0-21swapper/023:39:450
164109986,2cyclictest24277-21kworker/0:322:14:370
164109986,2cyclictest15480-21kworker/0:422:25:500
164109986,2cyclictest15480-21kworker/0:422:19:220
164109985,2cyclictest0-21swapper/021:51:520
164109985,1cyclictest649-21avahi-daemon23:10:410
164309976,0cyclictest0-21swapper/320:48:323
164309975,1cyclictest41-21ksoftirqd/323:37:373
164309975,1cyclictest41-21ksoftirqd/322:55:513
164309975,1cyclictest14875-21sshd21:50:123
164309974,2cyclictest648-21systemd-logind23:20:083
164219974,1cyclictest646-21dbus-daemon21:10:532
164219974,1cyclictest29591-21sshd22:25:022
164219973,2cyclictest24331-21sshd21:20:162
164219973,1cyclictest28482-21sshd21:15:062
164169975,1cyclictest646-21dbus-daemon22:31:151
164169975,1cyclictest4257-21lspci23:10:301
164169975,1cyclictest31105-21kworker/1:221:05:211
164169975,1cyclictest29019-21kworker/1:021:00:221
164109975,1cyclictest9-21ksoftirqd/022:31:320
164109975,1cyclictest684-21polkitd23:26:520
164109975,1cyclictest649-21avahi-daemon21:25:030
164109975,1cyclictest649-21avahi-daemon21:21:300
164109975,1cyclictest30966-21sshd23:21:200
164109974,2cyclictest649-21avahi-daemon21:55:130
164109974,2cyclictest649-21avahi-daemon00:03:070
164109974,2cyclictest646-21dbus-daemon00:05:320
164109974,2cyclictest13408-21sshd00:22:380
164309965,0cyclictest0-21swapper/320:05:123
164309964,1cyclictest646-21dbus-daemon21:09:223
164309963,2cyclictest17299-21snmpd20:24:523
164309963,2cyclictest17299-21snmpd19:54:033
164309960,5cyclictest0-21swapper/319:43:223
164219964,1cyclictest7777-21missed_timers20:05:162
164219963,2cyclictest17299-21snmpd19:18:042
164169965,1cyclictest24891-21kworker/1:120:55:241
164169965,1cyclictest15824-21kworker/1:219:10:371
164169965,0cyclictest0-21swapper/120:23:211
164169964,1cyclictest684-21polkitd21:20:041
164169964,1cyclictest6582-21kworker/1:320:05:241
164169964,1cyclictest649-21avahi-daemon20:50:001
164169963,2cyclictest17299-21snmpd19:35:231
164169960,5cyclictest0-21swapper/119:57:411
164169960,0cyclictest0-21swapper/119:50:501
164109963,2cyclictest700-21gdbus21:09:380
164109961,2cyclictest0-21swapper/020:53:480
164109960,5cyclictest0-21swapper/019:43:340
164309954,0cyclictest0-21swapper/319:23:223
164309953,1cyclictest29974-21cat21:00:153
164309953,1cyclictest19781-21cat20:35:123
164309953,1cyclictest17899-21grep19:10:203
164309953,1cyclictest17299-21snmpd20:41:013
164309953,1cyclictest17299-21snmpd20:32:253
164309953,1cyclictest17299-21snmpd20:26:153
164309953,1cyclictest17299-21snmpd20:01:023
164309953,1cyclictest17299-21snmpd19:55:063
164309953,1cyclictest17299-21snmpd19:38:073
164309953,1cyclictest10384-21timerwakeupswit20:10:213
164309950,1cyclictest18900-21sensors19:15:013
164219953,1cyclictest5595-21cat20:00:132
164219953,1cyclictest3528-21cat19:55:152
164219953,1cyclictest27751-21cat19:35:132
164219953,1cyclictest17299-21snmpd21:05:292
164219953,1cyclictest17299-21snmpd20:50:462
164219953,1cyclictest17299-21snmpd20:40:042
164219953,1cyclictest17299-21snmpd20:32:222
164219953,1cyclictest17299-21snmpd20:11:542
164219953,1cyclictest17299-21snmpd19:45:082
164219953,1cyclictest17299-21snmpd19:40:112
164219953,1cyclictest17299-21snmpd19:25:472
164219953,1cyclictest17299-21snmpd19:20:072
164219953,1cyclictest1420-21gltestperf19:50:122
164219953,1cyclictest1058-21sendmail21:01:452
164219953,1cyclictest1053-21lldpd20:25:122
164219950,4cyclictest19326-21/usr/sbin/munin20:35:232
164219950,4cyclictest0-21swapper/220:56:532
164219950,0cyclictest0-21swapper/220:46:232
164219950,0cyclictest0-21swapper/220:20:532
164169955,0cyclictest28717-21kworker/1:119:40:141
164169954,1cyclictest30791-21kworker/1:219:45:201
164169954,1cyclictest15824-21kworker/1:219:25:211
164169954,0cyclictest0-21swapper/119:21:311
164169953,1cyclictest17299-21snmpd20:50:281
164169953,1cyclictest17299-21snmpd20:10:211
164169953,1cyclictest17299-21snmpd20:00:241
164169953,1cyclictest15261-21/usr/sbin/munin20:25:121
164169953,1cyclictest11657-21cat20:15:141
164169952,2cyclictest19324-21taskset20:35:081
164169952,2cyclictest17299-21snmpd19:15:251
164109955,0cyclictest31110-21kworker/0:320:21:120
164109953,1cyclictest7633-21cat20:05:150
164109953,1cyclictest646-21dbus-daemon19:34:550
164109953,1cyclictest646-21dbus-daemon19:15:010
164109953,1cyclictest5557-21cat20:00:130
164109953,1cyclictest23910-21irqstats20:45:140
164109953,1cyclictest21562-21grep19:20:130
164109953,1cyclictest1914-21ntpq19:50:170
164109953,1cyclictest17793-21cat20:30:150
164109953,1cyclictest17299-21snmpd21:03:020
164109953,1cyclictest17299-21snmpd20:57:050
164109953,1cyclictest17299-21snmpd20:10:450
164109953,1cyclictest17299-21snmpd19:55:180
164109953,1cyclictest17299-21snmpd19:10:070
164109953,1cyclictest15752-21cat20:25:130
164109953,1cyclictest101ktimersoftd/019:25:170
164109952,2cyclictest646-21dbus-daemon20:35:000
164109952,2cyclictest21117-21crond20:40:000
164309942,1cyclictest25971-21needreboot19:30:153
164219942,1cyclictest11207-21cpu20:15:122
164219942,1cyclictest0-21swapper/219:10:112
164109942,1cyclictest27457-21cat19:35:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional