You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-27 - 11:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Sep 27, 2023 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47372800,0sleep30-21swapper/300:30:263
81072530,0sleep20-21swapper/223:37:392
292112520,0sleep30-21swapper/321:42:213
121722510,0sleep30-21swapper/322:51:413
205132500,1sleep020516-21switchtime21:40:300
34392480,0sleep00-21swapper/020:00:190
297962480,0sleep30-21swapper/322:55:233
39252410,2sleep21453199cyclictest23:03:232
206302310,0sleep30-21swapper/300:06:553
1264322817,7sleep10-21swapper/119:05:161
1417122413,6sleep20-21swapper/219:06:492
1409922312,7sleep30-21swapper/319:05:583
135152219,7sleep00-21swapper/019:05:230
146642200,0sleep00-21swapper/023:59:070
15512180,0sleep20-21swapper/221:16:532
55042150,1sleep0111rcuc/023:30:240
106552150,0sleep20-21swapper/222:58:062
102512150,0sleep10-21swapper/122:58:011
79332140,1sleep3391rcuc/300:04:273
323422140,0sleep00-21swapper/023:22:350
1453799140,12cyclictest661-21dbus-daemon23:53:593
19722130,0sleep00-21swapper/023:43:050
14526991312,0cyclictest15812-21lspci21:13:181
14526991312,0cyclictest11388-21lspci00:11:411
44202120,0sleep10-21swapper/122:10:231
1453199120,11cyclictest7536-21sshd21:11:302
14526991211,0cyclictest33150irq/27-ahci[00023:15:011
14526991211,0cyclictest33150irq/27-ahci[00021:18:171
14526991210,1cyclictest20729-21gdbus21:31:581
1452699120,11cyclictest6694-21grepconf.sh22:24:081
1453799119,1cyclictest20288-21sshd21:27:203
1453799119,1cyclictest19953-21bash23:26:393
1453799119,1cyclictest14331-21bash23:45:303
1453799110,10cyclictest19387-21lspci22:33:203
1453799110,10cyclictest0-21swapper/322:45:243
1453799110,0cyclictest0-21swapper/323:40:303
1453799110,0cyclictest0-21swapper/322:15:343
14531991110,0cyclictest3602-21sshd22:30:102
14531991110,0cyclictest0-21swapper/223:05:502
14531991110,0cyclictest0-21swapper/200:23:502
1453199110,10cyclictest0-21swapper/223:57:502
1453199110,10cyclictest0-21swapper/222:49:202
1453199110,10cyclictest0-21swapper/222:26:192
1452699119,1cyclictest0-21swapper/123:31:181
14526991110,0cyclictest8390-21lspci23:57:451
14526991110,0cyclictest18749-21lspci23:39:591
14526991110,0cyclictest0-21swapper/100:18:281
1452699110,10cyclictest0-21swapper/123:06:181
1452699110,10cyclictest0-21swapper/122:17:371
1452699110,10cyclictest0-21swapper/122:09:581
1452099119,1cyclictest31010-21sshd22:02:340
1452099110,10cyclictest0-21swapper/023:16:040
1452099110,0cyclictest0-21swapper/022:49:140
1452099110,0cyclictest0-21swapper/022:15:330
1452099110,0cyclictest0-21swapper/000:29:240
1453799109,0cyclictest0-21swapper/323:55:103
1453799109,0cyclictest0-21swapper/322:41:003
1453799109,0cyclictest0-21swapper/322:37:103
1453799109,0cyclictest0-21swapper/322:20:203
1453799109,0cyclictest0-21swapper/322:06:103
1453799109,0cyclictest0-21swapper/321:10:303
1453799109,0cyclictest0-21swapper/300:10:413
1453799108,1cyclictest2888-21sshd21:17:103
1453799100,9cyclictest0-21swapper/323:16:403
1453799100,0cyclictest0-21swapper/322:12:403
1453199109,0cyclictest0-21swapper/223:20:502
1453199109,0cyclictest0-21swapper/223:15:492
1453199109,0cyclictest0-21swapper/222:37:502
1453199109,0cyclictest0-21swapper/221:43:102
1453199100,9cyclictest0-21swapper/222:19:502
1453199100,0cyclictest0-21swapper/221:45:302
1452699109,0cyclictest30680-21lspci00:29:201
1452699109,0cyclictest26838-21lspci00:21:391
1452699109,0cyclictest0-21swapper/123:02:281
1452699100,9cyclictest0-21swapper/119:24:581
1452699100,9cyclictest0-21swapper/119:24:581
1452699100,0cyclictest0-21swapper/121:20:381
1452699100,0cyclictest0-21swapper/100:35:081
1452099109,0cyclictest0-21swapper/023:39:540
1452099109,0cyclictest0-21swapper/022:09:030
1452099109,0cyclictest0-21swapper/000:30:340
1452099100,9cyclictest0-21swapper/019:35:030
1452099100,0cyclictest0-21swapper/023:51:040
1452099100,0cyclictest0-21swapper/023:29:540
145379998,0cyclictest0-21swapper/323:21:403
145379998,0cyclictest0-21swapper/323:00:103
145379997,1cyclictest656-21systemd-logind21:30:063
145379996,2cyclictest661-21dbus-daemon21:45:333
145319998,0cyclictest0-21swapper/223:48:102
145319998,0cyclictest0-21swapper/222:09:302
145319998,0cyclictest0-21swapper/222:01:502
145319998,0cyclictest0-21swapper/219:58:292
145269999,0cyclictest5932-21lspci23:43:561
145269998,0cyclictest25732-21sshd22:27:581
145269998,0cyclictest18639-21lspci23:46:251
145269998,0cyclictest0-21swapper/123:26:181
145269998,0cyclictest0-21swapper/123:21:181
145269998,0cyclictest0-21swapper/122:31:481
145269998,0cyclictest0-21swapper/121:59:381
145209998,0cyclictest0-21swapper/022:28:340
145209998,0cyclictest0-21swapper/022:22:040
145209998,0cyclictest0-21swapper/021:22:540
4511280,1sleep3401ktimersoftd/323:36:523
23077280,0sleep30-21swapper/300:27:383
145379987,0cyclictest0-21swapper/323:31:403
145379987,0cyclictest0-21swapper/323:07:503
145379985,2cyclictest1-21systemd21:39:253
145379984,3cyclictest686-21gdbus21:54:123
145319987,0cyclictest0-21swapper/222:41:402
145319987,0cyclictest0-21swapper/221:24:502
145319987,0cyclictest0-21swapper/200:26:102
145319986,1cyclictest656-21systemd-logind00:31:542
145319985,2cyclictest650-21avahi-daemon21:32:372
145319985,2cyclictest650-21avahi-daemon00:38:462
145319984,3cyclictest650-21avahi-daemon21:57:112
145269987,0cyclictest0-21swapper/122:50:581
145269987,0cyclictest0-21swapper/122:03:281
145269986,1cyclictest25451-21lspci21:41:331
145269986,1cyclictest14574-21lspci23:12:121
145269985,2cyclictest650-21avahi-daemon23:53:501
145269985,2cyclictest650-21avahi-daemon21:46:081
145269981,1cyclictest131rcu_sched22:46:101
145209987,0cyclictest0-21swapper/022:56:540
145209987,0cyclictest0-21swapper/000:16:140
145209987,0cyclictest0-21swapper/000:01:540
145209986,1cyclictest661-21dbus-daemon22:53:070
145209986,1cyclictest656-21systemd-logind22:14:160
145209985,2cyclictest650-21avahi-daemon21:57:230
145209980,7cyclictest21212-21sshd21:27:320
145209980,4cyclictest3327-21munin-run23:09:590
20810270,1sleep321026-21lspci00:20:263
16237270,0sleep20-21swapper/221:52:572
145379975,1cyclictest650-21avahi-daemon23:12:063
145379975,1cyclictest10885-21lspci21:58:303
145379974,2cyclictest661-21dbus-daemon21:04:593
145379974,2cyclictest650-21avahi-daemon22:00:263
145379974,2cyclictest650-21avahi-daemon21:22:263
145379973,3cyclictest686-21gdbus00:19:223
145379973,3cyclictest1013-21snmpd00:36:373
145319976,0cyclictest0-21swapper/220:52:302
145319976,0cyclictest0-21swapper/220:17:292
145319975,1cyclictest661-21dbus-daemon00:01:582
145319975,1cyclictest650-21avahi-daemon23:54:122
145319975,1cyclictest650-21avahi-daemon23:32:202
145319975,1cyclictest650-21avahi-daemon22:10:542
145319975,1cyclictest650-21avahi-daemon21:35:342
145319975,1cyclictest650-21avahi-daemon00:16:252
145319974,2cyclictest650-21avahi-daemon00:06:442
145319973,3cyclictest686-21gdbus00:11:432
145319973,1cyclictest0-21swapper/223:11:262
145319972,2cyclictest14829-21sshd22:52:152
145319972,1cyclictest0-21swapper/223:40:242
145269976,0cyclictest0-21swapper/121:50:171
145269976,0cyclictest0-21swapper/120:54:571
145269975,1cyclictest650-21avahi-daemon22:41:061
145269975,1cyclictest650-21avahi-daemon00:31:211
145269975,1cyclictest614-17auditd00:02:011
145269970,1cyclictest131rcu_sched21:27:191
145209976,0cyclictest16149-21kworker/0:321:35:410
145209976,0cyclictest0-21swapper/022:35:040
145209976,0cyclictest0-21swapper/021:12:440
145209975,1cyclictest650-21avahi-daemon21:53:420
145209975,1cyclictest25551-21kworker/0:323:02:470
145209975,1cyclictest16149-21kworker/0:321:32:510
145209974,2cyclictest661-21dbus-daemon23:45:230
145209974,2cyclictest661-21dbus-daemon22:33:520
145209974,2cyclictest650-21avahi-daemon22:41:250
145209974,2cyclictest650-21avahi-daemon21:17:080
145209974,2cyclictest650-21avahi-daemon00:35:230
145209974,2cyclictest650-21avahi-daemon00:10:390
145209974,2cyclictest650-21avahi-daemon00:05:180
145379965,0cyclictest0-21swapper/320:10:293
145379963,1cyclictest680-21polkitd22:25:093
145379960,5cyclictest0-21swapper/320:40:223
145379960,5cyclictest0-21swapper/319:29:303
145319965,0cyclictest0-21swapper/219:21:292
145319965,0cyclictest0-21swapper/219:21:292
145319964,1cyclictest686-21gdbus23:25:242
145319964,1cyclictest661-21dbus-daemon22:20:082
145319963,2cyclictest661-21dbus-daemon19:40:002
145319963,2cyclictest1013-21snmpd19:33:232
145319962,1cyclictest0-21swapper/221:25:092
145319962,1cyclictest0-21swapper/220:06:292
145269966,0cyclictest33150irq/27-ahci[00020:09:551
145269965,0cyclictest0-21swapper/120:30:281
145269965,0cyclictest0-21swapper/119:49:581
145269964,1cyclictest686-21gdbus21:35:221
145269964,1cyclictest661-21dbus-daemon22:35:161
145269964,1cyclictest656-21systemd-logind00:05:191
145269963,2cyclictest1013-21snmpd21:07:201
145269963,2cyclictest1013-21snmpd19:19:341
145269960,5cyclictest0-21swapper/120:10:481
145269960,5cyclictest0-21swapper/119:55:581
145209965,0cyclictest27211-21kworker/0:021:45:190
145209964,1cyclictest9881-21mii-tool20:15:220
145209964,1cyclictest661-21dbus-daemon00:20:190
145209964,1cyclictest5038-21sshd23:10:100
145209963,2cyclictest1013-21snmpd21:06:140
145209963,2cyclictest1013-21snmpd19:42:270
145379953,1cyclictest680-21polkitd20:25:003
145379953,1cyclictest3742-21cat20:00:223
145379953,1cyclictest11917-21mii-tool20:20:233
145379953,1cyclictest1013-21snmpd21:05:443
145379953,1cyclictest1013-21snmpd20:47:593
145379953,1cyclictest1013-21snmpd20:35:123
145379953,1cyclictest1013-21snmpd20:17:133
145379953,1cyclictest1013-21snmpd20:06:033
145379953,1cyclictest1013-21snmpd19:55:363
145379953,1cyclictest1013-21snmpd19:45:353
145379953,1cyclictest1013-21snmpd19:40:123
145379953,1cyclictest1013-21snmpd19:37:083
145379953,1cyclictest1013-21snmpd19:20:293
145379953,1cyclictest1013-21snmpd19:20:283
145379953,1cyclictest1013-21snmpd19:15:083
145379953,1cyclictest1013-21snmpd19:10:053
145379952,2cyclictest661-21dbus-daemon21:00:003
145379952,2cyclictest521-40kipmi019:51:583
145379952,2cyclictest1013-21snmpd19:31:233
145319953,1cyclictest650-21avahi-daemon20:55:052
145319953,1cyclictest650-21avahi-daemon19:25:332
145319953,1cyclictest28183-21cat21:00:192
145319953,1cyclictest1714-21sendmail19:10:332
145319953,1cyclictest13846-21tail20:25:212
145319953,1cyclictest1037-21lldpd19:15:312
145319953,1cyclictest1013-21snmpd21:05:322
145319953,1cyclictest1013-21snmpd20:46:562
145319953,1cyclictest1013-21snmpd20:40:132
145319953,1cyclictest1013-21snmpd20:12:562
145319953,1cyclictest1013-21snmpd19:50:542
145319953,1cyclictest1013-21snmpd19:45:412
145319950,1cyclictest0-21swapper/220:30:262
145319950,0cyclictest0-21swapper/220:01:092
145269954,0cyclictest0-21swapper/120:56:081
145269953,1cyclictest680-21polkitd20:24:591
145269953,1cyclictest3393-21tr20:00:191
145269953,1cyclictest21910-21kernelversion19:25:221
145269953,1cyclictest20729-21gdbus19:14:551
145269953,1cyclictest20124-21kernelversion20:40:241
145269953,1cyclictest18986-21sshd20:35:441
145269953,1cyclictest1714-21sendmail20:20:291
145269953,1cyclictest1013-21snmpd21:01:381
145269953,1cyclictest1013-21snmpd20:17:101
145269953,1cyclictest1013-21snmpd19:50:391
145269953,1cyclictest1013-21snmpd19:39:051
145269953,1cyclictest1013-21snmpd19:33:261
145269953,1cyclictest0-21swapper/120:45:181
145269952,2cyclictest1013-21snmpd19:42:241
145209955,0cyclictest5074-21kworker/0:220:13:550
145209955,0cyclictest5074-21kworker/0:220:05:030
145209955,0cyclictest29502-21kworker/0:119:50:050
145209955,0cyclictest29502-21kworker/0:119:45:170
145209955,0cyclictest17295-21kworker/0:121:01:490
145209955,0cyclictest17295-21kworker/0:120:55:010
145209955,0cyclictest17295-21kworker/0:120:45:050
145209955,0cyclictest17295-21kworker/0:120:40:010
145209955,0cyclictest17295-21kworker/0:120:35:550
145209955,0cyclictest13215-21kworker/0:020:30:190
145209955,0cyclictest12391-21kworker/0:319:25:180
145209955,0cyclictest12391-21kworker/0:319:10:450
145209954,1cyclictest979-21kworker/0:019:55:230
145209954,1cyclictest17295-21kworker/0:120:50:220
145209953,1cyclictest24541-21sort19:30:270
145209953,1cyclictest17802-21cat19:15:230
145209953,1cyclictest1013-21snmpd20:26:180
145209953,1cyclictest1013-21snmpd20:20:010
145209953,1cyclictest1013-21snmpd19:20:350
145209953,1cyclictest1013-21snmpd19:20:350
145379942,1cyclictest23798-21expr20:50:203
145379942,1cyclictest15668-21cstates20:30:183
145319942,1cyclictest1013-21snmpd20:35:002
145319942,1cyclictest0-21swapper/219:40:232
145319940,1cyclictest11442-21/usr/sbin/munin20:20:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional