You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-08 - 08:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sun Sep 08, 2024 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
78132305270,23sleep10-21swapper/119:08:231
77582286220,21sleep00-21swapper/019:07:420
78992271211,47sleep30-21swapper/319:09:293
77042265228,22sleep20-21swapper/219:07:192
15752650,0sleep00-21swapper/000:15:300
134732630,0sleep10-21swapper/123:15:011
135262620,0sleep20-21swapper/221:20:202
32902590,0sleep10-21swapper/121:36:171
117312590,0sleep20-21swapper/223:57:332
159252530,0sleep10-21swapper/119:25:121
77212200,0sleep00-21swapper/023:32:450
271872190,0sleep30-21swapper/323:24:153
24712170,0sleep00-21swapper/022:44:440
23612150,0sleep20-21swapper/223:06:322
211782150,0sleep30-21swapper/323:41:503
167152150,0sleep00-21swapper/022:31:100
133312110,0sleep30-21swapper/322:06:353
804799105,3cyclictest19982-21systemd-journal21:25:531
804599109,1cyclictest12-21ksoftirqd/000:00:010
164242100,0sleep10-21swapper/100:29:491
148442100,0sleep10-21swapper/122:08:061
80559997,1cyclictest3016-21sh20:10:013
80559993,4cyclictest19982-21systemd-journal19:15:183
80519994,3cyclictest19982-21systemd-journal21:39:152
80519992,4cyclictest19818-21perf19:35:012
80479994,3cyclictest19982-21systemd-journal22:34:181
80479994,3cyclictest19982-21systemd-journal19:34:051
80459998,1cyclictest12-21ksoftirqd/023:20:010
80459996,2cyclictest12-21ksoftirqd/020:15:010
80459993,3cyclictest11054-21perf00:25:010
23144290,6sleep00-21swapper/000:05:530
1686290,1sleep00-21swapper/023:50:230
80559984,3cyclictest508-21dbus-daemon19:34:543
80559983,3cyclictest19982-21systemd-journal00:01:303
80559980,7cyclictest28992-21df_inode21:55:133
80479986,1cyclictest22-21ksoftirqd/120:15:001
80479985,2cyclictest508-21dbus-daemon23:39:231
80479985,2cyclictest22-21ksoftirqd/121:00:001
80479984,3cyclictest19982-21systemd-journal22:19:561
80479983,3cyclictest19982-21systemd-journal23:16:521
80459984,3cyclictest508-21dbus-daemon23:36:520
80459984,3cyclictest508-21dbus-daemon21:27:080
80459983,3cyclictest502-21systemd-logind22:58:050
80459983,3cyclictest19982-21systemd-journal23:49:590
80459983,3cyclictest19982-21systemd-journal22:28:020
80459983,3cyclictest19982-21systemd-journal00:29:020
80459980,7cyclictest25626-21ssh00:36:580
80459980,3cyclictest15574-21/usr/sbin/munin19:25:190
80559974,2cyclictest5057-21users22:00:213
80559974,2cyclictest19982-21systemd-journal20:48:013
80559973,3cyclictest6761-21expr22:25:153
80559973,3cyclictest19982-21systemd-journal20:34:553
80559973,3cyclictest10313-21apt-get20:25:123
80559973,2cyclictest19982-21systemd-journal23:13:253
80559973,1cyclictest0-21swapper/323:50:123
80559973,1cyclictest0-21swapper/322:50:023
80559973,1cyclictest0-21swapper/322:47:583
80559973,1cyclictest0-21swapper/322:38:393
80559972,3cyclictest19982-21systemd-journal20:37:033
80559972,3cyclictest19982-21systemd-journal00:14:593
80559971,1cyclictest141rcu_preempt22:55:393
80559970,7cyclictest0-21swapper/300:17:293
80559970,2cyclictest0-21swapper/323:16:053
80519976,1cyclictest20494-21ssh23:41:112
80519974,2cyclictest19982-21systemd-journal21:02:062
80519973,3cyclictest19982-21systemd-journal20:53:202
80519973,3cyclictest19982-21systemd-journal20:14:572
80519973,3cyclictest19982-21systemd-journal00:32:222
80519973,3cyclictest13954-21apt-get23:15:122
80519973,3cyclictest1-21systemd19:13:132
80519973,3cyclictest0-21swapper/200:22:402
80519973,1cyclictest0-21swapper/223:00:422
80519973,1cyclictest0-21swapper/200:35:342
80519973,1cyclictest0-21swapper/200:01:382
80519972,3cyclictest19982-21systemd-journal22:30:012
80519972,3cyclictest19982-21systemd-journal22:03:002
80519972,3cyclictest19982-21systemd-journal20:28:432
80519972,3cyclictest19982-21systemd-journal20:05:472
80479976,1cyclictest30483-21diskmemload00:10:081
80479974,2cyclictest19982-21systemd-journal00:03:341
80479973,3cyclictest7661-21lldpd22:55:421
80479973,3cyclictest30654-21snmpd20:31:541
80479973,3cyclictest19982-21systemd-journal21:20:011
80479973,3cyclictest15213-21sshd22:53:251
80479973,3cyclictest0-21swapper/100:37:281
80479973,1cyclictest0-21swapper/123:42:151
80479973,1cyclictest0-21swapper/121:31:111
80479971,5cyclictest6895-21latency_hist23:54:591
80479970,5cyclictest19982-21systemd-journal22:21:481
80479970,3cyclictest11441-21ssh22:28:191
80459974,2cyclictest508-21dbus-daemon21:47:090
80459974,2cyclictest508-21dbus-daemon20:23:180
80459973,3cyclictest30654-21snmpd00:32:550
80459973,3cyclictest28852-21diskstats23:25:120
80459973,3cyclictest19982-21systemd-journal21:54:400
80459973,3cyclictest19982-21systemd-journal20:25:480
80459973,3cyclictest19982-21systemd-journal00:12:030
80459973,2cyclictest19982-21systemd-journal22:47:390
80459973,2cyclictest14653-40rsyslog-rotate00:00:010
80459973,1cyclictest0-21swapper/023:05:220
80459972,3cyclictest19982-21systemd-journal22:03:170
80459972,3cyclictest19982-21systemd-journal19:52:250
80459972,2cyclictest12620-21ssh22:51:000
80459971,3cyclictest7169-21munin-run21:40:000
23578270,0sleep20-21swapper/221:50:372
80559966,0cyclictest0-21swapper/300:06:123
80559963,2cyclictest5325-21ls21:15:123
80559963,2cyclictest5106-21ssh23:30:233
80559963,2cyclictest508-21dbus-daemon21:45:053
80559963,2cyclictest3800-21grep20:10:153
80559963,2cyclictest30654-21snmpd23:09:283
80559963,2cyclictest30654-21snmpd21:50:113
80559963,2cyclictest24295-21ssh22:15:013
80559963,2cyclictest20199-21tr19:35:133
80559963,2cyclictest18278-21cat20:40:213
80559963,2cyclictest16378-21sh22:30:543
80559963,2cyclictest13270-21processes21:20:183
80559963,2cyclictest12456-21grep00:25:173
80559963,1cyclictest0-21swapper/323:25:093
80559962,3cyclictest6072-21cat20:15:143
80559962,3cyclictest31933-21awk21:10:163
80559962,3cyclictest31933-21awk21:10:163
80559962,3cyclictest30654-21snmpd23:46:593
80559962,3cyclictest30654-21snmpd21:41:233
80559962,3cyclictest30654-21snmpd21:05:123
80559962,3cyclictest30654-21snmpd21:00:123
80559962,3cyclictest30654-21snmpd19:50:113
80559962,3cyclictest30654-21snmpd19:27:003
80559962,3cyclictest30654-21snmpd19:20:163
80559962,3cyclictest29260-21cat22:40:153
80559962,3cyclictest26736-21cat21:30:123
80559962,3cyclictest24072-21cat20:55:133
80559962,3cyclictest22632-21apt-get00:35:113
80559962,3cyclictest19982-21systemd-journal00:21:053
80559962,3cyclictest1-21systemd22:20:313
80559962,3cyclictest11440-21cat23:35:153
80559962,1cyclictest0-21swapper/322:11:193
80559961,4cyclictest30026-21grep19:55:183
80559961,3cyclictest19982-21systemd-journal21:35:283
80559961,3cyclictest19982-21systemd-journal19:44:043
80559961,1cyclictest0-21swapper/323:00:133
80559960,2cyclictest8609-21ntp_states23:55:193
80559960,0cyclictest0-21swapper/300:30:003
80519966,0cyclictest0-21swapper/221:56:382
80519964,1cyclictest9640-21users20:20:202
80519964,1cyclictest11736-21in:imuxsock20:32:582
80519963,2cyclictest668-21runrttasks20:15:052
80519963,2cyclictest668-21runrttasks00:05:052
80519963,2cyclictest6259-21wc21:15:172
80519963,2cyclictest28-21ksoftirqd/219:15:012
80519963,2cyclictest27187-21grep00:10:122
80519963,2cyclictest26189-21grep23:45:192
80519963,2cyclictest25712-21ssh22:37:462
80519963,2cyclictest11736-21in:imuxsock23:10:102
80519963,2cyclictest10319-21sh21:41:192
80519963,2cyclictest0-21swapper/222:16:192
80519963,1cyclictest0-21swapper/221:30:452
80519962,3cyclictest32467-21smart_sda20:00:192
80519962,3cyclictest30654-21snmpd19:35:582
80519962,3cyclictest29231-21expr19:55:132
80519962,3cyclictest27447-21cat19:50:152
80519962,3cyclictest24520-21cat19:45:102
80519962,3cyclictest22845-21awk23:20:212
80519962,3cyclictest19845-21hddtemp_smartct20:45:142
80519962,3cyclictest15993-21ssh22:30:322
80519962,3cyclictest15869-21sshd23:38:342
80519962,3cyclictest1-21systemd19:29:032
80519962,3cyclictest11742-21expr00:25:142
80519962,3cyclictest0-21swapper/223:50:342
80519962,3cyclictest0-21swapper/222:50:122
80519962,3cyclictest0-21swapper/200:15:222
80519962,1cyclictest0-21swapper/222:49:292
80519962,1cyclictest0-21swapper/222:20:382
80519962,1cyclictest0-21swapper/221:27:082
80519961,3cyclictest19982-21systemd-journal21:45:052
80519961,3cyclictest19667-21sshd22:55:592
80519961,2cyclictest4244-21ssh23:30:182
80519961,2cyclictest29534-21ssh22:40:172
80519960,6cyclictest0-21swapper/222:07:062
80519960,3cyclictest20196-21ssh22:11:292
80519960,2cyclictest31737-21memory21:10:142
80519960,2cyclictest31737-21memory21:10:142
80479964,1cyclictest11002-21irqstats20:25:161
80479963,2cyclictest7833-21basename20:20:011
80479963,2cyclictest508-21dbus-daemon21:06:411
80479963,2cyclictest502-21systemd-logind21:50:551
80479963,2cyclictest3196-21cpu22:45:111
80479963,2cyclictest30654-21snmpd23:55:141
80479963,2cyclictest21363-21ssh22:35:081
80479963,2cyclictest21219-21cut00:05:121
80479963,2cyclictest2084-21rm23:06:181
80479963,2cyclictest19982-21systemd-journal20:43:001
80479963,2cyclictest19889-21ssh00:32:021
80479963,2cyclictest15414-21latency_hist19:25:021
80479963,2cyclictest11736-21in:imuxsock19:44:301
80479962,3cyclictest8936-21cat20:20:161
80479962,3cyclictest508-21dbus-daemon23:31:531
80479962,3cyclictest4825-21cat22:00:191
80479962,3cyclictest31923-21cat20:00:141
80479962,3cyclictest31308-21fschecks_count21:10:121
80479962,3cyclictest31308-21fschecks_count21:10:121
80479962,3cyclictest30654-21snmpd23:01:341
80479962,3cyclictest30654-21snmpd21:40:201
80479962,3cyclictest30654-21snmpd20:46:151
80479962,3cyclictest29276-21expr19:55:121
80479962,3cyclictest2636-21seq20:05:341
80479962,3cyclictest22770-21unixbench-2d23:20:211
80479962,3cyclictest22464-21awk20:50:181
80479962,3cyclictest19982-21systemd-journal19:15:421
80479962,3cyclictest1-21systemd19:51:111
80479962,3cyclictest10414-21ls19:15:011
80479962,3cyclictest0-21swapper/121:55:201
80479962,2cyclictest21828-21sshd19:37:431
80479962,1cyclictest141rcu_preempt21:45:191
80479962,1cyclictest0-21swapper/123:45:181
80479962,1cyclictest0-21swapper/122:41:141
80479962,1cyclictest0-21swapper/121:20:051
80479961,4cyclictest17310-21apt-get22:10:121
80479961,1cyclictest141rcu_preempt19:50:011
80479960,5cyclictest1009-21/usr/sbin/munin00:15:211
80479960,1cyclictest141rcu_preempt23:25:111
80479960,1cyclictest141rcu_preempt00:21:231
80459966,0cyclictest0-21swapper/022:13:280
80459963,2cyclictest668-21runrttasks22:23:170
80459963,2cyclictest30654-21snmpd21:01:380
80459963,2cyclictest30654-21snmpd20:45:050
80459963,2cyclictest30654-21snmpd20:15:050
80459963,2cyclictest29823-21wc21:55:180
80459963,2cyclictest29741-11brltty19:13:120
80459963,2cyclictest2607-21vmstat20:05:210
80459963,2cyclictest21003-21rm23:20:010
80459963,2cyclictest18776-21latency23:40:150
80459963,2cyclictest0-21swapper/022:37:510
80459963,2cyclictest0-21swapper/022:09:310
80459962,3cyclictest30654-21snmpd21:21:430
80459962,3cyclictest30654-21snmpd20:50:110
80459962,3cyclictest30654-21snmpd20:40:450
80459962,3cyclictest30654-21snmpd20:02:130
80459962,3cyclictest30654-21snmpd19:55:010
80459962,3cyclictest30654-21snmpd19:46:460
80459962,3cyclictest30654-21snmpd19:31:100
80459962,3cyclictest14147-21cat19:20:160
80459962,3cyclictest13505-21ntpq20:30:160
80459962,3cyclictest0-21swapper/021:10:120
80459962,3cyclictest0-21swapper/021:10:120
80459962,1cyclictest0-21swapper/023:10:590
80459962,1cyclictest0-21swapper/023:02:160
80459962,1cyclictest0-21swapper/021:30:000
80459961,4cyclictest19982-21systemd-journal19:17:490
80459961,3cyclictest19982-21systemd-journal21:40:540
80459961,1cyclictest0-21swapper/021:15:150
80459960,5cyclictest25709-21sshd20:57:000
80459960,3cyclictest26776-21ssh22:15:520
80559952,2cyclictest8953-21kernelversion19:10:163
80559952,2cyclictest8695-21hwlatdetect20:20:143
80559952,2cyclictest24898-21expr19:45:103
80559952,2cyclictest19508-21cut21:25:123
80559951,3cyclictest22081-21hwlatdetect20:50:153
80559951,1cyclictest51850irq/136-enp4s0-20:00:123
80519953,1cyclictest0-21swapper/220:55:022
80519952,2cyclictest28697-21cstates21:05:132
80519952,2cyclictest22987-21cat19:40:162
80519952,2cyclictest17941-21ntp_kernel_err20:40:192
80519952,2cyclictest15194-21cut20:35:142
80519952,2cyclictest13360-21/usr/sbin/munin19:20:112
80519951,3cyclictest28944-21tune2fs23:25:132
80479952,2cyclictest15026-21expr20:35:131
80479951,3cyclictest26924-21cat21:00:141
80459952,2cyclictest30140-21taskset21:06:160
80459952,2cyclictest22292-21find19:40:130
80459952,2cyclictest20510-21tune2fs19:35:150
80459952,2cyclictest14916-21cpuspeed_turbos20:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional