You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 10:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Wed Apr 24, 2024 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122962307273,22sleep20-21swapper/219:07:182
123672297236,49sleep10-21swapper/119:08:131
121822261227,22sleep00-21swapper/019:06:030
121532257222,22sleep30-21swapper/319:05:423
324472640,0sleep20-21swapper/200:11:472
186462610,0sleep20-21swapper/222:29:242
186462610,0sleep20-21swapper/222:29:242
94322570,0sleep00-21swapper/022:00:110
75442560,0sleep20-21swapper/222:44:532
311782540,0sleep30-21swapper/322:38:023
93882190,0sleep10-21swapper/122:22:221
108522190,0sleep00-21swapper/021:38:480
87822180,0sleep10-21swapper/123:54:281
232952180,0sleep10-21swapper/122:32:071
105712180,0sleep10-21swapper/123:09:471
288502170,0sleep10-21swapper/122:59:541
258682160,0sleep10-21swapper/121:49:061
84962150,0sleep20-21swapper/222:45:132
82142150,0sleep30-21swapper/320:10:213
168382140,0sleep30-21swapper/322:05:143
318162120,0sleep10-21swapper/122:15:171
228312120,0sleep00-21swapper/023:40:450
223662110,1sleep30-21swapper/300:04:403
255372100,0sleep30-21swapper/321:48:493
17511290,1sleep20-21swapper/220:30:182
17511290,1sleep20-21swapper/220:30:182
13723290,0sleep334-21ksoftirqd/322:02:543
126179990,8cyclictest6319-21ssh23:05:443
126139998,1cyclictest28-21ksoftirqd/222:40:012
126139998,1cyclictest28-21ksoftirqd/221:50:012
126099994,3cyclictest19982-21systemd-journal23:29:221
8829280,0sleep20-21swapper/222:21:512
126179983,3cyclictest19982-21systemd-journal22:40:073
126179983,3cyclictest19982-21systemd-journal21:19:103
126179983,3cyclictest16969-21lldpd23:56:303
126179980,7cyclictest6728-21ssh23:52:313
126179980,7cyclictest20173-21df_inode22:30:153
126139984,3cyclictest16858-21diskstats22:05:152
126139983,3cyclictest19982-21systemd-journal21:32:562
126139981,4cyclictest27538-21munin-run19:45:002
126139981,4cyclictest23067-21munin-run19:35:002
126099985,2cyclictest508-21dbus-daemon19:34:281
126099984,3cyclictest508-21dbus-daemon00:31:051
126099984,3cyclictest19982-21systemd-journal23:32:421
126099983,3cyclictest19982-21systemd-journal20:53:441
126059986,1cyclictest12-21ksoftirqd/019:15:010
126059985,2cyclictest19982-21systemd-journal19:26:330
126059984,3cyclictest508-21dbus-daemon23:45:370
126059984,2cyclictest19982-21systemd-journal20:00:450
126059982,3cyclictest20543-21munin-run20:40:010
126059982,3cyclictest1759-21cron20:00:000
126059982,2cyclictest12-21ksoftirqd/000:05:000
126179974,2cyclictest11736-21in:imuxsock23:37:413
126179973,3cyclictest6228-21cron20:10:013
126179973,3cyclictest508-21dbus-daemon22:21:213
126179973,3cyclictest19982-21systemd-journal00:09:563
126179973,3cyclictest13388-21snmpd20:30:263
126179973,3cyclictest13388-21snmpd20:30:253
126179973,2cyclictest19982-21systemd-journal23:33:313
126179973,1cyclictest0-21swapper/323:43:213
126179973,1cyclictest0-21swapper/322:50:143
126179972,4cyclictest32546-21sh21:30:273
126179972,3cyclictest19982-21systemd-journal22:55:083
126179971,4cyclictest19982-21systemd-journal22:47:123
126179970,3cyclictest12600-21ssh22:25:133
126179970,3cyclictest12600-21ssh22:25:133
126139974,2cyclictest508-21dbus-daemon20:07:502
126139974,2cyclictest11736-21in:imuxsock23:11:492
126139973,3cyclictest508-21dbus-daemon20:30:022
126139973,3cyclictest30800-21sensors_temp23:00:222
126139973,3cyclictest16421-40logrotate00:00:002
126139973,3cyclictest13388-21snmpd20:39:402
126139973,3cyclictest11736-21in:imuxsock22:53:532
126139973,2cyclictest502-21systemd-logind22:18:502
126139973,1cyclictest0-21swapper/221:50:412
126139972,3cyclictest19982-21systemd-journal23:45:132
126139972,3cyclictest19982-21systemd-journal23:29:552
126139972,3cyclictest19982-21systemd-journal20:12:262
126139972,3cyclictest19982-21systemd-journal19:11:062
126139971,4cyclictest19982-21systemd-journal21:10:002
126139971,3cyclictest31868-21latency_hist23:25:002
126139970,3cyclictest27769-21/usr/sbin/munin19:45:132
126099974,2cyclictest508-21dbus-daemon20:49:331
126099973,3cyclictest508-21dbus-daemon21:00:001
126099973,3cyclictest508-21dbus-daemon20:19:061
126099973,3cyclictest27403-21hwlatdetect22:35:171
126099973,3cyclictest19982-21systemd-journal22:05:041
126099973,3cyclictest16969-21lldpd22:28:431
126099973,3cyclictest16969-21lldpd22:28:421
126099973,3cyclictest13388-21snmpd19:22:351
126099973,3cyclictest1-21systemd00:05:231
126099973,1cyclictest0-21swapper/122:10:531
126099973,1cyclictest0-21swapper/121:18:291
126099972,3cyclictest19982-21systemd-journal00:21:541
126099972,3cyclictest16969-21lldpd23:02:431
126099971,5cyclictest508-21dbus-daemon20:10:021
126099970,7cyclictest0-21swapper/121:23:491
126099970,1cyclictest26898-21ssh21:26:491
126059974,2cyclictest19982-21systemd-journal23:00:000
126059974,2cyclictest19982-21systemd-journal19:35:000
126059973,3cyclictest508-21dbus-daemon00:13:340
126059973,3cyclictest21608-21memory20:40:190
126059973,3cyclictest13388-21snmpd00:36:330
126059973,3cyclictest12-21ksoftirqd/023:10:240
126059973,3cyclictest1-21systemd23:37:160
126059973,3cyclictest11736-21in:imuxsock00:24:010
126059973,3cyclictest10999-21sshd23:32:490
126059973,3cyclictest0-21swapper/023:21:570
126059973,3cyclictest0-21swapper/022:45:280
126059973,3cyclictest0-21swapper/021:11:290
126059973,3cyclictest0-21swapper/000:06:160
126059972,3cyclictest16969-21lldpd20:05:020
126059972,3cyclictest10839-21turbostat23:10:000
126059971,4cyclictest19982-21systemd-journal21:55:540
126059971,3cyclictest25510-21rm22:10:350
126059971,3cyclictest19027-21rm21:21:010
126059971,3cyclictest18621-21munin-run19:25:000
126059970,1cyclictest0-21swapper/023:30:000
126179964,1cyclictest15419-21grep19:15:013
126179964,1cyclictest0-21swapper/319:29:033
126179963,2cyclictest668-21runrttasks21:11:033
126179963,2cyclictest508-21dbus-daemon00:25:193
126179963,2cyclictest31587-21sh23:00:463
126179963,2cyclictest30978-21sh22:15:113
126179963,2cyclictest29573-21rm23:45:273
126179963,2cyclictest27698-21expr20:55:123
126179963,2cyclictest21002-21wc20:40:143
126179963,2cyclictest20547-21sh00:30:383
126179963,2cyclictest13388-21snmpd21:40:563
126179963,2cyclictest1-21systemd20:15:463
126179962,3cyclictest9848-21which00:20:203
126179962,3cyclictest508-21dbus-daemon21:10:003
126179962,3cyclictest3049-21sed20:00:173
126179962,3cyclictest25925-21cat20:50:163
126179962,3cyclictest24327-21grep00:35:163
126179962,3cyclictest24300-21cat22:10:153
126179962,3cyclictest15309-21sensors_temp20:25:193
126179962,3cyclictest13388-21snmpd21:56:263
126179962,3cyclictest13388-21snmpd21:02:503
126179962,3cyclictest13388-21snmpd20:21:283
126179962,3cyclictest13388-21snmpd19:50:033
126179962,3cyclictest13388-21snmpd19:45:033
126179962,3cyclictest13388-21snmpd19:35:263
126179962,3cyclictest13388-21snmpd19:10:053
126179962,3cyclictest13388-21snmpd00:10:183
126179962,2cyclictest19982-21systemd-journal23:15:103
126179962,1cyclictest0-21swapper/321:52:153
126179962,1cyclictest0-21swapper/321:20:383
126179961,3cyclictest19982-21systemd-journal19:34:543
126179961,3cyclictest16969-21lldpd21:25:073
126179961,2cyclictest12662-21ssh23:10:233
126179960,3cyclictest7165-21taskset21:35:233
126179960,2cyclictest3218-21/usr/sbin/munin00:15:153
126139963,2cyclictest668-21runrttasks23:31:372
126139963,2cyclictest5358-21ntpq23:05:212
126139963,2cyclictest508-21dbus-daemon20:45:212
126139963,2cyclictest26507-21ssh22:57:432
126139963,2cyclictest26238-21sh00:36:322
126139963,2cyclictest21722-21ssh22:30:362
126139963,2cyclictest18925-21cpuspeed19:25:072
126139963,2cyclictest13388-21snmpd00:15:422
126139963,2cyclictest11677-21ssh21:16:122
126139962,3cyclictest9094-21expr00:20:132
126139962,3cyclictest31010-21pluginstate19:50:222
126139962,3cyclictest29741-11brltty19:21:582
126139962,3cyclictest25474-21cat20:50:132
126139962,3cyclictest2298-21expr21:55:132
126139962,3cyclictest19982-21systemd-journal00:29:252
126139962,3cyclictest17660-21cat00:00:152
126139962,3cyclictest15298-21apt-key19:15:012
126139962,3cyclictest14715-21cat23:35:202
126139962,3cyclictest13388-21snmpd21:01:472
126139962,3cyclictest13388-21snmpd20:57:412
126139962,3cyclictest13388-21snmpd20:15:462
126139962,3cyclictest13388-21snmpd20:01:002
126139962,3cyclictest13388-21snmpd19:36:202
126139962,3cyclictest13388-21snmpd00:07:362
126139962,3cyclictest0-21swapper/222:03:412
126139962,1cyclictest0-21swapper/223:40:582
126139962,1cyclictest0-21swapper/223:15:242
126139962,1cyclictest0-21swapper/222:10:432
126139962,1cyclictest0-21swapper/221:41:562
126139962,1cyclictest0-21swapper/221:39:392
126139962,1cyclictest0-21swapper/221:25:092
126139962,1cyclictest0-21swapper/221:13:492
126139961,3cyclictest19982-21systemd-journal20:44:082
126139961,3cyclictest19982-21systemd-journal20:24:572
126139961,2cyclictest6500-21ssh23:52:182
126139961,2cyclictest19890-21wc00:30:192
126139960,3cyclictest16202-21dpkg21:20:002
126099966,0cyclictest0-21swapper/120:41:141
126099963,2cyclictest668-21runrttasks19:48:441
126099963,2cyclictest28243-21fschecks_count23:45:141
126099963,2cyclictest19982-21systemd-journal23:23:051
126099963,2cyclictest16533-21ssh00:27:001
126099963,2cyclictest13388-21snmpd21:00:471
126099963,2cyclictest13388-21snmpd19:25:501
126099963,2cyclictest13137-21cat21:40:161
126099963,2cyclictest11736-21in:imuxsock20:37:521
126099963,2cyclictest11736-21in:imuxsock00:00:131
126099963,2cyclictest1030-21ssh21:54:271
126099962,3cyclictest508-21dbus-daemon20:21:111
126099962,3cyclictest3447-21ls20:00:201
126099962,3cyclictest31083-21expr21:30:151
126099962,3cyclictest25288-21ssh23:43:051
126099962,3cyclictest2282-21cat21:10:121
126099962,3cyclictest18634-21expr23:15:121
126099962,3cyclictest16832-21cat19:15:171
126099962,3cyclictest1562-21expr22:40:151
126099962,3cyclictest14831-21ntpq23:35:221
126099962,3cyclictest13388-21snmpd21:06:391
126099962,3cyclictest13388-21snmpd19:55:421
126099962,3cyclictest13388-21snmpd19:35:021
126099962,3cyclictest13388-21snmpd00:15:061
126099962,1cyclictest0-21swapper/122:51:141
126099962,1cyclictest0-21swapper/122:46:571
126099962,1cyclictest0-21swapper/121:56:131
126099962,1cyclictest0-21swapper/121:35:081
126099962,1cyclictest0-21swapper/100:11:271
126099961,4cyclictest16969-21lldpd23:55:581
126099960,6cyclictest0-21swapper/120:25:221
126099960,5cyclictest8784-21grep20:15:011
126099960,5cyclictest16306-21/usr/sbin/munin20:30:181
126099960,5cyclictest16306-21/usr/sbin/munin20:30:181
126099960,3cyclictest9204-21/usr/sbin/munin22:00:141
126099960,0cyclictest0-21swapper/100:35:051
126059964,2cyclictest14780-21cron19:15:010
126059963,2cyclictest9325-21expr20:15:130
126059963,2cyclictest23794-21cut21:25:110
126059963,2cyclictest20540-21uname22:30:180
126059963,2cyclictest20152-21apt-get21:45:120
126059963,2cyclictest19982-21systemd-journal21:01:480
126059963,2cyclictest14678-21gltestperf20:25:130
126059963,2cyclictest13388-21snmpd19:53:310
126059962,3cyclictest6853-21awk20:10:100
126059962,3cyclictest31544-21ls22:15:150
126059962,3cyclictest29455-21apt-get23:00:130
126059962,3cyclictest27184-21fschecks_count22:35:160
126059962,3cyclictest26915-21sed19:40:260
126059962,3cyclictest19982-21systemd-journal22:50:080
126059962,3cyclictest13388-21snmpd21:51:590
126059962,3cyclictest13388-21snmpd21:15:450
126059962,3cyclictest13388-21snmpd21:06:200
126059962,3cyclictest13388-21snmpd20:58:080
126059962,3cyclictest13388-21snmpd20:45:110
126059962,3cyclictest0-21swapper/023:55:480
126059962,3cyclictest0-21swapper/023:50:010
126059962,3cyclictest0-21swapper/022:27:320
126059962,3cyclictest0-21swapper/022:27:320
126059962,3cyclictest0-21swapper/022:05:360
126059961,4cyclictest0-21swapper/022:40:210
126059961,3cyclictest19982-21systemd-journal00:33:100
126059961,3cyclictest19982-21systemd-journal00:16:290
126059960,5cyclictest5497-21/usr/sbin/munin22:20:210
126059960,3cyclictest30709-21rm21:30:120
126059960,3cyclictest18260-21rm23:15:110
126059960,3cyclictest16421-21ssh00:26:490
126179952,2cyclictest32223-21/usr/sbin/munin19:55:173
126179952,2cyclictest25729-21tr19:40:143
126179952,2cyclictest25061-21chrt23:20:023
126179952,2cyclictest19526-21ntp_states20:35:183
126179952,2cyclictest18404-21taskset19:22:303
126179951,3cyclictest32124-21ssh23:25:023
126179951,3cyclictest23027-21apt-get20:45:133
126139952,2cyclictest32238-21cat19:55:132
126099953,1cyclictest26364-21load19:40:191
126099952,2cyclictest30014-21basename19:50:131
126099952,2cyclictest13015-21cat19:10:131
126099951,3cyclictest11639-21expr23:10:141
126059952,2cyclictest23768-21cut19:35:170
126059952,2cyclictest11488-21cmp20:20:010
126059951,3cyclictest25467-21expr20:50:140
126059951,3cyclictest16713-21/usr/sbin/munin20:30:120
126059951,3cyclictest16713-21/usr/sbin/munin20:30:120
126059951,3cyclictest13388-21snmpd19:45:150
126059951,2cyclictest19982-21systemd-journal21:40:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional