You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-03 - 22:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Thu Oct 03, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131612313246,21sleep20-21swapper/207:06:092
134032283218,21sleep30-21swapper/307:09:193
132312270212,46sleep00-21swapper/007:07:030
134112259225,22sleep10-21swapper/107:09:251
211972600,0sleep30-21swapper/310:20:073
102952600,1sleep310294-21smartctl09:15:153
69352590,0sleep30-21swapper/312:13:553
122622580,0sleep10-21swapper/112:38:431
255432560,0sleep00-21swapper/009:56:240
147002560,0sleep30-21swapper/310:40:213
288062540,0sleep20-21swapper/211:42:232
288062540,0sleep20-21swapper/211:42:232
161602270,0sleep10-21swapper/110:41:351
292302190,1sleep30-21swapper/310:00:133
50012170,0sleep20-21swapper/208:00:152
112012160,1sleep10-21swapper/108:15:111
91282150,0sleep20-21swapper/210:10:132
306902140,0sleep10-21swapper/110:27:101
279292140,0sleep30-21swapper/309:59:133
17802140,0sleep30-21swapper/311:22:503
164422130,0sleep30-21swapper/312:20:153
1358199108,1cyclictest17479-21turbostat08:30:003
1356999107,2cyclictest12-21ksoftirqd/012:40:000
23768290,0sleep00-21swapper/010:21:120
135769994,3cyclictest19982-21systemd-journal11:45:172
135769994,3cyclictest19982-21systemd-journal11:03:082
135699990,8cyclictest1501-21/usr/sbin/munin12:10:140
135819983,3cyclictest19982-21systemd-journal09:02:253
135769984,3cyclictest28652-21sshd10:51:092
135769983,3cyclictest19982-21systemd-journal11:17:182
135769983,3cyclictest19982-21systemd-journal09:31:212
135769983,3cyclictest19982-21systemd-journal07:22:272
135729982,5cyclictest31915-21cron10:55:011
135699983,3cyclictest7661-21lldpd11:34:590
135699982,3cyclictest19107-21dump-pmu-power10:45:010
135699981,4cyclictest508-21dbus-daemon12:00:010
11199280,0sleep30-21swapper/312:16:353
32012270,0sleep20-21swapper/210:28:432
135819974,2cyclictest508-21dbus-daemon10:28:063
135819973,3cyclictest7661-21lldpd12:33:263
135819973,3cyclictest2135-21apt-get07:55:113
135819973,3cyclictest19982-21systemd-journal12:05:183
135819973,3cyclictest19982-21systemd-journal08:10:263
135819973,2cyclictest19982-21systemd-journal07:52:293
135819973,1cyclictest0-21swapper/311:51:323
135819972,3cyclictest19982-21systemd-journal11:58:383
135819972,3cyclictest19982-21systemd-journal09:00:003
135819972,3cyclictest19982-21systemd-journal08:43:233
135819970,2cyclictest11337-21df11:30:113
135769974,2cyclictest508-21dbus-daemon09:48:282
135769974,2cyclictest508-21dbus-daemon09:48:282
135769973,3cyclictest7350-21sshd08:05:152
135769973,3cyclictest508-21dbus-daemon09:10:002
135769973,3cyclictest30654-21snmpd11:34:542
135769973,3cyclictest30654-21snmpd11:24:062
135769973,3cyclictest29693-21grep10:00:152
135769973,3cyclictest19982-21systemd-journal08:18:252
135769973,3cyclictest0-21swapper/212:20:212
135769973,3cyclictest0-21swapper/210:23:132
135769973,1cyclictest0-21swapper/212:36:082
135769973,1cyclictest0-21swapper/209:53:132
135769972,4cyclictest0-21swapper/212:34:252
135769972,3cyclictest7661-21lldpd12:19:252
135769972,3cyclictest19982-21systemd-journal12:27:252
135769972,3cyclictest19982-21systemd-journal10:33:062
135769972,3cyclictest19982-21systemd-journal09:34:592
135769971,5cyclictest30654-21snmpd11:25:332
135729974,2cyclictest508-21dbus-daemon07:49:341
135729974,2cyclictest19982-21systemd-journal11:51:251
135729973,3cyclictest6973-21sshd09:40:471
135729973,3cyclictest19982-21systemd-journal07:11:371
135729973,3cyclictest18031-21apt-get11:35:121
135729973,3cyclictest17684-21cat09:50:151
135729973,3cyclictest0-21swapper/108:22:571
135729973,2cyclictest19982-21systemd-journal07:40:001
135729970,6cyclictest22-21ksoftirqd/108:45:111
135699976,1cyclictest12-21ksoftirqd/009:50:010
135699976,1cyclictest12-21ksoftirqd/009:50:010
135699974,2cyclictest508-21dbus-daemon09:10:190
135699974,2cyclictest32726-21df07:50:140
135699973,3cyclictest508-21dbus-daemon07:24:330
135699973,3cyclictest19982-21systemd-journal11:41:040
135699973,3cyclictest19982-21systemd-journal11:41:040
135699973,3cyclictest19982-21systemd-journal08:10:510
135699973,3cyclictest0-21swapper/011:15:360
135699973,3cyclictest0-21swapper/010:29:290
135699973,2cyclictest19982-21systemd-journal07:49:560
135699973,1cyclictest0-21swapper/010:02:140
135699973,1cyclictest0-21swapper/009:40:530
135699972,3cyclictest19982-21systemd-journal08:26:420
135699971,3cyclictest21806-21rm11:13:230
135699970,4cyclictest22860-21idleruntime-cro12:25:000
135819966,0cyclictest0-21swapper/311:25:133
135819966,0cyclictest0-21swapper/309:45:083
135819966,0cyclictest0-21swapper/309:45:083
135819964,1cyclictest668-21runrttasks07:35:123
135819964,1cyclictest16378-21irqstats07:15:023
135819964,1cyclictest15130-21diskstats09:20:133
135819964,1cyclictest0-21swapper/310:05:143
135819963,2cyclictest8097-21cat10:35:133
135819963,2cyclictest3928-21df09:10:143
135819963,2cyclictest23286-21/usr/sbin/munin12:25:173
135819963,2cyclictest18734-21irqstats08:30:153
135819963,2cyclictest18596-21head11:35:143
135819963,2cyclictest13051-21sendmail-msp08:20:003
135819963,2cyclictest1-21systemd10:51:283
135819963,2cyclictest0-21swapper/311:15:013
135819962,3cyclictest5164-21ntpd09:05:173
135819962,3cyclictest32181-21cat09:35:153
135819962,3cyclictest30654-21snmpd10:30:293
135819962,3cyclictest30654-21snmpd10:11:583
135819962,3cyclictest30654-21snmpd08:53:463
135819962,3cyclictest30654-21snmpd08:37:073
135819962,3cyclictest30654-21snmpd07:42:203
135819962,3cyclictest30654-21snmpd07:30:353
135819962,3cyclictest27698-21unixbench_singl09:30:193
135819962,3cyclictest22383-21cat07:25:183
135819962,3cyclictest21896-21uptime12:00:223
135819962,3cyclictest21593-21sshd10:45:263
135819962,3cyclictest18889-21apt-get07:20:123
135819962,3cyclictest16208-21processes10:15:193
135819962,3cyclictest13905-21cat07:10:133
135819962,1cyclictest0-21swapper/309:27:193
135819961,4cyclictest16959-21/usr/sbin/munin09:50:153
135819961,3cyclictest19982-21systemd-journal12:35:253
135819961,3cyclictest19982-21systemd-journal08:45:533
135819961,3cyclictest19982-21systemd-journal08:05:013
135819961,3cyclictest19982-21systemd-journal08:02:043
135819961,3cyclictest19982-21systemd-journal07:48:193
135819960,6cyclictest0-21swapper/311:48:043
135819960,3cyclictest25811-21wc11:40:173
135819960,3cyclictest25811-21wc11:40:173
135819960,2cyclictest6033-21ssh11:00:113
135819960,2cyclictest19982-21systemd-journal11:06:043
135819960,0cyclictest0-21swapper/310:55:383
135769963,2cyclictest31404-21/usr/sbin/munin09:00:142
135769963,2cyclictest30654-21snmpd08:25:092
135769963,2cyclictest23127-21ssh10:47:182
135769963,2cyclictest20394-21cut12:00:132
135769963,2cyclictest17385-21sh11:57:422
135769963,2cyclictest15116-21cat07:10:202
135769963,2cyclictest13706-21uniq08:20:142
135769963,2cyclictest13475-21cpuspeed_turbos10:40:142
135769963,2cyclictest11736-21in:imuxsock07:45:492
135769962,3cyclictest9054-21expr08:10:132
135769962,3cyclictest623-21cat10:55:152
135769962,3cyclictest5164-21ntpd10:15:172
135769962,3cyclictest508-21dbus-daemon10:05:342
135769962,3cyclictest30654-21snmpd11:10:152
135769962,3cyclictest30654-21snmpd11:07:332
135769962,3cyclictest29855-21cat08:55:152
135769962,3cyclictest28130-21ntpq12:05:162
135769962,3cyclictest2810-21cat07:55:152
135769962,3cyclictest27637-21interrupts08:50:152
135769962,3cyclictest26525-21ntpq07:35:182
135769962,3cyclictest23190-21cat08:40:172
135769962,3cyclictest20921-21cat09:25:132
135769962,3cyclictest18686-21date07:20:012
135769962,3cyclictest17992-21packagekitd08:30:002
135769962,3cyclictest0-21swapper/209:10:422
135769962,2cyclictest7661-21lldpd08:46:252
135769962,1cyclictest0-21swapper/212:12:012
135769962,1cyclictest0-21swapper/211:50:372
135769962,1cyclictest0-21swapper/209:55:212
135769962,1cyclictest0-21swapper/209:20:072
135769961,3cyclictest19982-21systemd-journal11:35:412
135769961,3cyclictest19982-21systemd-journal08:35:522
135769960,6cyclictest0-21swapper/209:40:332
135769960,4cyclictest19982-21systemd-journal10:35:112
135769960,4cyclictest19982-21systemd-journal07:41:142
135729966,0cyclictest0-21swapper/109:55:311
135729964,1cyclictest4750-21df08:00:131
135729964,1cyclictest0-21swapper/110:10:121
135729963,2cyclictest4950-21ssh10:06:081
135729963,2cyclictest30654-21snmpd12:05:071
135729963,2cyclictest30654-21snmpd08:56:581
135729963,2cyclictest2631-21chrt10:56:331
135729963,2cyclictest25438-21ssh11:40:151
135729963,2cyclictest25438-21ssh11:40:151
135729963,2cyclictest22317-21sh12:00:451
135729963,2cyclictest22-21ksoftirqd/108:30:001
135729963,2cyclictest21256-21cat10:45:191
135729963,2cyclictest16264-21systemctl10:15:191
135729963,2cyclictest16198-21sh12:20:141
135729963,2cyclictest15494-21ssh11:07:291
135729963,2cyclictest11736-21in:imuxsock09:25:291
135729963,2cyclictest0-21swapper/111:55:531
135729962,3cyclictest874-21sendmail_mailtr11:45:181
135729962,3cyclictest6371-21cat11:00:121
135729962,3cyclictest508-21dbus-daemon09:30:561
135729962,3cyclictest508-21dbus-daemon09:02:091
135729962,3cyclictest508-21dbus-daemon08:36:171
135729962,3cyclictest4739-21systemctl09:10:191
135729962,3cyclictest30698-21cat11:20:151
135729962,3cyclictest30654-21snmpd10:21:051
135729962,3cyclictest30654-21snmpd09:45:541
135729962,3cyclictest30654-21snmpd09:45:541
135729962,3cyclictest30654-21snmpd09:36:531
135729962,3cyclictest30654-21snmpd09:20:411
135729962,3cyclictest30654-21snmpd08:42:281
135729962,3cyclictest30654-21snmpd08:10:121
135729962,3cyclictest30654-21snmpd07:32:591
135729962,3cyclictest29806-21if_err_enp4s010:00:161
135729962,3cyclictest2470-21sed09:05:191
135729962,3cyclictest24428-21expr11:15:221
135729962,3cyclictest2122-21cat07:55:111
135729962,3cyclictest1465-21cat10:30:131
135729962,3cyclictest0-21swapper/112:25:051
135729962,3cyclictest0-21swapper/107:15:081
135729962,2cyclictest19982-21systemd-journal08:52:081
135729962,1cyclictest0-21swapper/112:31:291
135729962,1cyclictest0-21swapper/112:15:431
135729962,1cyclictest0-21swapper/112:11:541
135729962,1cyclictest0-21swapper/111:29:511
135729962,1cyclictest0-21swapper/110:36:211
135729962,1cyclictest0-21swapper/109:15:041
135729960,6cyclictest0-21swapper/111:31:011
135729960,6cyclictest0-21swapper/111:13:271
135729960,2cyclictest20845-21latency_hist07:25:011
135699963,2cyclictest3192-21diskmemload10:10:110
135699963,2cyclictest3192-21diskmemload10:07:020
135699963,2cyclictest30972-21chrt08:57:540
135699963,2cyclictest19740-21ssh10:45:090
135699963,2cyclictest19116-21gdbus08:40:000
135699963,2cyclictest18766-21sh10:17:390
135699963,2cyclictest1603-21taskset11:22:380
135699963,2cyclictest11736-21in:imuxsock08:50:380
135699963,2cyclictest0-21swapper/010:30:220
135699963,2cyclictest0-21swapper/007:55:120
135699963,1cyclictest0-21swapper/012:15:430
135699962,3cyclictest863-21tr11:45:180
135699962,3cyclictest30654-21snmpd08:40:220
135699962,3cyclictest30654-21snmpd08:23:260
135699962,3cyclictest30654-21snmpd08:07:120
135699962,3cyclictest30654-21snmpd08:00:050
135699962,3cyclictest30654-21snmpd07:35:200
135699962,3cyclictest30654-21snmpd07:31:230
135699962,3cyclictest27245-21cut09:30:170
135699962,3cyclictest20566-21expr12:00:130
135699962,3cyclictest20512-21expr09:25:110
135699962,3cyclictest19982-21systemd-journal09:25:000
135699962,3cyclictest19982-21systemd-journal08:15:510
135699962,3cyclictest19982-21systemd-journal07:42:540
135699962,3cyclictest0-21swapper/011:50:030
135699962,1cyclictest0-21swapper/012:25:140
135699962,1cyclictest0-21swapper/011:25:080
135699962,1cyclictest0-21swapper/011:06:390
135699962,1cyclictest0-21swapper/010:55:040
135699961,4cyclictest7795-21sh11:00:270
135699961,3cyclictest7661-21lldpd09:04:410
135699961,3cyclictest19982-21systemd-journal09:50:020
135699961,3cyclictest19982-21systemd-journal09:08:240
135699960,6cyclictest0-21swapper/009:17:360
135699960,4cyclictest19982-21systemd-journal08:33:470
135699960,3cyclictest9744-21rm10:36:050
135699960,3cyclictest784-21rm09:35:330
135699960,3cyclictest26900-21rm12:05:030
135819952,2cyclictest17617-21ssh11:10:053
135819951,3cyclictest13669-21expr08:20:133
135819950,3cyclictest502-21systemd-logind09:40:073
135769952,2cyclictest9564-21taskset09:15:062
135769952,2cyclictest32456-21grep07:50:122
135769952,2cyclictest23484-21cut07:30:142
135769950,4cyclictest21108-21apt-get07:25:112
135729953,1cyclictest27872-21acpi07:40:111
135729952,2cyclictest6800-21cstates08:05:121
135729952,2cyclictest436-21gltestperf07:50:151
135729951,3cyclictest1-21systemd08:30:011
135729950,3cyclictest19982-21systemd-journal07:25:111
135699953,1cyclictest668-21runrttasks08:45:110
135699952,2cyclictest31356-21expr12:30:110
135699952,2cyclictest25921-21readlink10:50:000
135699952,2cyclictest21478-21cat07:25:120
135699952,2cyclictest17919-21ssh11:35:030
135699951,3cyclictest9279-21kworker/0:207:15:010
135699951,2cyclictest29741-11brltty07:12:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional