You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-11 - 17:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Wed Dec 11, 2024 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89642284251,20sleep20-21swapper/207:06:482
89322283227,44sleep00-21swapper/007:06:220
89172271236,20sleep30-21swapper/307:06:133
89992265207,18sleep10-21swapper/107:07:161
70142620,0sleep30-21swapper/309:15:193
210752620,0sleep30-21swapper/310:35:123
91162600,0sleep20-21swapper/212:03:082
326422590,0sleep20-21swapper/210:47:482
188892590,0sleep30-21swapper/309:26:563
97802570,0sleep30-21swapper/310:58:103
222392550,0sleep30-21swapper/308:45:203
252332460,0sleep20-21swapper/209:33:402
308722190,0sleep10-21swapper/111:54:301
211862160,0sleep10-21swapper/112:13:041
93489995,3cyclictest19982-21systemd-journal12:08:183
93359994,3cyclictest19982-21systemd-journal12:12:330
93359994,3cyclictest19982-21systemd-journal09:32:450
93489985,2cyclictest30654-21snmpd11:54:293
93489984,3cyclictest19982-21systemd-journal09:47:413
93489983,3cyclictest502-21systemd-logind12:17:083
93489983,3cyclictest19982-21systemd-journal11:46:413
93489983,3cyclictest19982-21systemd-journal09:51:333
93439984,3cyclictest19982-21systemd-journal09:03:332
93439984,3cyclictest19982-21systemd-journal08:14:182
93439984,3cyclictest19982-21systemd-journal07:25:312
93359984,3cyclictest6706-21cron10:20:000
93359984,3cyclictest19982-21systemd-journal10:58:420
23998280,0sleep00-21swapper/010:02:380
93489974,2cyclictest11736-21in:imuxsock11:40:013
93489973,3cyclictest6712-21cron10:20:003
93489973,3cyclictest508-21dbus-daemon08:20:353
93489973,3cyclictest19982-21systemd-journal10:51:183
93489973,3cyclictest10086-21sshd10:22:443
93489973,2cyclictest19982-21systemd-journal11:00:023
93489972,3cyclictest502-21systemd-logind12:11:183
93489972,3cyclictest19982-21systemd-journal12:03:183
93489972,3cyclictest19982-21systemd-journal09:58:133
93489972,3cyclictest19982-21systemd-journal07:35:573
93489971,2cyclictest30654-21snmpd07:50:023
93439974,2cyclictest508-21dbus-daemon10:19:302
93439974,2cyclictest19116-21gdbus07:55:012
93439973,3cyclictest508-21dbus-daemon11:02:532
93439973,3cyclictest30654-21snmpd08:57:572
93439973,3cyclictest19982-21systemd-journal10:03:102
93439973,3cyclictest1-21systemd08:26:252
93439973,3cyclictest12108-21diskstats09:20:142
93439973,2cyclictest20523-21systemd-udevd12:28:192
93439973,2cyclictest19982-21systemd-journal11:40:012
93439973,1cyclictest0-21swapper/212:39:102
93439973,1cyclictest0-21swapper/212:13:442
93439973,1cyclictest0-21swapper/210:12:102
93439973,1cyclictest0-21swapper/209:59:042
93439972,3cyclictest19982-21systemd-journal11:14:082
93439971,4cyclictest19982-21systemd-journal10:57:022
93439971,3cyclictest11528-21basename07:15:012
93439970,4cyclictest3039-21perf08:05:002
93439970,4cyclictest15178-21ls09:55:012
93399974,2cyclictest2672-21sshd12:24:181
93399973,3cyclictest7609-21users09:15:211
93399973,3cyclictest508-21dbus-daemon11:35:011
93399973,3cyclictest508-21dbus-daemon11:35:011
93399973,3cyclictest22-21ksoftirqd/108:28:561
93399973,3cyclictest21350-21cron07:35:011
93399973,3cyclictest19982-21systemd-journal10:41:191
93399973,3cyclictest19982-21systemd-journal08:36:191
93399973,3cyclictest1628-21users09:10:191
93399973,3cyclictest0-21swapper/111:36:041
93399973,3cyclictest0-21swapper/109:55:091
93399973,2cyclictest19982-21systemd-journal12:09:551
93399973,2cyclictest19982-21systemd-journal08:58:181
93399973,1cyclictest0-21swapper/109:32:431
93399972,3cyclictest19982-21systemd-journal09:28:101
93399972,3cyclictest19982-21systemd-journal08:53:011
93399972,3cyclictest19982-21systemd-journal07:45:071
93399970,2cyclictest12107-21diskstats09:20:141
93359976,1cyclictest12-21ksoftirqd/011:10:010
93359976,1cyclictest12-21ksoftirqd/008:20:000
93359975,1cyclictest4216-21idleruntime-cro09:45:010
93359975,1cyclictest11718-21gltestperf11:00:140
93359974,2cyclictest11736-21in:imuxsock09:55:010
93359973,3cyclictest24404-21ntpq12:15:180
93359973,3cyclictest19982-21systemd-journal11:38:040
93359973,3cyclictest19982-21systemd-journal10:22:440
93359973,3cyclictest19982-21systemd-journal09:40:010
93359973,3cyclictest19982-21systemd-journal09:40:010
93359973,3cyclictest19982-21systemd-journal08:53:320
93359973,3cyclictest19982-21systemd-journal08:21:250
93359973,2cyclictest19982-21systemd-journal07:55:010
93359972,4cyclictest0-21swapper/010:45:110
93359972,3cyclictest19982-21systemd-journal10:14:190
93359972,3cyclictest19982-21systemd-journal08:05:340
93359972,2cyclictest29322-21perf10:45:010
93359971,3cyclictest20870-21perf08:45:000
93359970,7cyclictest0-21swapper/012:35:080
93359970,3cyclictest25010-21grep11:15:010
93359970,2cyclictest19982-21systemd-journal12:35:000
93489963,2cyclictest668-21runrttasks08:07:243
93489963,2cyclictest32611-21sshd10:47:463
93489963,2cyclictest30654-21snmpd08:00:203
93489963,2cyclictest22579-21ssh10:00:333
93489963,2cyclictest19211-21expr08:40:133
93489963,2cyclictest16148-21cut11:05:123
93489962,3cyclictest32081-21cat09:40:143
93489962,3cyclictest31889-21cat10:10:143
93489962,3cyclictest31466-21smart_sda11:20:213
93489962,3cyclictest30654-21snmpd12:31:093
93489962,3cyclictest30654-21snmpd12:25:153
93489962,3cyclictest30654-21snmpd11:55:113
93489962,3cyclictest30654-21snmpd10:26:303
93489962,3cyclictest30654-21snmpd10:07:153
93489962,3cyclictest30654-21snmpd09:05:553
93489962,3cyclictest30654-21snmpd09:01:283
93489962,3cyclictest30654-21snmpd08:55:153
93489962,3cyclictest30654-21snmpd08:54:003
93489962,3cyclictest30654-21snmpd07:55:383
93489962,3cyclictest30654-21snmpd07:47:403
93489962,3cyclictest30654-21snmpd07:30:373
93489962,3cyclictest30654-21snmpd07:25:133
93489962,3cyclictest30654-21snmpd07:22:573
93489962,3cyclictest25853-21grep11:15:173
93489962,3cyclictest25466-21sensors07:40:173
93489962,3cyclictest21898-21sensors11:10:193
93489962,3cyclictest17324-21cat08:35:163
93489962,3cyclictest15590-21expr12:35:153
93489962,3cyclictest0-21swapper/311:42:023
93489962,1cyclictest0-21swapper/311:30:163
93489962,1cyclictest0-21swapper/311:30:163
93489962,1cyclictest0-21swapper/309:30:133
93489962,1cyclictest0-21swapper/309:22:233
93489961,4cyclictest10215-21cat07:10:163
93489961,3cyclictest7661-21lldpd09:36:103
93489961,3cyclictest7661-21lldpd09:36:103
93489961,1cyclictest16223-21apt-get10:30:093
93489960,6cyclictest0-21swapper/312:21:213
93489960,5cyclictest32566-21expr09:10:113
93489960,5cyclictest3035-21/usr/sbin/munin11:25:153
93489960,5cyclictest26335-21head10:40:183
93489960,5cyclictest14601-21cpuspeed_turbos08:30:113
93489960,0cyclictest0-21swapper/307:17:303
93439966,0cyclictest0-21swapper/210:05:172
93439966,0cyclictest0-21swapper/209:35:052
93439966,0cyclictest0-21swapper/209:35:052
93439963,2cyclictest668-21runrttasks11:15:192
93439963,2cyclictest508-21dbus-daemon08:48:072
93439963,2cyclictest30654-21snmpd11:48:232
93439963,2cyclictest28791-21sh11:51:502
93439963,2cyclictest27505-21cut07:45:182
93439963,2cyclictest26133-21cat10:40:172
93439963,2cyclictest24093-21ssh10:38:292
93439963,2cyclictest19182-21ssh10:32:302
93439963,2cyclictest14804-21df08:30:122
93439963,2cyclictest11736-21in:imuxsock07:34:422
93439963,2cyclictest11497-21fschecks_time12:05:152
93439962,3cyclictest508-21dbus-daemon11:30:072
93439962,3cyclictest508-21dbus-daemon11:30:072
93439962,3cyclictest508-21dbus-daemon09:48:372
93439962,3cyclictest30654-21snmpd11:40:022
93439962,3cyclictest30654-21snmpd11:20:322
93439962,3cyclictest30654-21snmpd09:12:492
93439962,3cyclictest30654-21snmpd08:52:332
93439962,3cyclictest30654-21snmpd08:43:122
93439962,3cyclictest30654-21snmpd07:57:052
93439962,3cyclictest30404-21cat12:20:142
93439962,3cyclictest2684-21ntpq10:50:122
93439962,3cyclictest19982-21systemd-journal08:17:292
93439962,3cyclictest16848-21seq08:35:132
93439962,3cyclictest16657-21cat11:05:152
93439962,3cyclictest12695-21ntpq10:25:162
93439962,3cyclictest10175-21expr08:20:122
93439962,1cyclictest0-21swapper/212:31:212
93439962,1cyclictest0-21swapper/212:15:132
93439962,1cyclictest0-21swapper/211:25:222
93439961,4cyclictest0-21swapper/209:29:272
93439961,3cyclictest19982-21systemd-journal09:41:322
93439961,3cyclictest19982-21systemd-journal07:20:312
93439960,3cyclictest9483-21sshd09:17:372
93399966,0cyclictest0-21swapper/111:20:081
93399965,1cyclictest0-21swapper/111:28:481
93399963,2cyclictest9520-21taskset07:10:021
93399963,2cyclictest6686-21ssh09:45:461
93399963,2cyclictest668-21runrttasks09:04:341
93399963,2cyclictest6111-21sh08:10:141
93399963,2cyclictest508-21dbus-daemon07:30:011
93399963,2cyclictest30654-21snmpd12:30:161
93399963,2cyclictest30654-21snmpd10:15:031
93399963,2cyclictest30654-21snmpd09:40:291
93399963,2cyclictest24738-21grep07:40:121
93399963,2cyclictest21523-21fschecks_count08:45:151
93399963,2cyclictest11736-21in:imuxsock09:05:131
93399962,3cyclictest508-21dbus-daemon08:07:141
93399962,3cyclictest32604-21awk10:10:191
93399962,3cyclictest30779-21seq07:52:391
93399962,3cyclictest30654-21snmpd12:00:121
93399962,3cyclictest30654-21snmpd10:35:461
93399962,3cyclictest30654-21snmpd10:21:541
93399962,3cyclictest30654-21snmpd08:04:111
93399962,3cyclictest30654-21snmpd07:55:021
93399962,3cyclictest30654-21snmpd07:35:221
93399962,3cyclictest21499-21cat10:00:141
93399962,3cyclictest20016-21sshd11:42:491
93399962,3cyclictest19859-21ntpq08:40:171
93399962,3cyclictest16559-21seq07:20:521
93399962,3cyclictest16406-21grep10:30:101
93399962,3cyclictest15102-21cat08:30:141
93399962,3cyclictest0-21swapper/112:15:221
93399962,1cyclictest0-21swapper/112:35:351
93399962,1cyclictest0-21swapper/111:55:281
93399962,1cyclictest0-21swapper/111:46:571
93399962,1cyclictest0-21swapper/111:11:161
93399962,1cyclictest0-21swapper/111:02:441
93399962,1cyclictest0-21swapper/110:56:251
93399962,1cyclictest0-21swapper/109:52:121
93399961,3cyclictest19982-21systemd-journal10:50:471
93399961,3cyclictest19982-21systemd-journal10:45:461
93399961,3cyclictest19982-21systemd-journal07:16:211
93399960,6cyclictest0-21swapper/111:05:421
93399960,2cyclictest26129-21irqstats11:15:181
93399960,0cyclictest0-21swapper/110:05:191
93359964,1cyclictest22784-21ntp_states11:45:160
93359963,2cyclictest508-21dbus-daemon10:37:510
93359963,2cyclictest32758-21ntp_states11:55:210
93359963,2cyclictest19982-21systemd-journal07:40:010
93359963,2cyclictest16618-21df10:30:100
93359963,2cyclictest11736-21in:imuxsock07:15:010
93359963,2cyclictest1045-21cut09:10:160
93359962,3cyclictest7661-21lldpd07:59:290
93359962,3cyclictest6692-21cat12:00:230
93359962,3cyclictest6501-21pluginstate08:10:170
93359962,3cyclictest4011-21expr12:25:120
93359962,3cyclictest30654-21snmpd12:06:360
93359962,3cyclictest30654-21snmpd11:25:050
93359962,3cyclictest30654-21snmpd10:05:180
93359962,3cyclictest30654-21snmpd09:49:060
93359962,3cyclictest30654-21snmpd09:15:130
93359962,3cyclictest30654-21snmpd08:25:110
93359962,3cyclictest30654-21snmpd07:29:010
93359962,3cyclictest29668-21apt-get12:20:110
93359962,3cyclictest24212-21gdbus07:40:000
93359962,3cyclictest17616-21ntpq08:35:180
93359962,3cyclictest17559-21cat11:40:140
93359961,3cyclictest19982-21systemd-journal09:55:430
93359961,3cyclictest19982-21systemd-journal09:26:550
93359961,3cyclictest19982-21systemd-journal09:05:130
93359961,3cyclictest19982-21systemd-journal07:11:200
93359960,4cyclictest19982-21systemd-journal08:55:180
93359960,4cyclictest19982-21systemd-journal08:03:040
93359960,3cyclictest9023-21rm11:30:190
93359960,3cyclictest9023-21rm11:30:190
93359960,3cyclictest13771-21rm09:21:360
93359960,3cyclictest11642-21rm10:25:030
93359960,2cyclictest26370-21/usr/sbin/munin11:50:200
93359960,0cyclictest0-21swapper/011:22:000
93359960,0cyclictest0-21swapper/011:17:180
93489952,2cyclictest30654-21snmpd08:10:023
93489951,3cyclictest508-21dbus-daemon08:15:103
93489951,3cyclictest12215-21apt-get08:25:123
93439953,1cyclictest668-21runrttasks08:05:072
93439953,1cyclictest24685-21fschecks_count07:40:122
93439952,2cyclictest30208-21cut09:05:132
93439952,2cyclictest21743-21tr07:35:122
93439951,3cyclictest7329-21cstates10:20:152
93439951,3cyclictest11968-21apt-config07:15:012
93439951,3cyclictest0-21swapper/211:55:182
93399952,2cyclictest9957-21seq08:20:061
93399952,2cyclictest8159-21tune2fs08:15:141
93399952,2cyclictest3676-21ssh12:25:061
93399952,2cyclictest26562-21rm09:35:051
93399952,2cyclictest26562-21rm09:35:051
93399952,2cyclictest12144-21forks10:25:131
93359952,2cyclictest30654-21snmpd09:00:090
93359952,2cyclictest30654-21snmpd07:45:100
93359952,2cyclictest21317-21cat08:45:140
93359952,2cyclictest2011-21expr10:50:080
93359952,2cyclictest20027-21basename07:30:140
93359952,2cyclictest16088-21sendmail_mailqu07:20:200
93359952,2cyclictest14426-21basename08:30:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional