You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 05:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat Apr 20, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
378498799120,1cyclictest0-21swapper/322:20:103
378498799120,0cyclictest0-21swapper/323:25:123
378498799110,11cyclictest0-21swapper/323:59:573
378498799110,11cyclictest0-21swapper/320:55:203
378498799110,11cyclictest0-21swapper/320:25:153
378498799110,11cyclictest0-21swapper/319:30:013
378498799110,11cyclictest0-21swapper/300:25:123
378498799110,11cyclictest0-21swapper/300:00:193
378498799110,10cyclictest0-21swapper/323:15:143
3784987991010,0cyclictest0-21swapper/322:50:103
3784987991010,0cyclictest0-21swapper/322:05:003
3784987991010,0cyclictest0-21swapper/319:45:133
378498799100,10cyclictest0-21swapper/323:35:533
378498799100,10cyclictest0-21swapper/322:00:013
378498799100,10cyclictest0-21swapper/321:50:103
378498799100,10cyclictest0-21swapper/320:30:113
378498799100,10cyclictest0-21swapper/320:30:103
378498799100,0cyclictest0-21swapper/323:10:163
378498799100,0cyclictest0-21swapper/321:30:163
37849879999,0cyclictest0-21swapper/321:05:013
37849879999,0cyclictest0-21swapper/300:20:113
37849879999,0cyclictest0-21swapper/300:10:113
37849879990,9cyclictest0-21swapper/321:05:133
3784619291,1sleep00-21swapper/019:07:090
37849879988,0cyclictest0-21swapper/323:40:113
37849879988,0cyclictest0-21swapper/323:30:203
37849879988,0cyclictest0-21swapper/322:55:193
37849879988,0cyclictest0-21swapper/319:15:003
37849879980,8cyclictest0-21swapper/323:05:003
37849879980,8cyclictest0-21swapper/319:50:243
37849879980,8cyclictest0-21swapper/319:20:093
37849879980,0cyclictest0-21swapper/322:05:163
37849879980,0cyclictest0-21swapper/300:05:173
13129880,3rtkit-daemon0-21swapper/119:05:061
37849879977,0cyclictest0-21swapper/322:15:023
37849879977,0cyclictest0-21swapper/320:50:093
37849879977,0cyclictest0-21swapper/320:25:013
37849879977,0cyclictest0-21swapper/300:35:223
37849879966,0cyclictest0-21swapper/323:21:053
37849879966,0cyclictest0-21swapper/322:10:253
37849879966,0cyclictest0-21swapper/320:10:183
37849879966,0cyclictest0-21swapper/319:40:203
37849879960,6cyclictest0-21swapper/322:40:003
37849879955,0cyclictest0-21swapper/300:30:103
37849879954,0cyclictest0-21swapper/323:50:013
37849879954,0cyclictest0-21swapper/322:26:253
37849879952,0cyclictest0-21swapper/321:23:203
3784561252,2sleep20-21swapper/219:06:262
3783160250,2sleep30-21swapper/319:05:073
3822103240,0sleep00-21swapper/020:42:340
3794862240,0sleep10-21swapper/119:33:071
37849879944,0cyclictest0-21swapper/322:45:373
37849879944,0cyclictest0-21swapper/322:40:133
37849879944,0cyclictest0-21swapper/321:15:553
37849879940,4cyclictest0-21swapper/323:50:103
37849879940,4cyclictest0-21swapper/321:28:083
37849879940,4cyclictest0-21swapper/320:45:033
37849879940,4cyclictest0-21swapper/320:15:113
37849879940,4cyclictest0-21swapper/320:00:023
37849879940,4cyclictest0-21swapper/319:25:113
37849879940,3cyclictest0-21swapper/323:07:293
37849879940,3cyclictest0-21swapper/321:45:583
37849879940,3cyclictest0-21swapper/321:35:323
37849879940,3cyclictest0-21swapper/319:35:143
37849879940,3cyclictest0-21swapper/300:17:073
37849879940,2cyclictest0-21swapper/321:40:123
37849879940,2cyclictest0-21swapper/320:35:113
37849879940,2cyclictest0-21swapper/320:05:103
37849879940,0cyclictest0-21swapper/319:55:213
13129840,2rtkit-daemon717-21lldpd22:55:491
13129840,2rtkit-daemon717-21lldpd22:09:571
13129840,2rtkit-daemon717-21lldpd22:02:291
13129840,2rtkit-daemon717-21lldpd20:43:471
13129840,2rtkit-daemon538-21systemd-logind00:37:291
13129840,2rtkit-daemon524-21avahi-daemon23:05:111
13129840,2rtkit-daemon3858515-21aten2.4-expect22:10:111
13129840,2rtkit-daemon375-21systemd-udevd21:50:291
13129840,2rtkit-daemon356-21systemd-journal21:43:291
13129840,1rtkit-daemon717-21lldpd20:20:071
13129840,1rtkit-daemon538-21systemd-logind21:47:291
3892463230,0sleep20-21swapper/223:30:012
3890595230,2sleep03890626-21http23:25:110
3835692230,2sleep23835817-21python321:15:172
3802979230,1sleep23803005-21apt-get19:55:212
37849879930,3cyclictest0-21swapper/322:30:013
37849879930,3cyclictest0-21swapper/321:12:493
37849879930,3cyclictest0-21swapper/320:40:073
37849879930,2cyclictest0-21swapper/319:15:133
13129830,2rtkit-daemon3786977-21munin-node00:29:591
13129830,2rtkit-daemon269977-21sendmail-mta21:17:131
13129830,2rtkit-daemon2121-21packagekitd19:20:001
13129830,1rtkit-daemon717-21lldpd23:00:291
13129830,1rtkit-daemon717-21lldpd22:44:141
13129830,1rtkit-daemon717-21lldpd22:37:281
13129830,1rtkit-daemon717-21lldpd22:26:281
13129830,1rtkit-daemon717-21lldpd21:00:231
13129830,1rtkit-daemon717-21lldpd20:18:171
13129830,1rtkit-daemon717-21lldpd00:05:101
13129830,1rtkit-daemon617-21gmain23:46:271
13129830,1rtkit-daemon539-21wpa_supplicant23:15:301
13129830,1rtkit-daemon539-21wpa_supplicant00:32:541
13129830,1rtkit-daemon538-21systemd-logind19:12:291
13129830,1rtkit-daemon490-21rpcbind21:26:131
13129830,1rtkit-daemon3913837-21ssh00:17:461
13129830,1rtkit-daemon3843773-21df21:35:131
13129830,1rtkit-daemon3832470-21diskmemload00:01:561
13129830,1rtkit-daemon3809190-21aten_r1power_vo20:10:111
13129830,1rtkit-daemon3788320-21ntp_states19:15:181
13129830,1rtkit-daemon3786977-21munin-node22:20:421
13129830,1rtkit-daemon375-21systemd-udevd22:50:291
13129830,1rtkit-daemon356-21systemd-journal20:32:291
13129830,1rtkit-daemon356-21systemd-journal20:32:291
13129830,1rtkit-daemon356-21systemd-journal20:26:291
13129830,1rtkit-daemon356-21systemd-journal20:06:521
13129830,1rtkit-daemon3191333-21snmpd23:54:051
13129830,1rtkit-daemon3191333-21snmpd23:28:531
13129830,1rtkit-daemon3191333-21snmpd20:50:541
13129830,1rtkit-daemon3191333-21snmpd20:37:541
13129830,1rtkit-daemon3191333-21snmpd19:25:181
13129830,1rtkit-daemon1-21systemd23:10:201
13129830,1rtkit-daemon1-21systemd22:49:031
13129830,1rtkit-daemon1-21systemd22:33:551
13129830,1rtkit-daemon1-21systemd22:17:221
13129830,1rtkit-daemon1-21systemd21:55:531
13129830,1rtkit-daemon1-21systemd21:21:231
13129830,1rtkit-daemon1-21systemd20:01:581
13129830,1rtkit-daemon1-21systemd00:10:161
13129830,0rtkit-daemon0-21swapper/123:21:511
13129830,0rtkit-daemon0-21swapper/119:55:331
3920552220,0sleep00-21swapper/000:33:260
3917019220,1sleep00-21swapper/000:25:180
3905390220,0sleep20-21swapper/223:58:112
3896714220,1sleep20-21swapper/223:37:532
3894506220,0sleep00-21swapper/023:32:080
3893412220,1sleep13893436-21gltestperf23:30:161
3890168220,0sleep00-21swapper/023:23:310
3885914220,0sleep00-21swapper/023:13:340
3880143220,0sleep00-21swapper/023:00:140
3878076220,1sleep03878272-21df_inode22:55:130
3870797220,1sleep20-21swapper/222:36:382
3860669220,1sleep20-21swapper/222:15:132
3856573220,1sleep23856763-21df22:05:122
3855717220,0sleep00-21swapper/022:01:510
3851764220,1sleep00-21swapper/021:54:220
3847384220,1sleep00-21swapper/021:45:020
3846473220,0sleep00-21swapper/021:40:210
3845926220,1sleep23845997-21awk21:40:162
3844139220,1sleep20-21swapper/221:35:192
3836622220,0sleep00-21swapper/021:19:170
3830272220,1sleep23830327-21apt-config21:05:012
3828100222,0sleep00-21swapper/020:57:060
3811133220,1sleep03811373-21df_inode20:15:120
3808654222,0sleep00-21swapper/020:08:290
3805174220,0sleep23805200-21apt-get20:00:102
3799380220,1sleep03799556-21diskstats19:45:150
3793788220,1sleep03793852-21/usr/sbin/munin19:30:180
3791642220,1sleep03791839-21diskstats19:25:140
13129820,1rtkit-daemon714-21ntpd19:35:181
13129820,1rtkit-daemon3786977-21munin-node19:50:171
13129820,1rtkit-daemon269977-21sendmail-mta23:40:041
13129820,1rtkit-daemon1-21systemd23:55:121
13129820,1rtkit-daemon1-21systemd21:12:431
13129820,1rtkit-daemon1-21systemd20:55:381
13129820,1rtkit-daemon1-21systemd19:46:171
13129820,1rtkit-daemon1-21systemd19:40:061
13129820,0rtkit-daemon0-21swapper/123:35:231
13129820,0rtkit-daemon0-21swapper/121:30:361
13129820,0rtkit-daemon0-21swapper/121:05:151
13129820,0rtkit-daemon0-21swapper/120:45:041
13129820,0rtkit-daemon0-21swapper/100:20:031
3921441210,0sleep00-21swapper/000:35:190
3921121210,0sleep20-21swapper/200:35:172
3919039210,0sleep20-21swapper/200:30:122
3916525210,0sleep20-21swapper/200:25:132
3914372210,0sleep20-21swapper/200:20:082
3914108210,0sleep00-21swapper/000:20:020
3912309210,0sleep20-21swapper/200:15:152
3911993210,0sleep00-21swapper/000:15:010
3910184210,0sleep20-21swapper/200:10:122
3909873210,0sleep00-21swapper/000:10:010
3908265210,0sleep00-21swapper/000:05:130
3908009210,0sleep20-21swapper/200:05:112
3905893210,1sleep20-21swapper/200:00:112
3905887210,0sleep00-21swapper/000:00:090
3903738210,1sleep00-21swapper/023:55:080
3902929210,0sleep00-21swapper/023:50:200
3901624210,0sleep20-21swapper/223:50:102
3900136210,0sleep20-21swapper/223:45:182
3899486210,0sleep00-21swapper/023:45:130
3897231210,0sleep00-21swapper/023:40:070
3896965210,0sleep20-21swapper/223:40:022
3895720210,0sleep00-21swapper/023:35:190
3891212210,0sleep20-21swapper/223:25:182
3888637210,0sleep20-21swapper/223:20:122
3886450210,0sleep20-21swapper/223:15:162
3886346210,0sleep00-21swapper/023:15:150
3884476210,0sleep20-21swapper/223:10:132
3882846210,0sleep20-21swapper/223:05:162
3881900210,0sleep00-21swapper/023:05:020
3879984210,0sleep20-21swapper/223:00:112
3877874210,0sleep20-21swapper/222:55:122
3875824210,0sleep00-21swapper/022:50:130
3875700210,0sleep20-21swapper/222:50:112
3873590210,0sleep20-21swapper/222:45:142
3873573210,0sleep00-21swapper/022:45:050
3871594210,0sleep20-21swapper/222:40:152
3871456210,0sleep00-21swapper/022:40:040
3870390210,0sleep00-21swapper/022:35:200
3867556210,0sleep20-21swapper/222:30:142
3867275210,0sleep00-21swapper/022:30:130
3866661210,0sleep20-21swapper/222:27:302
3865252210,0sleep00-21swapper/022:25:150
3863226210,0sleep00-21swapper/022:20:150
3863090210,0sleep20-21swapper/222:20:132
3862032210,0sleep00-21swapper/022:16:320
3859108210,0sleep20-21swapper/222:10:172
3858461210,0sleep00-21swapper/022:10:100
3857664210,0sleep00-21swapper/022:05:220
3854257210,0sleep20-21swapper/222:00:122
3852193210,0sleep20-21swapper/221:55:172
3852130210,0sleep00-21swapper/021:55:140
3850140210,0sleep20-21swapper/221:50:152
3849044210,0sleep20-21swapper/221:46:272
3843485210,0sleep00-21swapper/021:35:130
3841513210,0sleep00-21swapper/021:30:130
3841236210,0sleep20-21swapper/221:30:102
3839879210,0sleep00-21swapper/021:25:160
3839107210,0sleep20-21swapper/221:25:112
3837877210,0sleep20-21swapper/221:20:222
3837181210,0sleep00-21swapper/021:20:160
3833208210,0sleep00-21swapper/021:10:150
3832457210,0sleep20-21swapper/221:10:022
3832181210,1sleep00-21swapper/021:06:310
3831048210,0sleep20-21swapper/221:05:172
3829091210,0sleep00-21swapper/021:00:160
3826645210,0sleep20-21swapper/220:55:092
3825596210,0sleep20-21swapper/220:50:242
3824747210,0sleep00-21swapper/020:50:100
3822664210,0sleep00-21swapper/020:45:150
3822540210,0sleep20-21swapper/220:45:122
3820646210,0sleep20-21swapper/220:40:132
3819347210,0sleep00-21swapper/020:35:170
3818679210,0sleep20-21swapper/220:35:112
3817490210,0sleep00-21swapper/020:30:180
3817490210,0sleep00-21swapper/020:30:170
3816745210,0sleep20-21swapper/220:30:122
3816745210,0sleep20-21swapper/220:30:112
3814825210,0sleep20-21swapper/220:25:152
3814574210,0sleep00-21swapper/020:25:020
3813404210,0sleep20-21swapper/220:20:142
3810947210,0sleep20-21swapper/220:15:112
3810378210,0sleep00-21swapper/020:10:520
3809469210,0sleep20-21swapper/220:10:142
3807096210,0sleep20-21swapper/220:05:102
3805329210,0sleep00-21swapper/020:00:110
3802957210,1sleep00-21swapper/019:55:030
3802448210,1sleep00-21swapper/019:51:320
3800799210,0sleep20-21swapper/219:50:012
3798877210,0sleep20-21swapper/219:45:022
3797359210,0sleep20-21swapper/219:40:162
3797244210,0sleep00-21swapper/019:40:140
3795865210,0sleep00-21swapper/019:35:190
3795266210,0sleep20-21swapper/219:35:122
3793522210,0sleep20-21swapper/219:30:172
3791897210,0sleep20-21swapper/219:25:162
3790158210,0sleep20-21swapper/219:20:152
3789267210,0sleep00-21swapper/019:20:020
3788284210,0sleep20-21swapper/219:15:202
3788065210,0sleep00-21swapper/019:15:170
3786477210,0sleep00-21swapper/019:10:250
3785254210,0sleep20-21swapper/219:10:152
3814813200,0sleep00-21swapper/020:25:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional