You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-14 - 22:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Sun Apr 14, 2024 00:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3835840991611,1cyclictest0-21swapper/320:40:103
3835840991311,1cyclictest0-21swapper/320:45:083
383584099130,2cyclictest0-21swapper/319:20:103
383584099130,2cyclictest0-21swapper/319:20:093
383584099120,12cyclictest0-21swapper/323:50:013
383584099120,11cyclictest0-21swapper/322:35:083
383584099120,0cyclictest3971270-21sleep00:39:563
383584099110,11cyclictest0-21swapper/323:45:023
383584099110,11cyclictest0-21swapper/323:45:013
383584099110,11cyclictest0-21swapper/321:10:193
383584099110,11cyclictest0-21swapper/320:50:103
383584099110,11cyclictest0-21swapper/320:20:103
383584099110,11cyclictest0-21swapper/319:15:013
383584099110,0cyclictest0-21swapper/322:20:103
383584099110,0cyclictest0-21swapper/321:05:103
3835840991010,0cyclictest0-21swapper/323:30:163
3835840991010,0cyclictest0-21swapper/322:50:093
3835840991010,0cyclictest0-21swapper/322:25:023
3835840991010,0cyclictest0-21swapper/321:00:153
3835840991010,0cyclictest0-21swapper/319:35:103
3835840991010,0cyclictest0-21swapper/319:30:173
383584099100,9cyclictest0-21swapper/320:00:113
383584099100,10cyclictest0-21swapper/322:30:143
383584099100,10cyclictest0-21swapper/320:30:093
383584099100,10cyclictest0-21swapper/320:15:103
383584099100,10cyclictest0-21swapper/300:15:183
383584099100,10cyclictest0-21swapper/300:05:163
383584099100,0cyclictest0-21swapper/322:15:153
383584099100,0cyclictest0-21swapper/321:30:093
38358409999,0cyclictest0-21swapper/322:55:123
38358409990,9cyclictest0-21swapper/323:50:023
38358409990,9cyclictest0-21swapper/323:00:163
38358409990,9cyclictest0-21swapper/321:40:163
38358409990,9cyclictest0-21swapper/300:20:203
38358409988,0cyclictest0-21swapper/322:45:093
38358409977,0cyclictest0-21swapper/322:05:103
38358409977,0cyclictest0-21swapper/300:10:113
38358409970,7cyclictest0-21swapper/323:25:103
38358409970,7cyclictest0-21swapper/322:15:013
38358409970,7cyclictest0-21swapper/322:00:493
38358409970,7cyclictest0-21swapper/321:55:013
38358409970,7cyclictest0-21swapper/321:23:173
38358409970,7cyclictest0-21swapper/319:50:163
13129870,3rtkit-daemon1-21systemd19:08:101
38358409966,0cyclictest0-21swapper/323:14:573
38358409966,0cyclictest0-21swapper/323:07:043
38358409966,0cyclictest0-21swapper/320:39:193
38358409966,0cyclictest0-21swapper/320:25:193
38358409965,1cyclictest0-21swapper/319:25:113
38358409962,4cyclictest0-21swapper/321:57:153
38358409962,4cyclictest0-21swapper/321:48:173
38358409960,6cyclictest0-21swapper/320:55:123
3835656260,3sleep30-21swapper/319:09:563
3833981262,3sleep20-21swapper/219:05:062
38358409955,0cyclictest0-21swapper/321:35:123
38358409951,2cyclictest0-21swapper/323:55:083
38358409950,5cyclictest3891701-21taskset21:29:433
38358409950,5cyclictest0-21swapper/300:00:103
38358409950,4cyclictest0-21swapper/323:23:173
38358409950,4cyclictest0-21swapper/321:15:083
3906370240,0sleep10-21swapper/122:00:271
3867143240,4sleep20-21swapper/220:29:402
38358409944,0cyclictest0-21swapper/323:15:093
38358409944,0cyclictest0-21swapper/300:30:093
38358409940,3cyclictest38480732sleep319:40:103
38358409940,3cyclictest0-21swapper/322:40:213
38358409940,3cyclictest0-21swapper/320:10:083
38358409940,2cyclictest0-21swapper/319:55:113
3833979241,1sleep00-21swapper/019:05:050
13129840,3rtkit-daemon3191333-21snmpd23:04:462
13129840,3rtkit-daemon3191333-21snmpd22:28:372
13129840,2rtkit-daemon717-21lldpd22:48:352
13129840,2rtkit-daemon717-21lldpd21:44:392
13129840,2rtkit-daemon717-21lldpd21:25:531
13129840,2rtkit-daemon717-21lldpd21:17:351
13129840,2rtkit-daemon717-21lldpd00:27:432
13129840,2rtkit-daemon538-21systemd-logind22:32:092
13129840,2rtkit-daemon538-21systemd-logind19:47:291
13129840,2rtkit-daemon375-21systemd-udevd23:58:302
13129840,2rtkit-daemon375-21systemd-udevd21:46:292
13129840,2rtkit-daemon375-21systemd-udevd19:34:301
13129840,2rtkit-daemon356-21systemd-journal23:33:262
13129840,1rtkit-daemon3837838-21munin-node22:41:172
13129840,1rtkit-daemon356-21systemd-journal22:05:292
13129840,1rtkit-daemon356-21systemd-journal20:09:261
3940121230,2sleep13940180-21ntpq23:20:151
3913543230,1sleep23913569-21apt-get22:20:092
3878747230,0sleep00-21swapper/020:55:230
38358409931,1cyclictest0-21swapper/319:45:113
38358409930,3cyclictest0-21swapper/323:35:073
38358409930,3cyclictest0-21swapper/320:05:403
38358409930,2cyclictest0-21swapper/300:25:103
38358409930,0cyclictest0-21swapper/319:15:023
13129830,2rtkit-daemon617-21gmain20:35:121
13129830,2rtkit-daemon3837838-21munin-node23:40:022
13129830,2rtkit-daemon3837838-21munin-node23:40:022
13129830,1rtkit-daemon717-21lldpd23:05:062
13129830,1rtkit-daemon717-21lldpd22:13:072
13129830,1rtkit-daemon717-21lldpd21:23:071
13129830,1rtkit-daemon717-21lldpd21:01:121
13129830,1rtkit-daemon717-21lldpd20:58:361
13129830,1rtkit-daemon717-21lldpd20:22:261
13129830,1rtkit-daemon714-21ntpd22:55:142
13129830,1rtkit-daemon714-21ntpd21:05:091
13129830,1rtkit-daemon539-21wpa_supplicant20:45:191
13129830,1rtkit-daemon539-21wpa_supplicant00:33:402
13129830,1rtkit-daemon524-21avahi-daemon20:40:491
13129830,1rtkit-daemon3926645-21apt-get22:50:092
13129830,1rtkit-daemon3894143-21apt-get21:35:092
13129830,1rtkit-daemon3837838-21munin-node23:50:132
13129830,1rtkit-daemon3837838-21munin-node00:00:132
13129830,1rtkit-daemon3820624-21munin-node19:10:061
13129830,1rtkit-daemon375-21systemd-udevd19:24:301
13129830,1rtkit-daemon375-21systemd-udevd19:24:291
13129830,1rtkit-daemon356-21systemd-journal23:12:272
13129830,1rtkit-daemon356-21systemd-journal22:19:562
13129830,1rtkit-daemon1-21systemd23:47:582
13129830,1rtkit-daemon1-21systemd23:16:322
13129830,1rtkit-daemon1-21systemd21:50:032
13129830,1rtkit-daemon1-21systemd21:13:441
13129830,1rtkit-daemon1-21systemd19:55:061
13129830,1rtkit-daemon1-21systemd00:14:572
13129830,1rtkit-daemon1-21systemd00:07:402
13129830,0rtkit-daemon0-21swapper/200:15:522
3972931220,0sleep00-21swapper/000:36:230
3966917220,0sleep00-21swapper/000:23:500
3966025220,1sleep13966196-21python300:20:201
3962619220,0sleep00-21swapper/000:13:260
3961378220,1sleep13961454-21irqstats00:10:151
3960486220,0sleep00-21swapper/000:08:210
3947406220,0sleep00-21swapper/023:35:550
3937871220,1sleep13938024-21ntp_states23:15:161
3937735220,1sleep03937870-21sort23:15:150
3926619220,1sleep00-21swapper/022:50:090
3920670220,1sleep03920744-21irqstats22:35:120
3913037220,1sleep00-21swapper/022:18:040
3904704220,1sleep00-21swapper/021:59:350
3900015220,0sleep00-21swapper/021:48:020
3896711220,1sleep00-21swapper/021:40:140
3895735220,0sleep00-21swapper/021:37:530
3893664220,0sleep10-21swapper/121:33:171
3893537222,0sleep03865341-21kworker/0:221:32:130
3881506220,0sleep23881532-21apt-get21:05:092
3880556220,1sleep23880815-21sed21:00:172
3879725220,1sleep00-21swapper/021:00:120
3878233220,1sleep23878359-21ntpq20:55:172
3873249220,1sleep23873254-21cron20:45:012
3870131220,1sleep00-21swapper/020:35:130
3867016220,1sleep00-21swapper/020:28:020
3862551220,1sleep23862712-21sed20:15:182
3849753220,1sleep23849982-21cut19:45:022
3848589220,1sleep03848778-21grep19:40:150
3837665220,0sleep00-21swapper/019:15:020
13129820,1rtkit-daemon617-21gmain20:01:251
13129820,1rtkit-daemon3191333-21snmpd20:10:271
13129820,1rtkit-daemon269977-21sendmail-mta21:29:112
13129820,1rtkit-daemon269977-21sendmail-mta20:25:111
13129820,1rtkit-daemon269977-21sendmail-mta19:37:011
13129820,1rtkit-daemon1-21systemd23:35:052
13129820,1rtkit-daemon1-21systemd23:24:562
13129820,1rtkit-daemon1-21systemd22:35:192
13129820,1rtkit-daemon1-21systemd19:50:111
13129820,1rtkit-daemon1-21systemd19:40:091
13129820,1rtkit-daemon1-21systemd19:25:111
13129820,1rtkit-daemon1-21systemd00:35:032
13129820,0rtkit-daemon0-21swapper/223:25:182
13129820,0rtkit-daemon0-21swapper/221:55:252
13129820,0rtkit-daemon0-21swapper/221:30:582
13129820,0rtkit-daemon0-21swapper/200:20:112
13129820,0rtkit-daemon0-21swapper/120:50:031
13129820,0rtkit-daemon0-21swapper/120:30:211
13129820,0rtkit-daemon0-21swapper/120:15:191
13129820,0rtkit-daemon0-21swapper/119:15:141
3971491210,0sleep10-21swapper/100:35:081
3969846210,0sleep10-21swapper/100:30:151
3969669210,0sleep00-21swapper/000:30:140
3967751210,0sleep00-21swapper/000:25:150
3967367210,0sleep10-21swapper/100:25:121
3964411210,0sleep00-21swapper/000:15:370
3963097210,0sleep10-21swapper/100:15:101
3959324210,0sleep13959535-21strings00:05:151
3957552210,0sleep00-21swapper/000:00:170
3956692210,0sleep10-21swapper/100:00:101
3954525210,0sleep00-21swapper/023:55:090
3954517210,0sleep10-21swapper/123:55:061
3952402210,0sleep10-21swapper/123:50:101
3952401210,0sleep00-21swapper/023:50:090
3951139210,0sleep00-21swapper/023:45:160
3950279210,0sleep10-21swapper/123:45:091
3948586210,0sleep00-21swapper/023:40:120
3948586210,0sleep00-21swapper/023:40:120
3948158210,0sleep10-21swapper/123:40:091
3948158210,0sleep10-21swapper/123:40:091
3946172210,0sleep10-21swapper/123:35:121
3943890210,0sleep10-21swapper/123:30:091
3943880210,0sleep00-21swapper/023:30:040
3941694210,0sleep13941931-21df23:25:131
3941491210,0sleep00-21swapper/023:25:040
3940411210,0sleep00-21swapper/023:20:180
3935115210,0sleep10-21swapper/123:10:081
3935109210,0sleep00-21swapper/023:10:030
3933125210,0sleep13933189-21cpu23:05:101
3932748210,0sleep00-21swapper/023:05:010
3930973210,0sleep10-21swapper/123:00:111
3930883210,0sleep00-21swapper/023:00:100
3929612210,0sleep10-21swapper/122:55:191
3928485210,0sleep00-21swapper/022:55:020
3926611210,0sleep10-21swapper/122:50:061
3925826210,0sleep00-21swapper/022:45:250
3924246210,0sleep10-21swapper/122:45:021
3922102210,0sleep10-21swapper/122:40:021
3919975210,0sleep10-21swapper/122:35:011
3918163210,0sleep10-21swapper/122:30:101
3918104210,0sleep00-21swapper/022:30:090
3916721210,0sleep10-21swapper/122:25:211
3915990210,0sleep00-21swapper/022:25:120
3913970210,0sleep10-21swapper/122:20:121
3913532210,0sleep00-21swapper/022:20:030
3912829210,0sleep10-21swapper/122:16:171
3910597210,0sleep00-21swapper/022:10:190
3909705210,0sleep10-21swapper/122:10:121
3907765210,0sleep00-21swapper/022:05:140
3907281210,0sleep10-21swapper/122:05:111
3905059210,0sleep00-21swapper/022:00:110
3902982210,0sleep10-21swapper/121:55:121
3900574210,0sleep10-21swapper/121:50:101
3900512210,0sleep00-21swapper/021:50:090
3898478210,0sleep10-21swapper/121:45:101
3896305210,0sleep10-21swapper/121:40:111
3894118210,0sleep10-21swapper/121:35:091
3891125210,0sleep00-21swapper/021:25:210
3887859210,0sleep20-21swapper/221:20:142
3887737210,0sleep00-21swapper/021:20:120
3885799210,0sleep00-21swapper/021:15:120
3885598210,0sleep20-21swapper/221:15:092
3884789210,0sleep20-21swapper/221:10:342
3883799210,0sleep00-21swapper/021:10:120
3882986210,0sleep00-21swapper/021:07:270
3875855210,0sleep20-21swapper/220:50:122
3875460210,0sleep00-21swapper/020:50:100
3874798210,0sleep00-21swapper/020:45:190
3873921210,0sleep20-21swapper/220:45:122
3872865210,0sleep00-21swapper/020:40:180
3869873210,0sleep20-21swapper/220:35:112
3868675210,0sleep00-21swapper/020:30:180
3867852210,0sleep20-21swapper/220:30:112
3865005210,1sleep00-21swapper/020:21:570
3863591210,0sleep20-21swapper/220:20:102
3861357210,0sleep00-21swapper/020:15:010
3861310210,0sleep20-21swapper/220:14:272
3859427210,0sleep00-21swapper/020:10:010
3858554210,0sleep00-21swapper/020:05:160
3857603210,0sleep20-21swapper/220:05:022
3857027210,0sleep00-21swapper/020:00:240
3856429210,0sleep20-21swapper/220:00:172
3854442210,0sleep20-21swapper/219:55:182
3854311210,0sleep00-21swapper/019:55:160
3852986210,0sleep00-21swapper/019:50:190
3852310210,0sleep20-21swapper/219:50:132
3850815210,0sleep00-21swapper/019:45:200
3850521210,0sleep20-21swapper/219:45:172
3846929210,0sleep20-21swapper/219:35:162
3846636210,0sleep00-21swapper/019:35:140
3844988210,0sleep20-21swapper/219:30:162
3844214210,0sleep00-21swapper/019:30:110
3843640210,1sleep00-21swapper/019:26:150
3842833210,0sleep20-21swapper/219:25:162
3841417210,0sleep00-21swapper/019:20:220
3841417210,0sleep00-21swapper/019:20:210
3840560210,0sleep20-21swapper/219:20:112
3840560210,0sleep20-21swapper/219:20:112
3838464210,0sleep20-21swapper/219:15:122
3837234210,0sleep20-21swapper/219:10:192
13129810,0rtkit-daemon0-21swapper/222:00:012
3922366200,0sleep00-21swapper/022:40:050
3835665200,0sleep00-21swapper/019:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional