You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-07 - 12:03

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Jul 07, 2022 00:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39080052500,0sleep40-21swapper/423:39:414
3688551991614,1cyclictest1010-21snmpd21:21:467
368855199140,1cyclictest3821423-21ssh22:11:407
3688551991311,1cyclictest1010-21snmpd22:37:247
368855199130,13cyclictest0-21swapper/721:43:087
368855199130,13cyclictest0-21swapper/721:43:087
3688550991313,0cyclictest0-21swapper/623:43:286
3688548991313,0cyclictest0-21swapper/520:09:405
3688548991313,0cyclictest0-21swapper/520:09:405
368854899130,13cyclictest0-21swapper/522:34:335
3688551991211,1cyclictest1010-21snmpd19:32:567
368855099120,0cyclictest0-21swapper/621:41:266
368855099120,0cyclictest0-21swapper/621:41:266
368854899128,4cyclictest0-21swapper/500:03:355
3688548991212,0cyclictest0-21swapper/523:33:215
368855199118,2cyclictest1010-21snmpd19:27:147
3688551991111,0cyclictest0-21swapper/723:59:597
368855099110,11cyclictest0-21swapper/620:10:376
368855099110,11cyclictest0-21swapper/620:10:376
3688548991111,0cyclictest0-21swapper/523:42:585
3688548991111,0cyclictest0-21swapper/520:39:465
3688547991111,0cyclictest0-21swapper/423:59:464
3688547991111,0cyclictest0-21swapper/421:23:134
368855199108,1cyclictest1010-21snmpd23:39:587
368855199108,1cyclictest1010-21snmpd20:34:427
368855199107,2cyclictest1010-21snmpd20:39:307
368855099105,4cyclictest17515-21llvmpipe-319:30:196
3688548991010,0cyclictest0-21swapper/521:42:125
3688548991010,0cyclictest0-21swapper/521:42:125
3688547991010,0cyclictest0-21swapper/422:36:034
3688547991010,0cyclictest0-21swapper/421:42:554
3688547991010,0cyclictest0-21swapper/421:42:554
3688547991010,0cyclictest0-21swapper/420:36:334
368854799100,10cyclictest0-21swapper/420:39:524
36885519995,2cyclictest17584-10wireplumber22:29:207
36885509999,0cyclictest0-21swapper/623:31:296
36885519984,2cyclictest17584-10wireplumber23:29:387
36885519984,2cyclictest17584-10wireplumber22:59:207
36885509988,0cyclictest0-21swapper/622:36:466
36885509988,0cyclictest0-21swapper/620:34:456
36885489988,0cyclictest0-21swapper/522:14:035
36885489988,0cyclictest0-21swapper/521:19:405
36885489988,0cyclictest0-21swapper/520:36:285
36885519975,1cyclictest1010-21snmpd00:14:207
36885519974,2cyclictest3725607-21cat20:09:337
36885519974,2cyclictest3725607-21cat20:09:337
36885519974,1cyclictest793-21systemd-logind23:24:207
36885519974,1cyclictest553-21systemd-journal23:09:207
36885519974,1cyclictest553-21systemd-journal22:44:207
36885519974,1cyclictest553-21systemd-journal19:44:207
36885519973,2cyclictest17584-10wireplumber00:34:207
36885509977,0cyclictest0-21swapper/621:21:536
36885509977,0cyclictest0-21swapper/600:01:456
36885489977,0cyclictest0-21swapper/519:26:465
36885479977,0cyclictest0-21swapper/423:34:144
36885519964,1cyclictest776-21dbus-daemon00:24:207
36885519964,1cyclictest3747841-21true20:49:207
36885519963,1cyclictest794-21systemd-machine19:24:217
36885519963,1cyclictest794-21systemd-machine00:09:197
36885519963,1cyclictest793-21systemd-logind21:14:217
36885519963,1cyclictest17584-10wireplumber22:19:207
36885519962,3cyclictest3954625-21systemd-run00:29:207
36885519962,2cyclictest553-21systemd-journal21:09:207
36885519962,2cyclictest3925169-40updatedb23:59:217
36885519962,2cyclictest17584-10wireplumber23:04:207
36885509966,0cyclictest0-21swapper/622:13:366
36885489960,5cyclictest0-21swapper/500:24:205
36885479966,0cyclictest0-21swapper/422:11:284
36885479966,0cyclictest0-21swapper/419:33:014
36885479962,3cyclictest0-21swapper/423:24:204
36885519953,1cyclictest3906157-21cut23:39:207
36885519953,1cyclictest3906157-21cut23:39:207
36885519953,1cyclictest3754040-21date20:59:217
36885519952,2cyclictest3842206-21cron22:34:207
36885519952,2cyclictest3803632-21date21:54:207
36885519952,2cyclictest3803632-21date21:54:207
36885519952,2cyclictest3736204-21latency_hist20:29:217
36885519952,2cyclictest3733313-21date20:24:207
36885519952,1cyclictest17584-10wireplumber23:49:207
36885519951,2cyclictest3718467-21awk19:59:207
36885519951,2cyclictest17584-10wireplumber21:29:207
36885519951,2cyclictest17584-10wireplumber21:04:207
36885519950,3cyclictest553-21systemd-journal23:54:207
36885519950,3cyclictest553-21systemd-journal23:29:207
36885519950,3cyclictest553-21systemd-journal23:19:207
36885519950,3cyclictest553-21systemd-journal21:49:207
36885519950,3cyclictest553-21systemd-journal20:19:207
36885519950,3cyclictest553-21systemd-journal20:04:217
36885519950,3cyclictest553-21systemd-journal19:54:207
36885519950,3cyclictest553-21systemd-journal19:39:207
36885519950,2cyclictest553-21systemd-journal19:14:217
36885509955,0cyclictest0-21swapper/620:41:226
36885489950,5cyclictest0-21swapper/523:19:195
36885489950,5cyclictest0-21swapper/522:34:205
36885489950,5cyclictest0-21swapper/522:04:205
36885489950,5cyclictest0-21swapper/521:49:205
36885489950,5cyclictest0-21swapper/521:34:205
36885489950,5cyclictest0-21swapper/521:04:205
36885489950,5cyclictest0-21swapper/520:54:205
36885489950,5cyclictest0-21swapper/520:34:215
36885489950,5cyclictest0-21swapper/520:19:205
36885489950,5cyclictest0-21swapper/520:04:215
36885489950,5cyclictest0-21swapper/519:59:205
36885489950,5cyclictest0-21swapper/519:29:235
36885489950,5cyclictest0-21swapper/519:24:215
36885489950,5cyclictest0-21swapper/519:14:205
36885489950,1cyclictest0-21swapper/523:09:205
36885479955,0cyclictest0-21swapper/420:12:074
36885479955,0cyclictest0-21swapper/420:12:074
36885479952,2cyclictest0-21swapper/400:24:204
36885479951,3cyclictest17518-21llvmpipe-619:25:194
36885519942,1cyclictest3964566-21cut00:39:207
36885519940,3cyclictest3944839-21latency_hist00:19:197
36885519940,3cyclictest3881668-21cut23:14:207
36885519940,3cyclictest3862362-21latency_hist22:54:207
36885519940,3cyclictest3857202-21latency_hist22:49:207
36885519940,3cyclictest3832859-21date22:24:207
36885519940,3cyclictest3818440-21date22:09:207
36885519940,3cyclictest3808117-21/usr/sbin/munin21:59:207
36885519940,3cyclictest3788888-21date21:39:207
36885519940,3cyclictest3783985-21date21:34:207
36885519940,3cyclictest3769413-21cat21:19:207
36885519940,3cyclictest3769413-21cat21:19:207
36885519940,3cyclictest3750787-21cat20:54:207
36885519940,3cyclictest3739002-21crond20:34:207
36885519940,3cyclictest3724470-21cat20:09:207
36885519940,3cyclictest3712879-21date19:49:217
36885519940,3cyclictest3695098-21latency_hist19:19:217
36885519940,3cyclictest3688578-21latency_hist19:09:217
36885519940,2cyclictest17584-10wireplumber22:04:207
36885509940,3cyclictest3700359-21chrt19:27:276
36885489944,0cyclictest0-21swapper/523:59:215
36885489944,0cyclictest0-21swapper/523:24:205
36885489944,0cyclictest0-21swapper/523:04:205
36885489944,0cyclictest0-21swapper/522:49:205
36885489944,0cyclictest0-21swapper/521:14:215
36885489944,0cyclictest0-21swapper/519:39:205
36885489944,0cyclictest0-21swapper/500:34:205
36885489944,0cyclictest0-21swapper/500:29:205
36885489944,0cyclictest0-21swapper/500:19:195
36885489943,1cyclictest0-21swapper/522:29:205
36885489942,1cyclictest3779097-21turbostat21:29:205
36885489940,4cyclictest0-21swapper/523:54:205
36885489940,4cyclictest0-21swapper/523:29:205
36885489940,4cyclictest0-21swapper/522:24:205
36885489940,4cyclictest0-21swapper/520:29:215
36885489940,0cyclictest0-21swapper/523:39:205
36885489940,0cyclictest0-21swapper/523:39:205
36885489940,0cyclictest0-21swapper/522:44:205
36885479941,2cyclictest17514-21llvmpipe-219:49:214
36885479940,3cyclictest3697913-21chrt19:24:204
36885479940,3cyclictest0-21swapper/422:34:204
36885509930,3cyclictest0-21swapper/600:19:206
36885509930,2cyclictest3759575-21taskset21:09:206
36885489933,0cyclictest0-21swapper/522:59:205
36885489933,0cyclictest0-21swapper/522:19:205
36885489933,0cyclictest0-21swapper/521:54:205
36885489933,0cyclictest0-21swapper/521:54:205
36885489933,0cyclictest0-21swapper/519:54:205
36885489933,0cyclictest0-21swapper/500:39:205
36885489930,3cyclictest0-21swapper/522:09:205
36885489930,3cyclictest0-21swapper/519:09:215
36885489930,0cyclictest0-21swapper/521:39:205
36885479930,3cyclictest0-21swapper/419:54:204
36885479930,2cyclictest3813237-21chrt22:04:204
36885479930,2cyclictest3759560-21turbostat21:09:204
36885479930,2cyclictest3739009-21turbostat20:34:204
36885479930,2cyclictest0-21swapper/420:19:204
36885479930,1cyclictest0-21swapper/422:59:204
36885509922,0cyclictest0-21swapper/623:59:216
36885509922,0cyclictest0-21swapper/621:54:206
36885509922,0cyclictest0-21swapper/621:54:206
36885509922,0cyclictest0-21swapper/621:49:206
36885509922,0cyclictest0-21swapper/620:34:206
36885509921,1cyclictest12950irq/27-ahci[00023:09:206
36885509921,1cyclictest12950irq/27-ahci[00022:44:206
36885509921,1cyclictest12950irq/27-ahci[00021:34:206
36885509921,1cyclictest12950irq/27-ahci[00021:29:206
36885509921,1cyclictest12950irq/27-ahci[00021:04:206
36885509921,1cyclictest12950irq/27-ahci[00020:59:216
36885509921,1cyclictest12950irq/27-ahci[00020:49:206
36885509921,1cyclictest12950irq/27-ahci[00019:24:216
36885509921,1cyclictest12950irq/27-ahci[00019:09:216
36885509921,1cyclictest12950irq/27-ahci[00000:14:206
36885509921,1cyclictest12950irq/27-ahci[00000:09:206
36885509920,2cyclictest3813249-21turbostat22:04:206
36885509920,2cyclictest3715516-21turbostat19:54:206
36885509920,2cyclictest0-21swapper/620:04:216
36885509920,2cyclictest0-21swapper/619:44:216
36885509920,2cyclictest0-21swapper/600:29:206
36885509920,1cyclictest3949723-21turbostat00:24:206
36885509920,1cyclictest3891311-21turbostat23:24:206
36885509920,1cyclictest3866922-21turbostat22:59:206
36885509920,1cyclictest3837672-21turbostat22:29:206
36885509920,1cyclictest3718450-21turbostat19:59:206
36885489922,0cyclictest0-21swapper/521:09:215
36885489920,2cyclictest0-21swapper/521:19:205
36885489920,2cyclictest0-21swapper/521:19:205
36885489920,1cyclictest0-21swapper/523:14:205
36885479920,2cyclictest0-21swapper/423:39:204
36885479920,2cyclictest0-21swapper/423:39:204
36885479920,2cyclictest0-21swapper/421:29:204
36885479920,2cyclictest0-21swapper/420:24:204
36885479920,1cyclictest3915589-21turbostat23:49:194
36885479920,1cyclictest3896181-21turbostat23:29:204
36885479920,1cyclictest3886434-21turbostat23:19:204
36885479920,1cyclictest3718450-21turbostat19:59:204
36885479920,1cyclictest0-21swapper/422:44:204
3768973210,0sleep40-21swapper/421:19:204
3768973210,0sleep40-21swapper/421:19:204
36885509911,0cyclictest0-21swapper/619:39:206
36885509910,1cyclictest3915589-21turbostat23:49:196
36885509910,1cyclictest3896181-21turbostat23:29:206
36885509910,1cyclictest3758931-1kworker/u17:021:14:216
36885509910,1cyclictest12950irq/27-ahci[00023:14:206
36885509910,1cyclictest12950irq/27-ahci[00022:24:206
36885509910,1cyclictest12950irq/27-ahci[00022:19:206
36885509910,1cyclictest12950irq/27-ahci[00021:39:206
36885509910,1cyclictest12950irq/27-ahci[00020:54:206
36885509910,1cyclictest12950irq/27-ahci[00020:24:206
36885509910,1cyclictest12950irq/27-ahci[00020:09:206
36885509910,1cyclictest12950irq/27-ahci[00019:14:216
36885509910,1cyclictest0-21swapper/623:54:206
36885509910,1cyclictest0-21swapper/623:39:206
36885509910,1cyclictest0-21swapper/623:39:206
36885509910,1cyclictest0-21swapper/623:19:196
36885509910,1cyclictest0-21swapper/623:04:206
36885509910,1cyclictest0-21swapper/622:49:206
36885509910,1cyclictest0-21swapper/622:34:206
36885509910,1cyclictest0-21swapper/621:59:206
36885509910,1cyclictest0-21swapper/621:19:206
36885509910,1cyclictest0-21swapper/621:19:206
36885509910,1cyclictest0-21swapper/620:29:216
36885509910,1cyclictest0-21swapper/620:19:206
36885509910,1cyclictest0-21swapper/619:49:216
36885509910,1cyclictest0-21swapper/619:19:216
36885509910,1cyclictest0-21swapper/600:39:206
36885509910,1cyclictest0-21swapper/600:34:196
36885489910,1cyclictest54-21ksoftirqd/520:09:205
36885489910,1cyclictest3915589-21turbostat23:49:195
36885489910,1cyclictest17518-21llvmpipe-619:49:215
36885489910,1cyclictest0-21swapper/522:54:205
36885489910,1cyclictest0-21swapper/521:59:205
36885489910,1cyclictest0-21swapper/520:49:205
36885489910,1cyclictest0-21swapper/520:24:205
36885489910,1cyclictest0-21swapper/519:44:205
36885489910,1cyclictest0-21swapper/519:19:215
36885489910,1cyclictest0-21swapper/500:09:195
36885479911,0cyclictest0-21swapper/421:04:204
36885479910,1cyclictest3706713-21turbostat19:39:204
36885479910,1cyclictest0-21swapper/423:59:214
36885479910,1cyclictest0-21swapper/423:54:204
36885479910,1cyclictest0-21swapper/423:09:204
36885479910,1cyclictest0-21swapper/423:04:204
36885479910,1cyclictest0-21swapper/422:49:204
36885479910,1cyclictest0-21swapper/422:29:204
36885479910,1cyclictest0-21swapper/422:24:204
36885479910,1cyclictest0-21swapper/422:19:204
36885479910,1cyclictest0-21swapper/422:09:204
36885479910,1cyclictest0-21swapper/421:59:214
36885479910,1cyclictest0-21swapper/421:54:204
36885479910,1cyclictest0-21swapper/421:54:204
36885479910,1cyclictest0-21swapper/421:49:204
36885479910,1cyclictest0-21swapper/421:39:204
36885479910,1cyclictest0-21swapper/421:34:204
36885479910,1cyclictest0-21swapper/421:14:214
36885479910,1cyclictest0-21swapper/420:59:214
36885479910,1cyclictest0-21swapper/420:49:204
36885479910,1cyclictest0-21swapper/420:04:214
36885479910,1cyclictest0-21swapper/419:19:214
36885479910,1cyclictest0-21swapper/419:14:204
36885479910,1cyclictest0-21swapper/419:09:214
36885479910,1cyclictest0-21swapper/400:39:204
36885479910,1cyclictest0-21swapper/400:34:194
36885479910,1cyclictest0-21swapper/400:29:204
36885479910,1cyclictest0-21swapper/400:19:204
36885479910,1cyclictest0-21swapper/400:14:204
36885479910,1cyclictest0-21swapper/400:09:194
36885509900,0cyclictest0-21swapper/622:54:206
36885509900,0cyclictest0-21swapper/622:09:206
36885489900,0cyclictest0-21swapper/520:59:215
36885489900,0cyclictest0-21swapper/500:14:205
36885479900,0cyclictest0-21swapper/423:14:204
36885479900,0cyclictest0-21swapper/422:54:204
36885479900,0cyclictest0-21swapper/420:54:204
36885479900,0cyclictest0-21swapper/420:29:214
36885479900,0cyclictest0-21swapper/420:09:204
36885479900,0cyclictest0-21swapper/419:44:204
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional