You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 07:00

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sun Jul 03, 2022 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
374050499170,16cyclictest0-21swapper/400:14:534
3740505991616,0cyclictest0-21swapper/519:56:405
3740505991515,0cyclictest0-21swapper/519:59:455
3740505991515,0cyclictest0-21swapper/519:24:485
3740505991515,0cyclictest0-21swapper/519:24:485
3740508991411,2cyclictest1010-21snmpd00:15:207
3740505991411,2cyclictest3842254-21cat21:39:495
3740508991313,0cyclictest0-21swapper/721:40:437
3740508991311,1cyclictest1010-21snmpd20:31:217
374050899130,13cyclictest0-21swapper/719:24:587
374050899130,13cyclictest0-21swapper/719:24:587
374050899130,0cyclictest0-21swapper/721:16:367
3740507991313,0cyclictest0-21swapper/622:17:536
374050799130,13cyclictest0-21swapper/623:13:516
3740507991212,0cyclictest0-21swapper/621:14:396
3740507991212,0cyclictest0-21swapper/620:37:366
374050499120,11cyclictest0-21swapper/420:47:334
374050499120,11cyclictest0-21swapper/420:47:334
374050499120,0cyclictest0-21swapper/420:38:154
374050899118,2cyclictest1010-21snmpd20:35:067
374050899118,2cyclictest1010-21snmpd19:56:087
3740508991111,0cyclictest0-21swapper/723:07:547
374050799110,11cyclictest0-21swapper/620:48:206
374050799110,11cyclictest0-21swapper/620:48:206
374050799110,11cyclictest0-21swapper/620:34:086
374050799110,11cyclictest0-21swapper/619:56:186
374050799110,0cyclictest0-21swapper/620:04:116
374050599119,1cyclictest0-21swapper/520:29:535
374050599110,11cyclictest0-21swapper/523:06:175
374050499110,11cyclictest0-21swapper/422:16:004
374050899107,2cyclictest1010-21snmpd20:00:357
3740507991010,0cyclictest0-21swapper/600:17:426
3740505991010,0cyclictest0-21swapper/522:41:135
3740505991010,0cyclictest0-21swapper/521:14:595
3740504991010,0cyclictest0-21swapper/423:06:084
3740504991010,0cyclictest0-21swapper/422:42:574
37405089999,0cyclictest0-21swapper/723:14:327
37405089997,1cyclictest1010-21snmpd20:45:247
37405089997,1cyclictest1010-21snmpd20:45:247
37405089996,2cyclictest1010-21snmpd22:16:237
37405089994,2cyclictest793-21systemd-logind20:14:367
37405089994,2cyclictest793-21systemd-logind20:14:367
37405059999,0cyclictest0-21swapper/523:10:045
37405049999,0cyclictest0-21swapper/421:40:314
37405089984,2cyclictest17584-10wireplumber22:39:517
37405089984,2cyclictest17584-10wireplumber20:29:367
37405059988,0cyclictest0-21swapper/520:37:275
37405059986,1cyclictest3993266-21/usr/sbin/munin00:14:545
37405049988,0cyclictest0-21swapper/420:30:414
37405049988,0cyclictest0-21swapper/419:54:444
37405089973,2cyclictest553-21systemd-journal21:59:367
37405089973,2cyclictest553-21systemd-journal21:59:367
37405089973,2cyclictest17584-10wireplumber23:04:357
37405089973,2cyclictest17584-10wireplumber20:54:367
37405089973,2cyclictest17584-10wireplumber20:54:367
37405059974,2cyclictest3798119-21cat20:44:505
37405059974,2cyclictest3798119-21cat20:44:505
37405059970,1cyclictest0-21swapper/522:14:475
37405049977,0cyclictest0-21swapper/423:09:364
37405049971,3cyclictest3978086-40logrotate23:59:364
37405089964,1cyclictest3758719-21systemd-run19:39:367
37405089964,1cyclictest3758719-21systemd-run19:39:367
37405089963,2cyclictest3963402-21systemd-run23:44:357
37405089963,1cyclictest794-21systemd-machine19:34:367
37405089963,1cyclictest553-21systemd-journal23:34:367
37405089963,1cyclictest17584-10wireplumber19:54:367
37405089962,3cyclictest3909523-21latency_hist22:49:357
37405089962,2cyclictest17584-10wireplumber23:29:357
37405089962,2cyclictest17584-10wireplumber22:24:367
37405089962,2cyclictest17584-10wireplumber19:14:367
37405089962,2cyclictest17584-10wireplumber00:04:367
37405089960,4cyclictest553-21systemd-journal23:59:367
37405089960,3cyclictest553-21systemd-journal19:49:367
37405089960,2cyclictest553-21systemd-journal23:54:357
37405079966,0cyclictest0-21swapper/621:43:596
37405049966,0cyclictest0-21swapper/421:18:174
37405089953,1cyclictest3914527-21sed22:54:367
37405089953,1cyclictest3850354-21cron21:49:367
37405089953,1cyclictest3840915-21crond21:39:367
37405089952,2cyclictest4012515-21cat00:34:367
37405089952,2cyclictest3865373-21crond22:04:367
37405089952,1cyclictest3870273-21awk22:09:367
37405089952,1cyclictest17584-10wireplumber22:29:367
37405089951,2cyclictest553-21systemd-journal00:09:367
37405089951,2cyclictest17584-10wireplumber23:39:367
37405089950,5cyclictest0-21swapper/721:09:367
37405089950,5cyclictest0-21swapper/720:24:367
37405089950,4cyclictest3993092-21date00:14:367
37405089950,3cyclictest553-21systemd-journal21:24:367
37405089950,3cyclictest553-21systemd-journal19:19:377
37405089950,3cyclictest553-21systemd-journal00:24:357
37405089950,3cyclictest553-21systemd-journal00:24:357
37405089950,2cyclictest553-21systemd-journal23:19:357
37405089950,2cyclictest553-21systemd-journal21:29:367
37405089950,2cyclictest553-21systemd-journal00:29:367
37405079950,5cyclictest0-21swapper/623:04:426
37405079950,5cyclictest0-21swapper/622:43:596
37405079950,5cyclictest0-21swapper/622:24:366
37405079950,5cyclictest0-21swapper/621:24:366
37405079950,3cyclictest3978132-40mlocate-run-upd23:59:366
37405059952,2cyclictest1-21systemd21:09:365
37405059950,3cyclictest3978206-40sh23:59:365
37405049952,2cyclictest3772415-21cat19:59:584
37405049952,2cyclictest3750420-21cpuspeed_turbos19:24:474
37405049952,2cyclictest3750420-21cpuspeed_turbos19:24:474
37405089941,2cyclictest4016979-21cron00:39:357
37405089940,3cyclictest3968406-21cat23:49:367
37405089940,3cyclictest3943948-21date23:24:367
37405089940,3cyclictest3919405-21latency_hist22:59:367
37405089940,3cyclictest3899899-21latency_hist22:39:367
37405089940,3cyclictest3894807-21latency_hist22:34:367
37405089940,3cyclictest3880430-21cat22:19:367
37405089940,3cyclictest3875216-21ls22:14:367
37405089940,3cyclictest3855788-21cut21:54:367
37405089940,3cyclictest3836345-21latency_hist21:34:377
37405089940,3cyclictest3816752-21ls21:14:367
37405089940,3cyclictest3805652-21crond20:59:367
37405089940,3cyclictest3796509-21latency_hist20:44:367
37405089940,3cyclictest3782383-21cut20:19:377
37405089940,3cyclictest3749983-21latency_hist19:24:367
37405089940,3cyclictest3740518-21cut19:09:377
37405089940,2cyclictest553-21systemd-journal21:04:367
37405089940,2cyclictest553-21systemd-journal20:09:367
37405089940,2cyclictest553-21systemd-journal19:44:367
37405079940,3cyclictest3938907-21systemd23:19:356
37405079940,3cyclictest3909470-21true22:49:356
37405079940,3cyclictest3750391-21wc19:24:476
37405079940,3cyclictest3750391-21wc19:24:476
37405059943,1cyclictest0-21swapper/521:39:365
37405059940,4cyclictest0-21swapper/523:54:355
37405059940,4cyclictest0-21swapper/523:29:355
37405059940,4cyclictest0-21swapper/521:14:365
37405059940,4cyclictest0-21swapper/500:34:365
37405059940,4cyclictest0-21swapper/500:09:365
37405059940,3cyclictest3860524-21true21:59:365
37405059940,3cyclictest3860524-21true21:59:365
37405059940,3cyclictest3802860-21chrt20:54:365
37405059940,3cyclictest3802860-21chrt20:54:365
37405059940,3cyclictest3776342-21taskset20:09:365
37405059940,3cyclictest3743536-21munin-node19:14:375
37405059940,0cyclictest0-21swapper/521:49:365
37405049942,2cyclictest0-21swapper/419:39:364
37405049942,2cyclictest0-21swapper/419:39:364
37405049942,1cyclictest1-21systemd19:34:364
37405049941,2cyclictest1-21systemd20:09:364
37405049940,3cyclictest3761723-21taskset19:44:364
37405049940,3cyclictest1-21systemd20:24:364
37405079931,1cyclictest0-21swapper/621:39:366
37405079930,3cyclictest0-21swapper/622:09:366
37405079930,3cyclictest0-21swapper/620:29:376
37405079930,3cyclictest0-21swapper/620:24:366
37405079930,2cyclictest3889873-21true22:29:366
37405079930,2cyclictest3865420-21chrt22:04:366
37405079930,2cyclictest3805692-21true20:59:366
37405079930,0cyclictest0-21swapper/619:34:366
37405059933,0cyclictest0-21swapper/522:54:365
37405059930,3cyclictest54-21ksoftirqd/521:29:365
37405059930,3cyclictest0-21swapper/523:34:365
37405059930,3cyclictest0-21swapper/523:04:355
37405059930,3cyclictest0-21swapper/522:59:365
37405059930,3cyclictest0-21swapper/522:34:365
37405059930,3cyclictest0-21swapper/522:24:355
37405059930,3cyclictest0-21swapper/500:29:365
37405059930,3cyclictest0-21swapper/500:24:365
37405059930,3cyclictest0-21swapper/500:24:365
37405059930,3cyclictest0-21swapper/500:04:365
37405059930,2cyclictest3963403-21true23:44:355
37405059930,2cyclictest3909463-21taskset22:49:355
37405059930,2cyclictest3865378-21turbostat22:04:365
37405059930,2cyclictest1-21systemd23:39:365
37405059930,2cyclictest1-21systemd22:29:365
37405059930,2cyclictest1-21systemd22:09:365
37405059930,2cyclictest1-21systemd20:59:365
37405059930,2cyclictest1-21systemd19:44:365
37405059930,2cyclictest1-21systemd19:39:365
37405059930,2cyclictest1-21systemd19:39:365
37405059930,2cyclictest1-21systemd19:34:365
37405049930,2cyclictest3958485-21turbostat23:39:364
37405049930,2cyclictest3884953-21turbostat22:24:354
37405049930,2cyclictest1-21systemd23:19:354
37405049930,2cyclictest1-21systemd23:04:364
37405049930,2cyclictest1-21systemd22:54:364
37405049930,2cyclictest1-21systemd22:49:354
37405049930,2cyclictest1-21systemd22:29:364
37405049930,2cyclictest1-21systemd21:59:364
37405049930,2cyclictest1-21systemd21:59:364
37405049930,2cyclictest1-21systemd21:49:364
37405049930,2cyclictest1-21systemd21:29:364
37405049930,2cyclictest1-21systemd20:29:364
37405049930,2cyclictest1-21systemd19:54:374
37405049930,2cyclictest1-21systemd19:19:374
37405049930,2cyclictest1-21systemd19:14:374
37405079921,1cyclictest782-21polkitd00:09:366
37405079921,1cyclictest12950irq/27-ahci[00023:24:366
37405079921,1cyclictest12950irq/27-ahci[00022:14:366
37405079921,1cyclictest12950irq/27-ahci[00021:04:366
37405079921,1cyclictest12950irq/27-ahci[00020:19:376
37405079921,1cyclictest12950irq/27-ahci[00020:14:366
37405079921,1cyclictest12950irq/27-ahci[00020:14:366
37405079921,1cyclictest12950irq/27-ahci[00000:34:366
37405079921,1cyclictest12950irq/27-ahci[00000:29:366
37405079920,2cyclictest3973190-21systemd23:54:356
37405079920,2cyclictest3958518-21systemd23:39:366
37405079920,2cyclictest3924217-21systemd23:04:366
37405079920,2cyclictest3914394-21systemd22:54:366
37405079920,2cyclictest3761656-21true19:44:366
37405079920,2cyclictest1-21systemd21:29:366
37405079920,2cyclictest0-21swapper/623:49:366
37405079920,2cyclictest0-21swapper/623:44:356
37405079920,2cyclictest0-21swapper/623:34:366
37405079920,2cyclictest0-21swapper/621:09:366
37405079920,2cyclictest0-21swapper/619:49:366
37405079920,2cyclictest0-21swapper/600:24:356
37405079920,2cyclictest0-21swapper/600:24:356
37405079920,1cyclictest3860492-21turbostat21:59:366
37405079920,1cyclictest3860492-21turbostat21:59:366
37405079920,1cyclictest3802727-21turbostat20:54:366
37405079920,1cyclictest3802727-21turbostat20:54:366
37405079920,1cyclictest3797103-21chrt20:44:366
37405079920,1cyclictest3767497-21turbostat19:54:366
37405079920,1cyclictest3758687-21turbostat19:39:366
37405079920,1cyclictest3758687-21turbostat19:39:366
37405079920,1cyclictest0-21swapper/619:14:376
37405079920,0cyclictest0-21swapper/623:29:366
37405079920,0cyclictest0-21swapper/621:54:366
37405059922,0cyclictest0-21swapper/519:19:375
37405059922,0cyclictest0-21swapper/500:14:365
37405059921,1cyclictest0-21swapper/521:54:365
37405059921,1cyclictest0-21swapper/521:24:365
37405059920,2cyclictest0-21swapper/521:04:365
37405059920,2cyclictest0-21swapper/520:29:365
37405059920,2cyclictest0-21swapper/519:24:365
37405059920,1cyclictest3764564-21turbostat19:49:365
37405059920,1cyclictest0-21swapper/523:19:355
37405059920,1cyclictest0-21swapper/520:44:365
37405059920,1cyclictest0-21swapper/519:54:375
37405049920,1cyclictest3973157-21turbostat23:54:354
37405049920,1cyclictest3953592-21turbostat23:34:364
37405049920,1cyclictest3948700-21turbostat23:29:364
37405049920,1cyclictest3805660-21turbostat20:59:364
37405049920,1cyclictest1-21systemd22:09:364
37405049920,1cyclictest1-21systemd22:04:364
37405049920,1cyclictest1-21systemd21:24:364
37405049920,1cyclictest0-21swapper/421:09:364
37405049920,1cyclictest0-21swapper/400:09:364
175888920,0rtkit-daemon0-21swapper/523:49:365
175888920,0rtkit-daemon0-21swapper/519:09:365
3918923210,0sleep40-21swapper/422:59:364
37405079910,1cyclictest782-21polkitd19:19:376
37405079910,1cyclictest12950irq/27-ahci[00021:14:366
37405079910,1cyclictest12950irq/27-ahci[00019:24:366
37405079910,1cyclictest12950irq/27-ahci[00019:09:376
37405079910,1cyclictest12950irq/27-ahci[00000:14:366
37405079910,1cyclictest0-21swapper/622:59:366
37405079910,1cyclictest0-21swapper/622:39:366
37405079910,1cyclictest0-21swapper/622:34:366
37405079910,1cyclictest0-21swapper/621:49:366
37405079910,1cyclictest0-21swapper/620:09:366
37405079910,1cyclictest0-21swapper/600:39:356
37405079910,1cyclictest0-21swapper/600:04:366
37405059910,1cyclictest54-21ksoftirqd/500:39:355
37405059910,1cyclictest0-21swapper/523:24:365
37405059910,1cyclictest0-21swapper/522:39:365
37405059910,1cyclictest0-21swapper/522:14:365
37405059910,1cyclictest0-21swapper/520:24:365
37405059910,1cyclictest0-21swapper/520:14:365
37405059910,1cyclictest0-21swapper/520:14:365
37405049910,1cyclictest0-21swapper/423:44:354
37405049910,1cyclictest0-21swapper/422:39:364
37405049910,1cyclictest0-21swapper/422:34:364
37405049910,1cyclictest0-21swapper/421:39:364
37405049910,1cyclictest0-21swapper/421:04:364
37405049910,1cyclictest0-21swapper/420:54:364
37405049910,1cyclictest0-21swapper/420:54:364
37405049910,1cyclictest0-21swapper/420:44:364
37405049910,1cyclictest0-21swapper/420:19:374
37405049910,1cyclictest0-21swapper/420:14:364
37405049910,1cyclictest0-21swapper/420:14:364
37405049910,1cyclictest0-21swapper/419:49:364
37405049910,1cyclictest0-21swapper/400:34:364
37405049910,1cyclictest0-21swapper/400:29:354
37405049910,1cyclictest0-21swapper/400:24:354
37405049910,1cyclictest0-21swapper/400:24:354
37405049910,1cyclictest0-21swapper/400:14:364
37405049910,1cyclictest0-21swapper/400:04:364
37405049910,0cyclictest0-21swapper/423:24:364
37405079900,0cyclictest0-21swapper/622:19:366
37405079900,0cyclictest0-21swapper/621:34:376
37405059900,0cyclictest0-21swapper/522:19:365
37405059900,0cyclictest0-21swapper/521:34:375
37405059900,0cyclictest0-21swapper/520:19:375
37405049900,0cyclictest0-21swapper/423:49:364
37405049900,0cyclictest0-21swapper/422:19:364
37405049900,0cyclictest0-21swapper/422:14:364
37405049900,0cyclictest0-21swapper/421:54:364
37405049900,0cyclictest0-21swapper/421:34:374
37405049900,0cyclictest0-21swapper/421:14:364
37405049900,0cyclictest0-21swapper/419:24:364
37405049900,0cyclictest0-21swapper/419:09:374
37405049900,0cyclictest0-21swapper/400:39:354
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional