You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-08 - 04:43

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack0slot2.osadl.org (updated Wed Feb 08, 2023 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188614399170,17cyclictest0-21swapper/623:54:376
188614499140,13cyclictest2583662-21sh23:57:577
188614499140,13cyclictest1696195-21snmpd23:09:517
188614399140,13cyclictest0-21swapper/600:18:256
188614499133,1cyclictest38314-10wireplumber23:18:207
1886144991313,0cyclictest0-21swapper/723:38:347
1886144991313,0cyclictest0-21swapper/722:00:207
188614399130,13cyclictest0-21swapper/623:18:036
188614399130,13cyclictest0-21swapper/623:06:326
188614399130,13cyclictest0-21swapper/619:38:166
188614099130,13cyclictest0-21swapper/423:08:534
1886144991212,0cyclictest0-21swapper/722:36:087
1886144991212,0cyclictest0-21swapper/720:58:237
1886144991210,1cyclictest2642736-21ntpq00:18:277
1886143991212,0cyclictest0-21swapper/621:27:136
1886141991212,0cyclictest0-21swapper/523:53:585
1886141991212,0cyclictest0-21swapper/521:24:405
188614199120,0cyclictest0-21swapper/523:38:315
23356902110,0sleep72336249-21latency_hist22:17:577
188614499119,1cyclictest2448698-21diskstats23:03:157
1886144991111,0cyclictest0-21swapper/720:21:017
188614499110,10cyclictest2200995-21cat21:23:147
188614499110,10cyclictest2199608-21munin-run21:22:577
188614499110,10cyclictest2075541-21sendmail20:27:577
188614499110,10cyclictest1696195-21snmpd20:34:597
1886143991111,0cyclictest0-21swapper/623:08:166
1886143991111,0cyclictest0-21swapper/621:58:166
188614399110,11cyclictest0-21swapper/619:04:046
1886141991111,0cyclictest0-21swapper/520:37:135
1886141991111,0cyclictest0-21swapper/520:21:465
1886140991111,0cyclictest0-21swapper/423:19:464
188614499100,9cyclictest2534691-21sed23:37:587
188614499100,9cyclictest2311608-21cut22:07:577
188614499100,2cyclictest94014-21systemd-journal21:42:577
188614499100,2cyclictest2596357-21munin-run00:02:577
1886141991010,0cyclictest0-21swapper/519:06:535
1886140991010,0cyclictest0-21swapper/423:05:444
1886140991010,0cyclictest0-21swapper/420:58:494
1886140991010,0cyclictest0-21swapper/420:18:564
188614099100,0cyclictest0-21swapper/419:04:124
383188990,1rtkit-daemon0-21swapper/420:36:564
18861449990,8cyclictest2162600-21latency_hist21:07:577
18861449990,8cyclictest1972757-21/usr/sbin/munin19:38:177
18861449990,7cyclictest2558860-40updatedb23:47:577
18861449990,3cyclictest1951753-21cut19:27:587
18861449990,2cyclictest2323848-21latency_hist22:12:587
18861449990,2cyclictest2224686-21latency_hist21:32:577
18861449990,1cyclictest2658180-21munin-run00:27:577
18861449990,1cyclictest1908453-21kthreadcore19:03:267
18861439999,0cyclictest0-21swapper/620:58:596
18861419999,0cyclictest0-21swapper/522:36:435
18861409999,0cyclictest0-21swapper/423:56:114
18861409999,0cyclictest0-21swapper/422:34:314
18861409999,0cyclictest0-21swapper/421:27:124
18861449980,7cyclictest2509639-21munin-run23:27:577
18861449980,7cyclictest2423181-21cat22:52:577
18861449980,7cyclictest2286450-21munin-run21:57:577
18861449980,6cyclictest1993004-21munin-run19:47:577
18861449980,2cyclictest2447770-21ls23:02:587
18861449980,1cyclictest2633468-21rm00:17:577
18861449980,1cyclictest2398227-21latency_hist22:42:577
18861449980,1cyclictest2187238-21awk21:17:577
18861449980,1cyclictest2137886-21sed20:57:577
18861449980,1cyclictest1962129-21cat19:32:587
18861449980,1cyclictest1921070-21sed19:12:587
18861439988,0cyclictest0-21swapper/623:39:296
18861439980,6cyclictest0-21swapper/619:27:586
18861419988,0cyclictest0-21swapper/520:59:365
18861409988,0cyclictest0-21swapper/422:01:154
18861449970,6cyclictest2621113-21ssh00:12:577
18861449970,6cyclictest2348282-21rm22:22:577
18861449970,6cyclictest2261699-21sendmail21:47:587
18861449970,5cyclictest2034310-21munin-run20:07:587
18861449970,2cyclictest2608901-21cut00:07:577
18861449970,1cyclictest2434912-21ssh22:57:577
18861449970,1cyclictest2361140-21date22:27:587
18861449970,1cyclictest2174954-21latency_hist21:12:587
18861439970,5cyclictest0-21swapper/620:36:566
18861419977,0cyclictest0-21swapper/523:18:305
18861419977,0cyclictest0-21swapper/519:39:025
18861419977,0cyclictest0-21swapper/500:19:495
18861409977,0cyclictest0-21swapper/419:38:254
18861449960,5cyclictest2571866-21latency_hist23:52:577
18861449960,5cyclictest2522332-21cat23:32:587
18861449960,5cyclictest2013968-21cat19:57:587
18861449960,3cyclictest94014-21systemd-journal20:47:587
18861449960,3cyclictest94014-21systemd-journal20:12:587
18861449960,3cyclictest751-17auditd20:42:577
18861449960,1cyclictest2274295-21latency_hist21:52:587
18861449960,0cyclictest2373541-21date22:32:577
18861419966,0cyclictest0-21swapper/523:11:525
18861419966,0cyclictest0-21swapper/523:03:315
18861419961,5cyclictest14950irq/16-ehci_hcd22:02:385
18861419961,5cyclictest13150irq/27-ahci[00022:27:585
18861449950,4cyclictest2484902-21cut23:17:577
18861449950,4cyclictest2410677-21date22:47:577
18861449950,4cyclictest2055229-21sed20:17:577
18861449950,4cyclictest2024028-21munin-plugin-st20:02:577
18861449950,3cyclictest94014-21systemd-journal19:37:577
18861449950,2cyclictest94014-21systemd-journal21:37:587
18861449950,2cyclictest94014-21systemd-journal20:52:577
18861449950,2cyclictest94014-21systemd-journal20:32:587
18861449950,2cyclictest94014-21systemd-journal19:52:577
18861449950,2cyclictest94014-21systemd-journal19:22:577
18861449950,2cyclictest94014-21systemd-journal19:17:587
18861449950,2cyclictest94014-21systemd-journal19:02:587
18861439950,5cyclictest0-21swapper/623:52:576
18861439950,5cyclictest0-21swapper/623:47:576
18861439950,5cyclictest0-21swapper/623:37:576
18861439950,5cyclictest0-21swapper/622:57:586
18861439950,5cyclictest0-21swapper/622:52:576
18861439950,5cyclictest0-21swapper/622:42:576
18861439950,5cyclictest0-21swapper/622:32:576
18861439950,5cyclictest0-21swapper/622:27:586
18861439950,5cyclictest0-21swapper/622:17:576
18861439950,5cyclictest0-21swapper/622:12:576
18861439950,5cyclictest0-21swapper/622:07:576
18861439950,5cyclictest0-21swapper/621:57:576
18861439950,5cyclictest0-21swapper/621:52:576
18861439950,5cyclictest0-21swapper/621:47:586
18861439950,5cyclictest0-21swapper/621:42:576
18861439950,5cyclictest0-21swapper/621:17:576
18861439950,5cyclictest0-21swapper/621:07:576
18861439950,5cyclictest0-21swapper/620:57:576
18861439950,5cyclictest0-21swapper/620:52:576
18861439950,5cyclictest0-21swapper/620:47:586
18861439950,5cyclictest0-21swapper/620:42:576
18861439950,5cyclictest0-21swapper/620:32:586
18861439950,5cyclictest0-21swapper/620:27:576
18861439950,5cyclictest0-21swapper/620:17:586
18861439950,5cyclictest0-21swapper/620:12:586
18861439950,5cyclictest0-21swapper/620:07:586
18861439950,5cyclictest0-21swapper/620:02:576
18861439950,5cyclictest0-21swapper/619:37:576
18861439950,5cyclictest0-21swapper/619:32:586
18861439950,5cyclictest0-21swapper/619:22:576
18861439950,5cyclictest0-21swapper/619:12:586
18861439950,5cyclictest0-21swapper/618:57:596
18861439950,5cyclictest0-21swapper/600:27:576
18861439950,5cyclictest0-21swapper/600:17:576
18861439950,5cyclictest0-21swapper/600:12:576
18861439950,5cyclictest0-21swapper/600:02:576
18861419950,5cyclictest0-21swapper/523:37:575
18861419950,5cyclictest0-21swapper/523:32:575
18861419950,5cyclictest0-21swapper/523:27:575
18861419950,5cyclictest0-21swapper/522:52:575
18861419950,5cyclictest0-21swapper/522:42:575
18861419950,5cyclictest0-21swapper/522:17:575
18861419950,5cyclictest0-21swapper/522:07:575
18861419950,5cyclictest0-21swapper/521:57:585
18861419950,5cyclictest0-21swapper/521:52:575
18861419950,5cyclictest0-21swapper/521:42:575
18861419950,5cyclictest0-21swapper/521:32:575
18861419950,5cyclictest0-21swapper/521:22:585
18861419950,5cyclictest0-21swapper/521:07:575
18861419950,5cyclictest0-21swapper/520:52:575
18861419950,5cyclictest0-21swapper/520:47:585
18861419950,5cyclictest0-21swapper/520:02:575
18861419950,5cyclictest0-21swapper/519:47:585
18861419950,5cyclictest0-21swapper/519:37:585
18861419950,5cyclictest0-21swapper/518:57:595
18861419950,5cyclictest0-21swapper/500:27:575
18861419950,5cyclictest0-21swapper/500:12:575
18861419950,5cyclictest0-21swapper/500:02:575
18861449940,3cyclictest1886171-21cat18:57:597
18861439944,0cyclictest0-21swapper/619:52:576
18861439944,0cyclictest0-21swapper/619:47:576
18861439940,4cyclictest0-21swapper/600:07:576
18861439940,3cyclictest0-21swapper/623:27:576
18861419944,0cyclictest0-21swapper/523:02:585
18861419944,0cyclictest0-21swapper/522:32:575
18861419940,4cyclictest0-21swapper/522:22:575
18861419940,4cyclictest0-21swapper/500:07:575
18861409940,3cyclictest2633912-21chrt00:18:064
18861409940,3cyclictest2534731-21taskset23:38:024
383188930,0rtkit-daemon0-21swapper/400:12:574
18861439930,3cyclictest0-21swapper/623:32:576
18861439930,3cyclictest0-21swapper/623:17:576
18861439930,3cyclictest0-21swapper/622:32:576
18861439930,3cyclictest0-21swapper/621:37:586
18861439930,3cyclictest0-21swapper/621:32:576
18861439930,3cyclictest0-21swapper/621:22:576
18861439930,3cyclictest0-21swapper/621:12:586
18861419930,3cyclictest0-21swapper/523:47:575
18861419930,3cyclictest0-21swapper/522:57:585
18861419930,3cyclictest0-21swapper/521:17:575
18861419930,3cyclictest0-21swapper/521:12:585
18861419930,3cyclictest0-21swapper/520:42:585
18861419930,3cyclictest0-21swapper/520:12:585
18861419930,3cyclictest0-21swapper/519:52:585
18861419930,3cyclictest0-21swapper/519:27:585
18861419930,3cyclictest0-21swapper/519:22:575
18861419930,3cyclictest0-21swapper/519:12:585
18861419930,3cyclictest0-21swapper/500:17:575
18861419930,2cyclictest2410728-21chrt22:47:575
18861409932,1cyclictest445-21jbd2/sda3-819:37:574
18861409930,2cyclictest2633479-21turbostat00:17:574
18861409930,2cyclictest2274077-21turbostat21:52:574
18861409930,1cyclictest3831889rtkit-daemon00:07:574
18861409930,1cyclictest0-21swapper/422:57:574
18861409930,1cyclictest0-21swapper/421:07:574
18861409930,1cyclictest0-21swapper/420:52:574
18861439920,2cyclictest0-21swapper/622:47:576
18861439920,2cyclictest0-21swapper/622:22:576
18861439920,2cyclictest0-21swapper/620:17:586
18861439920,2cyclictest0-21swapper/619:57:586
18861439920,2cyclictest0-21swapper/619:17:586
18861419922,0cyclictest0-21swapper/523:17:575
18861419921,1cyclictest13150irq/27-ahci[00022:12:585
18861419920,2cyclictest0-21swapper/520:32:585
18861419920,2cyclictest0-21swapper/520:07:585
18861419920,2cyclictest0-21swapper/519:32:585
18861419920,0cyclictest0-21swapper/521:47:585
18861409921,1cyclictest1002-21abrt-dump-journ19:47:574
18861409921,1cyclictest0-21swapper/421:47:584
18861409921,1cyclictest0-21swapper/419:52:584
18861409921,1cyclictest0-21swapper/400:27:574
18861409920,2cyclictest1000-21abrt-dump-journ20:02:574
18861409920,2cyclictest0-21swapper/423:47:584
18861409920,2cyclictest0-21swapper/422:52:574
18861409920,2cyclictest0-21swapper/422:27:584
18861409920,2cyclictest0-21swapper/420:47:584
18861409920,1cyclictest2534333-21turbostat23:37:574
18861409920,1cyclictest2522009-21chrt23:32:574
18861409920,1cyclictest2509637-21turbostat23:27:574
18861409920,1cyclictest24100972sleep422:47:574
18861409920,1cyclictest2336057-21turbostat22:17:574
18861409920,1cyclictest2199607-21turbostat21:22:574
18861409920,1cyclictest2106596-21turbostat20:42:574
18861409920,1cyclictest1951750-21turbostat19:27:584
18861409920,1cyclictest1941352-21turbostat19:22:584
18861409920,1cyclictest1002-21abrt-dump-journ19:12:574
18861409920,1cyclictest0-21swapper/421:57:574
18861409920,1cyclictest0-21swapper/421:17:574
18861409920,1cyclictest0-21swapper/421:12:584
18861409920,1cyclictest0-21swapper/420:07:584
18861409920,0cyclictest0-21swapper/420:32:584
18861409920,0cyclictest0-21swapper/420:12:584
18861439910,1cyclictest0-21swapper/623:02:586
18861419910,1cyclictest445-21jbd2/sda3-819:57:585
18861419910,1cyclictest13150irq/27-ahci[00021:37:585
18861419910,1cyclictest0-21swapper/523:52:575
18861419910,1cyclictest0-21swapper/520:57:575
18861419910,1cyclictest0-21swapper/520:27:575
18861419910,1cyclictest0-21swapper/519:17:585
18861409910,1cyclictest13150irq/27-ahci[00023:02:584
18861409910,1cyclictest0-21swapper/423:52:574
18861409910,1cyclictest0-21swapper/423:17:574
18861409910,1cyclictest0-21swapper/422:42:574
18861409910,1cyclictest0-21swapper/422:22:574
18861409910,1cyclictest0-21swapper/422:07:574
18861409910,1cyclictest0-21swapper/421:42:574
18861409910,1cyclictest0-21swapper/421:37:584
18861409910,1cyclictest0-21swapper/421:32:574
18861409910,1cyclictest0-21swapper/420:57:574
18861409910,1cyclictest0-21swapper/420:27:574
18861409910,1cyclictest0-21swapper/419:57:584
18861409910,1cyclictest0-21swapper/419:32:584
18861409910,1cyclictest0-21swapper/419:17:584
18861409910,1cyclictest0-21swapper/419:02:584
18861409910,1cyclictest0-21swapper/400:02:574
18861439900,0cyclictest0-21swapper/619:02:586
18861419900,0cyclictest0-21swapper/520:17:575
18861419900,0cyclictest0-21swapper/519:02:585
18861409900,0cyclictest0-21swapper/422:32:574
18861409900,0cyclictest0-21swapper/422:12:574
18861409900,0cyclictest0-21swapper/420:17:574
18861409900,0cyclictest0-21swapper/418:57:594
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional