You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-04 - 04:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed Oct 04, 2023 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
43734991313,0cyclictest0-21swapper/700:01:197
4373199130,13cyclictest0-21swapper/522:01:275
4373199130,13cyclictest0-21swapper/521:53:445
43730991313,0cyclictest0-21swapper/423:19:544
43734991212,0cyclictest0-21swapper/723:36:347
43734991212,0cyclictest0-21swapper/721:19:067
43734991212,0cyclictest0-21swapper/721:19:067
43734991210,1cyclictest725196-21ssh00:28:557
43733991212,0cyclictest0-21swapper/623:19:236
4373399120,0cyclictest0-21swapper/623:36:056
43731991212,0cyclictest0-21swapper/523:34:185
4373199120,12cyclictest0-21swapper/519:28:515
43730991212,0cyclictest0-21swapper/423:59:004
43730991212,0cyclictest0-21swapper/421:22:464
43730991212,0cyclictest0-21swapper/421:22:464
4373499112,2cyclictest168181-21munin-plugin-st20:13:557
4373499110,2cyclictest395154-21munin-plugin-st22:03:547
4373499110,10cyclictest94862-21cat19:34:187
43733991111,0cyclictest0-21swapper/621:13:066
43731991111,0cyclictest0-21swapper/523:21:325
43731991111,0cyclictest0-21swapper/522:36:175
4373199110,2cyclictest0-21swapper/519:52:385
4373199110,2cyclictest0-21swapper/519:52:385
43730991111,0cyclictest0-21swapper/423:38:214
43730991111,0cyclictest0-21swapper/423:26:414
4373099110,11cyclictest0-21swapper/419:37:564
5765872108,1sleep70-21swapper/723:22:577
43734991010,0cyclictest0-21swapper/721:49:417
4373499100,9cyclictest1053-21snmpd20:26:257
4373499100,9cyclictest1053-21snmpd19:49:347
4373499100,9cyclictest1053-21snmpd19:49:347
43733991010,0cyclictest0-21swapper/623:58:576
4373399100,5cyclictest0-21swapper/622:00:146
4373199101,2cyclictest0-21swapper/521:21:385
4373199101,2cyclictest0-21swapper/521:21:385
43731991010,0cyclictest0-21swapper/521:13:135
43731991010,0cyclictest0-21swapper/519:37:595
4373199100,0cyclictest0-21swapper/523:24:035
43730991010,0cyclictest0-21swapper/421:11:164
43730991010,0cyclictest0-21swapper/420:27:174
437349999,0cyclictest0-21swapper/721:13:167
437349990,8cyclictest76178-21cat19:24:177
437349990,8cyclictest1053-21snmpd23:28:397
437349990,8cyclictest1053-21snmpd22:34:297
437349990,8cyclictest1053-21snmpd21:04:087
437349990,6cyclictest205418-21grep20:33:557
437339999,0cyclictest0-21swapper/621:49:406
437339999,0cyclictest0-21swapper/621:18:566
437339999,0cyclictest0-21swapper/621:18:566
437339990,9cyclictest0-21swapper/623:27:536
437339990,9cyclictest0-21swapper/622:34:486
437339990,9cyclictest0-21swapper/621:06:516
437339990,9cyclictest0-21swapper/620:24:176
437339990,9cyclictest0-21swapper/619:37:066
437339990,9cyclictest0-21swapper/619:25:076
437319999,0cyclictest0-21swapper/521:04:135
437319991,0cyclictest0-21swapper/523:59:165
437319990,0cyclictest0-21swapper/520:26:085
437309999,0cyclictest0-21swapper/421:07:194
437349980,2cyclictest645521-21munin-plugin-st23:53:557
437349980,2cyclictest543273-21munin-plugin-st23:08:557
437349980,1cyclictest429617-21cut22:18:557
437309988,0cyclictest0-21swapper/421:59:494
437349971,4cyclictest65668-21cut19:18:557
437349970,6cyclictest140234-21munin-plugin-st19:58:557
437349970,2cyclictest1-21systemd20:03:557
437319970,2cyclictest0-21swapper/523:33:555
437309977,0cyclictest0-21swapper/419:27:514
437349961,4cyclictest242609-21/usr/sbin/munin20:53:557
437349960,3cyclictest656869-40ogrotate23:58:557
437349960,3cyclictest3382767-21systemd-journal23:43:557
437349960,3cyclictest3382767-21systemd-journal22:53:557
437349960,3cyclictest3382767-21systemd-journal22:33:557
437349960,3cyclictest3382767-21systemd-journal21:43:557
437349960,3cyclictest3382767-21systemd-journal21:38:557
437349960,3cyclictest3382767-21systemd-journal21:28:557
437349960,3cyclictest3382767-21systemd-journal21:03:557
437349960,3cyclictest3382767-21systemd-journal20:48:557
437349960,3cyclictest3382767-21systemd-journal20:18:567
437349960,3cyclictest3382767-21systemd-journal19:48:557
437349960,3cyclictest3382767-21systemd-journal19:43:557
437349960,3cyclictest3382767-21systemd-journal19:33:557
437349960,3cyclictest3382767-21systemd-journal00:33:557
437339960,6cyclictest0-21swapper/619:50:186
437339960,6cyclictest0-21swapper/619:50:186
437319960,2cyclictest0-21swapper/521:28:555
437309966,0cyclictest0-21swapper/419:48:584
437309966,0cyclictest0-21swapper/419:48:584
437349950,4cyclictest756-21dbus-daemon00:08:547
437349950,4cyclictest702465-21awk00:18:547
437349950,4cyclictest634311-21date23:48:557
437349950,4cyclictest43763-21date19:08:567
437349950,4cyclictest418435-21cut22:13:557
437349950,4cyclictest361511-21cut21:48:557
437349950,4cyclictest224328-21cut20:43:567
437349950,3cyclictest3382767-21systemd-journal21:18:557
437349950,3cyclictest3382767-21systemd-journal00:38:557
437349950,2cyclictest728-17auditd23:13:557
437349950,2cyclictest728-17auditd19:23:557
437349950,2cyclictest3382767-21systemd-journal23:33:557
437349950,2cyclictest3382767-21systemd-journal23:18:547
437349950,2cyclictest3382767-21systemd-journal22:58:557
437349950,2cyclictest3382767-21systemd-journal22:48:557
437349950,2cyclictest3382767-21systemd-journal22:43:547
437349950,2cyclictest3382767-21systemd-journal22:28:557
437349950,2cyclictest3382767-21systemd-journal22:23:557
437349950,2cyclictest3382767-21systemd-journal22:08:557
437349950,2cyclictest3382767-21systemd-journal21:58:557
437349950,2cyclictest3382767-21systemd-journal21:33:557
437349950,2cyclictest3382767-21systemd-journal20:58:567
437349950,2cyclictest3382767-21systemd-journal20:38:557
437349950,2cyclictest3382767-21systemd-journal20:38:557
437349950,2cyclictest3382767-21systemd-journal20:23:557
437349950,2cyclictest3382767-21systemd-journal19:13:567
437349950,2cyclictest3382767-21systemd-journal00:23:557
437349950,2cyclictest3382767-21systemd-journal00:13:557
437339950,5cyclictest0-21swapper/623:58:556
437339950,5cyclictest0-21swapper/623:53:546
437339950,5cyclictest0-21swapper/623:48:556
437339950,5cyclictest0-21swapper/623:43:556
437339950,5cyclictest0-21swapper/623:33:556
437339950,5cyclictest0-21swapper/623:18:546
437339950,5cyclictest0-21swapper/623:13:556
437339950,5cyclictest0-21swapper/623:08:556
437339950,5cyclictest0-21swapper/623:03:556
437339950,5cyclictest0-21swapper/622:58:556
437339950,5cyclictest0-21swapper/622:53:546
437339950,5cyclictest0-21swapper/622:43:546
437339950,5cyclictest0-21swapper/622:33:556
437339950,5cyclictest0-21swapper/622:28:556
437339950,5cyclictest0-21swapper/622:23:556
437339950,5cyclictest0-21swapper/622:18:556
437339950,5cyclictest0-21swapper/622:13:556
437339950,5cyclictest0-21swapper/622:08:556
437339950,5cyclictest0-21swapper/621:58:556
437339950,5cyclictest0-21swapper/621:48:556
437339950,5cyclictest0-21swapper/621:43:556
437339950,5cyclictest0-21swapper/621:38:546
437339950,5cyclictest0-21swapper/621:33:556
437339950,5cyclictest0-21swapper/621:28:556
437339950,5cyclictest0-21swapper/621:18:556
437339950,5cyclictest0-21swapper/621:03:556
437339950,5cyclictest0-21swapper/620:53:556
437339950,5cyclictest0-21swapper/620:48:556
437339950,5cyclictest0-21swapper/620:43:566
437339950,5cyclictest0-21swapper/620:38:556
437339950,5cyclictest0-21swapper/620:38:556
437339950,5cyclictest0-21swapper/620:33:556
437339950,5cyclictest0-21swapper/620:23:556
437339950,5cyclictest0-21swapper/620:18:566
437339950,5cyclictest0-21swapper/620:13:556
437339950,5cyclictest0-21swapper/620:08:566
437339950,5cyclictest0-21swapper/620:03:556
437339950,5cyclictest0-21swapper/619:58:556
437339950,5cyclictest0-21swapper/619:43:556
437339950,5cyclictest0-21swapper/619:33:556
437339950,5cyclictest0-21swapper/619:23:566
437339950,5cyclictest0-21swapper/619:18:556
437339950,5cyclictest0-21swapper/619:13:566
437339950,5cyclictest0-21swapper/619:08:566
437339950,5cyclictest0-21swapper/600:38:556
437339950,5cyclictest0-21swapper/600:33:556
437339950,5cyclictest0-21swapper/600:28:546
437339950,5cyclictest0-21swapper/600:23:556
437339950,5cyclictest0-21swapper/600:18:546
437339950,5cyclictest0-21swapper/600:08:546
437319950,3cyclictest0-21swapper/521:38:555
437319950,3cyclictest0-21swapper/521:18:555
437349940,3cyclictest532160-21cron23:03:557
437349940,3cyclictest159098-21cut20:08:567
437319941,0cyclictest0-21swapper/521:48:555
437319940,4cyclictest0-21swapper/519:18:565
437319940,3cyclictest429614-21turbostat22:18:555
437319940,0cyclictest0-21swapper/523:13:555
437319940,0cyclictest0-21swapper/521:43:555
437309940,3cyclictest464136-21chrt22:34:004
437309940,3cyclictest370491-21chrt21:49:394
437309940,3cyclictest350092-21chrt21:43:554
437339930,3cyclictest0-21swapper/619:48:556
437319930,0cyclictest0-21swapper/522:08:555
437309930,2cyclictest53116-21taskset19:13:564
437339920,2cyclictest0-21swapper/620:58:566
437319921,1cyclictest189-1kworker/5:1H00:23:555
437319921,1cyclictest13250irq/27-ahci[00023:58:555
437319921,1cyclictest13250irq/27-ahci[00023:53:545
437319921,1cyclictest13250irq/27-ahci[00023:08:555
437319921,1cyclictest13250irq/27-ahci[00022:53:555
437319921,1cyclictest13250irq/27-ahci[00022:28:555
437319921,1cyclictest13250irq/27-ahci[00022:23:555
437319921,1cyclictest13250irq/27-ahci[00021:58:555
437319921,1cyclictest13250irq/27-ahci[00020:58:565
437319921,1cyclictest13250irq/27-ahci[00020:48:555
437319921,1cyclictest13250irq/27-ahci[00020:38:555
437319921,1cyclictest13250irq/27-ahci[00020:08:565
437319921,1cyclictest13250irq/27-ahci[00020:03:555
437319921,1cyclictest13250irq/27-ahci[00019:58:555
437319921,1cyclictest13250irq/27-ahci[00019:43:555
437319921,1cyclictest13250irq/27-ahci[00019:13:565
437319921,1cyclictest13250irq/27-ahci[00000:18:545
437319921,1cyclictest13250irq/27-ahci[00000:08:545
437319921,0cyclictest151rcu_preempt20:13:555
437319920,2cyclictest0-21swapper/523:48:555
437319920,2cyclictest0-21swapper/523:18:555
437319920,2cyclictest0-21swapper/522:43:555
437319920,2cyclictest0-21swapper/500:38:555
437319920,1cyclictest74960-21turbostat19:23:555
437319920,1cyclictest736548-21turbostat00:33:555
437319920,1cyclictest725178-21turbostat00:28:545
437319920,0cyclictest0-21swapper/522:13:555
437309921,1cyclictest447-21jbd2/sda3-821:03:554
437309921,1cyclictest447-21jbd2/sda3-819:48:554
437309921,1cyclictest447-21jbd2/sda3-800:38:554
437309921,1cyclictest447-21jbd2/sda3-800:18:544
437309920,2cyclictest452573-21taskset22:28:554
437309920,1cyclictest0-21swapper/421:48:554
437309920,0cyclictest0-21swapper/423:18:554
437339910,1cyclictest601rcuc/600:13:556
437339910,1cyclictest0-21swapper/622:48:556
437319911,0cyclictest13250irq/27-ahci[00020:23:555
437319910,1cyclictest3013423-21kworker/5:321:03:555
437319910,1cyclictest13250irq/27-ahci[00020:43:565
437319910,1cyclictest13250irq/27-ahci[00020:38:555
437319910,1cyclictest13250irq/27-ahci[00019:08:565
437319910,1cyclictest0-21swapper/523:43:545
437319910,1cyclictest0-21swapper/523:03:555
437319910,1cyclictest0-21swapper/522:48:555
437319910,1cyclictest0-21swapper/522:33:555
437319910,1cyclictest0-21swapper/521:33:555
437319910,1cyclictest0-21swapper/520:33:555
437319910,1cyclictest0-21swapper/520:18:555
437319910,1cyclictest0-21swapper/519:48:555
437319910,1cyclictest0-21swapper/519:33:555
437319910,1cyclictest0-21swapper/500:13:555
437319910,0cyclictest0-21swapper/522:58:555
437319910,0cyclictest0-21swapper/520:53:555
437309910,1cyclictest72-21rcuop/722:53:544
437309910,1cyclictest72-21rcuop/719:08:564
437309910,1cyclictest563906-21kworker/4:023:33:554
437309910,1cyclictest447-21jbd2/sda3-821:33:554
437309910,1cyclictest447-21jbd2/sda3-800:28:544
437309910,1cyclictest447-21jbd2/sda3-800:23:554
437309910,1cyclictest242147-21kworker/u16:120:53:554
437309910,1cyclictest16073-21kworker/u16:219:33:554
437309910,1cyclictest102301-21kworker/4:220:43:564
437309910,1cyclictest0-21swapper/423:58:554
437309910,1cyclictest0-21swapper/423:53:544
437309910,1cyclictest0-21swapper/423:43:544
437309910,1cyclictest0-21swapper/423:13:554
437309910,1cyclictest0-21swapper/423:08:554
437309910,1cyclictest0-21swapper/423:03:554
437309910,1cyclictest0-21swapper/422:43:544
437309910,1cyclictest0-21swapper/422:33:554
437309910,1cyclictest0-21swapper/422:23:554
437309910,1cyclictest0-21swapper/422:18:554
437309910,1cyclictest0-21swapper/422:13:554
437309910,1cyclictest0-21swapper/422:08:554
437309910,1cyclictest0-21swapper/421:58:554
437309910,1cyclictest0-21swapper/421:38:544
437309910,1cyclictest0-21swapper/421:28:554
437309910,1cyclictest0-21swapper/421:18:554
437309910,1cyclictest0-21swapper/420:58:564
437309910,1cyclictest0-21swapper/420:48:554
437309910,1cyclictest0-21swapper/420:33:554
437309910,1cyclictest0-21swapper/420:18:554
437309910,1cyclictest0-21swapper/420:13:554
437309910,1cyclictest0-21swapper/420:03:554
437309910,1cyclictest0-21swapper/419:58:554
437309910,1cyclictest0-21swapper/419:43:554
437309910,1cyclictest0-21swapper/419:23:554
437309910,1cyclictest0-21swapper/419:18:554
437309910,1cyclictest0-21swapper/400:33:544
437309910,1cyclictest0-21swapper/400:08:544
437309900,0cyclictest0-21swapper/423:48:554
437309900,0cyclictest0-21swapper/422:58:554
437309900,0cyclictest0-21swapper/422:48:554
437309900,0cyclictest0-21swapper/420:38:554
437309900,0cyclictest0-21swapper/420:38:554
437309900,0cyclictest0-21swapper/420:23:554
437309900,0cyclictest0-21swapper/420:08:564
437309900,0cyclictest0-21swapper/400:13:554
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional