You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-04 - 23:01

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Feb 04, 2023 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259321899170,16cyclictest0-21swapper/507:24:205
259321899160,16cyclictest0-21swapper/507:21:165
259321899160,16cyclictest0-21swapper/506:58:445
2593217991513,1cyclictest38240-21llvmpipe-010:53:394
259321899140,0cyclictest0-21swapper/511:26:205
259321799140,13cyclictest0-21swapper/409:20:294
2593221991313,0cyclictest3201551-21ssh11:27:097
259322099130,13cyclictest0-21swapper/610:20:526
2593218991312,1cyclictest0-21swapper/510:16:495
259321899130,0cyclictest0-21swapper/511:07:255
259321899130,0cyclictest0-21swapper/510:22:395
259321799130,13cyclictest0-21swapper/410:15:024
259321799130,0cyclictest0-21swapper/410:20:524
2593221991212,0cyclictest0-21swapper/711:03:497
2593221991212,0cyclictest0-21swapper/710:52:097
259322199120,2cyclictest94014-21systemd-journal09:38:117
2593220991212,0cyclictest0-21swapper/610:13:186
259322099120,12cyclictest0-21swapper/611:27:526
259322099120,12cyclictest0-21swapper/609:21:076
2593218991212,0cyclictest0-21swapper/509:21:005
2593218991212,0cyclictest0-21swapper/508:08:105
2593217991212,0cyclictest0-21swapper/406:58:354
2593217991211,1cyclictest0-21swapper/407:18:314
2593221991111,0cyclictest0-21swapper/710:57:597
2593221991111,0cyclictest0-21swapper/708:45:247
2593221991110,0cyclictest0-21swapper/709:18:597
259322199110,8cyclictest918-21lldpd08:03:327
259322199110,10cyclictest2637145-21cat07:18:247
259322199110,10cyclictest1696195-21snmpd10:17:397
259322199110,10cyclictest1696195-21snmpd07:28:057
2593220991111,0cyclictest0-21swapper/608:38:246
2593218991111,0cyclictest0-21swapper/509:44:585
2593218991111,0cyclictest0-21swapper/507:58:245
2593217991111,0cyclictest0-21swapper/408:00:334
259321799110,11cyclictest0-21swapper/411:59:434
259322199100,9cyclictest2716672-21grep07:58:257
259322199100,9cyclictest1696195-21snmpd09:44:177
259322199100,7cyclictest954011-21systemd-resolve08:40:127
259322199100,7cyclictest918-21lldpd10:21:197
259322199100,3cyclictest2945145-21munin-plugin-st09:43:117
259322199100,1cyclictest918-21lldpd07:00:467
2593220991010,0cyclictest0-21swapper/610:56:496
2593220991010,0cyclictest0-21swapper/610:51:186
259322099100,10cyclictest0-21swapper/608:00:436
2593218991010,0cyclictest0-21swapper/511:59:365
2593218991010,0cyclictest0-21swapper/510:52:175
2593217991010,0cyclictest0-21swapper/408:05:264
259321799100,0cyclictest0-21swapper/408:44:234
25932219991,1cyclictest2920841-21latency_hist09:33:127
25932219990,8cyclictest3312834-21cat12:13:117
25932219990,8cyclictest3227134-21cat11:38:117
25932219990,8cyclictest2994479-21cat10:03:117
25932219990,8cyclictest2982256-21latency_hist09:58:117
25932219990,8cyclictest2908529-21date09:28:117
25932219990,8cyclictest2908529-21date09:28:117
25932219990,8cyclictest2859225-21munin-run09:08:117
25932219990,8cyclictest2715746-21sed07:58:127
25932219990,2cyclictest3276637-21cstates11:58:237
25932219990,2cyclictest3276210-21sed11:58:117
25932219990,2cyclictest2834258-21diskmemload12:08:117
25932209999,0cyclictest0-21swapper/607:23:216
25932189999,0cyclictest0-21swapper/508:42:325
25932219980,7cyclictest3214907-21latency_hist11:33:117
25932219980,7cyclictest3214907-21latency_hist11:33:117
25932219980,7cyclictest3018834-21latency_hist10:13:127
25932219980,7cyclictest2969537-21/usr/sbin/munin09:53:117
25932219980,2cyclictest3263902-21latency_hist11:53:117
25932219980,2cyclictest3190462-21latency_hist11:23:117
25932219980,1cyclictest777-21dbus-daemon07:18:127
25932219980,1cyclictest3349315-21latency_hist12:28:117
25932219980,1cyclictest3141257-21date11:03:117
25932219980,1cyclictest3055523-21latency_hist10:28:117
25932219980,1cyclictest3006828-21cut10:08:117
25932219980,1cyclictest2846955-21latency_hist09:03:117
25932219980,1cyclictest2834703-21exim408:58:117
25932219980,1cyclictest2755616-21cat08:18:127
25932209988,0cyclictest0-21swapper/611:07:516
25932209988,0cyclictest0-21swapper/609:44:276
25932179988,0cyclictest0-21swapper/411:25:214
25932179988,0cyclictest0-21swapper/411:06:444
25932179988,0cyclictest0-21swapper/409:45:524
383188970,0rtkit-daemon0-21swapper/509:13:125
25932219970,6cyclictest3239053-21ssh11:43:117
25932219970,6cyclictest3178161-21cat11:18:117
25932219970,6cyclictest3165694-21perf11:13:117
25932219970,6cyclictest2834258-21diskmemload12:18:117
25932219970,6cyclictest1696195-21snmpd07:53:127
25932219970,2cyclictest3104473-21perf10:48:117
25932219970,1cyclictest68-21ksoftirqd/711:48:117
25932219970,1cyclictest3079945-21perf10:38:117
25932219970,1cyclictest2871315-21munin-run09:13:117
25932219970,1cyclictest2685926-21munin-run07:43:117
25932219970,1cyclictest2685926-21munin-run07:43:117
25932219970,1cyclictest2665904-21latency_hist07:33:117
25932219970,1cyclictest2593214-21cyclictest09:18:117
25932209977,0cyclictest0-21swapper/607:01:076
25932219961,3cyclictest2775172-21awk08:28:117
25932219960,5cyclictest3092359-21cut10:43:117
25932219960,3cyclictest94014-21systemd-journal12:23:117
25932219960,3cyclictest94014-21systemd-journal08:23:117
25932219960,3cyclictest94014-21systemd-journal08:23:117
25932219960,3cyclictest94014-21systemd-journal08:13:117
25932219960,3cyclictest38314-10wireplumber08:53:117
25932179960,3cyclictest794-21systemd-logind12:08:114
3165757250,0sleep60-21swapper/611:13:116
25932219950,4cyclictest2785069-21awk08:33:117
25932219950,4cyclictest2626670-21cut07:13:127
25932219950,4cyclictest2593310-21cat06:58:127
25932219950,2cyclictest94014-21systemd-journal07:48:117
25932219950,2cyclictest94014-21systemd-journal07:38:127
25932219950,2cyclictest94014-21systemd-journal07:08:117
25932209955,0cyclictest0-21swapper/608:45:396
25932209950,4cyclictest2645644-21chrt07:19:196
25932209950,0cyclictest0-21swapper/612:01:506
25932189955,0cyclictest0-21swapper/508:46:195
25932179955,0cyclictest0-21swapper/408:42:394
25932179952,2cyclictest0-21swapper/407:18:124
25932179952,1cyclictest794-21systemd-logind07:28:114
25932179951,2cyclictest794-21systemd-logind10:43:114
25932179951,2cyclictest794-21systemd-logind07:08:114
25932179950,5cyclictest0-21swapper/410:50:134
25932179950,2cyclictest0-21swapper/411:33:114
25932179950,2cyclictest0-21swapper/411:33:114
25932219940,3cyclictest3068008-21cat10:33:117
25932219940,3cyclictest2794606-21latency_hist08:38:127
25932209940,3cyclictest2725961-21taskset08:03:156
25932189944,0cyclictest0-21swapper/512:23:115
25932189944,0cyclictest0-21swapper/512:18:115
25932189944,0cyclictest0-21swapper/511:13:115
25932189944,0cyclictest0-21swapper/510:53:115
25932189944,0cyclictest0-21swapper/509:53:115
25932189944,0cyclictest0-21swapper/507:33:115
25932189944,0cyclictest0-21swapper/507:18:125
25932189940,3cyclictest3104562-21chrt10:48:115
25932189940,3cyclictest2755629-21chrt08:18:125
25932179941,1cyclictest794-21systemd-logind12:28:114
25932179941,1cyclictest794-21systemd-logind11:53:114
25932179941,1cyclictest794-21systemd-logind10:28:114
25932179941,1cyclictest0-21swapper/412:23:114
25932179941,1cyclictest0-21swapper/409:28:114
25932179941,1cyclictest0-21swapper/409:28:114
25932179941,1cyclictest0-21swapper/409:08:114
25932179941,1cyclictest0-21swapper/407:33:114
25932179940,3cyclictest2932857-21chrt09:38:114
25932179940,3cyclictest2846904-21chrt09:03:114
25932179940,2cyclictest794-21systemd-logind12:18:114
25932179940,2cyclictest794-21systemd-logind10:48:114
25932179940,2cyclictest794-21systemd-logind09:53:114
25932179940,2cyclictest794-21systemd-logind09:13:124
25932179940,2cyclictest794-21systemd-logind08:28:114
25932179940,2cyclictest794-21systemd-logind08:23:114
25932179940,2cyclictest794-21systemd-logind08:23:114
25932179940,2cyclictest794-21systemd-logind07:43:114
25932179940,2cyclictest794-21systemd-logind07:43:114
25932179940,1cyclictest0-21swapper/411:48:114
25932209933,0cyclictest0-21swapper/611:43:116
25932209931,1cyclictest1002-21abrt-dump-journ09:38:116
25932209930,3cyclictest0-21swapper/609:13:126
25932209930,3cyclictest0-21swapper/608:23:116
25932209930,3cyclictest0-21swapper/608:23:116
25932209930,3cyclictest0-21swapper/607:33:116
25932209930,2cyclictest3080277-21chrt10:38:116
25932209930,1cyclictest13150irq/27-ahci[00006:58:126
25932189930,3cyclictest0-21swapper/512:28:105
25932189930,3cyclictest0-21swapper/512:08:115
25932189930,3cyclictest0-21swapper/511:53:105
25932189930,3cyclictest0-21swapper/511:48:115
25932189930,3cyclictest0-21swapper/511:43:115
25932189930,3cyclictest0-21swapper/511:38:115
25932189930,3cyclictest0-21swapper/511:33:115
25932189930,3cyclictest0-21swapper/511:33:115
25932189930,3cyclictest0-21swapper/511:18:115
25932189930,3cyclictest0-21swapper/511:03:115
25932189930,3cyclictest0-21swapper/510:43:115
25932189930,3cyclictest0-21swapper/510:28:115
25932189930,3cyclictest0-21swapper/510:08:115
25932189930,3cyclictest0-21swapper/510:03:115
25932189930,3cyclictest0-21swapper/509:58:115
25932189930,3cyclictest0-21swapper/509:43:115
25932189930,3cyclictest0-21swapper/509:38:115
25932189930,3cyclictest0-21swapper/509:33:115
25932189930,3cyclictest0-21swapper/509:28:115
25932189930,3cyclictest0-21swapper/509:28:115
25932189930,3cyclictest0-21swapper/509:18:115
25932189930,3cyclictest0-21swapper/509:08:115
25932189930,3cyclictest0-21swapper/509:03:115
25932189930,3cyclictest0-21swapper/508:53:115
25932189930,3cyclictest0-21swapper/508:33:115
25932189930,3cyclictest0-21swapper/508:28:115
25932189930,3cyclictest0-21swapper/508:23:115
25932189930,3cyclictest0-21swapper/508:23:115
25932189930,3cyclictest0-21swapper/507:58:115
25932189930,3cyclictest0-21swapper/507:48:125
25932189930,3cyclictest0-21swapper/507:43:115
25932189930,3cyclictest0-21swapper/507:43:115
25932189930,3cyclictest0-21swapper/507:13:125
25932189930,3cyclictest0-21swapper/507:08:115
25932189930,3cyclictest0-21swapper/506:58:125
25932189930,2cyclictest3079922-21turbostat10:38:115
25932179932,1cyclictest72-21rcuop/707:53:124
25932179930,1cyclictest794-21systemd-logind10:03:114
25932179930,1cyclictest0-21swapper/411:43:114
25932179930,1cyclictest0-21swapper/411:18:114
25932179930,1cyclictest0-21swapper/411:13:114
25932179930,1cyclictest0-21swapper/411:03:114
25932179930,1cyclictest0-21swapper/410:38:114
25932179930,1cyclictest0-21swapper/410:08:114
25932179930,1cyclictest0-21swapper/409:43:114
25932179930,1cyclictest0-21swapper/409:33:114
25932179930,1cyclictest0-21swapper/408:33:114
25932179930,1cyclictest0-21swapper/408:13:114
25932179930,1cyclictest0-21swapper/407:48:114
2592573230,0sleep40-21swapper/406:58:124
25932209922,0cyclictest0-21swapper/608:13:116
25932209921,1cyclictest445-21jbd2/sda3-808:33:116
25932209920,2cyclictest31408202sleep611:03:116
25932209920,2cyclictest2859222-21turbostat09:08:116
25932209920,2cyclictest2846886-21turbostat09:03:116
25932209920,2cyclictest2715654-21turbostat07:58:116
25932209920,2cyclictest1008268-21gmain12:28:116
25932209920,2cyclictest0-21swapper/612:23:116
25932209920,2cyclictest0-21swapper/612:08:116
25932209920,2cyclictest0-21swapper/611:58:116
25932209920,2cyclictest0-21swapper/611:33:116
25932209920,2cyclictest0-21swapper/611:33:116
25932209920,2cyclictest0-21swapper/610:13:126
25932209920,2cyclictest0-21swapper/610:08:116
25932209920,2cyclictest0-21swapper/609:53:116
25932209920,2cyclictest0-21swapper/609:28:116
25932209920,2cyclictest0-21swapper/609:28:116
25932209920,2cyclictest0-21swapper/609:18:116
25932209920,2cyclictest0-21swapper/608:58:116
25932209920,2cyclictest0-21swapper/608:53:116
25932209920,2cyclictest0-21swapper/608:38:126
25932209920,2cyclictest0-21swapper/607:53:126
25932209920,2cyclictest0-21swapper/607:48:116
25932209920,2cyclictest0-21swapper/607:38:126
25932209920,2cyclictest0-21swapper/607:13:126
25932209920,1cyclictest3104459-21turbostat10:48:116
25932209920,1cyclictest2636418-21turbostat07:18:126
25932209920,1cyclictest1002-21abrt-dump-journ09:43:116
25932209920,1cyclictest1002-21abrt-dump-journ08:18:116
25932209920,1cyclictest1001-21abrt-dump-journ07:43:116
25932209920,1cyclictest1001-21abrt-dump-journ07:43:116
25932209920,1cyclictest0-21swapper/611:53:116
25932209920,0cyclictest0-21swapper/611:18:116
25932189921,1cyclictest13150irq/27-ahci[00008:38:125
25932189920,2cyclictest13150irq/27-ahci[00008:58:115
25932189920,2cyclictest0-21swapper/508:13:115
25932189920,2cyclictest0-21swapper/507:53:125
25932189920,1cyclictest72-21rcuop/711:58:115
25932179921,1cyclictest2956294-21kworker/4:210:13:124
25932179920,1cyclictest28243352sleep408:53:114
25932179920,1cyclictest27549542sleep408:18:124
25932179920,1cyclictest2715654-21turbostat07:58:114
25932209911,0cyclictest0-21swapper/610:03:116
25932209911,0cyclictest0-21swapper/607:08:116
25932209910,1cyclictest3091121-21kworker/6:210:43:116
25932209910,1cyclictest2943940-1kworker/u17:210:33:116
25932209910,1cyclictest0-21swapper/612:18:106
25932209910,1cyclictest0-21swapper/612:13:116
25932209910,1cyclictest0-21swapper/611:48:116
25932209910,1cyclictest0-21swapper/611:38:116
25932209910,1cyclictest0-21swapper/611:23:116
25932209910,1cyclictest0-21swapper/610:28:116
25932209910,1cyclictest0-21swapper/609:58:116
25932209910,1cyclictest0-21swapper/609:33:116
25932209910,1cyclictest0-21swapper/608:28:116
25932189910,1cyclictest445-21jbd2/sda3-810:13:125
25932189910,1cyclictest13150irq/27-ahci[00007:38:125
25932189910,1cyclictest0-21swapper/512:13:115
25932189910,1cyclictest0-21swapper/511:23:115
25932189910,1cyclictest0-21swapper/510:33:115
25932179910,1cyclictest80-21kcompactd011:38:114
25932179910,1cyclictest72-21rcuop/711:58:114
25932179910,1cyclictest72-21rcuop/709:18:114
25932179910,1cyclictest72-21rcuop/707:13:124
25932179910,1cyclictest3188024-21kworker/4:011:23:114
25932179910,1cyclictest2784565-21kworker/4:208:38:124
25932179910,1cyclictest0-21swapper/412:13:114
25932179910,1cyclictest0-21swapper/410:33:114
25932179910,1cyclictest0-21swapper/409:58:114
25932179910,1cyclictest0-21swapper/408:58:114
25932179910,1cyclictest0-21swapper/407:38:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional