You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-04-02 - 14:29

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sun Apr 02, 2023 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191053699140,13cyclictest0-21swapper/407:35:274
191054199130,1cyclictest918-21lldpd10:59:557
191053899130,13cyclictest0-21swapper/611:50:436
191053899130,13cyclictest0-21swapper/611:35:266
191053899130,13cyclictest0-21swapper/608:22:376
191053799130,13cyclictest0-21swapper/509:01:025
1910536991313,0cyclictest0-21swapper/411:35:054
191054199120,9cyclictest954011-21systemd-resolve06:56:297
191054199120,3cyclictest2150723-21diskmemload11:34:557
191054199120,11cyclictest1696195-21snmpd11:54:047
191053899120,0cyclictest0-21swapper/611:00:266
1910537991212,0cyclictest0-21swapper/511:01:105
1910536991212,0cyclictest0-21swapper/407:40:014
191053699120,0cyclictest0-21swapper/411:40:174
191053699120,0cyclictest0-21swapper/411:40:174
191054199110,8cyclictest918-21lldpd10:49:467
191054199110,8cyclictest918-21lldpd07:34:377
191054199110,2cyclictest954011-21systemd-resolve10:21:287
191054199110,10cyclictest1696195-21snmpd11:41:257
191054199110,10cyclictest1696195-21snmpd11:41:257
191054199110,10cyclictest1696195-21snmpd09:42:467
191054199110,10cyclictest1696195-21snmpd08:59:507
191054199110,10cyclictest1696195-21snmpd08:55:387
191054199110,10cyclictest1696195-21snmpd08:16:527
191053899110,0cyclictest0-21swapper/609:02:596
1910536991111,0cyclictest0-21swapper/409:37:564
191053699110,11cyclictest0-21swapper/409:39:404
191053699110,11cyclictest0-21swapper/408:57:444
3831889100,0rtkit-daemon0-21swapper/608:55:336
191054199100,9cyclictest2150703-21sendmail08:54:287
191054199100,9cyclictest2082147-21/usr/sbin/munin08:19:517
191054199100,9cyclictest1696195-21snmpd09:36:457
191054199100,1cyclictest1924344-21/usr/sbin/munin07:00:107
1910538991010,0cyclictest0-21swapper/611:44:066
1910538991010,0cyclictest0-21swapper/611:44:066
1910538991010,0cyclictest0-21swapper/610:54:076
1910538991010,0cyclictest0-21swapper/608:17:446
1910538991010,0cyclictest0-21swapper/607:37:416
1910538991010,0cyclictest0-21swapper/607:04:066
1910538991010,0cyclictest0-21swapper/606:55:356
1910537991010,0cyclictest0-21swapper/509:42:585
1910536991010,0cyclictest0-21swapper/410:50:284
1910536991010,0cyclictest0-21swapper/410:20:404
1910536991010,0cyclictest0-21swapper/408:16:354
19105419990,8cyclictest2011446-21ntpq07:40:027
19105419990,7cyclictest1973383-21grep07:24:287
19105419990,1cyclictest2381818-21cut10:49:287
19105379999,0cyclictest0-21swapper/511:43:545
19105379999,0cyclictest0-21swapper/511:43:545
19105369999,0cyclictest0-21swapper/406:56:494
19105419980,2cyclictest68-21ksoftirqd/710:44:277
19105419980,2cyclictest2301350-21munin-plugin-st10:09:287
19105379988,0cyclictest0-21swapper/511:50:315
19105379988,0cyclictest0-21swapper/510:53:275
19105379988,0cyclictest0-21swapper/508:55:505
19105379988,0cyclictest0-21swapper/508:15:005
19105379988,0cyclictest0-21swapper/507:35:355
19105379988,0cyclictest0-21swapper/506:56:585
19105369988,0cyclictest0-21swapper/410:59:364
19105419970,6cyclictest2260954-21latency_hist09:49:287
19105419970,6cyclictest2211226-21latency_hist09:24:287
19105419970,6cyclictest1696195-21snmpd08:34:287
19105419970,1cyclictest2462248-21sed11:29:287
19105419970,0cyclictest0-21swapper/707:34:287
19105389977,0cyclictest0-21swapper/609:40:396
19105389972,1cyclictest151rcu_preempt10:04:286
19105379977,0cyclictest0-21swapper/507:40:105
19105369977,0cyclictest0-21swapper/411:51:474
19105369977,0cyclictest0-21swapper/408:21:294
19105419961,4cyclictest2361683-21latency_hist10:39:287
19105419961,4cyclictest2062052-21munin-run08:09:287
19105419960,5cyclictest2572627-21sed12:24:277
19105419960,5cyclictest2140951-21cat08:49:287
19105419960,4cyclictest2552458-21systemd-run12:14:287
19105419960,3cyclictest94014-21systemd-journal12:04:287
19105419960,3cyclictest94014-21systemd-journal11:59:277
19105419960,3cyclictest94014-21systemd-journal11:24:287
19105419960,3cyclictest94014-21systemd-journal10:59:277
19105419960,3cyclictest94014-21systemd-journal10:14:287
19105419960,3cyclictest94014-21systemd-journal10:04:287
19105419960,3cyclictest94014-21systemd-journal09:19:287
19105419960,3cyclictest94014-21systemd-journal09:19:287
19105419960,3cyclictest94014-21systemd-journal08:44:287
19105419960,3cyclictest94014-21systemd-journal08:39:287
19105419960,3cyclictest94014-21systemd-journal08:39:287
19105419960,3cyclictest94014-21systemd-journal08:29:287
19105419960,3cyclictest94014-21systemd-journal07:59:277
19105419960,3cyclictest94014-21systemd-journal07:54:287
19105419960,3cyclictest94014-21systemd-journal07:49:287
19105419960,3cyclictest751-17auditd09:09:287
19105419960,2cyclictest2281170-21idleruntime-cro09:59:287
19105389966,0cyclictest0-21swapper/609:35:276
19105389966,0cyclictest0-21swapper/607:40:506
19105389960,6cyclictest0-21swapper/610:19:346
19105389960,0cyclictest0-21swapper/608:49:286
19105379960,5cyclictest38246-21llvmpipe-607:00:265
19105419950,4cyclictest2472185-21sed11:34:287
19105419950,4cyclictest2321823-21sed10:19:287
19105419950,4cyclictest2191185-21sed09:14:287
19105419950,4cyclictest1983564-21date07:29:297
19105419950,4cyclictest1910747-21cat06:54:297
19105419950,2cyclictest94014-21systemd-journal12:19:287
19105419950,2cyclictest94014-21systemd-journal12:09:287
19105419950,2cyclictest94014-21systemd-journal11:49:287
19105419950,2cyclictest94014-21systemd-journal11:19:287
19105419950,2cyclictest94014-21systemd-journal11:14:277
19105419950,2cyclictest94014-21systemd-journal11:09:277
19105419950,2cyclictest94014-21systemd-journal10:34:287
19105419950,2cyclictest94014-21systemd-journal10:29:277
19105419950,2cyclictest94014-21systemd-journal09:54:287
19105419950,2cyclictest94014-21systemd-journal09:34:287
19105419950,2cyclictest94014-21systemd-journal09:29:287
19105419950,2cyclictest94014-21systemd-journal08:14:297
19105419950,2cyclictest94014-21systemd-journal08:04:287
19105419950,2cyclictest94014-21systemd-journal07:19:287
19105419950,2cyclictest94014-21systemd-journal07:14:287
19105419950,2cyclictest94014-21systemd-journal07:09:287
19105389950,5cyclictest0-21swapper/611:59:276
19105389950,5cyclictest0-21swapper/611:24:276
19105389950,5cyclictest0-21swapper/611:19:286
19105389950,5cyclictest0-21swapper/610:39:276
19105389950,5cyclictest0-21swapper/610:29:276
19105389950,5cyclictest0-21swapper/610:14:286
19105389950,5cyclictest0-21swapper/609:49:286
19105389950,5cyclictest0-21swapper/609:34:296
19105389950,5cyclictest0-21swapper/609:29:286
19105389950,5cyclictest0-21swapper/609:19:276
19105389950,5cyclictest0-21swapper/609:19:276
19105389950,5cyclictest0-21swapper/609:14:286
19105389950,5cyclictest0-21swapper/608:39:286
19105389950,5cyclictest0-21swapper/608:39:286
19105389950,5cyclictest0-21swapper/608:34:286
19105389950,5cyclictest0-21swapper/608:29:286
19105389950,5cyclictest0-21swapper/607:59:286
19105389950,5cyclictest0-21swapper/607:49:286
19105389950,5cyclictest0-21swapper/607:24:286
19105389950,5cyclictest0-21swapper/607:19:286
19105379950,5cyclictest0-21swapper/511:34:325
19105379950,5cyclictest0-21swapper/510:19:345
19105379950,5cyclictest0-21swapper/510:14:285
19105379950,5cyclictest0-21swapper/509:34:345
19105379950,5cyclictest0-21swapper/508:19:495
19105379950,5cyclictest0-21swapper/507:19:285
19105369950,5cyclictest0-21swapper/409:02:434
19105369950,4cyclictest38246-21llvmpipe-607:00:284
19105389944,0cyclictest0-21swapper/607:34:286
19105389943,1cyclictest72-21rcuop/708:44:286
19105389943,1cyclictest61-21ksoftirqd/606:54:296
19105389941,2cyclictest1001-21abrt-dump-journ09:59:286
19105389941,1cyclictest61-21ksoftirqd/611:14:276
19105389940,4cyclictest0-21swapper/610:09:286
19105389940,2cyclictest794-21systemd-logind09:24:286
19105389940,2cyclictest794-21systemd-logind07:29:286
19105379944,0cyclictest0-21swapper/510:59:275
19105379944,0cyclictest0-21swapper/509:54:285
19105379944,0cyclictest0-21swapper/508:14:295
19105379941,2cyclictest1001-21abrt-dump-journ11:24:285
19105379940,4cyclictest0-21swapper/512:14:275
19105379940,4cyclictest0-21swapper/512:04:285
19105379940,4cyclictest0-21swapper/508:54:285
19105379940,4cyclictest0-21swapper/508:39:285
19105379940,4cyclictest0-21swapper/508:39:285
19105379940,4cyclictest0-21swapper/508:09:285
19105379940,4cyclictest0-21swapper/507:59:285
19105369942,1cyclictest1973379-21turbostat07:24:284
19105369940,3cyclictest2191083-21taskset09:14:284
19105369940,1cyclictest0-21swapper/411:24:274
19105389930,3cyclictest0-21swapper/612:24:276
19105389930,3cyclictest0-21swapper/612:04:286
19105389930,3cyclictest0-21swapper/611:29:276
19105389930,3cyclictest0-21swapper/610:59:276
19105389930,3cyclictest0-21swapper/610:44:276
19105389930,3cyclictest0-21swapper/609:54:286
19105389930,3cyclictest0-21swapper/609:09:286
19105389930,3cyclictest0-21swapper/608:14:296
19105389930,3cyclictest0-21swapper/608:09:286
19105389930,3cyclictest0-21swapper/607:54:286
19105389930,3cyclictest0-21swapper/607:14:286
19105389930,2cyclictest2381672-21taskset10:49:286
19105389930,2cyclictest2150739-21chrt08:54:286
19105389930,1cyclictest0-21swapper/612:19:286
19105389930,1cyclictest0-21swapper/608:04:286
19105389930,0cyclictest0-21swapper/607:09:286
19105379933,0cyclictest0-21swapper/512:24:275
19105379931,1cyclictest0-21swapper/507:09:285
19105379930,3cyclictest0-21swapper/511:59:275
19105379930,3cyclictest0-21swapper/511:29:285
19105379930,3cyclictest0-21swapper/511:14:285
19105379930,3cyclictest0-21swapper/510:49:285
19105379930,3cyclictest0-21swapper/510:44:285
19105379930,3cyclictest0-21swapper/510:39:275
19105379930,3cyclictest0-21swapper/510:34:285
19105379930,3cyclictest0-21swapper/510:19:285
19105379930,3cyclictest0-21swapper/510:04:285
19105379930,3cyclictest0-21swapper/509:59:285
19105379930,3cyclictest0-21swapper/509:29:285
19105379930,3cyclictest0-21swapper/509:24:285
19105379930,3cyclictest0-21swapper/509:19:275
19105379930,3cyclictest0-21swapper/509:19:275
19105379930,3cyclictest0-21swapper/509:14:285
19105379930,3cyclictest0-21swapper/508:29:285
19105379930,3cyclictest0-21swapper/508:04:285
19105379930,3cyclictest0-21swapper/507:34:285
19105379930,3cyclictest0-21swapper/507:24:285
19105379930,2cyclictest2421800-21turbostat11:09:275
19105379930,2cyclictest1001-21abrt-dump-journ10:09:285
19105379930,1cyclictest13150irq/27-ahci[00009:49:275
19105379930,1cyclictest0-21swapper/508:49:285
19105369930,2cyclictest2261147-21chrt09:49:284
19105389920,2cyclictest2472278-21taskset11:34:286
19105389920,2cyclictest0-21swapper/611:49:286
19105389920,2cyclictest0-21swapper/610:34:286
19105389920,2cyclictest0-21swapper/610:19:286
19105389920,1cyclictest2421800-21turbostat11:09:276
19105389920,1cyclictest0-21swapper/612:14:276
19105379922,0cyclictest0-21swapper/507:54:285
19105379921,1cyclictest13150irq/27-ahci[00007:14:285
19105379920,2cyclictest0-21swapper/511:34:285
19105379920,2cyclictest0-21swapper/510:29:285
19105379920,2cyclictest0-21swapper/509:09:285
19105379920,2cyclictest0-21swapper/507:29:295
19105379920,1cyclictest2562529-21chrt12:19:285
19105379920,1cyclictest2130950-21turbostat08:44:285
19105369921,1cyclictest2350901-21kworker/4:110:34:284
19105369921,0cyclictest0-21swapper/407:19:284
19105369920,2cyclictest0-21swapper/411:59:274
19105369920,1cyclictest2552429-21turbostat12:14:274
19105369920,1cyclictest2461942-21turbostat11:29:274
19105369920,1cyclictest2371666-21turbostat10:44:284
19105369920,1cyclictest2361587-21turbostat10:39:284
19105369920,1cyclictest2130950-21turbostat08:44:284
19105369920,1cyclictest2121065-21turbostat08:39:284
19105369920,1cyclictest2121065-21turbostat08:39:284
19105369920,1cyclictest2052247-21turbostat08:04:284
19105369920,1cyclictest13150irq/27-ahci[00010:29:274
19105369920,1cyclictest0-21swapper/412:24:274
19105369920,1cyclictest0-21swapper/411:09:274
19105369920,1cyclictest0-21swapper/410:09:284
19105369920,1cyclictest0-21swapper/410:04:284
19105369920,1cyclictest0-21swapper/409:59:284
19105369920,1cyclictest0-21swapper/409:09:284
19105369920,0cyclictest0-21swapper/411:34:284
19105389910,1cyclictest445-21jbd2/sda3-812:09:286
19105379910,1cyclictest0-21swapper/512:09:285
19105379910,1cyclictest0-21swapper/511:49:285
19105379910,1cyclictest0-21swapper/511:19:285
19105379910,1cyclictest0-21swapper/507:49:285
19105379910,1cyclictest0-21swapper/506:54:295
19105379910,0cyclictest0-21swapper/509:34:285
19105379910,0cyclictest0-21swapper/508:34:285
19105369910,1cyclictest72-21rcuop/712:04:274
19105369910,1cyclictest72-21rcuop/709:54:284
19105369910,1cyclictest2071308-21kworker/4:108:49:284
19105369910,1cyclictest13150irq/27-ahci[00006:54:294
19105369910,1cyclictest0-21swapper/412:19:284
19105369910,1cyclictest0-21swapper/411:49:274
19105369910,1cyclictest0-21swapper/411:19:284
19105369910,1cyclictest0-21swapper/411:14:274
19105369910,1cyclictest0-21swapper/410:59:274
19105369910,1cyclictest0-21swapper/410:49:284
19105369910,1cyclictest0-21swapper/410:14:284
19105369910,1cyclictest0-21swapper/409:34:284
19105369910,1cyclictest0-21swapper/409:29:284
19105369910,1cyclictest0-21swapper/409:24:284
19105369910,1cyclictest0-21swapper/409:19:274
19105369910,1cyclictest0-21swapper/409:19:274
19105369910,1cyclictest0-21swapper/408:54:284
19105369910,1cyclictest0-21swapper/408:34:284
19105369910,1cyclictest0-21swapper/408:29:284
19105369910,1cyclictest0-21swapper/408:09:284
19105369910,1cyclictest0-21swapper/407:59:284
19105369910,1cyclictest0-21swapper/407:54:284
19105369910,1cyclictest0-21swapper/407:49:284
19105369910,1cyclictest0-21swapper/407:34:284
19105369910,1cyclictest0-21swapper/407:29:284
19105369910,1cyclictest0-21swapper/407:14:284
19105369910,1cyclictest0-21swapper/407:09:284
19105369900,0cyclictest0-21swapper/412:09:284
19105369900,0cyclictest0-21swapper/410:19:284
19105369900,0cyclictest0-21swapper/408:14:284
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional