You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-26 - 23:06

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sun Mar 26, 2023 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1149743991411,2cyclictest1456617-21kthreadcore11:15:137
1149743991313,0cyclictest0-21swapper/711:04:117
114974199130,13cyclictest0-21swapper/611:15:006
114974199130,13cyclictest0-21swapper/610:14:006
114973599130,0cyclictest0-21swapper/407:02:504
1149743991212,0cyclictest0-21swapper/710:13:547
1149743991212,0cyclictest0-21swapper/709:30:427
1149743991212,0cyclictest0-21swapper/708:13:557
1149743991212,0cyclictest0-21swapper/707:30:157
114974399120,1cyclictest1530883-21kthreadcore12:15:167
114974399120,11cyclictest1696195-21snmpd09:42:547
114974399120,11cyclictest1696195-21snmpd08:20:347
1149735991212,0cyclictest0-21swapper/412:18:564
1149735991212,0cyclictest0-21swapper/411:03:354
1149735991212,0cyclictest0-21swapper/407:43:214
114973599120,12cyclictest0-21swapper/411:39:034
114974399110,2cyclictest1525526-21munin-run12:14:557
114974399110,1cyclictest1195395-21cut07:25:197
114974399110,10cyclictest1696195-21snmpd07:00:207
114974199110,11cyclictest0-21swapper/612:17:456
114974199110,11cyclictest0-21swapper/609:02:356
114974199110,0cyclictest0-21swapper/607:04:486
1149740991111,0cyclictest0-21swapper/509:41:395
114974099110,11cyclictest0-21swapper/512:15:595
114974099110,11cyclictest0-21swapper/511:42:155
114974099110,0cyclictest0-21swapper/511:19:145
1149735991111,0cyclictest0-21swapper/410:24:294
1149735991111,0cyclictest0-21swapper/410:24:294
1149735991111,0cyclictest0-21swapper/409:31:494
1149735991111,0cyclictest0-21swapper/409:01:434
114973599110,11cyclictest0-21swapper/412:24:084
114973599110,11cyclictest0-21swapper/411:17:084
114973599110,0cyclictest0-21swapper/410:13:364
1149743991010,0cyclictest0-21swapper/710:22:157
1149743991010,0cyclictest0-21swapper/710:22:157
114974399100,9cyclictest1696195-21snmpd11:35:157
114974399100,9cyclictest1696195-21snmpd08:51:447
114974399100,7cyclictest918-21lldpd12:20:197
114974399100,7cyclictest1512405-21dump-pmu-power11:59:557
114974399100,2cyclictest918-21lldpd07:40:207
114974399100,2cyclictest1430968-21awk10:54:547
1149741991010,0cyclictest0-21swapper/610:20:186
1149741991010,0cyclictest0-21swapper/610:20:186
1149741991010,0cyclictest0-21swapper/609:42:476
1149741991010,0cyclictest0-21swapper/608:10:246
114974099100,10cyclictest0-21swapper/508:52:275
114974099100,10cyclictest0-21swapper/507:03:315
1149735991010,0cyclictest0-21swapper/410:53:484
1149735991010,0cyclictest0-21swapper/408:11:164
114973599100,0cyclictest0-21swapper/408:23:154
11497439990,8cyclictest1696195-21snmpd09:00:087
11497439990,7cyclictest918-21lldpd11:41:487
11497419999,0cyclictest0-21swapper/611:35:496
11497419999,0cyclictest0-21swapper/608:51:426
11497409999,0cyclictest0-21swapper/510:23:355
11497409999,0cyclictest0-21swapper/510:23:355
11497409999,0cyclictest0-21swapper/510:10:115
11497409999,0cyclictest0-21swapper/509:33:555
11497409999,0cyclictest0-21swapper/509:01:365
11497359999,0cyclictest0-21swapper/408:53:594
11497439980,6cyclictest1419529-21munin-plugin-st10:44:557
11497439980,6cyclictest1335757-21munin-plugin-st09:29:557
11497439980,2cyclictest1514115-21ssh12:04:557
11497419988,0cyclictest0-21swapper/611:01:276
11497419988,0cyclictest0-21swapper/610:53:056
11497359988,0cyclictest0-21swapper/409:44:264
11497439970,6cyclictest1406387-21latency_hist10:29:557
11497439970,4cyclictest94014-21systemd-journal10:04:557
11497439970,4cyclictest38314-10wireplumber07:14:567
11497439970,2cyclictest1477433-21cat11:29:567
11497419977,0cyclictest0-21swapper/609:31:356
11497409977,0cyclictest0-21swapper/511:01:255
11497439960,5cyclictest1267233-21systemd-run08:34:557
11497439960,3cyclictest94014-21systemd-journal11:24:557
11497439960,3cyclictest94014-21systemd-journal11:09:557
11497439960,3cyclictest94014-21systemd-journal10:34:557
11497439960,3cyclictest94014-21systemd-journal10:09:557
11497439960,3cyclictest94014-21systemd-journal09:54:557
11497439960,3cyclictest94014-21systemd-journal09:49:557
11497439960,3cyclictest94014-21systemd-journal09:24:557
11497439960,3cyclictest94014-21systemd-journal08:44:557
11497439960,3cyclictest94014-21systemd-journal08:29:557
11497439960,3cyclictest94014-21systemd-journal08:09:567
11497439960,3cyclictest94014-21systemd-journal08:04:567
11497439960,3cyclictest94014-21systemd-journal07:54:567
11497439960,3cyclictest94014-21systemd-journal07:24:567
11497419961,3cyclictest0-21swapper/607:26:316
11497419960,4cyclictest0-21swapper/607:32:106
11497409966,0cyclictest0-21swapper/512:21:115
11497409962,3cyclictest0-21swapper/510:53:355
11497359966,0cyclictest0-21swapper/411:42:314
11497439950,4cyclictest1429944-21idleruntime-cro10:49:557
11497439950,4cyclictest1371414-21cut09:59:567
11497439950,4cyclictest1324159-21cat09:19:567
11497439950,3cyclictest94014-21systemd-journal07:59:567
11497439950,2cyclictest94014-21systemd-journal12:09:557
11497439950,2cyclictest94014-21systemd-journal11:54:557
11497439950,2cyclictest94014-21systemd-journal11:49:557
11497439950,2cyclictest94014-21systemd-journal10:39:567
11497439950,2cyclictest94014-21systemd-journal10:19:557
11497439950,2cyclictest94014-21systemd-journal09:39:557
11497439950,2cyclictest94014-21systemd-journal09:14:557
11497439950,2cyclictest94014-21systemd-journal08:59:557
11497439950,2cyclictest94014-21systemd-journal08:49:567
11497439950,2cyclictest94014-21systemd-journal08:39:567
11497439950,2cyclictest94014-21systemd-journal08:19:557
11497439950,2cyclictest94014-21systemd-journal07:49:557
11497439950,2cyclictest94014-21systemd-journal07:39:567
11497439950,2cyclictest94014-21systemd-journal07:09:557
11497439950,2cyclictest94014-21systemd-journal06:59:567
11497439950,2cyclictest94014-21systemd-journal06:54:567
11497439950,0cyclictest0-21swapper/709:09:557
11497419950,5cyclictest0-21swapper/612:19:566
11497419950,5cyclictest0-21swapper/612:14:556
11497419950,5cyclictest0-21swapper/611:39:576
11497419950,5cyclictest0-21swapper/611:09:556
11497419950,5cyclictest0-21swapper/610:44:556
11497419950,5cyclictest0-21swapper/610:34:556
11497419950,5cyclictest0-21swapper/609:24:556
11497419950,5cyclictest0-21swapper/609:09:556
11497419950,5cyclictest0-21swapper/608:49:556
11497419950,5cyclictest0-21swapper/608:19:566
11497419950,5cyclictest0-21swapper/608:04:566
11497419950,5cyclictest0-21swapper/607:39:586
11497419950,5cyclictest0-21swapper/606:59:566
11497409950,5cyclictest0-21swapper/512:14:555
11497409950,5cyclictest0-21swapper/511:59:555
11497409950,5cyclictest0-21swapper/511:35:105
11497409950,5cyclictest0-21swapper/510:49:555
11497409950,5cyclictest0-21swapper/510:34:555
11497409950,5cyclictest0-21swapper/509:54:555
11497409950,5cyclictest0-21swapper/509:14:555
11497409950,5cyclictest0-21swapper/508:59:555
11497409950,5cyclictest0-21swapper/508:19:575
11497409950,5cyclictest0-21swapper/508:09:575
11497409950,5cyclictest0-21swapper/507:39:585
11497409950,5cyclictest0-21swapper/507:29:575
11497409950,5cyclictest0-21swapper/507:24:565
11497409950,5cyclictest0-21swapper/507:24:565
11497359951,3cyclictest0-21swapper/407:30:174
11497439940,3cyclictest1478651-21latency_hist11:34:557
11497439940,3cyclictest1454910-21latency_hist11:14:557
11497439940,3cyclictest1441945-21cat10:59:557
11497439940,3cyclictest1186546-21latency_hist07:19:567
11497419944,0cyclictest0-21swapper/611:49:556
11497419944,0cyclictest0-21swapper/609:59:566
11497419944,0cyclictest0-21swapper/609:14:556
11497419944,0cyclictest0-21swapper/607:24:556
11497419940,4cyclictest0-21swapper/608:34:556
11497419940,4cyclictest0-21swapper/608:09:566
11497419940,3cyclictest1372407-21turbostat10:04:556
11497409940,4cyclictest0-21swapper/508:39:565
11497409940,3cyclictest1002-21abrt-dump-journ09:59:565
11497409940,3cyclictest1002-21abrt-dump-journ08:04:565
11497359942,1cyclictest0-21swapper/410:44:554
11497359940,3cyclictest1453555-21taskset11:09:554
11497359940,3cyclictest1187954-21taskset07:25:084
11497419930,3cyclictest0-21swapper/607:54:566
11497419930,3cyclictest0-21swapper/607:39:566
11497419930,3cyclictest0-21swapper/607:19:566
11497409931,1cyclictest1513758-21turbostat12:04:555
11497409930,3cyclictest0-21swapper/510:44:555
11497409930,3cyclictest0-21swapper/508:09:565
11497409930,3cyclictest0-21swapper/507:39:565
11497409930,2cyclictest1175051-21taskset07:09:565
11497359931,1cyclictest47-21ksoftirqd/410:34:554
11497359930,2cyclictest1502337-21taskset11:54:554
11497359930,1cyclictest13150irq/27-ahci[00012:04:554
11497359930,1cyclictest0-21swapper/411:29:554
11497359930,1cyclictest0-21swapper/409:39:554
383188920,0rtkit-daemon0-21swapper/407:19:564
11497419922,0cyclictest0-21swapper/609:39:556
11497419921,1cyclictest445-21jbd2/sda3-810:39:566
11497419921,1cyclictest13150irq/27-ahci[00009:19:566
11497419920,2cyclictest1512400-21turbostat11:59:556
11497419920,2cyclictest0-21swapper/611:29:556
11497419920,2cyclictest0-21swapper/611:24:556
11497419920,2cyclictest0-21swapper/611:14:556
11497419920,2cyclictest0-21swapper/610:49:566
11497419920,2cyclictest0-21swapper/610:29:556
11497419920,2cyclictest0-21swapper/609:54:556
11497419920,2cyclictest0-21swapper/609:49:556
11497419920,2cyclictest0-21swapper/608:59:556
11497419920,2cyclictest0-21swapper/608:44:566
11497419920,2cyclictest0-21swapper/608:39:566
11497419920,2cyclictest0-21swapper/607:14:566
11497419920,1cyclictest1513758-21turbostat12:04:556
11497419920,1cyclictest1382868-21turbostat10:09:556
11497419920,1cyclictest1254896-21taskset08:19:566
11497419920,1cyclictest1175017-21turbostat07:09:556
11497419920,1cyclictest0-21swapper/610:19:556
11497419920,1cyclictest0-21swapper/608:29:556
11497419920,0cyclictest0-21swapper/611:34:556
11497419920,0cyclictest0-21swapper/609:29:556
11497409921,1cyclictest54-21ksoftirqd/506:59:565
11497409921,1cyclictest1334849-21kworker/u16:009:39:555
11497409921,1cyclictest13150irq/27-ahci[00008:19:555
11497409921,1cyclictest1002-21abrt-dump-journ10:09:555
11497409920,2cyclictest1002-21abrt-dump-journ10:59:555
11497409920,2cyclictest1002-21abrt-dump-journ09:19:565
11497409920,2cyclictest1002-21abrt-dump-journ07:54:565
11497409920,2cyclictest1002-21abrt-dump-journ07:14:565
11497409920,2cyclictest0-21swapper/510:39:565
11497409920,2cyclictest0-21swapper/508:29:555
11497409920,2cyclictest0-21swapper/507:19:565
11497409920,1cyclictest1466645-21turbostat11:24:555
11497409920,1cyclictest1406393-21turbostat10:29:555
11497409920,1cyclictest1278571-21turbostat08:44:555
11497409920,1cyclictest1002-21abrt-dump-journ11:34:555
11497409920,1cyclictest1002-21abrt-dump-journ11:29:555
11497409920,1cyclictest1002-21abrt-dump-journ10:04:555
11497359922,0cyclictest0-21swapper/408:04:564
11497359921,1cyclictest13150irq/27-ahci[00012:14:554
11497359921,1cyclictest13150irq/27-ahci[00012:09:554
11497359921,1cyclictest13150irq/27-ahci[00011:34:554
11497359921,1cyclictest13150irq/27-ahci[00011:14:554
11497359921,1cyclictest13150irq/27-ahci[00010:49:554
11497359921,1cyclictest13150irq/27-ahci[00010:39:564
11497359921,1cyclictest13150irq/27-ahci[00009:54:554
11497359921,1cyclictest1278571-21turbostat08:44:554
11497359921,0cyclictest13150irq/27-ahci[00006:54:564
11497359920,2cyclictest0-21swapper/411:59:554
11497359920,2cyclictest0-21swapper/409:29:554
11497359920,1cyclictest13150irq/27-ahci[00011:24:554
11497359920,1cyclictest13150irq/27-ahci[00010:59:554
11497359920,1cyclictest1288771-21turbostat08:49:564
11497359920,1cyclictest1243224-21turbostat08:09:564
11497359920,1cyclictest1160067-21modprobe06:59:564
11497359920,1cyclictest0-21swapper/411:49:554
11497359920,1cyclictest0-21swapper/410:29:554
11497359920,1cyclictest0-21swapper/410:09:554
11497359920,1cyclictest0-21swapper/407:49:554
11497359920,1cyclictest0-21swapper/407:39:564
11497359920,1cyclictest0-21swapper/407:09:554
11497359920,0cyclictest0-21swapper/407:14:564
11497419910,1cyclictest445-21jbd2/sda3-811:54:556
11497419910,1cyclictest445-21jbd2/sda3-807:59:566
11497419910,1cyclictest0-21swapper/612:09:556
11497419910,1cyclictest0-21swapper/610:59:556
11497419910,1cyclictest0-21swapper/607:49:556
11497419910,1cyclictest0-21swapper/606:54:566
11497409910,1cyclictest13150irq/27-ahci[00008:34:555
11497409910,1cyclictest1002-21abrt-dump-journ11:49:555
11497409910,1cyclictest1002-21abrt-dump-journ09:24:555
11497409910,1cyclictest1002-21abrt-dump-journ07:49:555
11497409910,1cyclictest0-21swapper/512:09:555
11497409910,1cyclictest0-21swapper/511:14:555
11497409910,1cyclictest0-21swapper/511:09:555
11497409910,1cyclictest0-21swapper/510:19:555
11497409910,1cyclictest0-21swapper/509:49:555
11497409910,1cyclictest0-21swapper/509:29:555
11497409910,1cyclictest0-21swapper/509:09:555
11497409910,1cyclictest0-21swapper/508:49:565
11497409910,1cyclictest0-21swapper/507:59:565
11497409910,1cyclictest0-21swapper/506:54:565
11497359910,1cyclictest72-21rcuop/708:59:554
11497359910,1cyclictest1371913-21kworker/u16:110:04:554
11497359910,1cyclictest13150irq/27-ahci[00007:54:564
11497359910,1cyclictest1242635-21kworker/u16:008:19:554
11497359910,1cyclictest0-21swapper/410:19:554
11497359910,1cyclictest0-21swapper/409:59:564
11497359910,1cyclictest0-21swapper/409:49:554
11497359910,1cyclictest0-21swapper/409:24:554
11497359910,1cyclictest0-21swapper/409:19:564
11497359910,1cyclictest0-21swapper/409:14:554
11497359910,1cyclictest0-21swapper/409:09:554
11497359910,1cyclictest0-21swapper/408:34:554
11497359910,1cyclictest0-21swapper/408:29:554
11497359910,1cyclictest0-21swapper/407:59:564
11497359910,1cyclictest0-21swapper/407:24:564
11497409900,0cyclictest0-21swapper/511:54:555
11497359900,0cyclictest0-21swapper/408:39:564
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional