You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-10 - 09:20

x86 Intel Core i9-9900K @3600 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack0slot4.osadl.org (updated Sat Jun 10, 2023 00:45:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22456702382363,10sleep70-21swapper/719:07:0013
22456942362344,9sleep130-21swapper/1319:07:225
22442842362355,4sleep60-21swapper/619:05:2412
22459062358340,8sleep150-21swapper/1519:09:497
22457322356337,10sleep80-21swapper/819:07:4914
22457232355334,12sleep50-21swapper/519:07:4711
22459052354335,9sleep140-21swapper/1419:09:486
22457352354336,8sleep110-21swapper/1119:07:543
22458112346326,12sleep100-21swapper/1019:08:402
22456652338320,10sleep20-21swapper/219:06:558
22457362336317,9sleep120-21swapper/1219:07:554
22455882334317,9sleep40-21swapper/419:05:5310
22455702334316,10sleep90-21swapper/919:05:4215
22456042333315,10sleep10-21swapper/119:06:061
22456062330313,9sleep30-21swapper/319:06:089
22456802327309,10sleep00-21swapper/019:07:090
2246314997736,20cyclictest60-21ksoftirqd/620:50:1012
2246314997714,42cyclictest0-21swapper/600:38:0012
2246314997714,41cyclictest141rcu_preempt22:03:3812
2246314997613,42cyclictest0-21swapper/621:36:0312
2246314997613,42cyclictest0-21swapper/619:31:3412
2246314997613,21cyclictest0-21swapper/623:15:0612
2246314997534,41cyclictest2361752-21ssh21:17:4912
2246314997513,42cyclictest0-21swapper/623:56:0512
2246314997513,42cyclictest0-21swapper/621:59:3712
2246314997512,42cyclictest2565842-21kworker/u32:300:31:4912
2246314997512,42cyclictest0-21swapper/621:12:1312
2246314997435,19cyclictest60-21ksoftirqd/623:54:4612
2246314997432,41cyclictest1693-21arpwatch22:43:1612
2246314997412,21cyclictest0-21swapper/622:39:2712
2246314997412,20cyclictest60-21ksoftirqd/620:22:2312
2246314997311,45cyclictest0-21swapper/622:06:5912
2246314997311,42cyclictest0-21swapper/620:19:2112
2246314997311,42cyclictest0-21swapper/619:47:1712
2246314997311,21cyclictest0-21swapper/600:29:2512
2246314997311,21cyclictest0-21swapper/600:29:2412
2246314997310,21cyclictest0-21swapper/623:38:5512
224631499729,42cyclictest0-21swapper/622:57:3612
2246314997230,42cyclictest553-21jbd2/nvme0n1p2-22:45:1012
2246314997210,42cyclictest2-21kthreadd19:39:2112
224630899718,21cyclictest2416177-21ssh22:00:2610
224631499697,20cyclictest0-21swapper/622:30:0212
224631499686,42cyclictest0-21swapper/619:22:4112
2246314996847,20cyclictest60-21ksoftirqd/620:45:3412
224630899685,21cyclictest0-21swapper/419:47:5310
224631499675,21cyclictest0-21swapper/621:32:5212
224631499664,42cyclictest0-21swapper/622:15:3012
224631499664,21cyclictest0-21swapper/622:12:5812
224631499654,41cyclictest0-21swapper/600:15:0512
224631499654,41cyclictest0-21swapper/600:15:0512
224631499642,21cyclictest0-21swapper/620:00:1812
224631499641,42cyclictest0-21swapper/620:42:3512
224631499631,62cyclictest0-21swapper/619:25:0712
224631499631,42cyclictest0-21swapper/620:37:1512
224630899631,21cyclictest2411563-21ssh21:55:5410
2246314996240,21cyclictest666-21systemd-journal23:49:2412
2246314996220,41cyclictest666-21systemd-journal20:11:5212
224631499620,42cyclictest0-21swapper/619:50:2712
224631499620,41cyclictest0-21swapper/623:10:3712
224631499610,40cyclictest0-21swapper/621:20:0612
2246314996020,20cyclictest666-21systemd-journal00:09:2112
224631499600,40cyclictest0-21swapper/621:50:0912
2246314995917,42cyclictest0-21swapper/622:23:5212
2246314995917,42cyclictest0-21swapper/621:48:3512
2246314995917,42cyclictest0-21swapper/620:06:0412
2246314995917,42cyclictest0-21swapper/600:10:3812
2246314995917,42cyclictest0-21swapper/600:10:3812
2246314995917,21cyclictest0-21swapper/621:25:3012
2246314995917,0cyclictest0-21swapper/600:00:2512
224631499590,17cyclictest0-21swapper/623:25:4412
224631499590,17cyclictest0-21swapper/623:03:2912
224631499590,17cyclictest0-21swapper/622:50:0212
2246308995917,21cyclictest0-21swapper/422:46:0210
2246314995817,21cyclictest2596245-21ssh00:22:2612
2246314995817,21cyclictest2596245-21ssh00:22:2612
2246314995816,42cyclictest0-21swapper/620:25:1912
2246314995816,42cyclictest0-21swapper/619:16:1712
2246314995816,0cyclictest0-21swapper/623:42:4712
2246314995816,0cyclictest0-21swapper/623:30:1812
224631499580,17cyclictest0-21swapper/623:07:5712
2246314995736,20cyclictest1693-21arpwatch23:23:5012
2246314995716,21cyclictest0-21swapper/622:25:3512
2246314995715,42cyclictest0-21swapper/621:41:1312
2246314995715,42cyclictest0-21swapper/619:10:5612
2246308995716,21cyclictest0-21swapper/419:13:4510
2246314995615,41cyclictest0-21swapper/621:00:3112
2246314995613,42cyclictest1693-21arpwatch19:44:4912
2246308995656,0cyclictest0-21swapper/420:40:3610
2246308995615,21cyclictest0-21swapper/423:25:2810
2246308995615,21cyclictest0-21swapper/422:43:1210
2246308995615,0cyclictest0-21swapper/423:12:0010
2246308995615,0cyclictest0-21swapper/422:13:0810
2246314995514,21cyclictest0-21swapper/620:30:2312
2246308995513,42cyclictest2572968-21/usr/sbin/munin00:05:1810
2246308995513,21cyclictest0-21swapper/421:29:2410
2246295995555,0cyclictest0-21swapper/121:10:571
2246314995413,41cyclictest0-21swapper/619:56:3312
2246314995413,20cyclictest0-21swapper/621:08:2112
2246314995412,0cyclictest0-21swapper/620:55:3112
2246308995413,21cyclictest0-21swapper/419:40:1910
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional