You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-02 - 09:50

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a4-7 -p99 -i200 -h400 -t4 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Fri Jun 02, 2023 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197940924737,6sleep60-21swapper/616:21:586
197940924737,6sleep60-21swapper/616:21:586
197928724535,6sleep40-21swapper/416:20:204
197928724535,6sleep40-21swapper/416:20:204
19793902393,32sleep70-21swapper/716:21:437
19793902393,32sleep70-21swapper/716:21:437
197929723525,6sleep50-21swapper/516:20:295
197929723525,6sleep50-21swapper/516:20:295
197998999170,16cyclictest0-21swapper/419:58:034
197998999170,16cyclictest0-21swapper/419:22:164
197999899160,15cyclictest0-21swapper/620:27:386
197999899160,15cyclictest0-21swapper/620:27:386
197999599160,0cyclictest0-21swapper/520:48:265
1979989991616,0cyclictest0-21swapper/421:10:064
197998999160,16cyclictest0-21swapper/420:59:034
197998999160,0cyclictest0-21swapper/420:14:364
197999999150,14cyclictest1047-21snmpd19:57:067
197999999150,14cyclictest1047-21snmpd18:48:407
197999899150,14cyclictest0-21swapper/619:20:486
1979995991515,0cyclictest0-21swapper/520:58:125
1979989991515,0cyclictest0-21swapper/419:14:324
197998999150,15cyclictest0-21swapper/419:48:544
1979998991412,1cyclictest2585421-21Xorg21:11:096
197999899140,14cyclictest0-21swapper/618:40:076
197999899140,0cyclictest0-21swapper/619:16:146
197999899140,0cyclictest0-21swapper/616:29:266
1979995991414,0cyclictest0-21swapper/519:57:405
1979989991414,0cyclictest0-21swapper/420:28:384
1979989991414,0cyclictest0-21swapper/420:28:384
1979998991313,0cyclictest0-21swapper/621:47:536
1979998991313,0cyclictest0-21swapper/620:44:406
1979998991313,0cyclictest0-21swapper/620:16:366
1979995991313,0cyclictest0-21swapper/519:17:565
197999599130,13cyclictest0-21swapper/517:00:435
1979989991313,0cyclictest0-21swapper/421:44:564
1979989991313,0cyclictest0-21swapper/420:48:394
197998999130,0cyclictest0-21swapper/418:14:574
197999999120,11cyclictest2573903-21cat20:24:347
197999999120,11cyclictest2573903-21cat20:24:347
1979995991212,0cyclictest0-21swapper/518:17:055
1979995991212,0cyclictest0-21swapper/516:47:235
1979995991212,0cyclictest0-21swapper/516:29:155
1979989991212,0cyclictest0-21swapper/417:39:294
1979989991212,0cyclictest0-21swapper/417:06:514
197999999110,10cyclictest2627159-21cat20:44:337
197999999110,10cyclictest2231882-21cat18:14:307
197999999110,10cyclictest1047-21snmpd20:56:587
197999999110,10cyclictest1047-21snmpd17:01:167
1979998991111,0cyclictest0-21swapper/618:48:106
1979998991111,0cyclictest0-21swapper/617:42:546
1979998991111,0cyclictest0-21swapper/617:35:586
1979995991111,0cyclictest0-21swapper/521:45:305
1979995991110,1cyclictest0-21swapper/518:41:035
1979989991111,0cyclictest0-21swapper/418:48:514
1979989991111,0cyclictest0-21swapper/416:45:154
197999999100,9cyclictest1047-21snmpd21:39:217
197999999100,9cyclictest1047-21snmpd19:48:147
197999999100,9cyclictest1047-21snmpd17:39:477
197999999100,9cyclictest1047-21snmpd17:35:207
197999999100,9cyclictest1047-21snmpd17:05:167
197999999100,9cyclictest1047-21snmpd16:46:037
197999999100,9cyclictest1047-21snmpd16:31:367
1979998991010,0cyclictest0-21swapper/621:43:476
1979998991010,0cyclictest0-21swapper/620:55:146
1979998991010,0cyclictest0-21swapper/619:58:286
1979998991010,0cyclictest0-21swapper/617:03:486
197999599109,1cyclictest2585421-21Xorg19:45:135
197999599109,1cyclictest2585421-21Xorg18:44:225
197999599100,0cyclictest2585421-21Xorg17:37:315
1979989991010,0cyclictest0-21swapper/418:41:354
1979989991010,0cyclictest0-21swapper/417:01:574
19799999992,1cyclictest2118683-21munin-run17:24:087
19799999990,8cyclictest1047-21snmpd20:14:487
19799999990,8cyclictest1047-21snmpd19:22:057
19799999990,8cyclictest1047-21snmpd19:14:297
19799989994,5cyclictest0-21swapper/618:09:386
19799959999,0cyclictest2585421-21Xorg17:39:345
19799959998,1cyclictest0-21swapper/521:42:495
19799959990,9cyclictest0-21swapper/520:27:255
19799959990,9cyclictest0-21swapper/520:27:255
19799899999,0cyclictest0-21swapper/418:10:514
19799899999,0cyclictest0-21swapper/416:32:004
19799999980,7cyclictest1047-21snmpd21:09:537
19799999980,7cyclictest1047-21snmpd18:42:077
19799999980,7cyclictest1047-21snmpd18:10:247
19799999980,2cyclictest2386022-21munin-run19:14:087
19799999980,1cyclictest2279672-21grep18:34:087
19799959987,1cyclictest2585421-21Xorg20:15:005
19799959980,0cyclictest0-21swapper/519:20:475
19799959980,0cyclictest0-21swapper/518:09:335
19799959980,0cyclictest0-21swapper/517:06:465
19799899988,0cyclictest0-21swapper/421:42:154
19799999970,6cyclictest1047-21snmpd21:47:247
19799899977,0cyclictest0-21swapper/417:36:014
19799999962,3cyclictest980-21containerd16:54:097
19799999962,3cyclictest2772204-21latency_hist21:39:087
19799999961,4cyclictest2545921-21idleruntime-cro20:14:087
19799999961,4cyclictest2439148-21ssh19:34:077
19799999961,4cyclictest2439148-21ssh19:34:077
19799999960,5cyclictest2758770-21latency_hist21:34:087
19799999960,5cyclictest2017852-21cut16:39:087
19799999960,5cyclictest1-21systemd17:29:087
19799999960,2cyclictest1-21systemd17:34:097
19799989964,2cyclictest0-21swapper/617:05:026
19799989960,5cyclictest0-21swapper/619:44:096
19799999953,1cyclictest2253057-21munin-run18:24:087
19799999952,2cyclictest2452502-21latency_hist19:39:087
19799999950,4cyclictest2812446-21sed21:54:087
19799999950,4cyclictest2652531-21cat20:54:087
19799999950,4cyclictest2652531-21cat20:54:087
19799999950,4cyclictest2572765-21date20:24:087
19799999950,4cyclictest2572765-21date20:24:087
19799999950,4cyclictest2519429-21cut20:04:087
19799999950,4cyclictest2426195-21cut19:29:087
19799999950,4cyclictest2359529-21cut19:04:087
19799999950,4cyclictest2333168-21cat18:54:087
19799999950,4cyclictest2293154-21sed18:39:097
19799999950,4cyclictest2208352-21basename18:04:087
19799999950,4cyclictest2096243-21sendmail17:14:087
19799999950,4cyclictest2029201-21latency_hist16:44:097
19799999950,3cyclictest754-21systemd-machine20:34:087
19799999950,3cyclictest520-21systemd-journal21:29:087
19799999950,3cyclictest520-21systemd-journal19:54:087
19799999950,3cyclictest520-21systemd-journal17:59:087
19799999950,3cyclictest520-21systemd-journal17:49:087
19799999950,2cyclictest520-21systemd-journal21:19:077
19799999950,2cyclictest520-21systemd-journal21:04:087
19799999950,2cyclictest520-21systemd-journal18:09:087
19799999950,2cyclictest520-21systemd-journal16:59:097
19799989951,1cyclictest2585421-21Xorg21:19:086
19799989950,5cyclictest0-21swapper/621:39:076
19799989950,5cyclictest0-21swapper/621:29:086
19799989950,5cyclictest0-21swapper/621:04:086
19799989950,5cyclictest0-21swapper/620:54:086
19799989950,5cyclictest0-21swapper/620:54:086
19799989950,5cyclictest0-21swapper/620:44:086
19799989950,5cyclictest0-21swapper/620:39:086
19799989950,5cyclictest0-21swapper/620:34:086
19799989950,5cyclictest0-21swapper/620:14:086
19799989950,5cyclictest0-21swapper/619:54:086
19799989950,5cyclictest0-21swapper/619:34:086
19799989950,5cyclictest0-21swapper/619:34:086
19799989950,5cyclictest0-21swapper/619:29:086
19799989950,5cyclictest0-21swapper/619:14:086
19799989950,5cyclictest0-21swapper/619:09:096
19799989950,5cyclictest0-21swapper/619:04:086
19799989950,5cyclictest0-21swapper/618:39:096
19799989950,5cyclictest0-21swapper/618:24:086
19799989950,5cyclictest0-21swapper/618:14:086
19799989950,5cyclictest0-21swapper/618:04:086
19799989950,5cyclictest0-21swapper/617:49:086
19799989950,5cyclictest0-21swapper/617:34:096
19799989950,5cyclictest0-21swapper/617:29:086
19799989950,5cyclictest0-21swapper/617:24:086
19799989950,5cyclictest0-21swapper/617:14:086
19799989950,5cyclictest0-21swapper/616:59:096
19799989950,5cyclictest0-21swapper/616:54:086
19799989950,5cyclictest0-21swapper/616:44:096
19799989950,5cyclictest0-21swapper/616:44:096
19799989950,5cyclictest0-21swapper/616:39:086
19799989950,4cyclictest0-21swapper/619:39:086
19799959950,5cyclictest0-21swapper/521:09:095
19799959950,0cyclictest2585421-21Xorg20:09:085
19799899950,5cyclictest0-21swapper/417:49:084
19799899950,3cyclictest0-21swapper/421:29:084
19799899950,3cyclictest0-21swapper/419:34:084
19799899950,3cyclictest0-21swapper/419:34:084
19799999940,3cyclictest2732604-21cat21:24:087
19799999940,3cyclictest2692698-21cat21:09:097
19799999940,3cyclictest2625438-21cron20:44:087
19799999940,3cyclictest2612775-21cat20:39:087
19799999940,3cyclictest2532929-21sendmail20:09:087
19799999940,3cyclictest2466255-21latency_hist19:44:097
19799999940,3cyclictest2373036-21sendmail19:09:087
19799999940,3cyclictest2266665-21latency_hist18:29:097
19799999940,3cyclictest2186202-21latency_hist17:54:087
19799999940,3cyclictest2107713-21latency_hist17:19:097
19799999940,3cyclictest1991626-21latency_hist16:29:087
19799999940,3cyclictest1991626-21latency_hist16:29:087
19799999940,2cyclictest520-21systemd-journal18:59:087
19799989940,4cyclictest0-21swapper/621:34:086
19799989940,4cyclictest0-21swapper/620:24:086
19799989940,4cyclictest0-21swapper/620:24:086
19799989940,4cyclictest0-21swapper/618:34:086
19799989940,4cyclictest0-21swapper/617:59:086
19799989940,4cyclictest0-21swapper/617:19:096
19799959941,2cyclictest2585421-21Xorg19:39:085
19799899942,1cyclictest2051364-21turbostat16:54:084
19799899940,3cyclictest2279864-21taskset18:34:084
19799899940,3cyclictest0-21swapper/417:34:094
19799899940,2cyclictest0-21swapper/420:34:084
19799899940,2cyclictest0-21swapper/419:29:084
19799899940,2cyclictest0-21swapper/417:24:084
19799989933,0cyclictest0-21swapper/616:29:096
19799989933,0cyclictest0-21swapper/616:29:096
19799989930,3cyclictest0-21swapper/621:24:086
19799989930,3cyclictest0-21swapper/620:04:086
19799989930,3cyclictest0-21swapper/618:59:086
19799989930,3cyclictest0-21swapper/618:54:086
19799989930,3cyclictest0-21swapper/618:29:096
19799989930,3cyclictest0-21swapper/618:09:096
19799989930,3cyclictest0-21swapper/617:54:086
19799959932,1cyclictest2585421-21Xorg21:39:085
19799959932,1cyclictest2585421-21Xorg20:54:085
19799959932,1cyclictest2585421-21Xorg20:54:085
19799959932,1cyclictest2585421-21Xorg20:34:085
19799959932,1cyclictest2585421-21Xorg20:24:085
19799959932,1cyclictest2585421-21Xorg20:24:085
19799959932,1cyclictest2585421-21Xorg20:04:085
19799959932,1cyclictest2585421-21Xorg19:54:085
19799959932,1cyclictest2585421-21Xorg19:34:085
19799959932,1cyclictest2585421-21Xorg19:34:085
19799959932,1cyclictest2585421-21Xorg19:14:085
19799959932,1cyclictest2585421-21Xorg18:34:085
19799959932,1cyclictest2585421-21Xorg17:24:095
19799959931,2cyclictest2585421-21Xorg20:14:085
19799959931,1cyclictest2585421-21Xorg18:39:095
19799959931,1cyclictest2585421-21Xorg18:04:085
19799959931,1cyclictest2585421-21Xorg17:34:095
19799959931,1cyclictest151rcu_preempt18:09:095
19799959930,3cyclictest0-21swapper/521:04:095
19799959930,3cyclictest0-21swapper/517:59:085
19799959930,2cyclictest2745646-21taskset21:29:075
19799959930,2cyclictest2585421-21Xorg19:04:085
19799959930,2cyclictest2346187-21taskset18:59:085
19799959930,1cyclictest54-21ksoftirqd/517:14:085
19799959930,1cyclictest0-21swapper/516:54:085
19799899930,3cyclictest0-21swapper/419:14:084
19799899930,3cyclictest0-21swapper/417:59:084
19799899930,3cyclictest0-21swapper/417:14:084
19799899930,2cyclictest2772197-21taskset21:39:084
19799899930,1cyclictest0-21swapper/416:44:084
19799899930,0cyclictest0-21swapper/419:54:084
19799899930,0cyclictest0-21swapper/419:04:084
2652037220,0sleep40-21swapper/420:54:084
2652037220,0sleep40-21swapper/420:54:084
19799989920,2cyclictest0-21swapper/621:54:086
19799989920,1cyclictest2585421-21Xorg21:09:096
19799959922,0cyclictest2585421-21Xorg20:44:085
19799959922,0cyclictest2585421-21Xorg17:19:095
19799959921,1cyclictest511irq_work/521:34:085
19799959921,1cyclictest2585421-21Xorg21:54:085
19799959921,1cyclictest2585421-21Xorg21:24:085
19799959921,1cyclictest2585421-21Xorg19:44:095
19799959921,1cyclictest2585421-21Xorg18:54:085
19799959921,1cyclictest2585421-21Xorg16:59:095
19799959920,2cyclictest0-21swapper/516:44:085
19799959920,2cyclictest0-21swapper/516:29:095
19799959920,2cyclictest0-21swapper/516:29:095
19799959920,1cyclictest2585421-21Xorg19:29:085
19799959920,1cyclictest2585421-21Xorg18:29:095
19799959920,1cyclictest2585421-21Xorg17:49:085
19799959920,1cyclictest0-21swapper/521:19:075
19799959920,1cyclictest0-21swapper/518:24:085
19799959920,1cyclictest0-21swapper/517:29:085
19799959920,0cyclictest0-21swapper/519:09:095
19799959920,0cyclictest0-21swapper/516:39:085
19799899921,1cyclictest2346114-21turbostat18:59:084
19799899920,2cyclictest0-21swapper/421:19:084
19799899920,2cyclictest0-21swapper/420:24:084
19799899920,2cyclictest0-21swapper/420:24:084
19799899920,2cyclictest0-21swapper/420:14:084
19799899920,2cyclictest0-21swapper/420:09:094
19799899920,2cyclictest0-21swapper/420:04:084
19799899920,2cyclictest0-21swapper/418:54:084
19799899920,2cyclictest0-21swapper/418:24:084
19799899920,2cyclictest0-21swapper/418:09:084
19799899920,2cyclictest0-21swapper/417:54:094
19799899920,2cyclictest0-21swapper/417:29:084
19799899920,2cyclictest0-21swapper/416:59:094
19799899920,2cyclictest0-21swapper/416:39:084
19799899920,1cyclictest2679050-21taskset21:04:084
19799899920,1cyclictest0-21swapper/420:44:084
19799899920,0cyclictest0-21swapper/421:54:084
19799899920,0cyclictest0-21swapper/421:09:094
19799899920,0cyclictest0-21swapper/419:39:084
19799899920,0cyclictest0-21swapper/419:09:094
19799899920,0cyclictest0-21swapper/418:39:094
19799899920,0cyclictest0-21swapper/418:04:084
19799899920,0cyclictest0-21swapper/416:29:094
19799989910,1cyclictest0-21swapper/620:09:086
19799989910,1cyclictest0-21swapper/619:44:096
19799959910,1cyclictest0-21swapper/521:09:095
19799959910,1cyclictest0-21swapper/520:39:085
19799959910,1cyclictest0-21swapper/517:54:085
19799899910,1cyclictest1990795-21kworker/u16:016:29:084
19799899910,1cyclictest0-21swapper/421:34:084
19799899910,1cyclictest0-21swapper/421:24:084
19799899910,1cyclictest0-21swapper/420:39:084
19799899910,1cyclictest0-21swapper/419:44:094
19799899910,1cyclictest0-21swapper/418:29:094
19799899910,0cyclictest0-21swapper/417:19:094
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional