You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-30 - 08:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Sep 30, 2023 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222348024940,6sleep40-21swapper/419:06:334
222348024940,6sleep40-21swapper/419:06:334
222364224636,6sleep50-21swapper/519:08:505
222364224636,6sleep50-21swapper/519:08:505
22235322373,30sleep70-21swapper/719:07:167
22235322373,30sleep70-21swapper/719:07:167
222359623415,6sleep60-21swapper/619:08:116
222359623415,6sleep60-21swapper/619:08:116
222390899160,3cyclictest2710352-21sh23:00:107
2223908991412,1cyclictest2235977-21grep19:14:147
222390599140,14cyclictest0-21swapper/522:57:505
222390899130,12cyclictest2804612-21cat23:44:327
222390599130,13cyclictest0-21swapper/521:32:245
222390599130,0cyclictest0-21swapper/523:45:465
2223903991313,0cyclictest0-21swapper/421:42:254
222390399130,13cyclictest0-21swapper/423:12:074
222390399130,13cyclictest0-21swapper/419:29:314
2223908991212,0cyclictest0-21swapper/722:22:477
2223908991212,0cyclictest0-21swapper/721:40:327
2223908991212,0cyclictest0-21swapper/720:44:347
222390899120,11cyclictest2312674-21cat19:54:337
2223907991212,0cyclictest0-21swapper/623:45:506
2223907991212,0cyclictest0-21swapper/622:58:516
2223907991212,0cyclictest0-21swapper/622:15:306
2223907991212,0cyclictest0-21swapper/600:19:256
222390799120,0cyclictest0-21swapper/623:11:186
222390799120,0cyclictest0-21swapper/622:22:176
222390799120,0cyclictest0-21swapper/621:40:586
2223905991212,0cyclictest0-21swapper/522:59:445
2223905991212,0cyclictest0-21swapper/519:16:025
222390599120,0cyclictest0-21swapper/519:51:305
222390399120,0cyclictest0-21swapper/419:14:514
2223908991111,0cyclictest0-21swapper/722:16:007
222390899110,10cyclictest1053-21snmpd21:32:247
222390899110,10cyclictest1053-21snmpd19:49:437
222390899110,10cyclictest1053-21snmpd00:21:527
2223907991111,0cyclictest0-21swapper/623:00:456
222390799110,11cyclictest0-21swapper/620:45:016
2223905991111,0cyclictest0-21swapper/523:12:115
2223908991010,0cyclictest0-21swapper/721:02:517
222390899100,9cyclictest1053-21snmpd23:10:507
222390899100,7cyclictest2780611-21munin-plugin-st23:34:117
222390899100,7cyclictest2598894-21munin-plugin-st22:14:117
2223907991010,0cyclictest0-21swapper/619:54:246
2223905991010,0cyclictest0-21swapper/521:02:175
2223905991010,0cyclictest0-21swapper/519:30:415
2223905991010,0cyclictest0-21swapper/500:20:175
222390599100,0cyclictest0-21swapper/519:58:455
222390399100,0cyclictest0-21swapper/421:00:004
22239089990,8cyclictest2700813-21munin-run22:59:107
22239079999,0cyclictest0-21swapper/621:03:186
22239079999,0cyclictest0-21swapper/619:14:416
22239059999,0cyclictest0-21swapper/522:22:135
22239059999,0cyclictest0-21swapper/520:48:065
22239089982,5cyclictest25793-21goa-identity-se23:19:107
22239089982,5cyclictest25793-21goa-identity-se23:19:107
22239089980,1cyclictest2348733-21munin-run20:14:117
22239079988,0cyclictest0-21swapper/619:49:126
22239079988,0cyclictest0-21swapper/619:33:366
22239059988,0cyclictest0-21swapper/522:14:295
22239089970,6cyclictest2376628-21grep20:29:117
22239089970,6cyclictest2283520-21munin-run19:39:117
22239089970,5cyclictest2273864-21idleruntime-cro19:34:117
22239089970,1cyclictest2496477-21grep21:29:117
22239079970,3cyclictest0-21swapper/621:29:176
22239039977,0cyclictest0-21swapper/420:47:524
22239089960,5cyclictest2724183-21latency_hist23:09:117
22239089960,5cyclictest2724183-21latency_hist23:09:117
22239089960,5cyclictest2485119-21systemd-run21:24:117
22239089960,3cyclictest728-17auditd00:34:117
22239089960,3cyclictest3382767-21systemd-journal23:44:107
22239089960,3cyclictest3382767-21systemd-journal22:49:117
22239089960,3cyclictest3382767-21systemd-journal22:39:117
22239089960,3cyclictest3382767-21systemd-journal22:09:117
22239089960,3cyclictest3382767-21systemd-journal22:04:117
22239089960,3cyclictest3382767-21systemd-journal21:19:117
22239089960,3cyclictest3382767-21systemd-journal21:09:117
22239089960,3cyclictest3382767-21systemd-journal21:09:117
22239089960,3cyclictest3382767-21systemd-journal20:54:117
22239089960,3cyclictest3382767-21systemd-journal20:39:117
22239089960,3cyclictest3382767-21systemd-journal19:44:127
22239089960,3cyclictest3382767-21systemd-journal00:29:107
22239089960,3cyclictest3382767-21systemd-journal00:09:117
22239089960,3cyclictest3382767-21systemd-journal00:04:117
22239089960,3cyclictest2837316-40ogrotate23:59:117
22239089960,2cyclictest2302151-21cut19:49:117
22239089960,2cyclictest1-21systemd22:54:117
22239079960,6cyclictest0-21swapper/623:59:116
22239079960,5cyclictest0-21swapper/622:29:116
22239059962,0cyclictest0-21swapper/521:41:335
22239039966,0cyclictest0-21swapper/422:14:444
22239089950,4cyclictest2644709-21date22:34:117
22239089950,4cyclictest2519405-21cut21:39:117
22239089950,4cyclictest2519405-21cut21:39:117
22239089950,4cyclictest2432692-21ls20:59:117
22239089950,4cyclictest2367551-21date20:24:127
22239089950,3cyclictest3382767-21systemd-journal21:49:117
22239089950,2cyclictest728-17auditd23:24:117
22239089950,2cyclictest3382767-21systemd-journal23:54:107
22239089950,2cyclictest3382767-21systemd-journal23:39:117
22239089950,2cyclictest3382767-21systemd-journal23:29:107
22239089950,2cyclictest3382767-21systemd-journal22:44:117
22239089950,2cyclictest3382767-21systemd-journal22:29:117
22239089950,2cyclictest3382767-21systemd-journal21:59:117
22239089950,2cyclictest3382767-21systemd-journal21:54:117
22239089950,2cyclictest3382767-21systemd-journal21:14:117
22239089950,2cyclictest3382767-21systemd-journal20:44:117
22239089950,2cyclictest3382767-21systemd-journal20:34:117
22239089950,2cyclictest3382767-21systemd-journal20:19:117
22239089950,2cyclictest3382767-21systemd-journal20:19:117
22239089950,2cyclictest3382767-21systemd-journal20:04:117
22239089950,2cyclictest3382767-21systemd-journal19:29:117
22239089950,2cyclictest3382767-21systemd-journal19:24:117
22239089950,2cyclictest3382767-21systemd-journal19:14:117
22239089950,2cyclictest3382767-21systemd-journal00:39:107
22239089950,2cyclictest3382767-21systemd-journal00:19:117
22239089950,2cyclictest3382767-21systemd-journal00:14:117
22239079950,4cyclictest0-21swapper/621:09:116
22239079950,4cyclictest0-21swapper/621:09:116
22239079950,1cyclictest0-21swapper/622:54:116
22239039955,0cyclictest0-21swapper/419:52:224
22239039950,5cyclictest0-21swapper/422:57:024
22239039950,5cyclictest0-21swapper/421:29:414
22239039950,5cyclictest0-21swapper/420:34:114
22239039950,5cyclictest0-21swapper/400:20:434
22239089940,1cyclictest728-17auditd20:09:117
22239079944,0cyclictest0-21swapper/600:39:106
22239079943,1cyclictest0-21swapper/621:29:116
22239079940,4cyclictest0-21swapper/622:49:106
22239079940,4cyclictest0-21swapper/622:14:116
22239079940,4cyclictest0-21swapper/621:54:116
22239079940,4cyclictest0-21swapper/621:49:116
22239079940,4cyclictest0-21swapper/621:19:116
22239079940,4cyclictest0-21swapper/621:14:116
22239079940,4cyclictest0-21swapper/600:04:106
22239079940,0cyclictest0-21swapper/623:29:116
22239079940,0cyclictest0-21swapper/622:44:116
22239079940,0cyclictest0-21swapper/621:39:116
22239079940,0cyclictest0-21swapper/621:39:116
22239079940,0cyclictest0-21swapper/621:24:116
22239059940,3cyclictest2599261-21chrt22:14:115
22239059940,2cyclictest151rcu_preempt20:34:115
22239059940,0cyclictest0-21swapper/522:54:115
22239059940,0cyclictest0-21swapper/520:04:115
22239039940,3cyclictest2803713-21chrt23:44:204
22239039940,3cyclictest2701537-21taskset22:59:114
22239039940,3cyclictest2610696-21chrt22:19:234
22239039940,3cyclictest2519367-21chrt21:39:114
22239039940,3cyclictest2519367-21chrt21:39:114
22239039940,3cyclictest2311847-21chrt19:54:204
22239079932,1cyclictest0-21swapper/623:34:116
22239079930,3cyclictest0-21swapper/623:54:116
22239079930,3cyclictest0-21swapper/623:44:106
22239079930,3cyclictest0-21swapper/623:39:116
22239079930,3cyclictest0-21swapper/623:19:116
22239079930,3cyclictest0-21swapper/623:19:116
22239079930,3cyclictest0-21swapper/622:09:116
22239079930,3cyclictest0-21swapper/622:04:116
22239079930,3cyclictest0-21swapper/620:34:116
22239079930,3cyclictest0-21swapper/620:09:116
22239079930,3cyclictest0-21swapper/620:04:116
22239079930,3cyclictest0-21swapper/619:49:126
22239079930,3cyclictest0-21swapper/619:39:126
22239079930,3cyclictest0-21swapper/619:14:116
22239079930,3cyclictest0-21swapper/600:19:116
22239079930,3cyclictest0-21swapper/600:09:116
22239079930,2cyclictest2655735-21turbostat22:39:116
22239059930,3cyclictest0-21swapper/522:49:115
22239059930,2cyclictest2496474-21turbostat21:29:115
22239059930,2cyclictest2485089-21turbostat21:24:115
22239059930,2cyclictest2451067-21turbostat21:09:115
22239059930,2cyclictest2451067-21turbostat21:09:115
22239059930,2cyclictest0-21swapper/521:19:115
22239059930,0cyclictest0-21swapper/523:29:115
22239039930,2cyclictest2928189-21turbostat00:39:104
22239039930,2cyclictest2780622-21chrt23:34:114
22239039930,2cyclictest2769243-21turbostat23:29:114
22239039930,2cyclictest2598878-21chrt22:14:104
22239079922,0cyclictest0-21swapper/600:14:116
22239079920,2cyclictest0-21swapper/623:24:116
22239079920,2cyclictest0-21swapper/623:09:116
22239079920,2cyclictest0-21swapper/623:09:116
22239079920,2cyclictest0-21swapper/622:34:116
22239079920,2cyclictest0-21swapper/621:59:106
22239079920,2cyclictest0-21swapper/620:54:116
22239079920,2cyclictest0-21swapper/620:44:116
22239079920,2cyclictest0-21swapper/620:39:126
22239079920,2cyclictest0-21swapper/620:29:116
22239079920,2cyclictest0-21swapper/620:24:126
22239079920,2cyclictest0-21swapper/620:19:116
22239079920,2cyclictest0-21swapper/620:19:116
22239079920,2cyclictest0-21swapper/620:14:116
22239079920,2cyclictest0-21swapper/619:44:126
22239079920,2cyclictest0-21swapper/619:29:116
22239079920,2cyclictest0-21swapper/619:24:116
22239079920,2cyclictest0-21swapper/600:34:116
22239079920,2cyclictest0-21swapper/600:29:106
22239059922,0cyclictest0-21swapper/522:39:105
22239059922,0cyclictest0-21swapper/500:09:115
22239059921,1cyclictest13250irq/27-ahci[00023:59:115
22239059921,1cyclictest13250irq/27-ahci[00023:54:105
22239059921,1cyclictest13250irq/27-ahci[00023:44:105
22239059921,1cyclictest13250irq/27-ahci[00023:24:115
22239059921,1cyclictest13250irq/27-ahci[00022:09:115
22239059921,1cyclictest13250irq/27-ahci[00021:49:115
22239059921,1cyclictest13250irq/27-ahci[00020:54:115
22239059921,1cyclictest13250irq/27-ahci[00020:39:115
22239059921,1cyclictest13250irq/27-ahci[00020:24:125
22239059921,1cyclictest13250irq/27-ahci[00019:49:125
22239059920,2cyclictest0-21swapper/523:39:115
22239059920,2cyclictest0-21swapper/522:04:115
22239059920,2cyclictest0-21swapper/520:44:115
22239059920,2cyclictest0-21swapper/520:19:115
22239059920,2cyclictest0-21swapper/520:19:115
22239059920,2cyclictest0-21swapper/520:09:115
22239059920,2cyclictest0-21swapper/519:44:125
22239059920,2cyclictest0-21swapper/519:29:115
22239059920,2cyclictest0-21swapper/519:24:115
22239059920,2cyclictest0-21swapper/519:14:125
22239059920,2cyclictest0-21swapper/500:29:105
22239059920,2cyclictest0-21swapper/500:19:115
22239059920,2cyclictest0-21swapper/500:14:115
22239059920,1cyclictest2848708-21turbostat00:04:115
22239059920,1cyclictest2746528-21turbostat23:19:105
22239059920,1cyclictest2746528-21turbostat23:19:105
22239059920,1cyclictest2348737-21turbostat20:14:115
22239059920,1cyclictest2283519-21turbostat19:39:115
22239059920,0cyclictest151rcu_preempt23:34:115
22239059920,0cyclictest151rcu_preempt20:29:115
22239059920,0cyclictest0-21swapper/521:59:115
22239059920,0cyclictest0-21swapper/521:54:115
22239039921,1cyclictest0-21swapper/400:09:114
22239039920,2cyclictest2292840-21taskset19:44:114
22239039920,1cyclictest0-21swapper/423:39:114
22239039920,1cyclictest0-21swapper/422:54:114
22239039920,1cyclictest0-21swapper/421:09:114
22239039920,1cyclictest0-21swapper/421:09:114
22239039920,1cyclictest0-21swapper/419:14:124
22239079910,1cyclictest0-21swapper/620:59:116
22239059910,1cyclictest13250irq/27-ahci[00022:34:115
22239059910,1cyclictest13250irq/27-ahci[00000:34:115
22239059910,1cyclictest0-21swapper/523:09:115
22239059910,1cyclictest0-21swapper/523:09:115
22239059910,1cyclictest0-21swapper/522:44:115
22239059910,1cyclictest0-21swapper/522:29:115
22239059910,1cyclictest0-21swapper/521:39:115
22239059910,1cyclictest0-21swapper/521:39:115
22239059910,1cyclictest0-21swapper/521:14:115
22239059910,1cyclictest0-21swapper/520:59:115
22239059910,1cyclictest0-21swapper/500:39:105
22239039910,1cyclictest72-21rcuop/723:19:104
22239039910,1cyclictest72-21rcuop/723:19:104
22239039910,1cyclictest72-21rcuop/720:04:114
22239039910,1cyclictest72-21rcuop/700:19:104
22239039910,1cyclictest447-21jbd2/sda3-821:29:114
22239039910,1cyclictest2869595-21kworker/u16:200:14:114
22239039910,1cyclictest2746568-21kworker/4:323:24:114
22239039910,1cyclictest2585144-21kworker/u16:022:09:114
22239039910,1cyclictest2264302-21kworker/u16:119:29:114
22239039910,1cyclictest2196768-21kworker/4:320:44:114
22239039910,1cyclictest127-21kswapd000:29:104
22239039910,1cyclictest0-21swapper/423:59:114
22239039910,1cyclictest0-21swapper/423:54:104
22239039910,1cyclictest0-21swapper/423:44:104
22239039910,1cyclictest0-21swapper/422:49:114
22239039910,1cyclictest0-21swapper/422:39:114
22239039910,1cyclictest0-21swapper/422:34:114
22239039910,1cyclictest0-21swapper/422:29:114
22239039910,1cyclictest0-21swapper/422:04:114
22239039910,1cyclictest0-21swapper/421:59:114
22239039910,1cyclictest0-21swapper/421:54:114
22239039910,1cyclictest0-21swapper/421:49:114
22239039910,1cyclictest0-21swapper/421:24:114
22239039910,1cyclictest0-21swapper/421:19:114
22239039910,1cyclictest0-21swapper/421:14:114
22239039910,1cyclictest0-21swapper/420:59:114
22239039910,1cyclictest0-21swapper/420:39:114
22239039910,1cyclictest0-21swapper/420:29:114
22239039910,1cyclictest0-21swapper/420:24:114
22239039910,1cyclictest0-21swapper/420:19:114
22239039910,1cyclictest0-21swapper/420:19:114
22239039910,1cyclictest0-21swapper/420:14:114
22239039910,1cyclictest0-21swapper/420:09:114
22239039910,1cyclictest0-21swapper/419:49:114
22239039910,1cyclictest0-21swapper/419:39:114
22239039910,1cyclictest0-21swapper/419:24:114
22239039910,1cyclictest0-21swapper/400:04:114
22239039900,0cyclictest0-21swapper/423:09:114
22239039900,0cyclictest0-21swapper/423:09:114
22239039900,0cyclictest0-21swapper/422:44:114
22239039900,0cyclictest0-21swapper/420:54:114
22239039900,0cyclictest0-21swapper/400:34:114
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional