You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 11:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat Apr 27, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2800680991411,1cyclictest0-21swapper/322:30:123
2800680991210,1cyclictest0-21swapper/300:15:103
280068099120,11cyclictest0-21swapper/323:50:103
280068099120,11cyclictest0-21swapper/320:15:173
280068099120,0cyclictest0-21swapper/321:45:133
280068099119,1cyclictest0-21swapper/323:30:103
280068099110,11cyclictest0-21swapper/322:15:183
280068099110,11cyclictest0-21swapper/321:40:123
280068099110,0cyclictest0-21swapper/323:25:133
280068099110,0cyclictest0-21swapper/321:50:133
280068099110,0cyclictest0-21swapper/320:40:173
2800680991010,0cyclictest0-21swapper/321:00:093
2800680991010,0cyclictest0-21swapper/319:50:093
280068099100,9cyclictest0-21swapper/323:15:023
280068099100,0cyclictest0-21swapper/319:10:193
28006809999,0cyclictest0-21swapper/323:40:013
28006809999,0cyclictest0-21swapper/323:00:123
28006809999,0cyclictest0-21swapper/321:20:213
28006809999,0cyclictest0-21swapper/319:30:003
28006809999,0cyclictest0-21swapper/300:25:263
28006809990,0cyclictest0-21swapper/320:55:003
28006809988,0cyclictest0-21swapper/321:25:103
28006809988,0cyclictest0-21swapper/321:10:133
28006809988,0cyclictest0-21swapper/320:11:313
28006809988,0cyclictest0-21swapper/319:45:093
28006809988,0cyclictest0-21swapper/300:30:113
28006809977,0cyclictest0-21swapper/323:55:113
28006809977,0cyclictest0-21swapper/323:45:163
28006809977,0cyclictest0-21swapper/323:19:053
28006809977,0cyclictest0-21swapper/322:55:073
28006809977,0cyclictest0-21swapper/322:40:183
28006809970,7cyclictest0-21swapper/320:58:333
28006809970,7cyclictest0-21swapper/300:35:213
13129870,3rtkit-daemon1-21systemd19:05:531
28006809966,0cyclictest0-21swapper/323:20:143
28006809966,0cyclictest0-21swapper/322:45:103
28006809966,0cyclictest0-21swapper/321:35:123
28006809966,0cyclictest0-21swapper/321:15:093
28006809966,0cyclictest0-21swapper/321:07:163
28006809966,0cyclictest0-21swapper/319:20:013
2800493260,3sleep30-21swapper/319:09:563
28006809955,0cyclictest0-21swapper/323:41:033
28006809955,0cyclictest0-21swapper/322:50:123
28006809955,0cyclictest0-21swapper/322:13:103
28006809955,0cyclictest0-21swapper/320:35:203
28006809955,0cyclictest0-21swapper/319:17:263
28006809955,0cyclictest0-21swapper/300:24:593
28006809955,0cyclictest0-21swapper/300:12:063
28006809954,1cyclictest0-21swapper/319:40:133
28006809950,4cyclictest0-21swapper/300:05:093
28006809950,0cyclictest0-21swapper/320:00:193
2799625251,2sleep22799728-21sendmail_mailqu19:05:182
13129850,3rtkit-daemon538-21systemd-logind23:07:292
28006809944,0cyclictest0-21swapper/322:38:293
28006809944,0cyclictest0-21swapper/320:45:223
28006809944,0cyclictest0-21swapper/320:23:203
28006809944,0cyclictest0-21swapper/319:37:133
28006809941,2cyclictest0-21swapper/321:55:093
28006809940,4cyclictest0-21swapper/322:10:003
28006809940,4cyclictest0-21swapper/320:30:013
28006809940,3cyclictest0-21swapper/323:06:423
28006809940,3cyclictest0-21swapper/322:23:273
28006809940,3cyclictest0-21swapper/322:00:593
28006809940,3cyclictest0-21swapper/321:31:313
28006809940,3cyclictest0-21swapper/300:03:553
28006809940,2cyclictest0-21swapper/322:25:103
28006809940,0cyclictest0-21swapper/320:08:483
2800231241,2sleep00-21swapper/019:06:320
13129840,2rtkit-daemon717-21lldpd19:59:591
13129840,2rtkit-daemon538-21systemd-logind21:44:291
13129840,2rtkit-daemon356-21systemd-journal22:44:292
13129840,2rtkit-daemon356-21systemd-journal21:53:291
13129840,2rtkit-daemon2802678-21munin-node21:57:241
13129840,2rtkit-daemon2802678-21munin-node00:25:112
13129840,0rtkit-daemon0-21swapper/121:14:181
2933649230,1sleep12933675-21apt-get00:30:121
2922787230,2sleep02922821-21unin-run00:05:020
2896482230,0sleep20-21swapper/223:00:242
2846236230,1sleep22846262-21apt-get21:05:132
2830293230,2sleep02830342-21cat20:25:010
2816972230,1sleep22816998-21apt-get19:50:092
2815047230,1sleep22815073-21apt-get19:45:102
28006809933,0cyclictest0-21swapper/319:30:123
28006809930,3cyclictest0-21swapper/319:55:353
28006809930,2cyclictest0-21swapper/320:30:103
13129830,2rtkit-daemon617-21gmain22:26:252
13129830,2rtkit-daemon617-21gmain20:15:181
13129830,2rtkit-daemon1-21systemd22:45:162
13129830,2rtkit-daemon1-21systemd00:30:162
13129830,1rtkit-daemon717-21lldpd23:44:372
13129830,1rtkit-daemon717-21lldpd21:35:511
13129830,1rtkit-daemon717-21lldpd21:01:061
13129830,1rtkit-daemon717-21lldpd20:02:451
13129830,1rtkit-daemon717-21lldpd19:10:191
13129830,1rtkit-daemon714-21ntpd23:45:092
13129830,1rtkit-daemon714-21ntpd22:08:472
13129830,1rtkit-daemon617-21gmain23:36:012
13129830,1rtkit-daemon539-21wpa_supplicant22:34:322
13129830,1rtkit-daemon490-21rpcbind00:09:362
13129830,1rtkit-daemon356-21systemd-journal22:23:292
13129830,1rtkit-daemon356-21systemd-journal21:30:441
13129830,1rtkit-daemon356-21systemd-journal20:36:021
13129830,1rtkit-daemon356-21systemd-journal20:30:501
13129830,1rtkit-daemon356-21systemd-journal19:49:501
13129830,1rtkit-daemon3191333-21snmpd23:27:552
13129830,1rtkit-daemon3191333-21snmpd20:25:261
13129830,1rtkit-daemon2903372-21sh23:19:512
13129830,1rtkit-daemon2850048-21apt-get21:15:011
13129830,1rtkit-daemon2842787-21df20:55:141
13129830,1rtkit-daemon2829601-21smartctl20:20:211
13129830,1rtkit-daemon2818235-21head19:50:201
13129830,1rtkit-daemon2802678-21munin-node23:34:042
13129830,1rtkit-daemon2802678-21munin-node22:01:121
13129830,1rtkit-daemon2802678-21munin-node00:16:172
13129830,1rtkit-daemon269977-21sendmail-mta22:52:442
13129830,1rtkit-daemon1-21systemd23:55:552
13129830,1rtkit-daemon1-21systemd22:55:062
13129830,1rtkit-daemon1-21systemd22:36:542
13129830,1rtkit-daemon1-21systemd22:16:512
13129830,1rtkit-daemon1-21systemd22:11:202
13129830,1rtkit-daemon1-21systemd21:22:341
13129830,1rtkit-daemon1-21systemd19:27:291
13129830,1rtkit-daemon1-21systemd19:15:041
13129830,1rtkit-daemon1-21systemd00:20:162
13129830,1rtkit-daemon1-21systemd00:10:392
13129830,1rtkit-daemon0-21swapper/120:45:061
13129830,0rtkit-daemon1311-21rtkit-daemon21:06:511
2937394220,0sleep00-21swapper/000:37:590
2932352220,1sleep12932467-21awk00:25:231
2930873220,1sleep00-21swapper/000:21:340
2926969220,0sleep10-21swapper/100:14:341
2926766220,1sleep02926772-21ssh00:12:490
2917519220,0sleep00-21swapper/023:50:200
2916087220,1sleep00-21swapper/023:47:210
2908232221,0sleep10-21swapper/123:30:131
2901547220,1sleep12901668-21aten_r1power_po23:15:121
2900246220,1sleep02900397-21sh23:10:220
2888548220,1sleep02888566-21munin-run22:45:000
2878815220,0sleep00-21swapper/022:20:190
2869367220,0sleep20-21swapper/221:59:322
2866264220,1sleep00-21swapper/021:50:210
2863594220,1sleep22863757-21sh21:45:162
2856950220,1sleep22856976-21apt-get21:30:112
2853713220,1sleep02853997-21unixbench_singl21:20:240
2853215220,1sleep22853329-21memory21:20:182
2852423220,0sleep00-21swapper/021:19:570
2848688220,1sleep00-21swapper/021:10:190
2837686220,0sleep00-21swapper/020:40:500
2836394220,1sleep22836334-21/usr/sbin/munin20:40:122
2832217220,0sleep00-21swapper/020:30:020
2831845220,0sleep00-21swapper/020:25:250
2818900220,1sleep22818926-21apt-get19:55:132
2817914220,1sleep02818086-21cat19:50:190
2808635220,0sleep00-21swapper/019:25:220
2805849220,1sleep12805918-21irqstats19:20:141
2804672220,0sleep00-21swapper/019:17:220
13129820,1rtkit-daemon617-21gmain19:30:381
13129820,1rtkit-daemon3191333-21snmpd20:05:101
13129820,1rtkit-daemon3191333-21snmpd00:36:542
13129820,1rtkit-daemon2802678-21munin-node19:35:101
13129820,1rtkit-daemon269977-21sendmail-mta19:40:531
13129820,1rtkit-daemon269977-21sendmail-mta00:00:052
13129820,1rtkit-daemon1-21systemd23:10:032
13129820,1rtkit-daemon1-21systemd20:40:031
13129820,1rtkit-daemon1-21systemd20:10:081
13129820,0rtkit-daemon0-21swapper/223:50:022
13129820,0rtkit-daemon0-21swapper/223:20:432
13129820,0rtkit-daemon0-21swapper/122:05:241
13129820,0rtkit-daemon0-21swapper/121:45:061
13129820,0rtkit-daemon0-21swapper/121:25:321
13129820,0rtkit-daemon0-21swapper/120:50:061
2936897210,0sleep10-21swapper/100:35:241
2933639210,0sleep00-21swapper/000:30:070
2931596210,0sleep00-21swapper/000:25:140
2929714210,0sleep10-21swapper/100:20:191
2928600210,1sleep00-21swapper/000:15:270
2927274210,0sleep10-21swapper/100:15:111
2923411210,0sleep00-21swapper/000:05:130
2923033210,0sleep12923084-21aten_r1power_cu00:05:101
2920652210,0sleep10-21swapper/100:00:031
2920191210,0sleep00-21swapper/023:56:120
2918926210,0sleep10-21swapper/123:55:131
2916841210,0sleep10-21swapper/123:50:131
2914772210,0sleep10-21swapper/123:45:141
2913153210,0sleep00-21swapper/023:40:200
2912870210,0sleep10-21swapper/123:40:171
2910353210,0sleep10-21swapper/123:35:121
2910283210,0sleep00-21swapper/023:35:110
2908609210,0sleep00-21swapper/023:30:160
2906864210,0sleep00-21swapper/023:25:230
2906307210,0sleep10-21swapper/123:25:161
2904381210,0sleep00-21swapper/023:20:180
2903925210,0sleep10-21swapper/123:20:111
2902866210,1sleep00-21swapper/023:15:350
2899470210,0sleep10-21swapper/123:10:151
2897523210,0sleep00-21swapper/023:05:140
2897288210,0sleep10-21swapper/123:05:111
2895687210,0sleep00-21swapper/023:00:180
2895358210,0sleep10-21swapper/123:00:151
2894468210,0sleep00-21swapper/022:56:210
2893021210,0sleep10-21swapper/122:55:061
2890978210,0sleep10-21swapper/122:50:141
2890904210,0sleep00-21swapper/022:50:050
2889319210,0sleep00-21swapper/022:45:170
2888574210,0sleep10-21swapper/122:45:021
2887300210,0sleep10-21swapper/122:40:171
2885324210,0sleep00-21swapper/022:35:200
2884295210,0sleep10-21swapper/122:35:011
2883109210,0sleep00-21swapper/022:30:210
2882451210,0sleep10-21swapper/122:30:141
2880568210,0sleep10-21swapper/122:25:121
2880398210,0sleep00-21swapper/022:25:110
2878218210,0sleep10-21swapper/122:20:121
2876498210,0sleep10-21swapper/122:15:171
2876073210,0sleep00-21swapper/022:15:120
2873925210,0sleep10-21swapper/122:10:081
2873917210,0sleep00-21swapper/022:10:030
2871882210,0sleep00-21swapper/022:05:140
2869724210,0sleep20-21swapper/222:00:132
2869680210,0sleep00-21swapper/022:00:030
2868367210,0sleep00-21swapper/021:55:180
2865613210,0sleep20-21swapper/221:50:152
2864212210,0sleep00-21swapper/021:45:220
2861726210,0sleep00-21swapper/021:40:170
2861601210,0sleep20-21swapper/221:40:152
2859752210,0sleep20-21swapper/221:35:192
2858819210,0sleep00-21swapper/021:35:010
2857054210,0sleep00-21swapper/021:30:130
2856201210,0sleep00-21swapper/021:25:480
2854828210,0sleep20-21swapper/221:25:102
2850533210,0sleep20-21swapper/221:15:022
2848170210,0sleep20-21swapper/221:10:132
2847010210,0sleep00-21swapper/021:05:230
2845084210,0sleep20-21swapper/221:00:182
2844821210,0sleep00-21swapper/021:00:160
2842361210,0sleep00-21swapper/020:55:060
2841858210,0sleep20-21swapper/220:55:002
2840180210,0sleep00-21swapper/020:50:100
2839935210,0sleep20-21swapper/220:50:002
2838493210,0sleep00-21swapper/020:45:150
2838260210,0sleep20-21swapper/220:45:132
2834512210,0sleep00-21swapper/020:35:130
2832492210,0sleep20-21swapper/220:30:122
2831270210,0sleep20-21swapper/220:25:192
2829385210,0sleep20-21swapper/220:20:192
2827279210,0sleep00-21swapper/020:15:170
2826703210,0sleep20-21swapper/220:15:112
2825742210,0sleep00-21swapper/020:10:200
2824717210,0sleep20-21swapper/220:10:102
2823208210,0sleep20-21swapper/220:05:142
2822930210,0sleep00-21swapper/020:05:120
2820976210,0sleep00-21swapper/020:00:130
2820841210,0sleep20-21swapper/220:00:112
2815562210,0sleep00-21swapper/019:45:160
2814279210,0sleep20-21swapper/219:40:242
2813202210,0sleep00-21swapper/019:40:140
2811444210,0sleep20-21swapper/219:35:122
2811209210,0sleep00-21swapper/019:35:100
2810319210,0sleep20-21swapper/219:30:252
2809265210,0sleep00-21swapper/019:30:110
2807390210,0sleep20-21swapper/219:25:122
2805498210,0sleep20-21swapper/219:20:112
2804881210,0sleep00-21swapper/019:20:010
2803300210,1sleep22803520-21cpuspeed_turbos19:15:122
2801575210,0sleep20-21swapper/219:10:192
2800859210,0sleep00-21swapper/019:10:130
2834379200,0sleep20-21swapper/220:35:032
2818888200,0sleep00-21swapper/019:55:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional