You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-09 - 17:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Mon Dec 09, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282783899130,12cyclictest0-21swapper/307:37:233
2827838991211,0cyclictest0-21swapper/311:40:143
282783899120,11cyclictest0-21swapper/312:15:023
282783899120,11cyclictest0-21swapper/310:35:133
282783899120,11cyclictest0-21swapper/310:20:143
282783899120,11cyclictest0-21swapper/307:55:183
282783899120,10cyclictest0-21swapper/309:20:123
282783899120,0cyclictest0-21swapper/312:05:113
282783899119,1cyclictest0-21swapper/311:05:103
2827838991111,0cyclictest0-21swapper/309:15:143
282783899110,10cyclictest0-21swapper/308:20:233
282783899110,10cyclictest0-21swapper/307:25:183
282783899109,0cyclictest0-21swapper/310:04:173
282783899109,0cyclictest0-21swapper/309:35:123
2827838991010,0cyclictest0-21swapper/311:45:133
2827838991010,0cyclictest0-21swapper/308:40:183
2827838991010,0cyclictest0-21swapper/307:50:203
2827838991010,0cyclictest0-21swapper/307:30:113
282783899100,8cyclictest0-21swapper/311:39:153
282783899100,8cyclictest0-21swapper/310:50:143
282783899100,10cyclictest0-21swapper/308:15:013
282783899100,0cyclictest0-21swapper/310:45:013
282783899100,0cyclictest0-21swapper/309:45:053
28278389999,0cyclictest0-21swapper/311:55:173
28278389999,0cyclictest0-21swapper/311:15:223
28278389999,0cyclictest0-21swapper/309:30:013
28278389999,0cyclictest0-21swapper/308:00:173
28278389998,0cyclictest0-21swapper/312:30:123
28278389998,0cyclictest0-21swapper/311:50:163
28278389998,0cyclictest0-21swapper/309:10:003
28278389998,0cyclictest0-21swapper/308:55:143
28278389997,1cyclictest0-21swapper/311:00:153
28278389988,0cyclictest0-21swapper/310:55:143
28278389988,0cyclictest0-21swapper/310:45:183
28278389988,0cyclictest0-21swapper/310:05:123
28278389988,0cyclictest0-21swapper/309:10:173
28278389988,0cyclictest0-21swapper/308:47:533
28278389984,1cyclictest0-21swapper/307:15:133
28278389977,0cyclictest0-21swapper/312:22:033
28278389977,0cyclictest0-21swapper/312:15:193
28278389977,0cyclictest0-21swapper/312:00:163
28278389977,0cyclictest0-21swapper/309:43:233
28278389977,0cyclictest0-21swapper/309:30:123
28278389977,0cyclictest0-21swapper/307:40:203
28278389976,1cyclictest0-21swapper/307:45:123
2825763271,3sleep30-21swapper/307:05:013
28278389966,0cyclictest0-21swapper/310:25:003
28278389966,0cyclictest0-21swapper/307:20:103
28278389965,0cyclictest0-21swapper/309:04:593
28278389964,1cyclictest0-21swapper/311:10:153
2826797262,2sleep10-21swapper/107:05:191
13989860,0rtkit-daemon2859823-21/usr/sbin/munin08:30:231
2879449250,3sleep12879475-21apt-get09:20:121
28278389955,0cyclictest0-21swapper/312:40:013
28278389955,0cyclictest0-21swapper/311:25:013
28278389955,0cyclictest0-21swapper/310:16:483
28278389955,0cyclictest0-21swapper/309:55:123
28278389955,0cyclictest0-21swapper/309:50:173
28278389955,0cyclictest0-21swapper/307:10:183
28278389954,1cyclictest0-21swapper/311:30:133
28278389954,0cyclictest0-21swapper/310:30:123
28278389954,0cyclictest0-21swapper/308:25:123
28278389954,0cyclictest0-21swapper/308:10:183
28278389950,5cyclictest0-21swapper/308:10:013
2919881241,1sleep12919907-21apt-get11:00:151
28278389944,0cyclictest0-21swapper/312:26:573
28278389944,0cyclictest0-21swapper/308:50:173
28278389943,0cyclictest0-21swapper/311:25:093
28278389943,0cyclictest0-21swapper/311:25:083
28278389943,0cyclictest0-21swapper/308:35:013
28278389941,2cyclictest0-21swapper/310:10:123
28278389940,3cyclictest2861150-21chrt08:30:433
2826502241,1sleep20-21swapper/207:05:162
13989840,2rtkit-daemon760-21snmpd12:10:261
13989840,2rtkit-daemon613-21systemd-logind12:06:511
13989840,2rtkit-daemon2942618-21ntpq11:55:211
13989840,2rtkit-daemon2868238-21if_eno108:50:161
13989840,1rtkit-daemon2856786-21/usr/sbin/munin08:20:221
2946062230,1sleep22946088-21apt-get12:05:112
2939265230,1sleep12939279-21apt-get11:50:021
2915321230,0sleep00-21swapper/010:49:090
2888214230,1sleep12887984-21apt-get09:45:061
2866486230,1sleep12866612-21ntp_states08:45:181
2854494231,1sleep2451ktimers/208:15:182
2825986231,1sleep00-21swapper/007:05:030
13989830,2rtkit-daemon760-21snmpd10:57:491
13989830,2rtkit-daemon760-21snmpd10:05:121
13989830,2rtkit-daemon760-21snmpd09:50:481
13989830,2rtkit-daemon1399-21sendmail-mta10:20:321
13989830,2rtkit-daemon1399-21sendmail-mta08:03:061
13989830,2rtkit-daemon1-21systemd09:40:461
13989830,1rtkit-daemon762-21ntpd07:17:431
13989830,1rtkit-daemon760-21snmpd07:49:381
13989830,1rtkit-daemon684-21gmain10:41:411
13989830,1rtkit-daemon684-21gmain10:30:581
13989830,1rtkit-daemon614-21wpa_supplicant07:39:441
13989830,1rtkit-daemon417-21systemd-journal07:59:561
13989830,1rtkit-daemon331-21plymouthd11:40:161
13989830,1rtkit-daemon2944353-21cstates12:00:141
13989830,1rtkit-daemon2933220-21ssh11:35:081
13989830,1rtkit-daemon2829889-21munin-node11:05:431
13989830,1rtkit-daemon2812976-21munin-node07:10:061
13989830,1rtkit-daemon1-21systemd11:48:131
13989830,1rtkit-daemon1-21systemd11:20:271
13989830,1rtkit-daemon1-21systemd10:51:071
13989830,1rtkit-daemon1-21systemd10:16:321
2951692220,0sleep00-21swapper/012:16:390
2941872220,1sleep02941898-21apt-get11:55:160
2939188220,0sleep20-21swapper/211:49:232
2935784220,1sleep22935346-21/usr/sbin/munin11:40:172
2934827220,1sleep02934829-21ssh11:37:560
2926626220,1sleep02926761-21memory11:15:190
2923460220,0sleep00-21swapper/011:07:020
2921673220,0sleep00-21swapper/011:04:420
2902690220,1sleep00-21swapper/010:18:380
2892802220,0sleep00-21swapper/009:55:140
2890595220,1sleep00-21swapper/009:50:160
2882116220,0sleep02882142-21apt-get09:30:080
2869248220,0sleep20-21swapper/208:52:522
2850159220,1sleep02850404-21diskstats08:05:150
2842786220,1sleep02842921-21memory07:45:180
2842459220,1sleep22842729-21df_inode07:45:152
2837783222,0sleep0814090-21kworker/0:2+events07:31:410
13989820,1rtkit-daemon684-21gmain11:16:191
13989820,1rtkit-daemon417-21systemd-journal11:10:331
13989820,1rtkit-daemon331-21plymouthd12:25:141
13989820,1rtkit-daemon2894761-21/usr/sbin/munin10:00:161
13989820,1rtkit-daemon2829889-21munin-node07:30:071
13989820,1rtkit-daemon1399-21sendmail-mta12:35:161
13989820,1rtkit-daemon1-21systemd10:46:091
13989820,1rtkit-daemon1-21systemd10:35:411
13989820,1rtkit-daemon1-21systemd08:05:121
13989820,1rtkit-daemon1-21systemd07:40:421
13989820,1rtkit-daemon1-21systemd07:22:161
13989820,0rtkit-daemon760-21snmpd09:25:071
13989820,0rtkit-daemon331-21plymouthd12:20:291
13989820,0rtkit-daemon331-21plymouthd12:15:041
13989820,0rtkit-daemon331-21plymouthd09:55:101
13989820,0rtkit-daemon331-21plymouthd09:10:131
13989820,0rtkit-daemon331-21plymouthd08:55:281
13989820,0rtkit-daemon331-21plymouthd08:41:331
13989820,0rtkit-daemon331-21plymouthd08:15:021
13989820,0rtkit-daemon331-21plymouthd07:25:101
13989820,0rtkit-daemon0-21swapper/112:30:131
13989820,0rtkit-daemon0-21swapper/111:30:151
13989820,0rtkit-daemon0-21swapper/111:25:141
13989820,0rtkit-daemon0-21swapper/111:25:141
13989820,0rtkit-daemon0-21swapper/110:25:031
13989820,0rtkit-daemon0-21swapper/110:10:251
13989820,0rtkit-daemon0-21swapper/109:35:331
13989820,0rtkit-daemon0-21swapper/109:31:111
13989820,0rtkit-daemon0-21swapper/109:15:161
13989820,0rtkit-daemon0-21swapper/109:05:071
13989820,0rtkit-daemon0-21swapper/109:00:071
13989820,0rtkit-daemon0-21swapper/108:35:221
13989820,0rtkit-daemon0-21swapper/108:25:191
13989820,0rtkit-daemon0-21swapper/108:10:181
13989820,0rtkit-daemon0-21swapper/107:50:031
2957595210,0sleep00-21swapper/012:35:110
2957370210,0sleep20-21swapper/212:35:012
2956894210,0sleep20-21swapper/212:31:062
2955756210,0sleep00-21swapper/012:30:120
2954847210,0sleep00-21swapper/012:26:270
2954779210,0sleep20-21swapper/212:25:532
2954411210,0sleep00-21swapper/012:24:380
2952616210,0sleep20-21swapper/212:20:122
2951761210,0sleep20-21swapper/212:17:132
2949477210,0sleep20-21swapper/212:10:322
2947899210,0sleep00-21swapper/012:10:010
2947448210,1sleep00-21swapper/012:06:020
2945281210,0sleep00-21swapper/012:00:220
2944420210,0sleep20-21swapper/212:00:162
2943507210,0sleep20-21swapper/211:58:192
2940585210,0sleep20-21swapper/211:50:232
2939813210,0sleep00-21swapper/011:50:170
2937429210,0sleep00-21swapper/011:45:130
2935437210,0sleep00-21swapper/011:40:160
2933420210,0sleep20-21swapper/211:35:182
2932440210,1sleep00-21swapper/011:30:190
2930882210,0sleep20-21swapper/211:30:022
2930525210,0sleep00-21swapper/011:26:520
2930525210,0sleep00-21swapper/011:26:520
2929058210,0sleep20-21swapper/211:20:202
2928259210,0sleep00-21swapper/011:20:140
2926298210,0sleep20-21swapper/211:15:172
2925866210,0sleep20-21swapper/211:14:532
2924504210,0sleep00-21swapper/011:10:180
2923589210,0sleep20-21swapper/211:08:112
2920402210,0sleep20-21swapper/211:00:202
2919340210,0sleep20-21swapper/210:57:442
2917764210,0sleep00-21swapper/010:55:130
2915846210,0sleep00-21swapper/010:50:170
2915679210,0sleep20-21swapper/210:50:152
2915129210,0sleep20-21swapper/210:47:272
2912842210,0sleep00-21swapper/010:40:400
2912697210,0sleep20-21swapper/210:40:222
2911216210,0sleep00-21swapper/010:39:570
2910123210,0sleep20-21swapper/210:35:182
2907299210,0sleep00-21swapper/010:30:110
2906695210,1sleep00-21swapper/010:26:560
2902848210,0sleep20-21swapper/210:20:012
2899056210,1sleep00-21swapper/010:10:150
2898924210,0sleep20-21swapper/210:10:092
2897643210,0sleep00-21swapper/010:05:180
2897366210,0sleep20-21swapper/210:05:162
2896072210,0sleep00-21swapper/010:00:250
2895628210,0sleep20-21swapper/210:00:192
2892647210,0sleep20-21swapper/209:55:122
2892141210,0sleep20-21swapper/209:52:482
2890172210,0sleep00-21swapper/009:48:490
2887750210,0sleep00-21swapper/009:43:050
2886132210,0sleep20-21swapper/209:40:032
2885081210,0sleep02885285-21/usr/sbin/munin09:35:190
2882239210,0sleep20-21swapper/209:30:102
2879636210,0sleep02879876-21df_inode09:20:160
2879443210,0sleep20-21swapper/209:20:092
2879012210,1sleep00-21swapper/009:18:230
2877179210,0sleep20-21swapper/209:15:012
2877117210,1sleep00-21swapper/009:14:260
2875801210,0sleep20-21swapper/209:10:212
2874849210,1sleep00-21swapper/009:05:510
2872063210,0sleep00-21swapper/009:00:260
2869664210,0sleep00-21swapper/008:55:130
2869281210,0sleep00-21swapper/008:53:180
2864725210,0sleep20-21swapper/208:40:182
2863951210,0sleep00-21swapper/008:40:130
2862424210,0sleep20-21swapper/208:35:152
2860605210,0sleep20-21swapper/208:30:232
2859299210,0sleep00-21swapper/008:26:320
2858456210,0sleep20-21swapper/208:25:172
2857520210,1sleep00-21swapper/008:23:160
2856717210,0sleep20-21swapper/208:20:222
2851884210,0sleep20-21swapper/208:10:132
2849723210,0sleep20-21swapper/208:05:012
2849453210,0sleep20-21swapper/208:01:322
2846805210,0sleep00-21swapper/007:55:180
2845528210,0sleep20-21swapper/207:50:322
2841836210,1sleep00-21swapper/007:42:140
2838757210,0sleep00-21swapper/007:35:160
2836569210,0sleep20-21swapper/207:30:192
2834618210,0sleep20-21swapper/207:25:152
2832284210,0sleep00-21swapper/007:20:080
2832077210,0sleep20-21swapper/207:20:012
2831319210,0sleep00-21swapper/007:15:200
2829643210,0sleep20-21swapper/207:15:022
2829539210,0sleep20-21swapper/207:13:422
2828424210,0sleep00-21swapper/007:10:150
2930323200,0sleep20-21swapper/211:25:052
2930323200,0sleep20-21swapper/211:25:042
2907048200,0sleep20-21swapper/210:30:022
2904954200,0sleep20-21swapper/210:25:012
2903105200,0sleep00-21swapper/010:20:030
2901005200,0sleep20-21swapper/210:15:052
2888210200,0sleep20-21swapper/209:45:022
2884105200,0sleep20-21swapper/209:35:022
2881425200,0sleep00-21swapper/009:25:040
2881215200,0sleep20-21swapper/209:25:022
2873498200,0sleep20-21swapper/209:05:042
2871586200,0sleep20-21swapper/209:00:042
2869651200,0sleep20-21swapper/208:55:042
2865826200,0sleep20-21swapper/208:45:032
2865592200,0sleep00-21swapper/008:45:010
2861483200,0sleep00-21swapper/008:35:010
2859809200,0sleep00-21swapper/008:30:030
2854044200,0sleep00-21swapper/008:15:030
2851872200,0sleep00-21swapper/008:10:030
2848046200,0sleep00-21swapper/008:00:020
2846112200,0sleep20-21swapper/207:55:042
2844200200,0sleep00-21swapper/007:50:010
2840377200,0sleep20-21swapper/207:40:032
2838277200,0sleep20-21swapper/207:35:032
2834189200,0sleep00-21swapper/007:25:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional