You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-15 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6.osadl.org (updated Fri Jun 14, 2024 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
287088499109103,4cyclictest2952235-21kworker/u8:1+events_unbound11:38:360
2870887999482,8cyclictest2924619-21latency_hist10:00:011
2870884999285,5cyclictest2954843-21kworker/u8:3+events_unbound11:55:000
2870884998982,5cyclictest2963601-21kworker/u8:1+events_unbound12:20:000
2870884998777,8cyclictest2890142-21latency_hist08:10:010
2870884998646,36cyclictest2883519-21latency_hist07:50:010
2870884998475,7cyclictest2950107-21latency_hist11:20:010
2870887998370,9cyclictest274-21systemd-journal11:40:191
2870887998170,7cyclictest2954866-21latency_hist11:35:011
2870884998169,9cyclictest2873941-21latency_hist07:20:010
2870887998070,7cyclictest2913220-21latency_hist09:25:011
2870884997870,6cyclictest2954843-21kworker/u8:3+flush-179:011:50:010
2870884997668,6cyclictest2930962-21kworker/u8:2+events_unbound10:35:000
2870887997570,3cyclictest2890380-21kworker/u8:1+flush-179:008:55:301
2870887997564,8cyclictest2906852-21latency_hist09:05:021
2870884997468,4cyclictest2919830-21kworker/u8:1+flush-179:009:45:000
2870884997466,6cyclictest2919830-21kworker/u8:1+flush-179:009:50:260
2870884997267,4cyclictest2954843-21kworker/u8:3+events_unbound11:40:190
2870884997267,4cyclictest2896760-21kworker/u8:3+flush-179:008:50:220
2870887997163,5cyclictest2960874-21kworker/u8:0+flush-179:012:24:591
2870884997161,7cyclictest2963601-21kworker/u8:1+flush-179:012:10:200
2870884997161,7cyclictest2963601-21kworker/u8:1+flush-179:012:10:200
2870887997059,8cyclictest2881927-21latency_hist07:45:011
2870887996859,7cyclictest2919830-21kworker/u8:1+flush-179:009:55:001
2870884996761,4cyclictest2923052-21kworker/u8:3+events_unbound10:00:260
2870884996759,7cyclictest2945360-21kworker/u8:2+flush-179:011:10:000
2870887996656,7cyclictest2962710-21/usr/sbin/munin11:55:281
2870884996662,3cyclictest2890380-21kworker/u8:1+flush-179:008:15:000
2870884996660,4cyclictest2960874-21kworker/u8:0+events_unbound12:35:260
2870884996655,5cyclictest2919830-21kworker/u8:1+events_unbound10:10:010
2870884996551,5cyclictest2870710-21kworker/u8:0+events_unbound07:35:290
2870884996551,5cyclictest2870710-21kworker/u8:0+events_unbound07:35:280
2870887996453,8cyclictest2896772-21latency_hist08:30:001
2870884996457,5cyclictest2923052-21kworker/u8:3+flush-179:010:20:000
2870884996457,5cyclictest2896760-21kworker/u8:3+flush-179:008:35:000
2870887996355,6cyclictest2870726-21latency_hist07:10:021
2870887996349,11cyclictest2899949-21apt-get08:40:011
2870887996348,13cyclictest2938991-21kworker/u8:3+flush-179:011:05:001
2870887996257,3cyclictest658-21Xorg07:55:591
2870884996257,4cyclictest2923052-21kworker/u8:3+flush-179:010:10:280
2870887996153,6cyclictest2930959-21kworker/u8:0+flush-179:010:55:011
2870887996152,7cyclictest2975980-21kworker/u8:4+flush-179:012:40:011
2870884996152,7cyclictest2932584-21latency_hist10:25:010
2870887996043,15cyclictest2964319-21/usr/sbin/munin12:00:181
2870884996055,4cyclictest2890380-21kworker/u8:1+flush-179:009:09:550
2870884996054,4cyclictest2896760-21kworker/u8:3+flush-179:008:40:250
2870884996053,5cyclictest2896760-21kworker/u8:3+events_unbound08:50:000
2870884996053,5cyclictest2896760-21kworker/u8:3+events_unbound08:50:000
2870884996050,7cyclictest2864445-21kworker/u8:2+flush-179:007:25:160
287088499600,57cyclictest2918300-21munin-run09:40:000
2870884995952,4cyclictest2880602-21kworker/u8:1+events_unbound07:40:250
2870884995852,5cyclictest2960874-21kworker/u8:0+events_unbound12:34:450
2870884995851,5cyclictest2890380-21kworker/u8:1+events_unbound08:25:280
2870884995752,4cyclictest2932620-21kworker/u8:1+flush-179:010:25:220
2870887995647,7cyclictest2919830-21kworker/u8:1+flush-179:010:05:271
2870887995647,7cyclictest2892242-21apt-get08:15:101
2870884995648,6cyclictest2890380-21kworker/u8:1+flush-179:008:55:260
287088499560,54cyclictest1-21systemd10:50:010
2870887995548,5cyclictest2864445-21kworker/u8:2+flush-179:007:40:011
2870887995548,5cyclictest2864445-21kworker/u8:2+flush-179:007:40:001
2870884995551,3cyclictest2910060-21kworker/u8:2+flush-179:009:20:160
2870884995551,3cyclictest2875572-21kworker/u8:3+flush-179:007:30:300
2870884995548,4cyclictest2896760-21kworker/u8:3+events_unbound08:35:120
2870884995546,7cyclictest2948495-21latency_hist11:15:010
2870887995447,5cyclictest2896760-21kworker/u8:3+flush-179:008:40:371
2870884995448,4cyclictest2910060-21kworker/u8:2+events_unbound09:25:210
2870887995244,6cyclictest2937359-21latency_hist10:40:011
2870884995246,4cyclictest2960874-21kworker/u8:0+events_unbound12:25:170
2870884995244,5cyclictest2906885-21kworker/u8:0+events_unbound09:15:120
2870884995241,4cyclictest2945360-21kworker/u8:2+events_unbound11:30:130
2870889995148,2cyclictest0-21swapper/208:16:002
2870887995147,3cyclictest2945360-21kworker/u8:2+flush-179:011:25:261
2870884995141,7cyclictest274-21systemd-journal09:32:350
2870887995040,8cyclictest2930996-21latency_hist10:20:011
2870887995040,7cyclictest2891727-21latency_hist08:15:001
2870884995045,4cyclictest2864445-21kworker/u8:2+flush-179:007:50:170
2870884995037,10cyclictest274-21systemd-journal07:55:120
2870887994927,19cyclictest274-21systemd-journal10:45:011
2870887994843,4cyclictest2875572-21kworker/u8:3+flush-179:008:05:301
287088799480,4cyclictest2970889-21latency_hist12:20:011
2870884994842,4cyclictest2890380-21kworker/u8:1+events_unbound09:00:130
2870884994841,5cyclictest2870710-21kworker/u8:0+flush-179:007:10:340
2870884994841,5cyclictest2870710-21kworker/u8:0+flush-179:007:10:340
4521791470,13ptp4l53390irq/134-eno1-TxRx-007:10:013
2870887994740,5cyclictest274-21systemd-journal11:39:431
2870884994741,4cyclictest2960923-21kworker/u8:2+flush-179:012:05:000
2870884994740,5cyclictest2960923-21kworker/u8:2+events_unbound11:55:140
2870887994642,2cyclictest0-21swapper/108:00:141
2870887994637,7cyclictest2960887-21latency_hist11:50:011
287088799460,29cyclictest2939177-21date10:45:011
2870884994642,3cyclictest2938991-21kworker/u8:3+flush-179:011:00:200
2870884994638,6cyclictest2890380-21kworker/u8:1+flush-179:009:15:010
2870887994542,2cyclictest2910060-21kworker/u8:2+flush-179:009:20:001
287088799450,42cyclictest0-21swapper/109:15:011
287088799450,1cyclictest0-21swapper/111:15:131
2870884994540,4cyclictest2894479-21kworker/u8:2+flush-179:008:24:560
2870884994540,4cyclictest2894479-21kworker/u8:2+flush-179:008:24:560
2870887994437,5cyclictest2864445-21kworker/u8:2+flush-179:007:55:001
2870884994436,6cyclictest274-21systemd-journal08:17:340
2870884994435,7cyclictest2920103-21apt-get09:45:140
2870887994337,5cyclictest2870710-21kworker/u8:0+flush-179:007:15:001
2870887994337,5cyclictest2870710-21kworker/u8:0+flush-179:007:15:001
2870884994338,4cyclictest2945360-21kworker/u8:2+flush-179:011:30:000
2870884994337,4cyclictest2930959-21kworker/u8:0+flush-179:011:20:260
2870884994337,4cyclictest2930959-21kworker/u8:0+flush-179:011:20:260
2870884994337,4cyclictest2870710-21kworker/u8:0+events_unbound07:20:380
2870884994337,4cyclictest2864445-21kworker/u8:2+flush-179:008:00:320
2870887994226,14cyclictest0-21swapper/109:30:011
2870884994237,3cyclictest2930959-21kworker/u8:0+flush-179:010:40:140
2870887994128,9cyclictest2968838-21latency_hist12:15:011
2870887994128,9cyclictest2968838-21latency_hist12:15:011
2870887994124,15cyclictest2877124-21latency_hist07:30:011
287088799410,38cyclictest2907109-21apt-get09:05:121
287088999400,1cyclictest0-21swapper/208:56:002
2870887994035,4cyclictest2960874-21kworker/u8:0+flush-179:012:25:311
2870887994020,18cyclictest0-21swapper/107:35:011
287088799401,2cyclictest658-21Xorg10:55:591
287088799401,10cyclictest2916911-21apt-get09:35:111
287088499401,37cyclictest658-21Xorg12:06:590
2870887993935,2cyclictest658-21Xorg12:33:591
2870887993923,15cyclictest0-21swapper/110:25:101
287088799390,38cyclictest0-21swapper/108:31:001
2870884993936,2cyclictest0-21swapper/010:36:590
287089299380,36cyclictest2960906-21sleep11:50:013
287088999380,36cyclictest0-21swapper/210:52:592
287088999380,36cyclictest0-21swapper/209:23:002
2870887993832,4cyclictest2903699-21latency_hist08:55:001
2870892993734,2cyclictest0-21swapper/307:17:003
287089299370,36cyclictest0-21swapper/307:42:583
287089299370,1cyclictest0-21swapper/310:15:583
2870889993734,2cyclictest0-21swapper/210:08:592
2870887993718,17cyclictest0-21swapper/111:15:001
2870884993733,3cyclictest2963601-21kworker/u8:1+flush-179:012:20:280
287088499370,36cyclictest0-21swapper/009:59:590
4521791360,3ptp4l441ktimers/307:50:123
4521791360,28ptp4l441ktimers/308:15:023
2870892993634,1cyclictest0-21swapper/309:12:003
2870892993634,1cyclictest0-21swapper/308:37:593
2870892993634,1cyclictest0-21swapper/307:23:593
2870892993633,2cyclictest0-21swapper/312:27:003
2870892993633,2cyclictest0-21swapper/312:16:593
2870892993633,2cyclictest0-21swapper/308:59:003
287089299360,35cyclictest0-21swapper/310:05:593
287089299360,1cyclictest0-21swapper/312:12:003
287089299360,1cyclictest0-21swapper/312:12:003
287089299360,1cyclictest0-21swapper/307:47:003
2870889993633,2cyclictest0-21swapper/212:20:592
287088999360,1cyclictest0-21swapper/211:44:592
287088999360,1cyclictest0-21swapper/210:12:592
2870887993632,2cyclictest658-21Xorg07:48:591
2870887993632,2cyclictest2951728-21systemd-run11:25:001
2870887993632,2cyclictest2951728-21systemd-run11:25:001
2870887993611,6cyclictest2932051-21ntp_states10:20:281
287088799360,8cyclictest2920043-21date09:45:011
2870884993629,5cyclictest1-21systemd10:55:010
2870892993533,1cyclictest0-21swapper/309:59:593
2870892993533,1cyclictest0-21swapper/309:40:593
2870892993531,2cyclictest0-21swapper/310:36:593
2870889993532,2cyclictest0-21swapper/212:31:592
2870887993528,5cyclictest2915305-21/usr/sbin/munin09:30:181
2870887993513,3cyclictest0-21swapper/110:00:141
287088799350,5cyclictest2935951-21latency_hist10:35:001
2870892993431,2cyclictest0-21swapper/308:06:593
2870889993431,2cyclictest0-21swapper/208:52:582
287088799340,7cyclictest2947091-21sed11:10:011
287088799340,6cyclictest2919842-21cron09:45:001
287088499340,31cyclictest0-21swapper/010:55:110
2870892993230,1cyclictest0-21swapper/309:08:593
2870892993229,2cyclictest0-21swapper/311:40:593
2870889993230,1cyclictest0-21swapper/211:34:592
2870889993229,2cyclictest0-21swapper/207:27:592
287088999320,30cyclictest0-21swapper/209:38:002
2870887993227,4cyclictest2872793-21cstates07:15:121
2870887993214,16cyclictest0-21swapper/111:50:261
2870892993129,1cyclictest0-21swapper/311:00:593
287089299310,27cyclictest0-21swapper/311:00:003
287089299310,27cyclictest0-21swapper/309:50:123
2870889993128,2cyclictest0-21swapper/209:02:002
2870887993127,3cyclictest1-21systemd10:15:001
2870887993125,4cyclictest2902285-21latency_hist08:50:011
2870887993125,4cyclictest2902285-21latency_hist08:50:001
4521791300,6ptp4l53390irq/134-eno1-TxRx-007:34:563
2870892993028,1cyclictest0-21swapper/310:45:593
2870892993027,2cyclictest0-21swapper/311:40:013
2870892993027,2cyclictest0-21swapper/309:30:023
2870892993026,2cyclictest0-21swapper/307:25:123
287089299300,2cyclictest0-21swapper/310:40:143
287089299300,2cyclictest0-21swapper/308:30:003
287089299300,28cyclictest0-21swapper/310:00:123
287089299300,28cyclictest0-21swapper/309:00:083
287089299300,27cyclictest0-21swapper/312:35:003
287089299300,27cyclictest0-21swapper/311:25:133
2870889993027,2cyclictest0-21swapper/211:55:592
2870889993027,2cyclictest0-21swapper/211:25:122
2870889993027,2cyclictest0-21swapper/210:42:592
2870889993027,2cyclictest0-21swapper/209:50:112
2870889993027,2cyclictest0-21swapper/208:40:032
2870889993027,2cyclictest0-21swapper/208:32:002
2870889993027,2cyclictest0-21swapper/208:25:122
287088999300,2cyclictest0-21swapper/212:15:022
287088999300,2cyclictest0-21swapper/207:30:122
287088999300,29cyclictest0-21swapper/209:30:012
287088999300,28cyclictest0-21swapper/211:20:592
287088999300,28cyclictest0-21swapper/211:20:592
287088999300,28cyclictest0-21swapper/211:15:112
2870887993022,6cyclictest0-21swapper/112:05:101
2870892992927,1cyclictest0-21swapper/311:50:123
2870892992926,2cyclictest0-21swapper/312:05:013
2870892992926,2cyclictest0-21swapper/310:50:153
2870892992926,2cyclictest0-21swapper/310:20:143
2870892992925,2cyclictest0-21swapper/308:55:013
287089299290,2cyclictest0-21swapper/311:20:123
287089299290,2cyclictest0-21swapper/311:20:123
287089299290,2cyclictest0-21swapper/308:25:013
287089299290,2cyclictest0-21swapper/308:25:013
287089299290,28cyclictest0-21swapper/311:15:113
287089299290,27cyclictest0-21swapper/310:30:133
287089299290,27cyclictest0-21swapper/310:25:113
287089299290,27cyclictest0-21swapper/308:40:163
287089299290,26cyclictest0-21swapper/309:45:143
287089299290,26cyclictest0-21swapper/307:55:023
287089299290,1cyclictest0-21swapper/310:10:103
2870889992927,1cyclictest0-21swapper/207:20:122
2870889992926,2cyclictest0-21swapper/212:25:012
2870889992926,2cyclictest0-21swapper/212:08:592
2870889992926,2cyclictest0-21swapper/209:15:112
2870889992926,2cyclictest0-21swapper/208:40:012
287088999290,2cyclictest0-21swapper/210:30:132
287088999290,2cyclictest0-21swapper/208:20:112
287088999290,2cyclictest0-21swapper/208:20:112
287088999290,2cyclictest0-21swapper/208:05:002
287088999290,2cyclictest0-21swapper/207:55:032
287088999290,28cyclictest0-21swapper/210:45:102
287088999290,27cyclictest0-21swapper/212:35:112
287088999290,27cyclictest0-21swapper/211:35:022
287088999290,27cyclictest0-21swapper/211:00:152
287088999290,27cyclictest0-21swapper/210:00:112
287088999290,27cyclictest0-21swapper/209:25:232
287088999290,27cyclictest0-21swapper/209:10:112
287088999290,27cyclictest0-21swapper/208:05:112
287088999290,27cyclictest0-21swapper/207:45:112
287088999290,1cyclictest0-21swapper/209:40:102
2870887992925,2cyclictest2874207-21apt-get07:20:121
2870892992826,1cyclictest0-21swapper/311:30:103
2870892992826,1cyclictest0-21swapper/308:10:113
2870892992825,2cyclictest0-21swapper/308:35:003
287089299280,2cyclictest0-21swapper/312:35:123
287089299280,2cyclictest0-21swapper/309:30:013
287089299280,27cyclictest0-21swapper/311:10:103
287089299280,27cyclictest0-21swapper/309:15:123
287089299280,24cyclictest0-21swapper/308:48:583
287089299280,24cyclictest0-21swapper/308:48:583
287089299280,1cyclictest0-21swapper/309:20:133
2870889992826,1cyclictest0-21swapper/210:55:112
2870889992825,2cyclictest0-21swapper/210:25:102
2870889992825,2cyclictest0-21swapper/209:45:142
287088999280,2cyclictest0-21swapper/211:55:012
287088999280,27cyclictest0-21swapper/211:45:132
287088999280,27cyclictest0-21swapper/207:40:022
287088999280,27cyclictest0-21swapper/207:40:022
287088999280,26cyclictest0-21swapper/212:10:112
287088999280,26cyclictest0-21swapper/212:10:112
287088999280,26cyclictest0-21swapper/209:56:002
287088999280,26cyclictest0-21swapper/209:05:112
287088999280,26cyclictest0-21swapper/207:55:012
287088799280,26cyclictest658-21Xorg08:20:591
287088799280,26cyclictest658-21Xorg08:20:581
2870892992725,1cyclictest0-21swapper/312:05:093
2870892992725,1cyclictest0-21swapper/311:59:583
2870892992724,2cyclictest0-21swapper/307:14:593
2870892992724,2cyclictest0-21swapper/307:14:583
287089299270,26cyclictest0-21swapper/308:00:123
287088999270,25cyclictest0-21swapper/210:35:112
287088999270,1cyclictest0-21swapper/211:05:122
4521791260,6ptp4l53390irq/134-eno1-TxRx-012:25:003
287089299260,2cyclictest0-21swapper/311:08:593
287088999260,2cyclictest0-21swapper/208:49:592
287088999260,2cyclictest0-21swapper/208:49:582
287088999260,25cyclictest0-21swapper/207:45:002
287088999260,24cyclictest0-21swapper/208:10:122
287088999260,24cyclictest0-21swapper/207:15:122
4521791250,5ptp4l53390irq/134-eno1-TxRx-009:40:003
2870892992522,2cyclictest0-21swapper/307:35:143
2870892992522,2cyclictest0-21swapper/307:35:133
2870889992523,1cyclictest0-21swapper/212:01:592
128899250,14rtkit-daemon2869445-21apt-get07:05:140
2870889992219,2cyclictest0-21swapper/210:15:592
2870889992119,1cyclictest0-21swapper/210:23:592
2870889992119,1cyclictest0-21swapper/207:10:142
2870889992119,1cyclictest0-21swapper/207:10:132
2870889992118,2cyclictest0-21swapper/211:10:112
28708899930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional