This paper introduces a novel data driven yaw control algorithm synthesis method based on Reinforcement Learning (RL) for a variable pitch variable speed wind turbine. Yaw control has not been extendedly studied in the literature; in fact, most of the currently considered developments in the scope of the wind energy are oriented to the pitch and speed control. The most important drawbacks of the yaw control are the very large time constants and the strict yaw angle change rate constraints due to the high mechanical loads when the wind turbine angle is changed in order to adequate it to the wind speed orientation. An optimal yaw control algorithm needs to be designed in order to adapt the rotor orientation depending on the wind turbine dynamics and the local wind speed regime. Consequently, the biggest challenge of the yaw control algorithm is to decide the moment and the quantity of the wind turbine orientation variation to achieve the highest quantity of power at each instant, taking into account the constraints derived from the mechanical limitations of the yawing system and the mechanical loads. In this paper, a novel based algorithm based on the RL Q-Learning algorithm is introduced. The first step is to obtain a model of the power generated by the wind turbine (a real onshore wind turbine in this paper) through a power curve, that in conjunction with a conventional proportional regulator will be used to obtain a dataset that explains the actual behaviour of the real wind turbine when a variety of different yaw control commands are imposed. That knowledge is then used to learn the best control action for each different state of the wind turbine with respect to the wind direction represented by the yaw angle, storing that knowledge in a matrix Q(s,a). The last step is to model that matrix through a MultiLayer Perceptron with BackPropagation (MLP-BP) Artificial Neural Network (ANN) to avoid large matrix management and quantification problems. Once that the optimal yaw controller has been synthetized, its performance has been assessed using a number of wind speed realizations obtained using the software application TurbSim, in order to analyze how the introduced novel algorithm deals with different wind speed scenarios.


    Access

    Download


    Export, share and cite



    Title :

    Artificial Neural Network Based Reinforcement Learning for Wind Turbine Yaw Control



    Publication date :

    2019-01-01


    Remarks:

    Energies Vol. 12. Nº 3. Special Issue 10 Years Energies - Horizon 2028). 436, 2019



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Adaptive PID Controller based on Reinforcement Learning for Wind Turbine Control

    M. Sedighizadeh / A. Rezazadeh | BASE | 2008

    Free access

    Traffic Signal Control Based on Reinforcement Learning and Fuzzy Neural Network

    Zhao, Hongxia / Chen, Songhang / Zhu, Fenghua et al. | IEEE | 2022


    Artificial neural network based control systems

    Lightowler,N. / Nareid,H. / Axeon,GB | Automotive engineering | 2003


    Artificial Neural Network Based Control Systems

    Nareid, H. / Lightowler, N. | SAE Technical Papers | 2003


    Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

    Ma, Dongfang / Chen, Xi / Ma, Weihao et al. | IEEE | 2024