Application of neuro evolution tools in automation of technical control systems

А.Yu. Doroshenko, I.Z. Achour

Abstract


Reinforced learning is a field of machine learning based on how software agents should perform actions in the environment to maximize the concept of cumulative reward. This paper proposes a new application of machine reinforcement learning techniques in the form of neuroevolution of augmenting topologies to solve control automation problems using modeling control problems of technical systems. Key application components include OpenAI Gym toolkit for developing and comparing reinforcement learning algorithms, full-fledged open-source implementation of the NEAT genetic algorithm called SharpNEAT, and intermediate software for orchestration of these components. The algorithm of neuroevolution of augmenting topologies demonstrates the finding of efficient neural networks on the example of a simple standard problem with continuous control from OpenAI Gym.

Prombles in programming 2021; 1: 16-25


Keywords


artificial neural networks; reinforced learning; genetic algorithms; control automation in technical systems

References


Haykin, Simon S. (1999). Neural networks: a comprehensive foundation. Prentice Hall.

Wilson, Halsey (2018). Artificial intelligence. Grey House Publishing. 184 pages.

Kenneth O. Stanley. Ph.D. Dissertation: EFFICIENT EVOLUTION OF NEURAL NETWORKS THROUGH COMPLEXIFICATION / Kenneth O. Stanley // Department of Computer Sciences, The University of Texas at Austin. – 2004. – http://nn.cs.utexas.edu/keyword?stanley:phd04

https://gym.openai.com/

https://sharpneat.sourceforge.io/

Russell, Stuart J.; Norvig, Peter (2010). Artificial intelligence: a modern approach (Third ed.). Upper Saddle River, New Jersey. P. 830, 831.

Kenneth O. Stanley and Risto Miikkulainen (2002). "Evolving Neural Networks Through Augmenting Topologies". Evolutionary Computation 10 (2): 99-127 CrossRef

https://gym.openai.com/envs/BipedalWalker-v2/

https://github.com/openai/gym/blob/master/gym/envs/box2d/bipedal_walker.py

https://tldp.org/LDP/lpg/node15.html

https://docs.microsoft.com/en-us/windows/win32/ipc/named-pipes?redirectedfrom=MSDN

https://github.com/mhammond/pywin32

https://medium.com/@himanshuxd/activation-functions-sigmoid-relu-leaky-relu-and-softmax-basics-for-neural-networks-and-deep-8d9c70eed91e

https://towardsdatascience.com/activation-functions-neural-networks-1cbd9f8d91d6




DOI: https://doi.org/10.15407/pp2021.01.016

Refbacks

  • There are currently no refbacks.