Software package for adaptive training of robot controllers based on neural networks

A.Y. Vitiuk, A.Yu. Doroshenko


The article deals with the development of a software solution for the application of neuroevolution algorithms when creating a controller for controlling a robotic arm. The main principles of the neuroevolutionary approach for training neural network controllers in tasks requiring reinforcement learning are considered. In particular, the advantages of the adaptive approach are determined for a wide class of scenarios in which the working limb can work: implementation of stable grasping, positioning, manipulation of objects. It is noted that the final result of neuroevolution is an optimal network topology, which makes the model more resource-efficient and easier to analyze. The paper considers a software system that provides the developer with all the necessary tools for modeling the behavior of a robotic agent in environments of various levels of complexity: both two-dimensional and three-dimensional. In addition, the possibility of specifying the state of the agent not only as a set of data from sensors, but also as an image of the current environment from the camera is considered. According to the results of the experiments, the high efficiency of the search for the best solution using the NEAT algorithm is noted. It has been established that the proposed solution allows productively obtaining an effective policy in the form of a neural network, which has a minimal configuration, which will allow to increase the speed of the controller, which is critical for the operation of a real system.
Thus, the use of a software solution for the adaptive development of a neuroevolutionary controller for solving tasks with a robotic limb allows to increase the efficiency of the learning process and obtain an optimal network topology.

Prombles in programming 2023; 4: 98-107


neural network; neuroevolution; robotic arm; reinforcement learning; NEAT; fitness function


Antonin Raffin, et al. Stable-Baselines3: Reliable Reinforcement Learning Implementations, 2021.

I. Omelianenko, Hands-On Neuroevo-lution with Python: Build high-performing artificial neural network architectures using neuroevolution-based algorithms, Packt Publishing, 2019

Kenneth O. Stanley and Risto Miikku-lainen, Evolving Neural Networks Through Augmenting Topologies, Evolutionary Computation 10 (2): 99-127, 2002. CrossRef

Application of neuroevolution tools in technical control automation systems / A.Y. Doroshenko, I.Z. Ashur // Problems of programming. - 2021. - No. 1. - P. 16-25.

A. Vitiuk, A. Doroshenko. A software package for estimating stereo camera calibration error in a computer vision system. Problems of programming, 2022. No. 3-4. P. 469-477. CrossRef

Neuroevolution of a Robot Arm Controller, 2004. URL:

OpenAI Gym 2D Robot Arm Environment, URL:

Verbancsics, P., Stanley, K.O., 2010. Evolving static representations for task transfer. Journal of Machine Learning Research. Vol. 11. pp 1737-1769.



  • There are currently no refbacks.