Distributed implementation of neuroevolution of augmenting topologies method

I.Z. Achour, A.Yu. Doroshenko

Abstract


Despite the neuroevolution of augmenting topologies method strengths, like the capability to be used in cases where the formula for a cost function and the topology of the neural network are difficult to determine, one of the main problems of such methods is slow convergence towards optimal results, especially in cases with complex and challenging environments. This paper proposes the novel distributed implementation of neuroevolution of augmenting topologies method, which considering availability of sufficient computational resources allows drastically speed up the process of optimal neural network configuration search. Batch genome evaluation was implemented for the means of proposed solution performance optimization, fair, and even computational resources usage. The proposed distributed implementation benchmarking shows that the generated neural networks evaluation process gives a manifold increase of efficiency on the demonstrated task and computational environment.

Prombles in programming 2021; 3: 03-15

 


Keywords


NEAT; neuroevolution of augmenting topologies; artificial neural networks; reinforcement learning; genetic algorithms; distributed computing; cloud computing

References


Evolution 101: Neuroevolution | BEACON. BEACON | An NSF Center for the Study of Evolution in Action. URL: https:// beacon-center.org/blog/2012/08/13/evolu- tion-101-neuroevolution/ (date of access: 08.08.2021).

Subbotin S., Oliinyk A., Oliinyk O. Noniterative, Evolutionary, and Multiagent Methods of Synthesis of Fuzzy Logic and Neural Network Models / ed. by S. O. Subbotin. Zaporizhzhya : ZNTU, 2009. 375 p.

Stanley K. O. Efficient evolution of neural networks through complexification : Thesis. 2004. URL: http://hdl.handle.net/2152/1266 (date of access: 08.08.2021).

NeuroEvolution of Augmenting Topologies. Department of Computer Science, College of Engineering and Computer Science@UCF. URL: http://www.cs.ucf.edu/~kstanley/ neat.html (date of access: 08.08.2021).

Stanley K. O., Miikkulainen R. Evolving Neural Networks through Augmenting Topologies. Evolutionary Computation. 2002. Vol. 10, no. 2. P. 99-127. (date of access: 08.08.2021). https://doi.org/10.1162/106365602320169811

Stanley K. O., Bryant B. D., Miikkulainen R. Real-Time Neuroevolution in the NERO Video Game. IEEE Transactions on Evolutionary Computation. 2005. Vol. 9, no. 6. P. 653-668. (date of access: 08.08.2021). https://doi.org/10.1109/TEVC.2005.856210

Stanley K. O., Miikkulainen R. Competitive Coevolution through Evolutionary Complexification. Journal of Artificial Intelligence Research. 2004. Vol. 21. P. 63-100. URL: https://doi.org/10.1613/jair.1338 (date of access: 08.08.2021).

https://doi.org/10.1613/jair.1338

Green C. SharpNEAT Neuroevolution Framework. SharpNEAT Neuroevolution Framework. URL: https://sharpneat.source-forge.io/ (date of access: 08.08.2021).

Andrews G. R. Foundations of multithreaded, parallel, and distributed programming. Reading, Mass : Addison-Wesley, 2000. 664 p.

Arora S. Computational complexity: A modern approach. Cambridge : Cambridge University Press, 2009.

https://doi.org/10.1017/CBO9780511804090

Lynch N. A. Distributed algorithms. San Francisco, Calif : Morgan Kaufmann, 1997. 872 p.

Peleg D. Distributed computing: A locality-sensitive approach. Philadelphia : Society for Industrial and Applied Mathematics, 2000.

https://doi.org/10.1137/1.9780898719772

Booch G., Rumbaugh J., Jacobson I. Unified Modeling Language User Guide, The (2nd Edition) (The Addison-Wesley Object Technology Series). 2nd ed. Addison-Wes- ley Professional, 2005. 496 p.

ASP.NET documentation. Developer tools, technical documentation and cod- ing examples | Microsoft Docs. URL: https://docs.microsoft.com/en-us/aspnet/ core/?view=aspnetcore-5.0 (date of access: 08.08.2021).

Introduction to gRPC. gRPC. URL: https:// grpc.io/docs/what-is-grpc/introduction/ (date of access: 08.08.2021).

Language Guide | Protocol Buffers | Google Developers. Google Developers. URL: https://developers.google.com/protocol-buffers/docs/overview (date of access: 08.08.2021).

The 11-multiplexer Problem. GEP: Home. URL: https://www.gene-expression-programming.com/webpapers/Ferreira- CS2001/Section6/SS5/SSS2.htm (date of access: 08.08.2021).

Powering .NET 5 with AWS Graviton2: Benchmarks | Amazon Web Services. Amazon Web Services. URL: https://aws.ama- zon.com/ru/blogs/compute/powering-net- 5-with-aws-graviton2-benchmark-results/ (date of access: 08.08.2021).




DOI: https://doi.org/10.15407/pp2021.03.003

Refbacks

  • There are currently no refbacks.