Training multi-agent teams from zero knowledge with the competitive coevolutionary team-based particle swarm optimiser

Loading...
Thumbnail Image

Authors

Scheepers, Christiaan
Engelbrecht, Andries P.

Journal Title

Journal ISSN

Volume Title

Publisher

Springer

Abstract

A new competitive coevolutionary team-based particle swarm optimiser (CCPSO(t)) algorithm is developed to train multi-agent teams from zero knowledge. The CCPSO(t) algorithm is applied to train a team of agents to play simple soccer. The algorithm uses the charged particle swarm optimiser in a competitive and cooperative coevolutionary training environment to train neural network controllers for the players. The CCPSO(t) algorithm makes use of the FIFA league ranking relative fitness function to gather detailed performance metrics from each game played. The training performance and convergence behaviour of the particle swarm is analysed. A hypothesis is presented that explains the lack of convergence in the particle swarms. After applying a clustering algorithm on the particle positions, a detailed visual and quantitative analysis of the player strategies is presented. The final results show that the CCPSO(t) algorithm is capable of evolving complex gameplay strategies for a complex non-deterministic game.

Description

Keywords

Cooperative coevolution, Competitive coevolution, Neural networks, Charged particle swarm optimiser, Zero knowledge, Multi agent system, Simple soccer, Competitive coevolutionary team-based particle swarm optimiser (CCPSO(t)), CCPSO(t) algorithm

Sustainable Development Goals

Citation

Scheepers, C & Engelbrecht, AP 2016, 'Training multi-agent teams from zero knowledge with the competitive coevolutionary team-based particle swarm optimiser', Soft Computing, vol. 20, no. 2, pp. 607-620.