Training multi-agent teams from zero knowledge with the competitive coevolutionary team-based particle swarm optimiser
Loading...
Date
Authors
Scheepers, Christiaan
Engelbrecht, Andries P.
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Abstract
A new competitive coevolutionary team-based particle
swarm optimiser (CCPSO(t)) algorithm is developed to
train multi-agent teams from zero knowledge. The CCPSO(t)
algorithm is applied to train a team of agents to play simple
soccer. The algorithm uses the charged particle swarm optimiser
in a competitive and cooperative coevolutionary training
environment to train neural network controllers for the
players. The CCPSO(t) algorithm makes use of the FIFA
league ranking relative fitness function to gather detailed
performance metrics from each game played. The training
performance and convergence behaviour of the particle swarm
is analysed. A hypothesis is presented that explains the lack
of convergence in the particle swarms. After applying a clustering
algorithm on the particle positions, a detailed visual
and quantitative analysis of the player strategies is presented.
The final results show that the CCPSO(t) algorithm is capable
of evolving complex gameplay strategies for a complex
non-deterministic game.
Description
Keywords
Cooperative coevolution, Competitive coevolution, Neural networks, Charged particle swarm optimiser, Zero knowledge, Multi agent system, Simple soccer, Competitive coevolutionary team-based particle swarm optimiser (CCPSO(t)), CCPSO(t) algorithm
Sustainable Development Goals
Citation
Scheepers, C & Engelbrecht, AP 2016, 'Training multi-agent teams from zero knowledge with the competitive coevolutionary team-based particle swarm optimiser', Soft Computing, vol. 20, no. 2, pp. 607-620.