Please be advised that the site will be down for maintenance on Sunday, September 1, 2024, from 08:00 to 18:00, and again on Monday, September 2, 2024, from 08:00 to 09:00. We apologize for any inconvenience this may cause.
dc.contributor.advisor | Engelbrecht, Andries P. | |
dc.contributor.coadvisor | Helbig, Marde | |
dc.contributor.postgraduate | Bosman, Anna Sergeevna | |
dc.date.accessioned | 2019-07-09T09:02:58Z | |
dc.date.available | 2019-07-09T09:02:58Z | |
dc.date.created | 2019-09-03 | |
dc.date.issued | 2019 | |
dc.description | Thesis (PhD)--University of Pretoria, 2019. | en_ZA |
dc.description.abstract | Neural network training is a highly non-convex optimisation problem with poorly understood properties. Due to the inherent high dimensionality, neural network search spaces cannot be intuitively visualised, thus other means to establish search space properties have to be employed. Fitness landscape analysis encompasses a selection of techniques designed to estimate the properties of a search landscape associated with an optimisation problem. Applied to neural network training, fitness landscape analysis can be used to establish a link between the properties of the error landscape and various neural network hyperparameters. This study applies fitness landscape analysis to investigate the influence of the search space boundaries, regularisation parameters, loss functions, activation functions, and feed-forward neural network architectures on the properties of the resulting error landscape. A novel gradient-based sampling technique is proposed, together with a novel method to quantify and visualise stationary points and the associated basins of attraction in neural network error landscapes. | en_ZA |
dc.description.availability | Unrestricted | en_ZA |
dc.description.degree | PhD | en_ZA |
dc.description.department | Computer Science | en_ZA |
dc.description.sponsorship | NRF | en_ZA |
dc.identifier.citation | Bosman, AS 2019, Fitness Landscape Analysis of Feed-Forward Neural Networks, PhD Thesis, University of Pretoria, Pretoria, viewed yymmdd <http://hdl.handle.net/2263/70634> | en_ZA |
dc.identifier.other | S2019 | en_ZA |
dc.identifier.uri | http://hdl.handle.net/2263/70634 | |
dc.language.iso | en | en_ZA |
dc.publisher | University of Pretoria | |
dc.rights | © 2019 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria. | |
dc.subject | neural networks | en_ZA |
dc.subject | loss surfaces | en_ZA |
dc.subject | classification | en_ZA |
dc.subject | modality | en_ZA |
dc.subject | visualisation | en_ZA |
dc.subject | fitness landscape analysis | en_ZA |
dc.subject | UCTD | |
dc.title | Fitness Landscape Analysis of Feed-Forward Neural Networks | en_ZA |
dc.type | Thesis | en_ZA |