Utilizing Genetic Algorithms for Tuning and Enhancing Hyperparameters of Neural Networks
Abstract
The present study utilized a genetic algorithm to optimize the hyperparameters of an MLP neural network. The key hyperparameters, including the hidden layer sizes, number of epochs, learning rate, and optimization algorithm, were subjected to optimization using the genetic algorithm. The Iris flower dataset and the handwritten Numeral dataset were employed to evaluate the performance of the optimized model. The results showed significant improvements in the classification accuracy achieved through the genetic algorithm optimization. The Iris dataset yielded a perfect accuracy of 100%, indicating excellent classification performance. Similarly, the handwritten Numeral dataset achieved an accuracy of 94%, demonstrating the effectiveness of the optimized model in recognizing handwritten Numeral. These findings underscore the importance of genetic algorithms in fine-tuning and enhancing the hyperparameters of MLP neural networks. The application of the genetic algorithm resulted in improved performance and increased classification accuracy in both datasets, showcasing the potential of this approach in improving the performance of neural network models.
Full text article
Authors
Copyright (c) 2023 Journal of Pure & Applied Sciences
This work is licensed under a Creative Commons Attribution 4.0 International License.
In a brief statement, the rights relate to the publication and distribution of research published in the journal of the University of Sebha where authors who have published their articles in the journal of the university of Sebha should how they can use or distribute their articles. They reserve all their rights to the published works, such as (but not limited to) the following rights:
- Copyright and other property rights related to the article, such as patent rights.
- Research published in the journal of the University of Sebha and used in its future works, including lectures and books, the right to reproduce articles for their own purposes, and the right to self-archive their articles.
- The right to enter a separate article, or for a non-exclusive distribution of their article with an acknowledgment of its initial publication in the journal of Sebha University.
Privacy Statement The names and e-mail addresses entered on the Sabha University Journal site will be used for the aforementioned purposes only and for which they were used.