Hyperparameter tuning for big data using Bayesian optimisation
Theckel Joy, Tinu, Rana, Santu, Gupta, Sunil and Venkatesh, Svetha 2016, Hyperparameter tuning for big data using Bayesian optimisation, in ICPR 2016: Proceedings of the 23rd International Conference on Pattern Recognition, IEEE, Piscataway, N.J., pp. 2574-2579, doi: 10.1109/ICPR.2016.7900023.
Attached Files
Name
Description
MIMEType
Size
Downloads
Title
Hyperparameter tuning for big data using Bayesian optimisation
ICPR 2016: Proceedings of the 23rd International Conference on Pattern Recognition
Publication date
2016
Conference series
Pattern Recognition International Conference
Start page
2574
End page
2579
Total pages
6
Publisher
IEEE
Place of publication
Piscataway, N.J.
Summary
Hyperparameters play a crucial role in the model selection of machine learning algorithms. Tuning these hyperparameters can be exhaustive when the data is large. Bayesian optimisation has emerged as an efficient tool for hyperparameter tuning of machine learning algorithms. In this paper, we propose a novel framework for tuning the hyperparameters for big data using Bayesian optimisation. We divide the big data into chunks and generate hyperparameter configurations for the chunks using the standard Bayesian optimisation. We utilise this information from the chunks for hyperparameter tuning on big data using a transfer learning setting. We evaluate the performance of the proposed method on the task of tuning hyperparameters of two machine learning algorithms. We show that our method achieves the best available hyperparameter configuration within less computational time compared to the state-of-art hyperparameter tuning methods.
Every reasonable effort has been made to ensure that permission has been obtained for items included in DRO. If you believe that your rights have been infringed by this repository, please contact drosupport@deakin.edu.au.