Faster & More Reliable Tuning of Neural Networks: Bayesian Optimization with Importance Sampling

No abstract is available for this paper.

• Publication year

  2021

• Venue

  International Conference on Artificial Intelligence and Statistics

• Publication date

  Unknown publication date

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameters

  2019cited by this paper
• Bayesian Optimization Meets Bayesian Optimal Stopping

  2019cited by this paper
• Training Deep Models Faster with Robust, Approximate Importance Sampling

  2018cited by this paper
• Not All Samples Are Created Equal: Deep Learning with Importance Sampling

  2018influential reference
• Combination of Hyperband and Bayesian Optimization for Hyperparameter Optimization in Deep Learning

  2018cited by this paper
• BOHB: Robust and Efficient Hyperparameter Optimization at Scale

  2018cited by this paper
• Google Vizier: A Service for Black-Box Optimization

  2017cited by this paper
• Hyperparameter optimization of deep neural networks: combining Hperband with Bayesian model selection

  2017cited by this paper
• Bayesian Optimization with Gradients

  2017cited by this paper
• CPSG-MCMC: Clustering-Based Preprocessing method for Stochastic Gradient MCMC

  2017cited by this paper
• Stochastic Learning on Imbalanced Data: Determinantal Point Processes for Mini-batch Diversification

  2017cited by this paper
• Wide Residual Networks

  2016cited by this paper
• Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets

  2016influential reference
• Gaussian Process Bandit Optimisation with Multi-fidelity Evaluations

  2016cited by this paper
• Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization

  2016cited by this paper
• Speeding Up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves

  2015cited by this paper
• Non-Uniform Stochastic Average Gradient Method for Training Conditional Random Fields

  2015cited by this paper
• Online Batch Selection for Faster Training of Neural Networks

  2015cited by this paper
• Predictive Entropy Search for Multi-objective Bayesian Optimization

  2015cited by this paper
• Freeze-Thaw Bayesian Optimization

  2014cited by this paper
• Stochastic Optimization with Importance Sampling for Regularized Loss Minimization

  2014cited by this paper
• Predictive Entropy Search for Efficient Global Optimization of Black-box Functions

  2014cited by this paper
• Multi-Task Bayesian Optimization

  2013cited by this paper
• Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm

  2013cited by this paper
• Practical Bayesian Optimization of Machine Learning Algorithms

  2012cited by this paper
• Algorithms for Hyper-Parameter Optimization

  2011cited by this paper
• Entropy Search for Information-Efficient Global Optimization

  2011influential reference
• Learning Multiple Layers of Features from Tiny Images

  2009cited by this paper
• Multi-fidelity optimization via surrogate modelling

  2007cited by this paper
• Multi-task Gaussian Process Prediction

  2007cited by this paper
• Sequential kriging optimization using multiple-fidelity evaluations

  2006cited by this paper
• The mnist database of handwritten digits

  2005cited by this paper
• Efficient Global Optimization of Expensive Black-Box Functions

  1998cited by this paper
• SDO : A Statistical Method for Global Optimization

  1997cited by this paper
• A statistical method for global optimization

  1992cited by this paper
• On Bayesian Methods for Seeking the Extremum

  1974cited by this paper

• Eight years of AutoML: categorisation, review and trends

  2023cites this paper
• Fair and green hyperparameter optimization via multi-objective and multiple information source Bayesian optimization

  2022cites this paper
• Bayesian Optimization Over Iterative Learners with Structured Responses: A Budget-aware Planning Approach

  2022cites this paper
• Loosening Identification of Multi-Bolt Connections Based on Wavelet Transform and ResNet-50 Convolutional Neural Network

  2022cites this paper
• Put Attention to Temporal Saliency Patterns of Multi-Horizon Time Series

  2022cites this paper
• Adaptive Importance Sampling meets Mirror Descent : a Bias-variance Tradeoff

  2021cites this paper