Sample size selection in optimization methods for machine learning

No abstract is available for this paper.

• Publication year

  2012

• Venue

  Mathematical programming

• Publication date

  2012-08-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1007/S10107-012-0572-5
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Accelerated Block-coordinate Relaxation for Regularized Optimization

  2012cited by this paper
• On the Use of Stochastic Hessian Information in Optimization Methods for Machine Learning

  2011cited by this paper
• Distributed delayed stochastic optimization

  2011cited by this paper
• Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent

  2011cited by this paper
• Hybrid Deterministic-Stochastic Methods for Data Fitting

  2011cited by this paper
• Deep learning via Hessian-free optimization

  2010cited by this paper
• On the Use of Stochastic Hessian Information in Unconstrained Optimization

  2010influential reference
• Optimal Distributed Online Prediction Using Mini-Batches

  2010cited by this paper
• Composite objective mirror descent

  2010cited by this paper
• Efficient Online and Batch Learning Using Forward Backward Splitting

  2009cited by this paper
• Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization

  2009cited by this paper
• Primal-dual subgradient methods for convex problems

  2009cited by this paper
• Sparse Reconstruction by Separable Approximation

  2008cited by this paper
• Variable-Number Sample-Path Optimization

  2008cited by this paper
• Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems

  2007cited by this paper
• The Tradeoffs of Large Scale Learning

  2007influential reference
• RESEARCH OUTPUTS / RÉSULTATS DE RECHERCHE

  2006cited by this paper
• Accelerated training of conditional random fields with stochastic gradient methods

  2006cited by this paper
• A New Active Set Algorithm for Box Constrained Optimization

  2006cited by this paper
• Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming

  2005cited by this paper
• Variable-sample methods for stochastic optimization

  2003cited by this paper
• The Sample Average Approximation Method for Stochastic Discrete Optimization

  2002cited by this paper
• On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs

  2000cited by this paper
• Newton's Method for Large Bound-Constrained Optimization Problems

  1999cited by this paper
• A simulation-based approach to two-stage stochastic programming with recourse

  1998cited by this paper
• Convergence Analysis of Stochastic Algorithms

  1996cited by this paper
• De-noising by soft-thresholding

  1995cited by this paper
• Acceleration of stochastic approximation by averaging

  1992cited by this paper
• A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds

  1991cited by this paper
• On the Goldstein-Levitin-Polyak gradient projection method

  1974cited by this paper
• The conjugate gradient method in extremal problems

  1969cited by this paper
• A Stochastic Approximation Method

  1951cited by this paper
• Mathematical Statistics

  1944cited by this paper

• An Adaptive Framework for Robust Structural Shape Optimization under Uncertainty

  2026cites this paper
• Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent

  2026cites this paper
• Inertial proximal stochastic gradient method with adaptive sampling for non-convex and non-smooth problems

  2026cites this paper
• Stochastic conjugate gradient algorithm with an inertial extrapolation step for nonconvex optimization in machine learning

  2026cites this paper
• A line-search based SGD algorithm with Adaptive Importance Sampling

  2026cites this paper
• A novel stochastic conjugate gradient algorithm based on a stochastic differential equation perspective

  2026cites this paper
• An efficient hybrid sampling surrogate model-based method for the indoor environment multi-objective optimization

  2026cites this paper
• Negative Curvature Methods with High-Probability Complexity Guarantees for Stochastic Nonconvex Optimization

  2026cites this paper
• GPU-Optimized Deep Learning Methods for Single-Cell Protein Localization Classification: A Comparative Analysis

  2025cites this paper
• A variable dimension sketching strategy for nonlinear least-squares

  2025cites this paper
• Boosting Accelerated Proximal Gradient Method with Adaptive Sampling for Stochastic Composite Optimization

  2025cites this paper
• Differentially Private Gradient-Tracking-Based Distributed Stochastic Optimization over Directed Graphs

  2025cites this paper
• Adaptive Batch Size and Learning Rate Scheduler for Stochastic Gradient Descent Based on Minimization of Stochastic First-order Oracle Complexity

  2025cites this paper
• Sample size determination: posterior distributions proximity

  2025cites this paper
• On the Convergence and Complexity of the Stochastic Central Finite-Difference Based Gradient Estimation Methods

  2025cites this paper
• BISTRO -- A Bi-Fidelity Stochastic Gradient Framework using Trust-Regions for Optimization Under Uncertainty

  2025cites this paper
• Generalized subsampled Newton methods for optimization and its application

  2025cites this paper
• Convergence-Guaranteed Algorithms for l1/2-Regularized Quadratic Programs with Assignment Constraints

  2025cites this paper
• Sample Size Determination: Likelihood Bootstrapping

  2025cites this paper
• Variable metric proximal stochastic gradient methods with additional sampling

  2025cites this paper
• ASMOP: Additional sampling stochastic trust region method for multi-objective problems

  2025cites this paper
• Extended sparse Kaczmarz method with surrogate hyperplane for sparse solutions to inconsistent linear systems

  2025cites this paper
• Training speedups via batching for geometric learning: an analysis of static and dynamic algorithms

  2025cites this paper
• Derivative-free stochastic optimization via adaptive sampling strategies

  2025cites this paper
• Generalized subsampled Newton method for large-scale linear inequalities with Tikhonov regularization

  2025cites this paper
• Identifying Risk Factors for Poor Efficacy of Adalimumab Treatment in Patients With Crohn’s Disease: Insights From Machine Learning Models

  2025cites this paper
• Capturing the Dynamics of Aboveground Carbon Stock in Intertidal Seagrass Meadows using Sentinel-2 Time-Series Imagery

  2025cites this paper
• A line search framework with restarting for noisy optimization problems

  2025influential citation
• ItsDEAL: Inexact two-level smoothing descent algorithms for weakly convex optimization

  2025influential citation
• AdLoCo: adaptive batching significantly improves communications efficiency and convergence for Large Language Models

  2025influential citation
• Training Autoencoders Using Stochastic Hessian-Free Optimization with LSMR

  2025influential citation
• Stochastic Adaptive Gradient Descent Without Descent

  2025cites this paper
• SMOP: Stochastic trust region method for multi-objective problems

  2025cites this paper
• Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum

  2025cites this paper
• An adaptive importance sampling algorithm for risk-averse optimization

  2025cites this paper
• Adaptive data pruning for efficient federated learning on heterogeneous clients

  2025cites this paper
• An Interpretable Deep Learning Framework for Biomarker Discovery in Complex Disease Survival Outcomes

  2025cites this paper
• Complexity guarantees for risk-neutral generalized Nash equilibrium problems

  2025cites this paper
• Simulation Optimization: An Introductory Tutorial on Methodology

  2024cites this paper
• System for Detection and Quantitative Evaluation of Compensatory Movement in Post-Stroke Patients Based on Wearable Sensor and Machine Learning Algorithm

  2024cites this paper
• Simulation model calibration with dynamic stratification and adaptive sampling

  2024cites this paper
• Central Finite-Difference Based Gradient Estimation Methods for Stochastic Optimization

  2024cites this paper
• Prediction of the Splitting Tensile Strength of Manufactured Sand Based High-Performance Concrete Using Explainable Machine Learning

  2024cites this paper
• A multilevel stochastic regularized first-order method with application to finite sum minimization

  2024cites this paper
• Foundation Model Makes Clustering a Better Initialization for Active Learning

  2024cites this paper
• Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation

  2024cites this paper
• Exploiting negative curvature in conjunction with adaptive sampling: theoretical results and a practical algorithm

  2024influential citation
• Machine learning based analysis of single-cell data reveals evidence of subject-specific single-cell gene expression profiles in acute myeloid leukaemia patients and healthy controls.

  2024cites this paper
• A Proximal Stochastic Quasi-Newton Algorithm with Dynamical Sampling and Stochastic Line Search

  2024influential citation
• A Study of First-Order Methods with a Deterministic Relative-Error Gradient Oracle

  2024cites this paper
• Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

  2024influential citation
• A Scalable Adaptive Sampling Approach for Surrogate Modeling of Rigid Pavements Using Machine Learning

  2024cites this paper
• A Model of Precise Delivery of Advertising based on Encrypted Transmission in Network

  2024cites this paper
• The sparse Kaczmarz method with surrogate hyperplane for the regularized basis pursuit problem

  2024influential citation
• Co-seismic landslides susceptibility evaluation of Bayesian random forest considering InSAR deformation: a case study of the Luding Ms6.8 earthquake

  2024cites this paper
• Utilising AI technique to identify depression risk among doctoral students

  2024cites this paper
• Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods

  2024influential citation
• An investigation of stochastic trust-region based algorithms for finite-sum minimization

  2024cites this paper
• A variable metric proximal stochastic gradient method: An application to classification problems

  2024cites this paper
• Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate

  2024cites this paper
• Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers

  2024cites this paper
• A stochastic gradient method with variance control and variable learning rate for Deep Learning

  2024cites this paper
• Review of Large-Scale Simulation Optimization

  2024cites this paper
• Stochastic ISTA/FISTA Adaptive Step Search Algorithms for Convex Composite Optimization

  2024cites this paper
• Estimating absorption and scattering in quantitative photoacoustic tomography with an adaptive Monte Carlo method for light transport

  2024cites this paper
• A Gradually Reinforced Sample-Average-Approximation Differentiable Homotopy Method for a System of Stochastic Equations

  2024cites this paper
• AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size

  2024influential citation
• A stochastic variance reduced gradient method with adaptive step for stochastic optimization

  2024cites this paper
• AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods

  2024influential citation
• How does extreme point sampling affect non-extreme simulation in geographical random forest?

  2024cites this paper
• Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent

  2024cites this paper
• Adaptive Sampling Stochastic Multigradient Algorithm for Stochastic Multiobjective Optimization

  2023cites this paper
• Data Sampling In Federated Learning: Principles, Features And Taxonomy

  2023cites this paper
• Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization with Optimal Noise Scheduling

  2023cites this paper
• Differentially Private Distributed Stochastic Optimization with Time-Varying Sample Sizes

  2023cites this paper
• A Randomized Algorithm for Nonconvex Minimization With Inexact Evaluations and Complexity Guarantees

  2023cites this paper
• Biased stochastic conjugate gradient algorithm with adaptive step size for nonconvex problems

  2023cites this paper
• Complexity Guarantees for Nonconvex Newton-MR Under Inexact Hessian Information

  2023cites this paper
• Dynamic Data Sample Selection and Scheduling in Edge Federated Learning

  2023cites this paper
• An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints

  2023cites this paper
• A Deep Neural Network Two-part Model and Feature Importance Test for Semi-continuous Data

  2023cites this paper
• Painless Stochastic Conjugate Gradient for Large-Scale Machine Learning

  2023cites this paper
• A sequential quadratic programming method for nonsmooth stochastic optimization with upper-C^2 objective

  2023cites this paper
• Thermal resistance prediction of aerogel fabrics after repeated washing based on small-sample data

  2023cites this paper
• AutoML with Bayesian Optimizations for Big Data Management

  2023cites this paper
• A novel fractional uplink power control framework for self-organizing networks

  2023cites this paper
• QGABS: GPU Tensor Core-accelerated Quantized Graph Neural Network based on Adaptive Batch Size

  2023cites this paper
• A new inexact gradient descent method with applications to nonsmooth convex optimization

  2023cites this paper
• An Overview of Stochastic Quasi-Newton Methods for Large-Scale Machine Learning

  2023cites this paper
• A new method for improving prediction performance in neural networks with insufficient data

  2023cites this paper
• Rail Defect Detection Using Ultrasonic A-Scan Data and Deep Autoencoder

  2023cites this paper
• Prediction of high strength ternary blended concrete containing different silica proportions using machine learning approaches

  2023cites this paper
• Image reconstruction in quantitative photoacoustic tomography using adaptive optical Monte Carlo

  2023cites this paper
• A trust region method for noisy unconstrained optimization

  2023influential citation
• Real-time detection and forecast of flashovers by the visual room fire features using deep convolutional neural networks

  2023cites this paper
• Learning rate selection in stochastic gradient methods based on line search strategies

  2023cites this paper
• Efficient Online Edge Learning for UAV Object Detection via Adaptive Batch Size Fitting

  2023cites this paper
• A deep neural network framework to derive interpretable decision rules for accurate traumatic brain injury identification of infants

  2023cites this paper
• Facilitating Early-Stage Backdoor Attacks in Federated Learning With Whole Population Distribution Inference

  2023cites this paper
• Improved Powered Stochastic Optimization Algorithms for Large-Scale Machine Learning

  2023cites this paper