In Preparation/Preprints

  • Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives
    Konstantinos Oikonomidis, Jan Quan, Kimon Antonakopoulos, ASF, Volkan Cevher, Panagiotis Patrinos
    arXiv preprint [arXiv]
  • Adaptive Conditional Gradient Descent
    Abbas Khademi, ASF
    Submitted [arXiv] [HAL]


Published

  • On the Role of Batch Size in Stochastic Conditional Gradient Methods
    Rustem Islamov, Roman Machacek, Aurelien Lucchi, ASF, Eduard Gorbunov, Volkan Cevher
    International Conference on Machine Learning ICML [arXiv]
  • Training Neural Networks at Any Scale
    Thomas Pethick, Kimon Antonakopoulos, ASF, Leena Chennuru Vankadara, Volkan Cevher
    Signal Processing Magazine [arXiv]
  • Numerical Implementation of Variational Morphological Operators on Graphs
    Miguel Amorim, Jean-Christophe Pesquet, Tristan Portugues, ASF, Hugues Talbot
    Discrete Geometry and Mathematical Morphology DGMM [HAL]
  • Generalized Gradient Norm Clipping & Non-Euclidean (L0,L1)-Smoothness
    Thomas Pethick, Wanyun Xie, Mete Erdogan, Kimon Antonakopoulos, ASF, Volkan Cevher
    Neural Information Processing Systems NeurIPS (Oral) [arXiv]
  • Training Deep Learning Models with Norm-Constrained LMOs
    Thomas Pethick, Wanyun Xie, Kimon Antonakopoulos, Zhenyu Zhu, ASF, Volkan Cevher
    International Conference on Machine Learning ICML (Spotlight) [arXiv]
  • Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems
    Jérôme Bolte, Edouard Pauwels, ASF
    SIAM Optimization [Publisher] [arXiv]
  • A Stochastic Bregman Primal-Dual Splitting Algorithm for Composite Optimization
    ASF, Cesare Molinari, Jalal Fadili
    Pure and Applied Functional Analysis 2023, Special Edition in honor of Lev Bregman [Publisher] [arXiv]
  • Nonsmooth Implicit Differentiation for Machine Learning and Optimization
    Jérôme Bolte, Tâm Lê, Edouard Pauwels, ASF
    Neural Information Processing Systems NeurIPS [Publisher] [arXiv]
  • Inexact and Stochastic Generalized Conditional Gradient with Augmented Lagrangian and Proximal Step
    ASF, Cesare Molinari, Jalal Fadili
    Journal of Nonsmooth Analysis and Optimization [Publisher] [arXiv]
  • Generalized Conditional Gradient with Augmented Lagrangian for Composite Minimization
    ASF, Cesare Molinari, Jalal Fadili
    SIAM Optimization [Publisher] [arXiv]
  • Comparison of Bayesian Credible Intervals to Frequentist Confidence Intervals
    Kathy Gray, Brittany Hampton, ASF, Allison McConnel, Casey Bausell
    Journal of Modern Applied Statistical Methods [Publisher (pdf)]


PhD Thesis

  • First-Order Noneuclidean Splitting Methods for Large-Scale Optimization: Deterministic and Stochastic Algorithms
    ASF
    University of Caen, Normandie [HAL]