Issues

• ScalingOpt | Welcome to join the Optimization Community!

  jettify/pytorch-optimizer#544 · Filter by author tianshijing opened on Dec 3, 2025

• Muon

  jettify/pytorch-optimizer#543 · Filter by author jason718 opened on Aug 22, 2025

• AttributeError: module 'torch_optimizer' has no attribute 'Lion'

  jettify/pytorch-optimizer#542 · Filter by author SamMohel opened on Dec 10, 2024
  1

• How to stop memory leak while using adahessian?

  jettify/pytorch-optimizer#540 · Filter by author Shubh-Goyal-07 opened on Aug 8, 2024
  1

• [Feature Request] Aida optimizer

  jettify/pytorch-optimizer#538 · Filter by author okbalefthanded opened on Feb 15, 2024

• AttributeError: module 'torch_optimizer' has no attribute 'MAGRAD'

  jettify/pytorch-optimizer#537 · Filter by author SamMohel opened on Dec 18, 2023
  1

• Configurable step size instead of hard-coded default values for adafactor

  jettify/pytorch-optimizer#535 · Filter by author lamthuy opened on Sep 23, 2023

• Implementation of Shampoo inconsistent with the paper

  jettify/pytorch-optimizer#502 · Filter by author siddharth9820 opened on May 29, 2023

• Include the Sophia Optimizer

  jettify/pytorch-optimizer#501 · Filter by author bratao opened on May 24, 2023

• adahessian bug: it does not support the 3D conv

  jettify/pytorch-optimizer#500 · Filter by author ziming-liu opened on May 17, 2023

• Include AdaNorm optimizer (WACV 2023)

  jettify/pytorch-optimizer#499 · Filter by author shivram1987 opened on Mar 18, 2023

• Include Lion Optimizer

  jettify/pytorch-optimizer#498 · Filter by author Haoxiang-Wang opened on Feb 19, 2023
  2

• Is library alive?

  jettify/pytorch-optimizer#496 · Filter by author dkajtoch opened on Jan 19, 2023
  2

• VeLO: Training Versatile Learned Optimizers by Scaling Up

  jettify/pytorch-optimizer#479 · Filter by author hoangmit opened on Nov 23, 2022
  2

• Adai Optimizer ICML2022 Oral: adaptive momentum hyperparameters instead of adaptive learning rate

  jettify/pytorch-optimizer#476 · Filter by author zeke-xie opened on Nov 5, 2022

• fix readme kappa

  jettify/pytorch-optimizer#468 · Filter by author pavelbatyr opened on Oct 7, 2022

• Adan optimiser: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

  jettify/pytorch-optimizer#459 · Filter by author iiSeymour opened on Aug 23, 2022
  1

• Complex numbers

  jettify/pytorch-optimizer#458 · Filter by author Ni-Chen opened on Aug 20, 2022

• spot bug in SGDW implementation (weight decay part)

  jettify/pytorch-optimizer#454 · Filter by author Leiay opened on Aug 8, 2022

• Which version of Shampoo is implemented?

  jettify/pytorch-optimizer#452 · Filter by author RylanSchaeffer opened on Aug 8, 2022
  2

• lamb optimizer mistake

  jettify/pytorch-optimizer#443 · Filter by author trofimovaolga opened on Jun 24, 2022

• the implementation of SGDW is not consistent with paper?

  jettify/pytorch-optimizer#433 · Filter by author twmht opened on Apr 20, 2022

• Adafactor fails to run on a custom (rfs) resnet12 (with MAML)

  jettify/pytorch-optimizer#405 · Filter by author brando90 opened on Dec 3, 2021
  3

• Example of how to use scheduler

  jettify/pytorch-optimizer#404 · Filter by author brando90 opened on Dec 3, 2021
  2

• AdamD implementation (or option to skip bias-correction to adam-derived optimizers)?

  jettify/pytorch-optimizer#385 · Filter by author jstjohn opened on Oct 25, 2021
  1