A functional framework for nonsmooth autodiff with maxpooling functions - Sorbonne Université
Pré-Publication, Document De Travail Année : 2024

A functional framework for nonsmooth autodiff with maxpooling functions

Bruno Després

Résumé

We make a comment on the recent work Boustany (2024), by showing that the Murat-Trombetti (2003) Theorem is a simple and efficient mathematical framework for nonsmooth automatic differentiation of maxpooling functions. In particular it gives a the chain rule formula which correctly defines the composition of Lipschitz-continuous functions which are piecewise C 1 . The formalism is applied to four basic examples, with some tests in PyTorch. A self contained proof of an important Stampacchia formula is in the appendix.
Fichier principal
Vignette du fichier
nonsmooth.pdf (299.56 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04846612 , version 1 (18-12-2024)

Identifiants

  • HAL Id : hal-04846612 , version 1

Citer

Bruno Després. A functional framework for nonsmooth autodiff with maxpooling functions. 2024. ⟨hal-04846612⟩
0 Consultations
0 Téléchargements

Partager

More