Search Results - "Noci, Lorenzo"

Don't be lazy: CompleteP enables compute-efficient deep transformers

Dey, Nolan, Zhang, Bin Claire, Noci, Lorenzo, Li, Mufan, Bordelon, Blake, Bergsma, Shane, Pehlevan, Cengiz, Hanin, Boris, Hestness, Joel

Understanding and Minimising Outlier Features in Neural Network Training

He, Bobby, Noci, Lorenzo, Paliotta, Daniele, Schlag, Imanol, Hofmann, Thomas

Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning

Kim, Sanghwan, Noci, Lorenzo, Orvieto, Antonio, Hofmann, Thomas

2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Super Consistency of Neural Network Landscapes and Learning Rate Transfer

Noci, Lorenzo, Meterez, Alexandru, Hofmann, Thomas, Orvieto, Antonio

How Good is a Single Basin?

Lion, Kai, Noci, Lorenzo, Hofmann, Thomas, Bachmann, Gregor

Disentangling Linear Mode-Connectivity

Altintas, Gul Sena, Bachmann, Gregor, Noci, Lorenzo, Hofmann, Thomas

Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit

Bordelon, Blake, Noci, Lorenzo, Li, Mufan Bill, Hanin, Boris, Pehlevan, Cengiz

The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit

Noci, Lorenzo, Li, Chuning, Li, Mufan Bill, He, Bobby, Hofmann, Thomas, Maddison, Chris, Roy, Daniel M.

Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers

Anagnostidis, Sotiris, Pavllo, Dario, Biggio, Luca, Noci, Lorenzo, Lucchi, Aurelien, Hofmann, Thomas

The Curious Case of Benign Memorization

Anagnostidis, Sotiris, Bachmann, Gregor, Noci, Lorenzo, Hofmann, Thomas

Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse

Noci, Lorenzo, Anagnostidis, Sotiris, Biggio, Luca, Orvieto, Antonio, Singh, Sidak Pal, Lucchi, Aurelien

How Tempering Fixes Data Augmentation in Bayesian Neural Networks

Bachmann, Gregor, Noci, Lorenzo, Hofmann, Thomas

Precise characterization of the prior predictive distribution of deep ReLU networks

Noci, Lorenzo, Bachmann, Gregor, Roth, Kevin, Nowozin, Sebastian, Hofmann, Thomas

Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect

Noci, Lorenzo, Roth, Kevin, Bachmann, Gregor, Nowozin, Sebastian, Hofmann, Thomas

Adversarial Learning for Debiasing Knowledge Graph Embeddings

Arduini, Mario, Noci, Lorenzo, Pirovano, Federico, Zhang, Ce, Shrestha, Yash Raj, Paudel, Bibek