[spcl_bcast] A Paradigm Shift To Second Order Methods For Machine Learning

2021 43:05
Synopsis
Speakers: Amir Gholami, Zhewei Yao Venue: SPCL_Bcast, recorded on 24 September, 2020 Abstract: The amount of compute ...

You Might Also Like

Numerics of ML 12 -- Second-Order Optimization for Deep Learning -- Lukas Tatzel 1:23:50
Numerics Of Ml 12 -- Second-order Optimization For Deep Lear...
2024
Stochastic Second Order Optimization Methods I 1:06:41
Stochastic Second Order Optimization Methods I
2019
Peter Richtarik - On Second Order Methods and Randomness 1:12:22
Peter Richtarik - On Second Order Methods And Randomness
2021
Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations 11:58
Second-order Information In Non-convex Stochastic Optimizat...
2021
Optimization for Deep Learning (Momentum, RMSprop, AdaGrad, Adam) 15:52
Optimization For Deep Learning (momentum, Rmsprop, Adagrad, ...
2024
Zhewei Yao -- RandNLA and its Applications in Second-order Optimization and Deep Learning 37:47
Zhewei Yao -- Randnla And Its Applications In Second-order O...
2020
Who's Adam and What's He Optimizing? | Deep Dive into Optimizers for Machine Learning! 23:20
Who's Adam And What's He Optimizing? | Deep Dive Into Optimi...
2025
SGD-OGR 2nd order optimizers with Online Gradient Regression for Hessian estimation 57:46
Sgd-ogr 2nd Order Optimizers With Online Gradient Regression...
2023
Direct Preference Optimization (DPO) - How to fine-tune LLMs directly without reinforcement learning 21:15
Direct Preference Optimization (dpo) - How To Fine-tune Llms...
2025
CS 201 | MICHAEL MAHONEY | UC BERKELELY | OCT 6 2020 1:11:11
Cs 201 | Michael Mahoney | Uc Berkelely | Oct 6 2020
2021
Sparse maximal update parameterization: A holistic approach to sparse training dynamics 4:46
Sparse Maximal Update Parameterization: A Holistic Approach ...
2026
Download Options
Choose a download method below. All links open in new tabs.
Service Features Action
Ssvid
MP4 & MP3 • HD Quality • Browser Extension Available
Download
SaveFrom
MP4 & MP3 • HD Quality • Browser Extension Available
Download
Security Notice: These are third-party services. We recommend using antivirus software and being cautious of pop-up ads.