@udayaghai Profile picture

Udaya Ghai

@udayaghai

Applied Scientist @Amazon, PhD in Machine Learning @PrincetonCS

Joined May 2022
Similar User
Satyen Kale photo

@SatyenKale

Xinyi Chen photo

@XinyiChen2

Nikunj Saunshi photo

@NSaunshi

Jason‎ Hartline‎ photo

@jasondhartline

Yishay Mansour photo

@YishayMansour

Thejakeyboy photo

@Thejakeyboy

Danilo Joksimovic photo

@djoksimo

naman agarwal photo

@naman33k

Lee Cohen photo

@_Lee_Cohen_

Zak Mhammedi photo

@mhammediz

Udari Madhushani Sehwag photo

@UdariMadhu

Alon Cohen photo

@AlonCoh77726439

Vlad Feinberg photo

@FeinbergVlad

Kristjan Greenewald photo

@KGreenewald

Tal Daniel photo

@TalDaniel8

Udaya Ghai Reposted

(1/n) 💡How can we speed up the serial runtime of long pre-training runs? Enter Critical Batch Size (CBS): the tipping point where the gains of data parallelism balance with diminishing efficiency. Doubling batch size halves the optimization steps—until we hit CBS, beyond which…

Tweet Image 1

Loading...

Something went wrong.


Something went wrong.