Explore index
ZeRO
A distributed training technique that reduces memory footprint by sharding optimizer states, gradients, and parameters.
No public content is connected to this entity yet.
Explore index
A distributed training technique that reduces memory footprint by sharding optimizer states, gradients, and parameters.
No public content is connected to this entity yet.