Fully Sharded Data Parallel (FSDP)
AIFully Sharded Data Parallel (FSDP): A technique that splits a model's weights and optimiser state across devices to cut memory use, letting bigger models train.
Fully Sharded Data Parallel (FSDP): A technique that splits a model's weights and optimiser state across devices to cut memory use, letting bigger models train.