FairScale Trend

An open-source library for large-scale model training, providing tools for distributed training and model parallelism.