ColossalAI

Colossal-AI: A Unified Deep Learning System for Big Model Era. Colossal-AI provides a collection of parallel components for you. We aim to support you to write your distributed deep learning models just like how you write your model on your laptop. We provide user-friendly tools to kickstart distributed training and inference in a few lines.