A minimalist LLM training framework that lets you train a 64M-parameter language model from scratch in about 2 hours. Includes complete data preprocessing, training, and inference pipelines for learning and experimentation.
A minimalist LLM training framework that lets you train a 64M-parameter language model from scratch in about 2 hours. Includes complete data preprocessing, training, and inference pipelines for learning and experimentation.