We value your privacy
This site uses cookies to improve your browsing experience, analyze site traffic, and show personalized content.
This open-source project aims to train a miniature language model MiniMind from scratch, with a size of just 26MB, MiniMind AI is extremely lightweight, approximately 1/7000 the size of GPT-3, designed to enable fast inference and even training on CPUs. This project is not only an open-source initiative but also a beginner's tutorial for LLMs, and serves as a nascent open-source model with the hope of inspiring further development.