INTELLECT–1: Launching the First Decentralized Training of a 10B Parameter Model

Prime Intellect is launching INTELLECT-1, a decentralized training of a 10-billion-parameter AI model. This open-source project invites contributors to provide computing power for transparent AI. Using the Prime framework, it enables fault-tolerant training across distributed data centers. Features include elastic device management and optimized communication. Based on the Llama-3 architecture, the model will train on high-quality datasets. This project advances decentralized AI development, with plans to scale to larger models.