INTELLECT–1: Launching the First Decentralized Training of a 10B Parameter Model
Prime Intellect is launching INTELLECT-1, a decentralized training of a 10-billion-parameter AI model. This open-source project invites contributors to provide computing power for transparent AI. Using the Prime framework, it enables fault-tolerant training across distributed data centers. Features include elastic device management and optimized communication. Based on the Llama-3 architecture, the model will train...