1 day ago

Bittensor’s Subnet 3 Trains 72B AI Model on Decentralized Network

TLDR: Covenant-72B scored 67.1 on MMLU zero-shot, beating LLaMA-2-70B’s 65.6 under identical test conditions. SparseLoCo reduced communication overhead by 146x using sparsification, 2-bit quantization, and error feedback across nodes. Gauntlet scored every node’s contribution via loss evaluation and OpenSkill ranking, all recorded on the blockchain. $TAO rose 14% to $236 post-announcement, with Grayscale expanding its [...]

The post Bittensor’s Subnet 3 Trains 72B AI Model on Decentralized Network appeared first on Blockonomi.

Source: Blockonomi →