Microsoft researchers say they’ve developed a hyper-efficient AI model that can run on CPUs

Microsoft researchers have developed BitNet b1.58 2B4T, the largest 1-bit AI model to date with 2 billion parameters. This compressed model can run on CPUs, outperforms similar-sized models on certain benchmarks, and operates faster while using less memory, though it currently requires a custom framework for optimal performance.