Microsoft researchers say they’ve developed a hyper-efficient AI model that can run on CPUs
SMRTR summary
Microsoft researchers have developed BitNet b1.58 2B4T, the largest 1-bit AI model to date with 2 billion parameters. This compressed model can run on CPUs, outperforms similar-sized models on certain benchmarks, and operates faster while using less memory, though it currently requires a custom framework for optimal performance.
SMRTR provides this summary for quick context. The original article belongs to Daily.dev.
Read the original article