Google unveils TurboQuant AI-compression algorithm, which it claims can hugely reduce LLM memory usage

Google launched TurboQuant, an AI compression algorithm that reduces large language model memory usage by six times through a two-stage process combining PolarQuant coordinate transformation and single-bit quantization. The system maintains accuracy while enabling faster processing and lower operational costs, potentially making advanced AI models more accessible on resource-constrained devices.