World's smallest AI supercomputer achieves world record with 120B-parameter LLM support on-device
SMRTR summary
American startup Tiiny has released the AI Pocket Lab, a pocket-sized supercomputer that runs large language models with up to 120 billion parameters locally without requiring cloud access or discrete GPUs. The device operates within 65W of power using a 12-core ARM CPU and custom AI module, earning a Guinness World Record for local 100B-class model execution while promising enhanced privacy and reduced costs.
SMRTR provides this summary for quick context. The original article belongs to TechRadar.
Read the original article