tiny-diffusion: A character-level language diffusion model trained on Tiny Shakespeare

Researchers created tiny-diffusion, a compact 10.7 million parameter language model that generates text using diffusion techniques rather than traditional methods. Trained on Shakespeare's works in just 30 minutes, the model demonstrates how diffusion processes can create coherent text generation in a lightweight, locally-runnable format.