Teaching AI models the broad strokes to sketch more like humans do

MIT and Stanford researchers have developed SketchAgent, an AI system that can create sketches from text prompts in a more human-like, stroke-by-stroke manner. Using multimodal language models, SketchAgent can draw abstract concepts without training on specific datasets. The system can work collaboratively with humans, adding essential strokes to complete drawings. While it currently produces simple doodles and stick figures, SketchAgent shows promise for enhancing human-AI interaction in visual communication and could potentially aid in teaching or diagramming complex ideas.