AI learns CAD just by watching designers work and starts building 3D models itself
SMRTR summary
After watching humans click, drag, and navigate through 41,000 CAD software videos, an AI system at MIT has learned to design 3D objects just like a human engineer would. The researchers created what they call VideoCAD, a dataset that captures every mouse movement and menu selection as designers build everything from simple parts to complex house layouts. "For example, let's say we drew a sketch by drawing a line from point 1 to point 2. We translated those high-level actions to user-interface actions, meaning we say, go from this pixel location, click, and then move to a second pixel location, and click, while having the 'line' operation selected," explains graduate student Ghadi Nehme. The AI can now take a 2D sketch and independently operate CAD software to create 3D models, potentially serving as a "CAD co-pilot" that could make design work more accessible to beginners and speed up repetitive tasks for experienced engineers.
SMRTR provides this summary for quick context. The original article belongs to Interesting Engineering.
Read the original article