New Apple study shows LLMs can tell what you’re doing from audio and motion data

Apple researchers demonstrated that large language models can accurately identify user activities like cooking, exercising, or cleaning by analyzing text descriptions generated from audio and motion sensor data, achieving impressive results even without specific training for these tasks. This breakthrough could enable more precise activity recognition in Apple devices when traditional sensor data alone provides insufficient information.