A tool turns a mobile phone and VR headset into a virtual camera for Blender

Raül Torres says he has used Claude to create a tool for controlling the camera in 3D scenes without relying only on the text of a prompt. The phone version consists of a web page using WebXR that reads the phone’s position and rotation, and a Python add-on for Blender that moves the scene’s camera in real time. When he presses REC and walks around the room, Blender records the keyframes; the phone screen shows what the camera sees.

Afterwards, according to his account, the recording is stopped, an MP4 is exported and that video serves as a camera reference for the Seedance 2.5 video generator. The official Seedance 2.5 page confirms that the model can take a reference video as a guide for camera movement.

A second version brings the same method to a Meta Quest 3 headset: using Quest Link and the VR Scene Inspection (OpenXR) add-on that comes with Blender, the person recording holds a virtual camera in the controller, the trigger starts and stops recording, and the joysticks allow tracking shots and pans. The author notes that he still has to fine-tune details, such as the speed of the left controller.

For the audiovisual or art classroom, the idea matters because it hands control of framing and movement back to students: they build the set, decide where the camera goes and AI is used afterwards to transform that material. The author gives his own series, “Never Sleep Again”, as an example of his way of working, which the paper reported on 1 November. The tools described are a personal development and, for now, the group has only his screenshots, test videos and explanation to go on.