WAN2.1 camera -Lens Control-KJ

Alibaba’s team provides dedicated “Camera/Camera‑Motion Control” weights and methods in the Wan 2.1 Fun‑Control branch. The core idea is to inject camera motion as an explicit condition into the diffusion model, enabling controllable pan/zoom/tilt/roll movements.

Model and Capabilities

- Provides specialized camera‑control checkpoints (1.3B/14B), supporting video generation at 16 fps and multiple resolutions (512/768/1024), with configurable motion types and strengths (e.g., zoom_in, pan).

- Methodologically, it introduces point trajectories, trajectory unrolling, and motion‑intensity modeling to precisely control camera/object motion, which can be used as a camera path control signal.

Usage and Workflow

- Load the camera‑control weights in your workflow and supply a starting frame/reference image. Configure motion type and strength via camera‑embedding/camera‑motion parameter nodes to generate videos with explicit camera movements (pan/tilt/roll/zoom).