PolyChase
Introductionโ
Polychase is a free, open-source add-on for Blender that performs mesh-based 3D motion tracking. It tracks the movement (pose, or rotation and translation) of a rigid 3D object (mesh) within video footage, or the camera itself, and can convert between the two. It is an open-source alternative to commercial tools like KeenTools GeoTracker.
The process relies on:
- 3D Mesh Input: a 3D model of the object being tracked.
- PnP Solving: the Perspective-n-Point problem, 3D points on the mesh matched to 2D locations in the video.
- Optical Flow: automatic correspondences from sparse optical flow data.
- User-Guided Correction: manual correction via "bin mode" (interactive 3D pinning).
- Refinement: factor graph optimization (bundle adjustment) to globally smooth the final motion trajectory.
The outcome is a 3D mesh that stays accurately "glued" to the moving object throughout the video sequence.
It serves investigators who need to track a rigid object (a vehicle, a structure) through footage and keep a 3D mesh aligned to it across the sequence.
Key Takeawaysโ
Mesh-based tracking
Tracks a rigid 3D object through video with Perspective-n-Point solving and optical flow.
User-guided correction
Bin mode lets you pin the mesh to the footage manually when tracking drifts.
Globally refined motion
Factor-graph refinement produces a smooth, consistent trajectory across the whole sequence.
Installationโ
- Download the addon from https://github.com/theartful/polychase.
- Install via Edit > Preferences > Add-ons.
Version 0.0.3; declared minimum Blender 4.2.
Usageโ
Scene Setup and Video Analysisยท setup
Import the 3D mesh of the rigid object, create a Polychase tracker, define the geometry/camera/video inputs, set the SQLite database location, and run video analysis to generate sparse optical flow.
Initial Mesh Alignment and Maskingยท align
Set the camera focal length if known, enter bin mode, and drag bins to align the mesh to the object in the footage. Press M to mask parts that should not influence the track (transparent areas, moving/deformable parts, inaccurate mesh).
Automatic Tracking and Inter-frame Correctionยท track
Run automatic tracking forward or backward. If the mesh drifts, stop, re-enter bin mode, correct the pose at that keyframe, and run refinement on the tracked segment. Repeat until the desired coverage is reached.
Final Global Refinementยท refine
Run comprehensive global refinement on the entire tracked section. Factor-graph optimization minimizes reprojection error across all frames for globally consistent motion.
Limitationsโ
- Requires a 3D model of the object being tracked. You cannot track from footage alone.
- Tracking quality depends on the mesh accuracy and the visible detail in the footage.
- Sparse optical flow can struggle with fast or low-texture motion; manual correction may be needed frequently.
Resourcesโ
- Camera Matching, the related camera technique
- Camera Tracking, for tracking the camera rather than the object
- KeenTools GeoTracker for Blender, the commercial reference Polychase is inspired by
Sourcesโ
- PolyChase, GitHub, source and download