Skip to main content

PolyChase

ADDON
๐Ÿ“–3 min read

Latest Version: 0.0.12
Polychase: An Open-Source Motion Tracking Add-on for Blender by Ahmed Essam

Introductionโ€‹

Polychase is a free, open-source add-on for Blender that performs mesh-based 3D motion tracking. It tracks the movement (pose, or rotation and translation) of a rigid 3D object (mesh) within video footage, or the camera itself, and can convert between the two. It is an open-source alternative to commercial tools like KeenTools GeoTracker.

The process relies on:

  1. 3D Mesh Input: a 3D model of the object being tracked.
  2. PnP Solving: the Perspective-n-Point problem, 3D points on the mesh matched to 2D locations in the video.
  3. Optical Flow: automatic correspondences from sparse optical flow data.
  4. User-Guided Correction: manual correction via "bin mode" (interactive 3D pinning).
  5. Refinement: factor graph optimization (bundle adjustment) to globally smooth the final motion trajectory.

The outcome is a 3D mesh that stays accurately "glued" to the moving object throughout the video sequence.

It serves investigators who need to track a rigid object (a vehicle, a structure) through footage and keep a 3D mesh aligned to it across the sequence.


Key Takeawaysโ€‹

Mesh-based tracking

Tracks a rigid 3D object through video with Perspective-n-Point solving and optical flow.

User-guided correction

Bin mode lets you pin the mesh to the footage manually when tracking drifts.

Globally refined motion

Factor-graph refinement produces a smooth, consistent trajectory across the whole sequence.


Installationโ€‹

  1. Download the addon from https://github.com/theartful/polychase.
  2. Install via Edit > Preferences > Add-ons.

Version 0.0.3; declared minimum Blender 4.2.


Usageโ€‹

Scene Setup and Video Analysisยท setup

Import the 3D mesh of the rigid object, create a Polychase tracker, define the geometry/camera/video inputs, set the SQLite database location, and run video analysis to generate sparse optical flow.

Initial Mesh Alignment and Maskingยท align

Set the camera focal length if known, enter bin mode, and drag bins to align the mesh to the object in the footage. Press M to mask parts that should not influence the track (transparent areas, moving/deformable parts, inaccurate mesh).

Automatic Tracking and Inter-frame Correctionยท track

Run automatic tracking forward or backward. If the mesh drifts, stop, re-enter bin mode, correct the pose at that keyframe, and run refinement on the tracked segment. Repeat until the desired coverage is reached.

Final Global Refinementยท refine

Run comprehensive global refinement on the entire tracked section. Factor-graph optimization minimizes reprojection error across all frames for globally consistent motion.


Limitationsโ€‹

  • Requires a 3D model of the object being tracked. You cannot track from footage alone.
  • Tracking quality depends on the mesh accuracy and the visible detail in the footage.
  • Sparse optical flow can struggle with fast or low-texture motion; manual correction may be needed frequently.

Resourcesโ€‹

Sourcesโ€‹

  1. PolyChase, GitHub, source and download