PROFESSIONAL 3D TRACKING


Helping VFX artists since 2003, SynthEyes™ is a standalone application optimized for camera, object, geometry, planar tracking, and much more. Discover real tracking power and performance with complete control over tracking and solving, blazing-fast performance, a huge feature list, and exports to many applications — all at an affordable price!

  • Incredibly fast tracking and solving saves time, even on shots with thousands of frames.
  • Professional tracking means complete control over tracking and solving
  • Full lens distortion analysis, including radial-4th and anamorphic-6th with corresponding distortion nodes in major compositing applications
  • Exports to an extensive list of industry-leading 3D and compositing applications

WHAT'S NEW

SynthEyes 2024.1

Introducing the new "SynthEyes Advanced Lens Distortion" plugin for After Effects. Watch overview video.

  • Directly supports all SynthEyes lens models, animated distortion, and off-center lenses.
  • Export 3D meshes and textures directly to After Effects with the AE version selector set to "Beta after 2024.1."
  • Updated plugins for compatibility with Apple M1/M2/M3 processors and Multi-Frame Rendering on Windows and macOS.
  • Automatically reduces the number of exported tracker layers based on a user-defined limit.
  • Supports solver-side distortion, though not identical to Fusion and Nuke's zero-pass workflow due to AE limitations.
  • Properly supports shots with non-square pixels without precomps.

FEATURES

PRODUCTION GRADE TRACKING AND SOLVING


SynthEyes features an extensive supervised tracking feature set with high-performance automatic tracking, 3D planar tracking, AprilTags, cleanup, and add-tracker tools.

  • SynthEyes offers advanced tracking capabilities, including automatic tracking, 3D planar tracking, AprilTags, and tools to clean up and add trackers
  • Track both cameras and moving objects in your footage
  • Use a Geometric Hierarchy tracking system to track objects with complex relationships
  • Precise 3D and 2D Planar Tracking with mask options
  • Benefit from neural-based tracking methods and handle multiple supervised trackers simultaneously
  • Tools for identifying and managing problematic trackers
  • Support for tracking in stereoscopic 3D
  • Calibrate various lens types for accurate tracking
  • Ideal for 360° VR shots and motion capture
  • Quickly solve complex, long shots
  • Support for different lens models, including radial-4th and anamorphic-6th
  • Control camera and object paths for precise solves
  • Achieve stable results with tripod-mounted cameras
  • Animated lens distortion parameters to track realistically
  • Flexible solver settings to meet your specific needs
  • Post-solve tools to clean up and fine-tune your tracking results
  • Solve and stabilize 360° VR footage with ease
  • Match to 3D set models such as lidar scans

SCENE EXPORTS


SynthEyes can export the tracked scene to a large number of other packages and formats, supporting formats such as USD, FBX, OBJ, and Alembic.

  • Export native project data to 3D packages including Maya, 3ds Max, Blender, Lightwave, and Cinema 4D
  • Create project scenes in compositing applications, including After Effects, Nuke, Fusion/Resolve, Flame, and Houdini
  • Animated stabilization and distortion maps can be exported using distortion maps (on packages supporting them)
  • More advanced pipelines: Take advantage of flexible ASCII text exporters for tracker 2D paths and 3D positions, camera/object paths, and animated illumination

COORDINATE SYSTEM SETUP


SynthEyes offers powerful tools to position, align, and size the entire scene in a 3D environment, so you can ensure the world scale and coordinates of your scene match the rest of your workflow.

  • Auto-placement tool analyzes scene structure to create a good initial scene coordinate system
  • Quick precision setup wizard — click 3 trackers, then realign
  • Easy manual complete-scene re-positioning and scaling
  • Line-based alignment system for nodal-tripod and lock-off shots, or use the mesh pinning tool in its camera setting
  • Flexible coordinate system alignment controls for complex situations
  • Constrained Points (Axis Control) view to quickly examine coordinate system settings of all trackers at once with a right-click menu for modifications
  • Coordinate placement methods based on camera positioning
  • Select the desired solution using coordinate polarity controls when several solutions are possible
  • Exact constraints for survey data, including infrequent GPS waypoints
  • Distance constraints to utilize on-set sizing measurements
  • Coordinate system setup before or after solving

Lens Calibration

SynthEyes has extensive tools not only for calculating distortion during solving, but also for lens calibration from lens grids. Rectify Lens Grid for "just fix it" unmodeled lens distortion correction, especially for complex lens types. Tilt detection and correction if grid spacing and camera-to-grid measurements are available. Lens Master Calibration system handles linear, inverse linear, anamorphic lenses, and four fisheye lens variants.

  • Rectify Lens Grid for distortion correction
  • Calibration for various lens types
  • Calibration methods including random-dot calibration
  • Lens distortion presets for different workflows

Geometric Hierarchy Tracking

Spectacularly powerful and flexible toolset for 3D tracking multi-level constrained hierarchies of moving parts, directly tracking supplied meshes, or using normal (supervised) trackers.

  • Toolset for tracking moving parts in 3D
  • Tracking of kinematic chains and secondary animation
  • Integration with motion capture for BVH export

Stabilization

SynthEyes features integrated stabilization for normal and 360VR shots driven by 3D solves, including creating a "physical" rig for export.

  • Stabilization capabilities are built into the image preprocessor including normal (with lens distortion) and 360VR shots
  • Stabilization driven by full 3D solves, or approximate 2D tracking data
  • Manual adjustments as needed
  • Automatic "zoom" determination for normal shots (multiple modes)
  • Stabilization rig creator for non-360VR shots creates a "physical" equivalent for the stabilization, so downstream 3D packages can perform the actual stabilization
  • Export of 360VR stabilization data directly to supported packages including After Effects, Fusion, and Hitfilm
  • Setup of 360VR stabilization as an animated textured sphere for alternative export
  • Integrated resampling to other output resolutions and aspects

Object Separation

SynthEyes has user-friendly tools to separate elements and exclude them from tracking.

  • Automatically select trackers only within a green screen region
  • Set up regions for each moving object or garbage mattes for actors, for example
  • Keyframe-animated splines to define regions
  • Quick square and circle spline setup
  • Import spline control points from tracker paths for rapid setup
  • Animated enables for splines
  • Use a rotoscoped alpha-channel

ViewShift System

Use ViewShift for complex object removals, combining split takes, generating animated texture maps, and more!

  • Camera mapping and rendering system
  • Uses matchmoved 3D camera paths and set models
  • Removes objects against various reflector meshes (not just planes)
  • Quick setup tools for working from a clean plate
  • Illumination compensation for better matching
  • Multiple timing modes
  • Control via animated splines or mesh outlines
  • Various output modes for previews and compositing
  • Matte generation with softening
  • Animated texture maps from meshes
  • Multiple independent ViewShift outputs

Meshes In/Out

SynthEyes can read and write a variety of mesh and vertex cache formats, supporting most commonly used 3D / compositing applications used in the industry.

  • Import and export industry standard 3D mesh formats: OBJ, C4D, COLLADA (DAE), DXF, PTS, LWO and XYZ Lidar, SynthEyes SBM, 3DS (import only)
  • Custom Mesh options for quick insertion into SynthEyes scenes on par with basic cubes, spheres, etc.
  • Vertex caches in/out: Alembic .abc, Maya .mcx, Lightwave .mdd, 3dsmax .pc2

Scripting

Feel the awesome next-generation power and flexibility of typed or spoken natural language control with the Synthia instructible assistant. Automate frequent tasks using Synthia, Sizzle, or Python scripting.

  • Use native Sizzle scripting language or Python API/SDK
  • The Synthia natural language intelligent assistant turns plain language into powerful script commands
  • Use scripts to modify and extend SynthEyes functionality, including access to scene and image preprocessing

TECH/SPECS

Product:

Release Number:

Syntheyes

2024

Requirements:

MacOS Catalina (10.15) or later.

  • *** IMPORTANT *** Cheese-grater Mac Pros from 2012 and earlier won't work! SynthEyes requires the AVX instruction set. (SynthEyes may notify you about this at startup.) Look for AVX in the output of the terminal command “sysctl machdep.cpu.features”. If SynthEyes crashes at startup and you have an older processor, that is the problem. SynthEyes uses AVX for performance not possible with old CPUs. SynthEyes 1905 can be run on older CPUs.
  • MacOS Sonoma (14), Ventura (13), Monterey (12), Big Sur (11), Catalina (10.15). Big Sur or later required for Blackmagic RAW.
  • Universal build for Apple Silicon (M1/M2/etc) or Intel Mac with AVX support (“Sandy Bridge” or later), see above
    • Windows 10 or later.

      • *** IMPORTANT *** SynthEyes requires the AVX instruction set. (SynthEyes may notify you about this at startup.) Check Microsoft's cpuinfo64 tool for a plethora of information. SynthEyes uses AVX for performance not possible with old CPUs. SynthEyes 1905 can be run on older CPUs.
      • 64-bit Intel version of Windows 10 or 11. Windows 10 version 1903 or later is required for full globalization support. HEVC/h.265 support uses an optional Windows 10 download.
      • Intel or AMD “x64” processor with AVX (“Sandy Bridge” or later or comparable AMD, no Atom-based processors.) See above.

      Linux: CentOS 7+ or compatible Linux distribution on x86_64.

Hardware:

Recommended Hardware:

Intel or AMD “x64” processor with AVX (“Sandy Bridge” or later or comparable AMD, no Atom-based processors.)

Memory: 2 GB RAM minimum. 4+ GB is strongly recommended. 8-32 GB or more typical for pro, 360VR, and film users

Graphics Card: 1280x768 or larger display with OpenGL support. High-DPI displays supported (100% or 200% scaling), Windows 10 required for full functionality. Large multi-head configurations require graphics cards with sufficient memory. RED GPU decode assist requires 2+ GB video RAM.

Network: Must have an enabled network adapter (wifi or ethernet)

Warning: the “Nahimic” audio system (NahimicOSD.dll) has a parasitic video overlay that is problematic to a number of apps including SynthEyes, and may cause a hang or crash when entering the graph editor or perspective view. If so, disable or uninstall it. Quick directions that might work: Click the Windows icon, type “services”, right-click the Services app, click Run as Administrator. Scroll down to Nahimic, right-click and select Properties. Change the Startup type to Disabled.

Minimal Requirements:

Processor: At least 1-GHz Pentium IV

Memory: 2 GB

Disk: At least 1 GB

Graphics Card: Must support OpenGL

Monitor: Minimum resolution 1200×800 pixels

Licensing options:

Perpetual, or Annual / Monthly Subscription options

Node-locked, cross platform license.

Upgrade + Support Renewal available.

For enterprise floating licenses, contact us.

VERSIONS

  • SynthEyes 2024 - 18 October 2023. New RLM-based licensing. New full-featured Maya ASCII and 3D Equalizer exporters are now included, along with other new features, updates, and bug fixes.
  • SynthEyes 2304 - Released 14 April 2023. New lens models for radial and anamorphic shots, animated parameter solving, and more.
  • SynthEyes 2210 - Released 20 October 2022. Kurves color correction, rotomask improvements, prepset manager and many more.
  • SynthEyes 2206 - Released 6 June 2022. Bug fixes and improvements, notably in Rectify Grid.
  • SynthEyes 2204 - Released 22 April 2022. Many new features, including new license manager and license types.
  • SynthEyes 2107 - Released 6 July 2021. Bug fixes and small improvements to 2106.
  • SynthEyes 2106 - Released 11 June 2021. Internationalization, AprilTags, Coalesce Closest in 3D, solving improvements, and more.
  • SynthEyes 2102 - Updated build 1050 released 11 February 2021, replacing build 1049. Apple Silicon, new look, more performance.
  • SynthEyes 2007 - Released 14 July 2020. New ARRIRAW and Blackmagic BRAW readers, installation improvements, Bug fixes.
  • SynthEyes 2004 - Released 24 April 2020. New neural automatic and supervised tracking approaches, new lighting-invariant tracking.
  • SynthEyes 1905 - Released 10 May 2019. Blender export updated for 2.80 etc, easy setup of ViewShift from a single clean plate, further GeoH rigging work, new preferences exporter, etc.
  • SynthEyes 1903 - Released 25 March 2019. New ViewShift system for removals, split takes, etc; GeoH rigging improvements; stabilization rig creator scripts rolled in; much more.
  • SynthEyes 1806 - Released 27 June 2018. Massive solver advancements, featuring individual channel locking for moving objects, new lens solving capabilities, and gigantic "order-of-magnitude" performance improvements for large scenes.
  • SynthEyes 1708 - Released 25 August 2017. A ton of updates, especially for movie importing, solving, and exporting.

VIDEOS

FAQ

The manuals can be found on SynthEyes's Help menu.

On macOS, do not use the Help menu's search box, it is a macOS feature that searches only the macOS help.

This section covers general questions about match-moving: what it is, what you can do with it, overall workflow…

What is Camera Tracking?

"Camera tracking" or "Matchmoving" or "3D Tracking" is the process of analyzing a video clip or film shot to determine where—in 3D—the camera went, what its field of view was, and where parts of the set were. The 3D path of a rigid moving object can be determined as well.

Overall Workflow

Shoot. In SynthEyes, track using the automated system or supervised trackers, solve for the camera and environment information, export to your existing 3D animation or compositing software (Maya, Lightwave, 3ds max, Modo, After Effects...). Using your 3D software, create effects matching the original shot. Render. Composite. Edit.

Why Automated and Supervised Tracking?

If SynthEyes can track and solve automatically, why does it have supervised capabilities ? It's like cruise control on a car: automatic for the boring stuff, manual for heavy traffic. SynthEyes lets you mix and match, even in the same shot.

Can I Match One Still Image?

Yes, if there are a number of parallel lines present (See "Tripod and Lock-off Shot Alignment" in the manual). Or, if you know the exact 3D coordinates of a half-dozen or more visible features.

Can I Use Known Coordinates?

If you have survey data from a set or construction site, you can use those known coordinates to match the entire match-moved scene to that data.

FAQs covering installing and licensing SynthEyes—getting it going to start with.

Installer Fails

If an installer refuses to run, or the OS claims it is corrupted, please download again after turning off any and all "download managers." Try a different browser if necessary.

Turn off auto-save—some network's protocols apparently do not perform the renaming of the previous file properly, ie from foo.sni to foo.sni.bac Turn off auto-save in the Save/Export section of the preferences.

macOS: If the text in the SynthEyes user-interface buttons is missing or garbled, you have removed or altered macOS's system Lucida Grande font, and need to restore it. You must not override the system Lucida Grande font by placing a different one in /Library/Fonts, /Network/Library/Fonts, or ~/Library/Fonts.

Crashes During Startup

*** IMPORTANT *** SynthEyes requires support for the AVX instruction set. If you've never run SynthEyes before on a machine, you have an older machine, and SynthEyes crashes at startup, your machine probably doesn't support AVX. (On Linux, it may mean that you need to install additional subcomponents, see the Linux support area.)

If you've run SynthEyes before successfully, and now it crashes in startup, either SynthEyes crashed previously or your entire machine wasn't shut down properly. You can manually reset the preferences to fix that.

Crash or Hang?

Is it a crash or a hang? SynthEyes might seem frozen, but it could be processing a task that takes time, especially after starting certain operations. Be patient, like when opening a long movie file, which needs indexing for all image frames.

For Windows, use Task Manager to create a dump file for diagnostics (see instructions below). On macOS, select the process, Inspect it, and then Sample.

Windows Note: A problematic audio system called "Nahimic" with a video overlay may cause hangs, especially when entering the graph editor or perspective view. It's found on machines from major manufacturers, including Dell. If you encounter this issue, disable or uninstall Nahimic.

How to Report a Crash or Hang

If you encounter a crash or hang in SynthEyes, follow these steps to help us diagnose the issue:

  1. Capture a full-screen screenshot immediately.
  2. Document your actions for the 30 seconds leading up to the crash, including keystrokes and mouse clicks.
  3. If an "Imminent Crash" dialog appears, take a full-screen screenshot before clicking "Continue" to understand the specific problem detected.
  4. Emphasize using full-screen screenshots to provide a complete view of the interface.
  5. If you encounter an error during a solve, send the SynthEyes scene (sni) file.
  6. For significant issues, like "file reading doesn't work" or "planar tracking doesn't work," provide a detailed description of your operating system and processor.
  7. On MacOS, gather information from the macOS crash reporter. If it doesn't appear, here's what to do:
    • Open the Console app from Applications > Utilities in Finder.
    • Select Crash Reports.
    • Locate the most recent crash report for SynthEyes in the list.
    • Right-click the desired log's file name.
    • Either copy the contents and paste them directly into an email or send the crash report as an attachment.
  8. In Windows, users can retrieve core dump files as follows:
    • Start SynthEyes.
    • Click the File/User Data Folder item.
    • Navigate up two levels to the AppData folder, then down into the Local, SynthEyes, and CrashDumps folders.
    • Right-click the last dump file and select Send to/Compressed (zipped) folder. Email the file or post larger files.
  9. On Linux, users should consult their system's settings to determine the core dump file location. Every Linux system may have its own complex scheme, for example, RedHat/CentOS may use the Automatic Bug Reporting Tool (ABRT).

Recovering your SynthEyes scene (SNI) file

In many SynthEyes-detected crashes, SynthEyes will save your current SNI scene file. When you restart SynthEyes, click File/User Data File. The saved file is crash.sni there; you can check its date. Don't use it to replace any earlier versions of the SNI file you may have made; use it as a next version. If you've been using SynthEyes's auto-versioning features, you should also have a sequence of earlier versions.

If you got an error about running out of memory, check that you have plenty of free disk space on your main system drive. Your operating system likes to think ahead, and make sure it has somewhere to keep SynthEyes if it needs to move the running application to disk temporarily. (Technical explanation: it wants backing store for the virtual memory, even if the physical memory exists.)

Click here for resources if your scene looks good in SynthEyes, but you have trouble exporting to a downstream application, or the match move isn't the same in that application.

  • Be sure to check the Top, Front, and Side views in SynthEyes to make sure the scene is as expected, not just the camera view.
  • Check the support area for updated scripts.
  • See the tutorial on diagnosing export issues.
  • Be on the lookout for single-frame shifts between the camera animation and imagery if you see slight sliding or jittering in the downstream application.
  • Make sure that the export file name and entire path name do not contain any accented or special characters. Valid characters are A-Z, a-z, 0-9, underscore, dash, and space (better without spaces, never first or last character).
  • Downstream applications may need to be set for English language input.
  • The Maya script has a first-frame setting that may need adjusting depending on your setup, if you notice small velocity-dependent shifts.
  • If you have trouble with the Electric Image camera export, you probably need to switch to an Implicit camera type.
  • Use notepad/textedit to open the Sizzle script for your export type. Check for configuration values, limitations, requirements, comments etc. at the top of the script.
  • If you need to report a problem, send the SNI file, the exported output, and a screen capture of the importing application: either any error messages, or the appearance of the imported scene.