DIGITAL CAMERA TRACKING JIEYI ZHANG, TIANLANG YANG, YIRAN YE
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
2
T H E P H YG I TA L L A B O R A TO RY
2022
I D E A S E N T E RTA I N M E N T ST U D I O
3
D I G I TA L C A M E R A T R A C K I N G
WINTER
4
T H E P H YG I TA L L A B O R A TO RY
0#
DIGITAL CAMERA TRACKING
YIRAN YE, JIEYI ZHANG, TIANLANG YANG
Digital camera tracking analyzes video sequences to extract camera motion and 3D scene data. This is a powerful tool to merge our physical world and the desired digital world. In the film industry, camera tracking bridges between concept art and production design so that with this step we can add digital objects into our scene and for compositing. The final result is that Digital object inserted into the real space via tracking points. This movement ensure anything that gets rendered out in 3D will be from the same angles as the live action footage at all times. Using physical/digital camera properties (focal length + depth) and camera movement to generate tracking points positions in space to match physical and digital space to camera view so as to add digital elements to physical scene, add physical elements to digital scene or combine digital and physical objects & scenes.
2022
WINTER
Camera Tracking Test: Laocoon On the Table
I D E A S E N T E RTA I N M E N T ST U D I O
5
6
2022
T H E P H YG I TA L L A B O R A TO RY
CASE STUDY (INDUSTRY) 1917 uses digital camera tracking to disguise and blend the transition of several natural pieces of landscape or architecture. According to Biddiss, there were no CGI explosions or soldiers in the film, which was designed to look like one continuous shot for the entirety of its 119 minutes running time. Most of the scenes in 1917 are live action instead of shooting in front of a green screen. However, there are still elements in the background that do not fit the setting. In that case, the VFX team combines the digital camera tracking, and compositing to replace/ subtract/ add appropriate items in the film.
1917 still https://www.imdb.com/title/tt8579674/
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
KEY IMAGE OF YOUR CASE STUDY (FINAL OUTPUT OF THE TECHNIQUE)
Because 1917 is a one-shot film, actors or actresses have the designated routine to move. There are many markers at the scene. We guess these markers also work as tracking markers to a certain degree. Without camera tracking, the after effect can’t composite into the set easily because of the camera motion, depth of field, and the complex relationship between foreground and background.
7
D I G I TA L C A M E R A T R A C K I N G
I D E A S E N T E RTA I N M E N T ST U D I O
Alfred Mendes runs through the town (BOTTOM) https://www.traileraddict.com/1917/featurette-behind-the-scenes
The cast and crew filming ‘1917’ (TOP) François Duhamel
WINTER
8
2022
T H E P H YG I TA L L A B O R A TO RY
CASE STUDY (INDIE)
Parked Cars Are Boring Michael Seidel.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
A video of characters escaping an explosion in a car looks real. We can see in the final work that the camera is slowly moving backwards and even a little jittery. There are exploding cars and houses, flames and smoke, and fleeing figures.
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
9
Parked Cars Are Boring Michael Seidel.
KEY IMAGE(S) OF YOUR CASE STUDY (BEHIND THE SCENES
D I G I TA L C A M E R A T R A C K I N G
In fact, in the original footage there were only quiet street corners, which means that the author added exploding cars, exploding houses and flames through post-effects. The author tracks the running track and focal length of the camera by capturing the anchor points in the film, which helps to add new objects and effects matching with the footage.
10
T H E P H YG I TA L L A B O R A TO RY
ANALYSIS About the technique: Digital camera tracking is a fundamental technique to blend physical and virtual environments and objects. When the given environment is tracked well. it’s easy to add any desired object to the tracking point and the position and the angle of the object can change according to the camera. It is widely used in film VFX compositing for sci-fi movies and also used in commercials. Good Condition: A footage shot with high resolution, good contrast, good focus and steady camera movement. Problematic: Big scenes like drone shot Object in motion, Object too far in distance, Reflection, Occluded features, Motion blur, Noise, Low contrast, Soft focus Speculation: Real-time tracking for real-time compositiing in news, sports, facefilter, architecture on-site real-time rendering.
GLOSSARY MOTION TRACKER A motion detecting tool to realize camera motion tracking.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
FOOTAGE A shot or series of shots of a specified nature or subject. TRACKING POINT Points that detect and pin to the pixels. Also they follow the movement of the detected pixels. 2D TRACKING Procedure that generate tracking points in 2D space on one frame or the whole footage. 3D SOLVE-NODAL PAN Reconstruct 3D space with tracking point that apply to nodal pan. FULL 3D RECONSTRUCTION Reconstruct 3D space with tracking point that apply to most camera movements except nodal pan. CONSTRAINT Tools that constraint the tracking point with the world coordinate. There are position constraint, vector constraint and planar constraint.
2022
I D E A S E N T E RTA I N M E N T ST U D I O
D I G I TA L C A M E R A T R A C K I N G
Camera Tracking Test: On the Pool Table(TOP) Camera Tracking Points: On the Pool Table(MIDDLE) Camera Tracking Test: Snow Ball (BOTTOM)
WINTER
11
12
T H E P H YG I TA L L A B O R A TO RY
HARDWARE To realize digital camera tracking, what you need for hardware are simple: any camera and any computer that can run a tracking software, even available with some app on the phone. Also it is not a fixed procedure. Problems may appear in any footage. So, it is important to use your brain to solve the problem manually under certain circumstances. LIST OF REQUIRED HARDWARE Camera options: iPhone 13 Pro (Low Budget) Nikon D3200 (Mid Budget) Blackmagic Pocket Cinema Camera 6K Pro (High Budget) Sony PXW-FX9VK (Industrial Professional) Computer options: Dell G15 (Low Budget) MacBook Pro (Mid Budget) Alienware Aurora Ryzen™ Edition R14 (High Budget) Your Brain:
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
In good condition.
1.iPhone 13Pro (apple.com) 2.Nikon D3200 (nikonusa.com) 3.Sony PXW-FX9VK (https://www.fullcompass.com) 4.MacBook Pro (apple.com) 5.Alienware Aurora Ryzen™ Edition R14 (dell.com) 6.Use your smart brain (https://www.sohu.com/a/383437251_221322)
2022
I D E A S E N T E RTA I N M E N T ST U D I O
1
4
2
5
3
6
13
D I G I TA L C A M E R A T R A C K I N G
Required hardware.
WINTER
14
T H E P H YG I TA L L A B O R A TO RY
SOFTWARE And there are multiple choices of software that we can use for the tracking process such as cinema4d, blender, even with After Effect you can do this.
LIST OF REQUIRED SOFTWARE OPTIONS Cinema4D 59.97% of the 3D computer graphic market use Cinema4D. Uworld, Apple, ESPN, TEGNA, Bank of Ameria, Nexstar Media Group. Blender 5.02% of the 3D computer graphic market use Blender. Embark Studios, Egosoft, EA Games, Paper Bunker, Gameloft, Wolfire, Wube Software, Goodbye Kansas, Infinity Ward, Ubisoft. PFtrack Sony Imageworks, The Mill, UbiSoft, Riot, Stan Winston Studios, Digital Domain, Cinesite, Double Negative, The Orphanage, CORE Digital, MPC and Animal Logic. Nuke Favored by big movie studios in compositing. Digital Domain, Walt Disney Animation Studios, Blizzard Entertainment, DreamWorks Animation, Illumination Mac Guff, Sony Pictures Imageworks, Sony Pictures Animation, Framestore, Weta Digital, Double Negative, Industrial Light & Magic., Studio Ghibli.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Adobe After Effect Most widely used indie scale VFX compositing tool, not used by big movie studios.
AUXILIARY SOFTWARE OPTIONS Adobe Premiere Film editing tool, used for exporting footage as frames. Adobe Photoshop Image editing tool, used for exporting footage as frames.
2022
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
15
Maxon Cinema4D
Blender
PFTrack
NUKE
Adobe Premiere Pro
Adobe Photoshop
D I G I TA L C A M E R A T R A C K I N G
Lists of camera tracking softwares
Adobe After Effect
16
T H E P H YG I TA L L A B O R A TO RY
FOOTAGE REQUIREMENTS Meeting these requirements when shooting the footage can increase the chance of successful tracking.
a. Tracking Points and Minimum Spacing
Number of tracking points: 1000
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Minimum spacing: 10
Number of tracking points: 5000 Minimum spacing: 2
Larger Number Smaller Minimum Spacing (Heavy Calculation)
2022
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
17
b. Tracking Markers
With Markers
More markers/more contrast
D I G I TA L C A M E R A T R A C K I N G
No markers
18
2022
T H E P H YG I TA L L A B O R A TO RY
c. Speed
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
11s footage
4s footage
Lower speed should be better.
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
19
d. Steadiness
Steady camera mmovement
No shake
D I G I TA L C A M E R A T R A C K I N G
Shaking camera mmovement
20
T H E P H YG I TA L L A B O R A TO RY
e. Lighting
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Bright
Dark
Light & Bright
2022
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
21
f. Resolution
1080 p
Higher resolution
D I G I TA L C A M E R A T R A C K I N G
4K UHD
22
2022
T H E P H YG I TA L L A B O R A TO RY
g. Camera Movement
Orbit dolly
Pan & tilt
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Dolly
More aspects of the environment & objects
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
23
h. Camera Focal Length
26mm focal length
More aspects of the environment & objects
D I G I TA L C A M E R A T R A C K I N G
76mm focal length
24
T H E P H YG I TA L L A B O R A TO RY
i. Focal Length Changes
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Gradually zooming in
Directly changing focal length
Gradually change the focal length
2022
I D E A S E N T E RTA I N M E N T ST U D I O
25
D I G I TA L C A M E R A T R A C K I N G
WINTER
26
T H E P H YG I TA L L A B O R A TO RY
2022
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
HERO IMAGE OF YOU
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
27
D I G I TA L C A M E R A T R A C K I N G
OUR DEMO PROJECT
28
2022
T H E P H YG I TA L L A B O R A TO RY
EXAMPLE: LAOCOON ON THE TABLE
Digital Laocoon and his sons statue on the table.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
The LAOCOON AND HIS SONS statue is a digital 3D model and it is added on my table via digital camera tracking. This statue has the right spatial relationship with the physical space and with extra efforts the lighting and shadow also approach what it really is in the physical space.
I D E A S E N T E RTA I N M E N T ST U D I O
29
Summary of Steps Hardware: iPhone 8 Plus Software: Adobe Premiere 2021, Cinema4D R25 Non compositing: (If getting tracking points only) 01. Shooting 02. Exporting footages as frames in Adobe Premiere Pro. (Optional)* 03. Importing footage to Cinema4D R25. 04. Full Solve/2D Tracking (Choose 1 option)* 05. 3D Solve Pre compositing: (If continuing ) 06. Constraint 07. Generate Point Cloud 08. Insert 3D Assets 09. Export camera and animate background Advanced Tracking: #04. Advanced Tracking Settings
Please read texts and images carefully!
D I G I TA L C A M E R A T R A C K I N G
WINTER
30
T H E P H YG I TA L L A B O R A TO RY
01
Shooting This step creates the footage for tracking.
1. Use any camera or device with camera to take a video clip you want. Here is an example of using iPhone camera: Camera Focal Length Data: iPhone 8 Plus: 28mm(Primary) 56mm(Tele) iPhone X: 28mm (Primary) 56mm (Tele) iPhone13 Pro: 13mm (Wide) 26mm (Primary) 77mm (Tele)
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
2. There are multiple choices of camera movements:
Camera Movements https://beverlyboy.com/cinematography/camera-movements-explained-with-examples/
2022
I D E A S E N T E RTA I N M E N T ST U D I O
31
However, the quality of tracking is related to the type of camera movement. Here are the qualities from good to bad of camera tracking by camera movement:
Camera movements for tracking results: from good to bad
Here roll is recommended. Find something on a table and shoot it with roll. After shooting, import your video clip to your PC/Laptop.
Using orbit dolly as camera movement to shoot the object
D I G I TA L C A M E R A T R A C K I N G
WINTER
32
T H E P H YG I TA L L A B O R A TO RY
02
Export Footage as Frames(Optional) This step the video will be exported as frames. This step is aiming at rendering with Octane because Octane only recognizes frame pictures.
03
If not rendering with Octane, skip to . 1. Import the video clip to Adobe Premiere File-New-Project Double Click [Import media to start]-select video clip(Fig 1)
Fig 1
2. Export the video clip to footage as frames File-Export-Media Format: [JPEG] Output Name: rename and choose location Video-Frame Rate: 24 or 30 (Fig 2) Time Interpolation: Frame Sampling Export
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Result: A series of frames as footage (Fig 3)
Fig 2
Fig 3
2022
WINTER
33
I D E A S E N T E RTA I N M E N T ST U D I O
03
Import Footage to Cinema4D (e.g.R25) This step is the start of handling the footage. 1. Open Cinema4D Select Track Mode (Fig 4)(Look may vary in different versions)
OR
Fig 4 2. Double click [Double click to create MT object] or click Motion Tracker (Fig 5)
03 Fig 5
Fig 6
D I G I TA L C A M E R A T R A C K I N G
3. Double click [Double click to select footage] (Fig 6) If render with Octane, select the first picture of the footage series.(JPG, PNG) If render with default renderer, select the video file.(AVI, MP4, etc)
34
2022
T H E P H YG I TA L L A B O R A TO RY
04 Full Solve/2D Tracking (Choose 1 option)
This step offers 2 options: one is a faster way called Full Solve which can do 2D tracking and 3D solve together. Another one is step by step starting from 2D tracking. It is to track the strong contrast pixels of each frame based on the graphic information. 1. After importing the footage, the workspace is as follow (fig 7) Locate the Footage tab Set the sampling to 100% if there is enough memory for the computer
Fig 7
Option 1: Full Solve(fast way) 2.1 The Full Solve is a faster way of tracking from 2D to 3D. At the bottom left, click [Full Solve] The software will automatically finish 2D tracking and 3D solve. Then jump to
06.
Option 2: Step by Step(regular way, more control)
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
1. The space to the right of the Footage tab is [2D TRACKING]. There are two directions of 2D Tracking. The first one is [AUTOMATIC TRACKING]. Cinema 4D has a pretty good Auto Track feature. In some cases, this works just fine.(Fig 8)
STAGE ## PHOTO OR SCREENCAPTURE 2
1 3
Fig 8
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
35
2. Advanced Setting: Maskout problematic parts (fig 9) (Optional) For better tracking quality, under these circumstances can the mask be used: Object in motion, Object too far in distance, Reflection, Occluded features Motion blur, Noise, Low contrast, Soft focus
#04a to see masking steps.
If needed, please jump to If not needed, go to next step.
Fig 9
3. Tracking Options: 1#Auto Tracking: Fast way to track the whole scene
Fig 10.1
D I G I TA L C A M E R A T R A C K I N G
At the Motion Tracker Object Panel Choose 2D Tracking-Automatic Tracking Set [Number of Tracks] and [Minimum Spacing] as needed Check [Auto Replace Lost Tracks] Click [<Auto Track>] to generate 2D tracking points for the whole footage (fig 10.1)
36
T H E P H YG I TA L L A B O R A TO RY
2#Manual Tracking: customized way to track specific quality points (go to
#04 Chapter)
At the Motion Tracker Object Panel Choose 2D Tracking-Manual Tracking Press Ctrl and click on the screen for a high contrast point Adjust the yellow frame for Size and Search as needed Click [<Manual Track>] to generate 2D tracking point for the whole footage (fig 10 right)
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Aim Size Search
Fig 10.2 2D tracking result:(fig 11) Pink outline diamond: 2D Auto Track point Blue cross: 2D Manual Tracking point Yellow squares: 2D Manual Tracking point selected
Fig 11
2022
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
37
05 3D Solve
This step is to generate tracking points in 3D digital space to reconstruct space in the footage. This step is the end of tracking process. Further steps are to prepare for the compositing.
1.Solve Mode Options (Based on Camera Movement) 1. Go to Motion Tracker Object Tab-3D Solve(Click the Motion Tracker Layer if not shown)
a.Full 3D Reconstruction
Fig 12
D I G I TA L C A M E R A T R A C K I N G
2.2 If the camera movement is not a nodal pan, then select [Full 3D Reconstruction] in the [Solve Mode](Fig 12)
38
T H E P H YG I TA L L A B O R A TO RY
b.Nodal Pan 2.2 If the camera movement is a nodal pan, then select [Nodal Pan] in the [Solve Mode](Fig 13)
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Fig 13
2.Change [Focal Length] according to camera in [Known and Constant] e.g. iPhone 8 Plus Focal Length: 28mm Click Run 3D solver, result looks like the right of Fig 14. Green point means good long tracking points, red point means only tracking for a short time. (Fig 14)
Fig 14
2022
WINTER
I D E A S E N T E RTA I N M E N T ST U D I O
06
39
Constraint This step is to build connection between the footage space and the model space. Later on 3D assets can be inserted into the footage space. Also this step can adjust the world coordinate to the footage space. 1. Before going to create constraints, these layers are explained so that users can switch to different features.
Layers Explained: Motion Tracker: Click to see 2D Tracking Points Solved Camera: Click white frame to see overview User Feature: Manual Tracking Points Auto Feature: Automatic Tracking Points Fig 15 2. Long click [Create Position Constraint] to see other constraints (Fig 16, 17) Create Position Constraint to one tracking point to set the base point; Create Planar Constraint to 3 points to set the base plane(Fig 18)
Fig 16
Position Constraint: Set the base point of the coordinate. Vector Constraint: Direction of axis and length. Planar Constraint: Base plane position. Fig 17
Fig 18
D I G I TA L C A M E R A T R A C K I N G
3. For [Create Postion Constraint], click on one tracking point to set the base point. For [Create Planar Constraint], click 3 tracking points to set a planar constraint
40
T H E P H YG I TA L L A B O R A TO RY
3. Select Y axis and click [Create Plane] (Fig 19) Result looks like Fig 20 Check the generated 3D space by clicking the Solved Camera frame button. (Fig 21)
Fig 19
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Fig 20
switch between camera view and third perspective view
Fig 21
2022
WINTER
41
I D E A S E N T E RTA I N M E N T ST U D I O
07
Generate Point Cloud(optional) This step is not required but it helps you understand the digital space of the footage and helps build 3D assets into the space. If understanding the 3D space is not needed, jump to
08.
1. Click Motion Tracker layer-Click the [Reconstruction] Tab and click [Generate Point Cloud] (Fig 22)to check the space in 3D (Fig 23).
Fig 22
switch between camera view and third perspective view
Fig 23
D I G I TA L C A M E R A T R A C K I N G
2. To checkt the space in 3D, click the frame button on the [Solved Camera] (Fig 23).
42
T H E P H YG I TA L L A B O R A TO RY
08 Insert 3D Assets (optional)
This step is merging the digital assets with the physical world. You can either insert basic geometries as placeholders for the compositing team to detailed the model or insert refined models and do basic compositing yourself. 1. Open a 3D asset and copy and paste into the file. Move, scale and rotate to the desired position.(Fig 24) Go to the point cloud view to check the position of 3D asset in 3D (Fig 25) Also, markers can be inserted to examine the reconstructed 3D space (Fig 26)
Fig 24
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Fig 25
Fig 26 2. Some basic geometries can be inserted as placeholders for the compositing team to later detailed the model. (Fig 27)
Fig 27
2022
WINTER
43
I D E A S E N T E RTA I N M E N T ST U D I O
09
Export camera and animate background (optional)
a. Export Camera If you need to export camera to other team, Here is the guidance: Select <SOLVED CAMERA>, <BACKGROUND>, maybe some markers to the aimed file.(Fig 28)
Fig 28
b. Animate Background Because background’s texture is image sequences, you need extra steps to make it animated.(Fig 29)
1
3 ## PHOTO OR SCREENCAPTURE STAGE 4
5 6 Fig 29
FRAMES NUMBER OF THE VIDEO
D I G I TA L C A M E R A T R A C K I N G
2 DOUBLE CLICK
44
2022
T H E P H YG I TA L L A B O R A TO RY
# 04 Advanced Tracking Settings (optional) a. Mask out problematic parts For better tracking quality, under these circumstances can the mask be used: Object in motion, Object too far in distance, Reflection, Occluded features Motion blur, Noise, Low contrast, Soft focus 1. Press [Create Mask] on the bottom bar, click on the footage to draw a close polygon as the mask area. 2. In the bottom right bar, select [Mask] and select [Exclude From Mask].
1
2
this part interferes tracking results
3 4
b. Adjust Numerical value to fit the footage in Autotrack
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Choose a middle frame which cover most of the view of your footage. Then Adjust <NUMBER OF TRACKS> and <MINIMUM SPACING>. After that, click <CREATE AUTO TRACK>.
2
1
I D E A S E N T E RTA I N M E N T ST U D I O
45
If the <NUMBER OF TRACKS> is too high or the <MINIMUM SPACING> is too low, the tracking points will be over concentrated. If the <NUMBER OF TRACKS> is too low or the <MINIMUM SPACING> is too high, the tracking points might be not enough for analysing camera position.
(Not ideal result) Over concentrated tracking points
Ideal result of tracking point density and distribution.
D I G I TA L C A M E R A T R A C K I N G
WINTER
46
2022
T H E P H YG I TA L L A B O R A TO RY
c. Manual Tracking (choose markers or special points) If you need to adjust your tracks manually, you can choose <MANUAL TRACKING> To observe the status of tracking points better, click <TRACK> layouts
3
STAGE ## PHOTO OR SCREENCAPTURE
2
1
c. Adding Tracking Point
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Once in the Manual Tracking tab, create a new manual tracker by simply <Ctrl+clicking> in the viewport. Move it to a good position on the footage. A Tracker View will appear on the right.
Ctrl+click
WINTER
47
I D E A S E N T E RTA I N M E N T ST U D I O
c. Adjust Tracking Point
The principle of motion track in Cinema4D is the Track algorithm. Click the <TRACKER VIEW> ; recognising this point depends on the black and white contrast. It can also use different <COLOR FILTERS> to get better recognition results.
1 2
c. Tracking
STAGE ## PHOTO OR SCREENCAPTURE
D I G I TA L C A M E R A T R A C K I N G
Create as many points as you need. Use the <ARROW BUTTONS> to move forward or backward in the timeline. Or hit the <MANUAL TRACK> button to have the tracker run through the entire clip.
48
2022
T H E P H YG I TA L L A B O R A TO RY
d. Adjust Tracking Points by Frames
Both Auto Track and Manual Track need to give the assessment of tracking points. <MOTION TRACKER GRAPH VIEW> can help to do it.
1
3 2
STAGE ## PHOTO OR SCREENCAPTURE
2
1
d. Use Graph View to observe tracking results by point In the TOP-DOWN MODE, red means bad tracking status, green means good tracking status.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Click <GRAPH VIEW>, can switch to graph mode.
WINTER
49
I D E A S E N T E RTA I N M E N T ST U D I O
d. Adjust Point
The line will turn orange when selected. Normally, number above 0.3 means the bad tracking status. If there are enough tracking points, the bad point can be <DELETE>.
1 2
e. Trim Track If there are not enough tracking points or the tracking points have good tracking status the most of time.
STAGE ## PHOTO OR SCREENCAPTURE
D I G I TA L C A M E R A T R A C K I N G
Click <TRIM TRACK> can delete the bad part automatically.
50
T H E P H YG I TA L L A B O R A TO RY
FINAL OUTPUT Here is the mixture of camera tracking results of different footage from outside city environment to interior. The process of camera tracking is breaking down into different view with tracking points, inserted geometries and solve camera.
EXPLAINER VIDEO Here is a video explaining and demonstrating how to do basic camera tracking.
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
Link: https://www.youtube.com/watch?v=mM1ANgk19Jw
2022
I D E A S E N T E RTA I N M E N T ST U D I O
51
IMAGE OF EXPLAINER VIDEO OUTPUT
D I G I TA L C A M E R A T R A C K I N G
WINTER
JIEYI ZHANG, TIANL ANG YANG, YIRAN YE
52
T H E P H YG I TA L L A B O R A TO RY
2022
I D E A S E N T E RTA I N M E N T ST U D I O
53
D I G I TA L C A M E R A T R A C K I N G
WINTER