Week 5 - 3D Tracking Workshop, Continued

Fig.1 - Solving and unsolving tracks

Today we learnt about camera tracking and lens distortion. Following the image below (figure 2), I created a mask out independent moving asset. This makes an asset stick to the scene instead of following the camera, and adjusting the image to the perspective drawn by using the Roto node. The Roto node can now be activated just by pressing R in the node graph editor. This has to be connected to the camera tracker which is connected to the viewer. By double-clicking on the roto tracker u can point by clicking around the scene where the asset would be placed as shown in figure 3. Then set a spline key (with a plus sign) in the Roto editor. When playing the scene I was able to see the red box stay in place whilst the dots around the box were moving but not interacting with the box created. 

Afterwards, I then went on to create a StMap for lens distortion. I added a checkerboard that matches the lens for the video. I used the nodes (from up to down); reformat, grade sharpen and lens distortion. After this, I went to the lens distortion node and located analysis and 'detect'. This will then create an undetached square which I had to put together nicely by creating a row of lines that did not connect with another line. I did this by going to the left side of the viewport and clicking add lines. using the left-hand corner to add the lines, I finished the square and clicked on solve (from lens distortion node) which turned the square green. This then improved the lens and made the scene wider and refined. 

At the end of the day, I was tired as there were so many mistakes made with the lens distortion. For example, when I clicked 'solved the square' it would go below the image in the viewport. However in conclusion I was able to solve it as there were some mistakes in my lens distortion. Thus, lens distortion takes time to perfect and I should be more careful when perfecting the square. Today was a success as I was able to problem-solve some of the issues myself. 

Fig.2 - Using Camera Tracker

Fig.3 - Lens distortion

Fig.4 - Final Lens Demo