123D Catch Evaluation


123D Catch Evaluation
(i have only handed in an evaluation of this project as this is all i was told was required)

For this project we were set the task of using Autodesk 123d catch to create a 3D model and composite it over real life footage. As my creative media project has a lot of motion tracking in it I decided I also wanted to motion track my model in my scene. I believe towards the end of the module motion tracking become a compulsory element anyway. 

First off I set about creating some models. I took photos of lots of things in my house, from my own camcorder to shoes, bowls off smellies and mugs. I found early on that 123D Catch didn’t like processing images taken in doors as all of my models looked terrible. I must have attempted at least ten different objects before I decided I would book out a better camera from the equipment store and try again. I got out a Nikon d50 and it made a little difference, my models were slightly better. 

I still wasn’t happy so I decided to go outside and take some photos. I came across a strange mound/sculpture which had some graffiti on it and a post box. The models for these turned out pretty well, as you will see from the files I have handed in.

As I have a decent grasp of the match moving software Boujou I decided instead to used Autodesk Matchmover, to increase my portfolio of knowledge. I found the programs to be very similar as you have to go through the same processes of entering coordinates, with Boujou being slightly more advanced as it has a better tracking engine for footage that is very shaky or slightly out of focus.

First of I attempted to track some footage I filmed in the local part but Matchmover could not accurately add track points to it. I re tried these process many times introducing track markers to my footage but it still wouldn’t work. In the end I filmed my desk and added track markers, and was able to get a very good track out of it.

I decided to composite my Sony Handy Cam model on to this and add a shadow for extra realism, using Autodesk 3dS Max to match up the model with the footage, and then Adobe After Effects to composite them together. I then did my final composition render in Adobe Premiere Pro where I also added music to the piece.

I did another track with the sculpture and placed it on my dining room table using exactly the same processes. I decided to do two to show the amount of effort that I have put into doing this project.

Over the course of this project I have learned how to use two new programs in Autodesk 123D Catch and Autodesk Machmover, which is a good thing and sets me up well for work in the future, as I will have a wider knowledge of various programs used in the film industry.

Evaluation



Overview

For this project we were set the task of using green screen to composite real life footage. As the project was supposed to have a personal theme I decided to recreate the journey I take home every weekend to see my baby daughter.
As I go home on the train I thought this would be an interesting project to try and put together, and after discussing it with ken we also came up with the idea of me falling asleep on the train and having a dream.
As I have gone into quite a lot of detail of how I put my project together on my journal, I will briefly discuss the different stages I went through to complete my project.

After finalizing my idea the first thing I did was to go out and obtain all the elements I needed to put my project together. First I started off by filming a back plate for when I get off the train. This involved taking a Canon XF100 and a tripod back home to Leicester with me, to film the train I normally catch to my home town pulling into the station. The day was pretty over cast so there were not a lot of shadows, but luckily there were other people on the platform to get on the train, which I think added a bit more realism to the shot.

Next I wanted to do the back plate for looking out of the window, in the shots where I am sat on the train. So the following weekend I took my camera back with me, and sat it on some books so it had a decent steady shot out of the train window. Unfortunately I think due to the speed of the train the footage was unusable so I set about different ways of obtaining this shot. What I did was to look on the internet and after viewing lots of videos decided on one I found on YouTube, which I believe is set in America, but was the closest to looking like the UK. 

Next I went out and got my photograph for the shot inside the train carriage. I took about thirty pictures all together with a Nikon D50, so I had plenty to go on with.

I then went into Adobe After Effects to start putting together the inside of the train shot. I did this by first taking the interior photograph and carefully masking out the window, and placing the window footage below it. I then duplicated the photograph and shrank it to add some depth to the window frame.

Just after Easter, ken and I then went into the green screen studio to film the shots of me on the train and walking down the platform. We set up two Kino Flo lights and a deflector to film both the shorts as I have explained in my journal, so that the lighting and shadows were as accurate as can be. We did several takes so that I had plenty to choose from.

Now I had all of my shots done I had to put the whole project together. To do this I used Adobe After Effects. I keyed out my green screen footage using Keylight 2.1 and placed it over the relevant back plates. After keying out I still had a lot of masking to do, which took the most time of all.
I then added shadows using a mixture of masks and duplicated layers, the whole time applying colour correction techniques to help match up my footage. I then added extra elements like a vignette to add extra shadows to the footage and also to draw the viewer to the center of the composition.

After I was happy with everything I then did my final colour correcting. I used an adjustment layer and placed it over the top of everything. I added a curves adjustment, tint and a glow to help make the colours more realistic, and you can see the results of this in my journal.

I then added shots of my daughter for the dream sequence that I had pre-composed earlier and placed them in to the shot, using a white solid to fade from reality into the dream sequence. After I was happy I pre-composed everything and moved it into a new composition where I then added a twirl effect which is used as the transition into the dream.

Then I rendered out the whole project as an uncompressed AVI so not to lose any quality, and took it into Adobe Premiere Pro for editing and adding the sound effects. I found all of my sound effects on YouTube and used Adobe Sound Booth to convert them to WAV files. All that was left to do now was to put the sounds in place and do some test renders and correct any errors. I then rendered out my finished project using the ‘match sequence settings’ option in Premiere Pro to get the best quality possible.

Problems / Help

The most help I had throughout this project was from ken when we went into the green screen studio to film my project. This is because he has such a great knowledge of lighting and how to get around problems. Thanks to his help I think my footage is many times over better than what I could have achieved by myself, and what I have learned from these experiences have been invaluable.

Other help I got was online in the form of tutorials. This was the case when I came to keying out my green screen footage. As I had never gone through this process before my initial attempts looked poor at best, with bits of my body completely missing. Luckily I found a great tutorial on videocopilot.net, http://www.videocopilot.net/tutorials/basic_color_keying/ which helped me obtain a much better result for my keying, as I have explained in much detail in my journal. I also found a really good tutorial on the same website http://www.videocopilot.net/tutorials/mid_air_emergency/ that helped me with my colour correction. It helped me in a sense that it showed me the different colour correction effects I needed to use like curves adjustments, tint and glow effects and how best to utilize these effects within my project.

Over the course of the project I also encountered many problems, some of them due to errors of my own making. An example of this was when we were in the green screen studio and we had just filmed both the shots I needed. Ken then noticed that the camera was set to interlaced, and as I could not remember if my back plates were interlaced or progressive we had to re film both shots, just to make sure. This made the session twice as long, purely down to my error.

As I mentioned I also had difficulty recording the shot out of the train window, was there was too much glare and reflection coming off the window when I filmed it on the train, and it was a dull day. After this I decided to source a clip off of the internet.

Another big problem I had was with the chair I had used to sit on in the green screen studio. We placed a green hoody over the back of the chair in hope that it would key out properly when it came to removing the green. Unfortunately the green was to dull and when I tried to key it out most of my body and face disappeared to, and no matter what I tried I could not get it to look good. So I then had to go through the clips every two to five frames, depending on my amount of movement and mask out the back of the chair. This was a very time consuming and tedious process.

Changes I Would Make

If I could go back and change anything or have had more time, I would have changed a number of things.
First off when filming my back plate I would have noted down if it was interlaced or progressive, and at what angle the platform was adjacent to the camera, so that we wouldn’t have had to film so many takes in the green screen studio, and my footage would have also had a better perspective scale to it for the platform shot.

While in the studio I would have set the camera up so that the back of my chair was just out of shot, either this or use a backless chair. This would have saved me a lot of time but it is also another lesson I have learned from this project.

Since completing the project I have also noticed a number of problems with the finished work. One of these is the shadow that appears on the window when I am sorting out my hair after waking. It looks a little odd and I believe there may be a partial mask over it I have left on by mistake. Also the train window is very blown out and could do with having a bit more contrast. I would also like to add some more reflections to my face, as when the footage brightness changes the lighting on me doesn’t. I will be changing all of these problems and adding the reflections for my show reel.

Conclusion

Over all considering at the start of this project I had not really experimented with green screen keying and compositing, I feel my project has had a positive outcome, and that the quality of my work is of an expected standard. I have learned a lot of invaluable experience from doing this module, from learning how to key, how to set up cameras and lighting and also what not to do during these processes, which sets me up well for the future.

Final Finished Project

Please watch in HD.

Final Edit


Once I was happy with my project in After Effects I rendered it out as an uncompressed AVI, so not to lose any picture quality.


I then did the same with the platform clip, and took them both into Premiere Pro for editing. 

In Premiere Pro I added my sound effects, fading them in and out using key frames, and also fading my footage in and out at the appropriate times.

I had a few test renders and tweaked things here and there before my final render, In which I used the
‘match sequence settings’ option to get a decent render. 


Obtaining Sound Clips


For the sound of the train I was pretty lucky that the window footage had a good sound to it, so I used that.

For the dream sequence, both the sound of going into the dream and when I am then in the dream, I had to look for appropriate sounds. Fortunately I first found a good dream transition sound on YouTube. It’s a sound I have heard often before and is also used for flash backs or revisited memories, so I felt it fitted in pretty well.

http://www.youtube.com/watch?v=xQ-SMsaYZuM


For the dream itself I wanted the sound of a cot mobile, and after looking at a few decided on this one.

 http://www.youtube.com/watch?v=vn-NyrVdXaY


I downloaded them both using http://www.savevid.com/ as I mentioned earlier, downloading in mp4 format.

I then took both sound clips into Adobe Sound Booth and converted them from video to WAV files, ready for me to add them to my project.


The Platform Shot



The platform shot has used similar techniques, with both colour correcting me and the back plate. This included curves and tint adjustments on both, as well as exposure adjustments on myself.

For shadows I added two subtle shadows to my feet, as there were no strong shadows in the background footage. I did this by creating two black solid layers and masking them to move with my feet using key frames, and then feathering them out.














I then also added a shadow/reflection on to the side of the train by duplicating the layer of me, making it 25% opacity and then adding a box blur to it. I think this effect worked very nicely.


Bringing In The Dream Sequence



I then brought in the dream sequence on a single layer, as I had previously pre-composed it. I placed it in between both shots on the train and then set about creating the transitions.

I knew I wanted it to spin in and out in a dreamy way so I created a white solid layer and placed it over the top. I then had it fade in and out so that the scenes didn’t just jump from one image to another while it was spiraling.














Once I was happy I pre-composed my entire project and moved it to a new composition, and then added a twirl effect. This was to give the impression of entering a dream. I simply applied the twirl and reversed it using evenly timed key frames.