Maya Export Position and Normal Pass to Pixel Cloud Tutorial

Hey guys, this tutorial is a brief overview on how to use Maya to quickly create a position pass and normal pass to be used with the Pixel Cloud plugin for After Effects. The process is pretty much the same as in my previous tutorials but this is dedicated to exporting the passes from Maya and the adjustments necessary after importing into After Effects.

On a side note, I’ve started setting up a Forum for any questions regarding Pixel Cloud, Scripts and even just general graphics talk! If you have any technical questions please feel free to post here and for my customers feel free to email me at support@blurrypixel.com I’ll get back to you! The forum is still in the beta stages but feel free to start using it!

Share this post!

Pixel Cloud Relight Demo Coming!

The upcoming Pixel Cloud plugin for After Effects can be used to relight a source image affecting the diffuse and specular properties. Coming soon I’ll be posting a revealing demo of how easy it is to take a static image from a 3D package and use Pixel Cloud and After Effects’ own 3D lights to create a dynamic and believable composite with moving lights, shadows, and reflections. Here’s an end product of what it will look like!

3D model courtesy of Stanford 3D Model Repository

Share this post!

Recreality: The Future of Cinema?

I just received my Lytro and have been having a blast taking photos with it. It’s absolutely brilliant. If you’re unfamiliar with this camera, it allows you to focus the picture after it’s already been taken. The move from in-camera to in-post is certainly being lead by technology and economics. My Pixel Cloud plugin is also trying to bring more of those capabilities into After Effects. Just look at the Microsoft Kinect and how innovative pioneers are using its ranging features to recreate environments from recorded point clouds.¬†And Samsung has developed a sensor that not only records RGB but Depth pixels as well! These are amazing innovations for effects artists.

Imagine a future where we can record whole rooms as animated environments. Think 3D scanners that scan whole rooms at one time and at 24fps. We could completely eliminate conventional camera motion control and create everything in-post. We could change the lighting setups, create digital camera rigs all after the video has already been shot. Not as CG but as recorded pixels in 3D space; An accurate representation of reality that we can manipulate to our choosing. This opens up possibilities for interactive story-telling, not to mention subjective 3D stereography. I could imagine a dozen more uses.

This isn’t just virtual reality but recreated reality, “Recreality.”

Share this post!

Pixel Cloud Demo: Animating a Photo

[CORRECTION] Although we use the term depth map, the correct term for usage should be height map. The main difference being that a height map denotes distance from a flat surface and a depth map denotes distance from the camera.

I’ve shown how we can use a CG render and a Position Pass in After Effects to animate and relight a 3D displaced Pixel Cloud. But not all 3D programs can produce a Position Pass and photographic sources obviously do not come with specialized passes. Pixel Cloud can still get around these limitations.

Although not yet released, this demo/tutorial gives a quick look at how simple it is to use the Pixel Cloud plugin to create a realistic camera animation with a simple photograph. Pixel Cloud can use not only Position Passes but Depth Map passes as well within an 8-bpc project.

So keep an eye out for more updates on how close we are getting to release Pixel Cloud!

Share this post!

What is Relighting?

What is Relighting for After Effects?

For After Effects and compositing in general, relighting is the process of changing the perceived shading of an already rendered 3D image. This includes the diffuse shading and specularity of the 3D image. One could drastically change the perceived position of the sun or whether an object is shiny or not. In other compositing packages this may also include cast shadows.

Relighting is actually a commonplace process in many node-based compositing packages like Nuke. Until recently, this was not possible within After Effects. The fact that After Effects had a 2GB memory limitation as well as limited support for 32bit footage certainly limited its capability to relight a shot.

32bit images can take up a lot of memory and processing power. Take your heaviest comp and turn on 32bit. Your comp may take up all your memory and most of the effects aren’t 32bit ready making your output simply 8bit images with a decimal point on the end. Imagine relighting a 4K video in CS4. You couldn’t and the process would still be very sluggish on CS5 but the possibility is there. And that’s what Pixel Cloud will do. Extend that potential. And make that opportunity available.

The truth is, After Effects was never meant for this type of compositing. Node-based solutions filled a market that AE simply could not. But CS5 and above is changing all that. 64bit and no memory limitation means that After Effects is just beginning to compete in a market of film-quality compositing and special effects. After Effects and Premiere can help open up a world that is filling with digital filmmakers. Technology just continues to become more powerful and even cheaper.

After Effects has a bit of ways to go in order to become a compositing standard. It could still be faster. It should have stronger tools for customizing workflow or at least more education on the scripting interface. And why not create a more node-like interface for the flowchart for the many users who come from a 3D background? But for the price, a regular production cycle, pages of tutorial information and legions of users, CS5 already is the de facto standard.

Passes

To light a scene, you basically need 3 bits of information from the 3D package. The position of the surface and the direction that the surface is pointing. Lastly you will need the camera information which was used to render the scene in the first place. This would be the camera position, direction and focal length. The light information is provided by the compositing program.

The position information is rendered into a position pass. Some people call it a “P” pass but I prefer position pass. The surface direction is provided by the normal pass. The position pass takes the x,y,z coordinates of the points being rendered and saves them in a 32bit image as r,g,b color information. The normal pass takes the vector coordinates of the normals of those points and saves them the same way. The images have to be 32bit as these images can handle floating point values greater than 255 and can even be negative. These values also have to be in the same coordinate system. In other words, if the position pass is in camera coordinates then the normal pass must also be in camera coordinates.

Given these 2 passes and the camera, the compositing program can then use a bit of trigonometry and some fancy mathematics to simulate what the lighting would be at those corresponding screen coordinates with any given light.

Why would you do all this when you could simply go back into your 3D software and re-render the scene? Because that could mean hours of rendering and since compositing is generally much faster than re-rendering, if you could just fix it during compositing why not try that? By rendering extra passes during the rendering stage you could end up saving yourself tons of time instead of wasting hours trying to make sure the sun’s highlights are on the right side or your character’s nose is shiny enough.

Share this post!

Relight with Pixel Cloud

I’m excited to say that there will indeed be relighting functionality built into the Point Cloud plugin. Still in Beta, I’m happy to show off a little bit of what this relighting capability can do for your workflow! I’m still looking for a couple of beta testers who are serious and will be committed to helping me bring this plugin to release. In particular, I’m looking for Windows CS4 and CS5 After Effects users who use 3DSM and/or Maya and will be able to help me provide animated examples of relighting 3D renders in an After Effects workflow. You should be familiar enough to provide a workflow for generating position as well as normal passes. Please reply to betaprogram@blurrypixel.com.

 

Share this post!

Beta Testers Wanted!

20110508-112400.jpg

The Point Cloud plugin has moved into the Beta stage and us nearing release! Update: Thanks for all the responses! We currently have enough testers now!

I’m looking for a few good beta testers to help me QA the current build. Broadcast, film After Effects compositors integrating 3D applications in their workflow. Maya, Cinema 4D and 3DS Max. Your help is wanted! Please write to betaprogram@blurrypixel.com for more information.

Update: Thanks for all the responses! We currently have enough testers now!

Share this post!

Point Cloud at the Bi-Coastal User Group Presentations

Lloyd Alvarez of Aescripts + Aeplugins was to give a presentation at AENY last Thursday, Jan 27th. Unfortunately, it was canceled due to the snow storm in New York City. However, he was kind enough to do the presentation online! And even better, my Point Cloud plugin was part of the presentation!

I am currently working with Aescripts + Aeplugins to release this plugin in the near future. So look out for it! And check out his presentation which demos loads of fantastic plugins and scripts including the fantastic BGRenderer script and of course a sneak peak at my Point Cloud plugin! So check it out here.

UPDATE: The Point Cloud presentation begins at 37:30 so stick around for the whole presentation!

Share this post!

Pixel Clouds in the Distance

Fantastic news! I am close to releasing my Point Cloud tool plugin for After Effects. This effect will allow you to displace your 2D pixels into 3D space and it reacts to the 3D camera like a 3D layer. What can this do for you? It can help you visualize your composites better, where to place your cards in terms of position and scale. Plus there are lots of other uses to discover! Take a look at movie to see what I mean.

Share this post!

Plugin Demo for Pixel Cloud

Fantastic progress being done on the up and coming plugin for After Effects. I was recently able to stitch a video together to showcase what else this plugin can do besides compositing images from 3D packages. You can implement your own position pass as a displacement matte for a planar image. And it need not be 32 bit either. 8-bit does just fine.

Share this post!