Rendering Synthetic Objects into images
- Started
- Last post
- 22 Responses
- Beeswax
http://kevinkarsch.com/publicati…
I can't wait to see this as a feature in Photoshop
- mikotondria30
Bloody wow, that's awesome results.
- epill0
this is great for animating gifs.. some intense tech in that vid
- monospaced0
amazing, simply amazing
- sigg0
i'm blown away. this is really amazing.
- jon_d0
I call bullshit
- eieio0
Basically they've taken a procedure that is possible right now with a much more indepth and complicated workflow in a 3d application, things like matching the lighting of a photo and remodelling certain elements of a scene, image analysis stuff that recreates the light of a 2d image in 3d and compositing stuff and combine it all into one piece of software that works more intuitively in one method with basically any image... and they seem to have done it very well.
- Normally you need HDRI to light a scene like that but they've made it possible with any picture.eieio
- jon_d0
i was joking.
- utopian0
This App/Plug-in could save Adobe!
- Yeah because their competition is putting them out.monospaced
- SteveJobs0
actually, this *is* 3d. all of the added components are using 3d computations, from the geometry and light sources you specify but it's using a 2-dimensional skin.
nothing new though. games were doing this a decade ago (albeit on a more primitive level) before 3d was able to look as good as the preferred prerendered 2d backgrounds.
http://en.wikipedia.org/wiki/Pre…
later they took the games to the next level by substituting static backgrounds with cg loops. which would animated scenes with flickered light or a swaying chandelier. still, the objects in the scene were lit correctly because of the geometry outlined for that area.stil though, it's amazing what they've accomplished
- babaganush0
Awesome. I actually need this right now...
- ApeRobot0
Impressive.
- Samothrace0
seems like they've been using this for video games for some time
- eieio0
They haven't been using this in video games or movies for some time, they've been using 3D software and various tools with a much more complicated technique to do the same thing. What they've done here is take this sophisticated process and combine it into one workflow and in a very thorough and accurate way. Also they've made it possible with any type of image, typically you need HDRI or other special imaging tools.
" Currently, to insert objects into the scene, some scene geometry must be manually created, and lighting models may be produced by photographing mirrored light probes placed in the scene, taking multiple photographs of the scene, or even modeling the sources manually. Either way, the process is painstaking and requires expertise.
We propose a method to realistically insert synthetic objects into
existing photographs without requiring access to the scene, special
equipment, multiple photographs, time lapses, or any other aid."
- SteveJobs0
all hdr does is take light, or more accurately, color data from a set of exposures and uses a given algorithm to produce the photographed scene as the human eye, or a receptacle with the ability to perceive a greater dynamic range would have captured it.
this however, just takes geometric data and a light source and computes the distrubition of light against the given angeles on a pre-rendered background. it's pretty simple in theory, but the effects as displayed are pretty impressive to see because of the illusion of real light being cast.
a few minutes of doing this in photoshop to simulate effect (mine isn't near as good because i can't compute math for angles light attenuation, etc.)
orig
artifical light:
- eieio0
hdri is a combination of three or so pictures with different exposures to create an image that has full exposure at any given point. In some 3d applications you can use an hdr file to light a scene extremely realistically...
http://www.max-realms.com/module…
http://3dmaxtutorialfree.blogspo…
The people who made this software mention this technique and HDR in the write up,
http://kevinkarsch.com/publicati…
"... can be used to capture a physically accurate radiance map for the position where a synthetic object is to be inserted. This method requires a considerable amount of user input: HDR photographs of the probe, converting these photos into an environment map, and manual modeling of scene geometry and materials."As I've said they're taking this complicated technique and streamlining into one piece of straightforward software. And in this case, which is as far as my knowledge perfectly new and ingenuitive, is that you don't actually need HDRI for this software to do that, which is awesome. It is also very physically/visually accurate, subsequently optimizing the realism.
- eieio0
http://en.wikipedia.org/wiki/Hig…
'(HDRI or just HDR) is a set of techniques that allow a greater dynamic range between the lightest and darkest areas of an image than current standard digital imaging techniques or photographic methods. This wide dynamic range allows HDR images to more accurately represent the range of intensity levels found in real scenes, ranging from direct sunlight to faint starlight, and is often captured by way of a plurality of differently exposed pictures of the same subject matter.'http://en.wikipedia.org/wiki/Hig…
'(HDRR or HDR rendering), also known as high dynamic range lighting, is the rendering of computer graphics scenes by using lighting calculations done in a larger dynamic range.'
- SteveJobs0
oh i see. so basically the light source can pull from the lighter exposures for a more accurate result.
and yes, i'm aware of what hdr is. i wrote a commercially available hdr software. i know the field all too well