Dynamics in Image-based Rendering

The inherent rigidity of Image-based Rendering (IBR) techniques, i.e., images once captured cannot be modified is a major limitation which cannot satisfy computer graphics needs. Our goal is to push this limit and provide novel scene synthesis beginning only with images of the scene as input. To this end, we propose techniques to introduce dynamics into Image based Rendering techniques. In any IBR model, there exists two aspects, the scene (whose image is captured) and the viewpoint (from which the image is captured). The possibility of novelty in "scene synthesis" therefore lies in both these two aspects.Specifically, 1. Image-based Relighting (IBRL) for opaque objects. 2. Environment Matting (EM): Discovering the complex illumination effects emanating from the interaction of the environment with a transparent object. 3. Object Pose: Create realistic animation sequences of an object moving along any arbitrary path in any specified environment given only images of the static object. 4. Viewpoint: Generating detailed views of a scene from novel viewpoints, once authentic imagery of the scene has been acquired using a camera gantry, or a handheld camera.