Sergio Moreschini: Research project 1, “Enhanced lightfield representation for continuous-parallax contect” (Tampere University of Technology)
Project information:
In order to create a new concept of representation independent of capturing and display methods we aim to incorporate geometrical information in a light field (LF) representation. The outcome is defined: Enhanced Lightfield (ELF) Representation for continuous parallax content.
The concept of Full Parallax Imaging is based on the user’s experience, therefore the main goal is providing the observer with highest realism: dynamic scenes which smoothly respond to any variation of the observer’s position with respect to the object. It is directly related with another concept, the plenoptic function: a 7D continuous function describing a sensor capable of capturing light rays impinging from different directions which is approximated by its 4D representation known in literature as Light Field (LF). As sensing devices are predominantly digital, visual sensing of 3D scenes can be formulated as sampling of the LF. In this scenario, a complete reconstruction of the 7D continuous function from its samples would be necessary to calculate and render any possible view of the scene. Such reconstruction should not be limited to some specific kind of scene and should also include information related to the geometry of the scene. The combination of image based and geometry based information in the representation of the LF is the ELF representation.
Current status of the project:
During the first year in Tampere University of Technology I focused most of my research in studying the scientific publications related to my project. The main topics of my literature survey were basically five: Lightfield, Capturing, Depth Estimation, Holography and Shearlet/Curvelets. This resulted in the creation of my personal “literature review” which represents the foundations on which my project is based.
Along with this, I attended the workshop: “Multi-Camera Image Processing for Media Productions” held at the premises of the Centre of Immersive Visual Technologies (CIVIT) by Frederik Zilly from Fraunhofer IIS. Moreover, I attended the three training school organized by the ETN-FPI in Newcastle upon Tyne, Valencia and Kiel.
On September 1st, I arrived in Kiel where I will perform my research until November at the Christian-Albrechts-University in collaboration with Raytrix GmbH and REALEYES GmbH.
Sergio has a Bachelor’s degree in Electronic Engineering (2012), and a Master’s degree in Information and Communication Technology Engineering (2016), both from University of Roma Tre, Italy. During his Master’s studies, Sergio was a visiting student at Tampere University of Technology, Finland.
Contact information:
Tampere University of Technology, Laboratory of Signal Processing
Mailing address:
P.O.Box 553, FI-33101 Tampere, Finland
Street address:
Korkeakoulunkatu 1, TE309, FI-33720 Tampere, Finland
E-mail: sergio.moreschini@tut.fi