Chair of
Multimedia Communications and Signal Processing
Prof. Dr.-Ing. André Kaup

Coding of Dynamic Light Fields

Field of activity: Video Signal Processing and Transmission
Research topic: Video Coding and Transmission
Staff: Dr.-Ing. Ulrich Fecker

Coding of Dynamic Light Fields

Three-dimensional objects with complex reflection of light (e. g. fur, fabrics or trees) can only be rendered inadequately using classical geometry-based models. For a light field, in contrast, numerous images of the same scene are recorded from different viewpoints by a camera system without the need to know the scene geometry. From the resulting data structure, arbitrary intermediate views of the object can be reconstructed.

While the recorded object does not change over time when a static light field is applied, a dynamic light field can be used to record moving objects. That way, flexible 3-D objects (e. g. a beating heart) can be viewed from different perspectives.

One decisive difficulty is the enormous amount of data in the order of several gigabytes which is produced when light fields are recorded. Thus, efficient source coding of the light field data is needed. Starting from the principles of classical video coding, concepts to code static light fields have already been devised. In this project, coding techniques for dynamic light fields shall be developed.

This work is funded by the Deutsche Forschungsgemeinschaft (DFG) as Project C8 of the Sonderforschungsbereich 603 (Collaborative Research Centre) "Model Based Analysis and Visualization of Complex Scenes and Sensor Data".

Results

Please see the German web pages for the results.

Publications

2009-13
CRIS
U. Fecker
   [bib]

Coding Techniques for Multi-View Video Signals, Dissertation
Erlanger Berichte aus Informations- und Kommunikationstechnik, Vol. 22, Shaker Verlag, Aachen, Germany, Mar. 2009
2008-22
CRIS
U. Fecker, J. Seiler, A. Kaup
   [doi]   [bib]

4-D Frequency Selective Extrapolation for Error Concealment in Multi-View Video
IEEE, 10th International Workshop on Multimedia Signal Processing (MMSP 2008), Pages: 267-272, Cairns, Australia, Oct. 2008
2008-4
CRIS
U. Fecker, M. Barkowsky, A. Kaup
   [bib]

Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video
IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT) Vol. 18, Num. 9, Pages: 1258-1267, Sep. 2008
2007-36
CRIS
U. Fecker, M. Barkowsky, A. Kaup
   [bib]

Time-Constant Histogram Matching for Luminance and Chrominance Compensation of Multi-View Video Sequences
Picture Coding Symposium (PCS), Lisbon, Portugal, Nov. 2007
2007-24
CRIS
U. Fecker, A. Kaup
   [bib]

Complexity Evaluation of Random Access to Coded Multi-View Video Data
Invited paper, Proc.15th European Signal Processing Conference (EUSIPCO 2007), Pages: 1-4, Poznan, Poland, Sep. 2007
2006-44
CRIS
A. Kaup, U. Fecker
   [bib]

Analysis of Multi-Reference Block Matching for Multi-View Video Coding
7th Workshop Digital Broadcasting, Pages: 33-39, Erlangen, Germany, Sep. 2006
2006-17
CRIS
U. Fecker, M. Barkowsky, A. Kaup
   [bib]

Improving the Prediction Efficiency for Multi-View Video Coding Using Histogram Matching
Picture Coding Symposium (PCS 2006), Beijing, China, Apr. 2006
2006-17
CRIS
U. Fecker, M. Barkowsky, A. Kaup
   [bib]

Improving the Prediction Efficiency for Multi-View Video Coding Using Histogram Matching
Picture Coding Symposium (PCS 2006), Beijing, China, Apr. 2006
2006-4
CRIS
U. Fecker, A. Guenegues, I. Scholz, A. Kaup
   [bib]

Depth Map Compression for Unstructured Lumigraph Rendering
Visual Communications and Image Processing (VCIP 2006), San Jose, CA, USA, Jan. 2006
2005-48
CRIS
U. Fecker, A. Kaup
   [bib]

Statistical Analysis of Multi-Reference Block Matching for Dynamic Light Field Coding
10th International Fall Workshop - Vision, Modeling, and Visualization (VMV), Pages: 445-452, Erlangen, Germany, Nov. 2005
2005-40 U. Fecker, M. Barkowsky, A. Kaup
   [bib]

Luminance and Chrominance Compensation for Multi-View Sequences Using Histogram Matching
ISO/IEC JTC1/SC29/WG11, Document MPEG2005/M12487, Nice, France, Oct. 2005
2005-33
CRIS
U. Fecker, A. Kaup
   [bib]

H.264/AVC-Compatible Coding of Dynamic Light Fields Using Transposed Picture Ordering
13th European Signal Processing Conference (EUSIPCO), Antalya, Turkey, Sep. 2005
2004-20 U. Fecker, A. Kaup
   [bib]

Transposed Picture Ordering for Dynamic Light Field Coding
ISO/IEC JTC1/SC29/WG11, Document MPEG2004/M10929, Redmond, WA, USA, Jul. 2004