Chair of
Multimedia Communications and Signal Processing
Prof. Dr.-Ing. André Kaup

Coding and Processing of Non-Rectilinear Image and Video Data

Field of activity: Video Signal Processing and Transmission
Research topic: Video Coding and Transmission
Staff: Dipl.-Ing. Andrea Eichenseer

This research topic deals with the efficient coding and signal processing of image and video material captured with extreme optics (e.g., ultra wide-angle lenses).

More specifically, the radial distortions as they appear in imagery captured with fisheye cameras shall be investigated with regard to their effect on the coding efficiency of conventional hybrid video codecs. Video codecs such as the widely-used standard H.264/AVC as well as its successor H.265/HEVC are designed for image and video material that exhibits rectilinear characteristics, i.e., straight lines are depicted as such. Furthermore, the employed motion estimation and compensation only consider purely translational motion which has adverse effects on the coding of radially distorted imagery. Therefore, methods for compensating such radial distortions shall be developed and analyzed for both intra-frame and inter-frame prediction. Further topics of interest include algorithms for error concealment, super-resolution, etc., which also benefit from an adaptation to the fisheye characteristics.

The sequences created and captured in the course of this research topic have been collected and published as a data set, available for download at http://www.lms.lnt.de/fisheyedataset/.

Example of a Fisheye image of lecture hall H6:

Beispiel Fischauge

This project is partly supported by the German Research Foundation (DFG) as Research Area A.3 of the Research Training Group GRK-1773 "Heterogeneous Image Systems".

Publications

2017-31
CRIS
A. Eichenseer, M. Bätz, A. Kaup
   [bib]

Disparity Estimation for Fisheye Images with an Application to Intermediate View Synthesis
accepted for IEEE International Workshop on Multimedia Signal Processing (MMSP), London-Luton, UK, Oct. 2017
2016-28
CRIS
M. Bätz, A. Eichenseer, A. Kaup
   [doi]   [bib]

Multi-Image Super-Resolution for Fisheye Video Sequences Using Subpixel Motion Estimation Based on Calibrated Re-Projection
European Signal Processing Conf. (EUSIPCO), Pages: 1872 - 1876, Budapest, Hungary, Aug. 2016
2016-22
CRIS
A. Eichenseer, M. Bätz, A. Kaup
   [link]   [doi]   [bib]

Motion Estimation for Fisheye Video Sequences Combining Perspective Projection with Camera Calibration Information
IEEE Int. Conf. on Image Processing (ICIP), Pages: 4493-4497, Phoenix, AZ, USA, Sep. 2016
2016-5
CRIS
A. Eichenseer, A. Kaup
   [link]   [doi]   [bib]

A Data Set Providing Synthetic and Real-World Fisheye Video Sequences
IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Pages: 1541-1545, Shanghai, China, Mar. 2016
2015-24
CRIS
A. Eichenseer, J. Seiler, M. Bätz, A. Kaup
   [link]   [doi]   [bib]

Temporal Error Concealment for Fisheye Video Sequences Based on Equisolid Re-Projection
European Signal Processing Conf. (EUSIPCO), Pages: 1611-1615, Nice, France, Sep. 2015
2015-22
CRIS
A. Eichenseer, M. Bätz, J. Seiler, A. Kaup
   [link]   [doi]   [bib]

A Hybrid Motion Estimation Technique for Fisheye Video Sequences Based on Equisolid Re-Projection
IEEE Int. Conf. on Image Processing (ICIP), Pages: 3565-3569, Québec City, Canada, Sep. 2015
2014-27
CRIS
A. Eichenseer, A. Kaup
   [link]   [doi]   [bib]

Coding of Distortion-Corrected Fisheye Video Sequences Using H.265/HEVC
IEEE Int. Conf. on Image Processing (ICIP), Pages: 4132-4136, Paris, France, Oct. 2014