Regensky, Andy
Andy Regensky, M. Sc.
Research
Since February 2020 I am dealing with the efficient compression of fisheye- and 360°-video data. Special focus is put on effective inter-prediction, where the current image is predicted based on already decoded, temporally preceding or following images. Previous methods for inter-prediction are designed for videos with perspective projection, which follow the pinhole camera model. The special projections of fisheye and 360° images, which can no longer be described by the pinhole camera model, lead to a significantly reduced efficiency of these methods. By incorporating the projection function into the process of inter-prediction, its effectiveness can be increased significantly. Thereby, the projection-based approach is not limited to inter-prediction and can potentially be applied to many other techniques in video coding and signal processing.
More information on the broad topic of next generation video communications at the chair can be found here: Next generation video communications
Theses Offered
I offer theses in the field of projection-based fisheye and 360° video coding at any time. Special attention is placed on sufficient experience with Python or C++ and basic knowledge of image and video signal processing. Of course, the required experience scales corresponding to previous study experience: Less experience is expected for a bachelor thesis than for a research internship or a master thesis. If you are interested, just send me an email with a short introduction of your interests and, if applicable, your previous experience in software development and image and video signal processing (e.g. lectures, internships, work experience, private projects).
Finished Theses
- Generation of 3D Models from 360° Images (2020)
- Coding of Distortion-Corrected Fisheye Video Sequences using H.266/VVC (2021)
- Development of a Projection-based Intra Prediction Method for Fisheye Images (2021)
- Improving Resampling in Viewport-Adaptive Fisheye Motion Compensation (2021)
- Sphärische Bewegungsmodelle für die Blockbasierte Bewegungskompensation von 360°-Video (2021)
- Investigation of a Rendering Pipeline for the Automatic Generation of Training Data for Checkerboard Segmentation (2022)
- An Overview of the State of the Art in 360-Degree Image and Video Stitching (2022)
- Comparison of the Resampling Quality for Non-Perspective Image Formats (2022)
- Referenzfreie Brennweitenschätzung für perspektivische Videosequenzen (2022)
- Aiding Learned Camera Calibration through Known Reference Patterns (2022)
- Development of a Viewport-Adaptive 360-Degree Image Resampling Technique (2022)
- Development of a Stitching Framework for a Quad-Fisheye 360-Degree Camera (2023)
- Projection-Aware End-to-End Learned Video Compression for 360-Degree Video (2023)
Awards
- : Luise Prell-Preis (Luise Prell Stiftung) – 2021
Teaching
Publications
2022
Fast Reconstruction of Three-Quarter Sampling Measurements Using Recurrent Local Joint Sparse Deconvolution and Extrapolation
In: IEEE Transactions on Circuits and Systems II: Express Briefs 69 (2022), p. 2398-2402
ISSN: 1057-7130
DOI: 10.1109/TCSII.2022.3160012
BibTeX: Download
, , , , :
2021
A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Toronto, 6. June 2021 - 11. June 2021)
DOI: 10.1109/ICASSP39728.2021.9413576
URL: https://arxiv.org/abs/2202.13892
BibTeX: Download
, , :
2020
Boosting Compressed Sensing Using Local Measurements and Sliding Window Reconstruction
In: IEEE Transactions on Image Processing 29 (2020), p. 7931 - 7944
ISSN: 1057-7149
DOI: 10.1109/TIP.2020.3007822
BibTeX: Download
, , , :
Real-Time Frequency Selective Reconstruction through Register-Based Argmax Calculation
IEEE International Workshop on Multimedia Signal Processing (MMSP) (Tampere, 21. September 2020 - 24. September 2020)
DOI: 10.1109/MMSP48831.2020.9287071
URL: https://arxiv.org/abs/2202.13926
BibTeX: Download
, , , :
FishUI: Interactive Fisheye Distortion Visualization
IEEE International Conference on Visual Communications and Image Processing (VCIP) (Macau, 1. December 2020 - 4. December 2020)
DOI: 10.1109/VCIP49819.2020.9301754
BibTeX: Download
, , :
2019
Probabilistic modeling for learning-based distance estimation
23rd International Congress on Acoustics (ICA) (Aachen)
BibTeX: Download
, , :