This paper presents a new online preprocessing strategy to detect and discard ongoing bad frames in video sequences. These include frames where an accurate localization between corresponding points is difficult, such as for blurred frames, or which do not provide relevant information with respect to the previous frames in terms of texture, image contrast and non-flat areas. Unlike keyframe selectors and deblurring methods, the proposed approach is a fast preprocessing working on a simple gradient statistic, that does not require to compute complex time-consuming image processing, such as the computation of image feature keypoints, previous poses and 3D structure, or to know a priori the input sequence. The presented method provides a fast and useful frame pre-analysis which can be used to improve further image analysis tasks, including also the keyframe selection or the blur detection, or to directly filter the video sequence as shown in the paper, improving the final 3D reconstruction by discarding noisy frames and decreasing the final computation time by removing some redundant frames. This scheme is adaptive, fast and works at runtime by exploiting the image gradient statistic of the last few frames of the video sequence. Experimental results show that the proposed frame selection strategy is robust and improves the final 3D reconstruction both in terms of number of obtained 3D points and reprojection error, also reducing the computational time.

Bellavia F., Fanfani M., Colombo C. (2015). Fast adaptive frame preprocessing for 3D reconstruction. In J. Braz, S. Battiato, F. Imai (a cura di), Proceedings of the 10th International Conference on Computer Vision Theory and Applications (pp. 260-267). SciTePress [10.5220/0005272702600267].

Fast adaptive frame preprocessing for 3D reconstruction

Bellavia F.;
2015-01-01

Abstract

This paper presents a new online preprocessing strategy to detect and discard ongoing bad frames in video sequences. These include frames where an accurate localization between corresponding points is difficult, such as for blurred frames, or which do not provide relevant information with respect to the previous frames in terms of texture, image contrast and non-flat areas. Unlike keyframe selectors and deblurring methods, the proposed approach is a fast preprocessing working on a simple gradient statistic, that does not require to compute complex time-consuming image processing, such as the computation of image feature keypoints, previous poses and 3D structure, or to know a priori the input sequence. The presented method provides a fast and useful frame pre-analysis which can be used to improve further image analysis tasks, including also the keyframe selection or the blur detection, or to directly filter the video sequence as shown in the paper, improving the final 3D reconstruction by discarding noisy frames and decreasing the final computation time by removing some redundant frames. This scheme is adaptive, fast and works at runtime by exploiting the image gradient statistic of the last few frames of the video sequence. Experimental results show that the proposed frame selection strategy is robust and improves the final 3D reconstruction both in terms of number of obtained 3D points and reprojection error, also reducing the computational time.
2015
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi Di Elaborazione Delle Informazioni
978-989-758-091-8
Bellavia F., Fanfani M., Colombo C. (2015). Fast adaptive frame preprocessing for 3D reconstruction. In J. Braz, S. Battiato, F. Imai (a cura di), Proceedings of the 10th International Conference on Computer Vision Theory and Applications (pp. 260-267). SciTePress [10.5220/0005272702600267].
File in questo prodotto:
File Dimensione Formato  
VISAPP_2015_90.pdf

accesso aperto

Tipologia: Versione Editoriale
Dimensione 386.58 kB
Formato Adobe PDF
386.58 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/385525
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? ND
social impact