Image matching is the core of many computer vision applications for cultural heritage. The standard image matching pipeline detects keypoints at the beginning and freezes them until bundle adjustment, by which keypoints are allowed to move in order to improve the overall scene estimation. Recent deep image matching approaches do not follow this scheme, historically imposed by computational limits, and progressively refine the localization of the matches in a coarse-to-fine manner. This paper investigates the use of traditional computer vision approaches based on template matching to update the keypoint position throughout the whole matching pipeline. In order to improve the accuracy of the template matching, the usage of the coarse-to-fine refinement is explored and a novel normalization strategy for the local keypoint patches is designed. Specifically, the proposed patch normalization assumes a local piece-wise planar approximation of the scene and warps the corresponding patches according to a “middle homography”, so that, after normalization, patch distortion is roughly equally distributed within the two original patches. The experimental comparison of the considered approaches, mainly focused on cultural heritage scenes but straightforwardly generalizable to other common scenarios, shows the strengths and limitations of each evaluated method. This analysis indicates promising and interesting results for the investigated approaches, which can effectively be deployed to design better image matching solutions

Bellavia, F., Morelli, L., Colombo, C., Remondino, F. (2024). Progressive Keypoint Localization and Refinement in Image Matching. In G.L. Foresti, A. Fusiello, E. Hancock (a cura di), Image Analysis and Processing - ICIAP 2023 Workshops Udine, Italy, September 11–15, 2023, Proceedings, Part II (pp. 322-334). Springer [10.1007/978-3-031-51026-7_28].

Progressive Keypoint Localization and Refinement in Image Matching

Bellavia, Fabio
;
2024-01-21

Abstract

Image matching is the core of many computer vision applications for cultural heritage. The standard image matching pipeline detects keypoints at the beginning and freezes them until bundle adjustment, by which keypoints are allowed to move in order to improve the overall scene estimation. Recent deep image matching approaches do not follow this scheme, historically imposed by computational limits, and progressively refine the localization of the matches in a coarse-to-fine manner. This paper investigates the use of traditional computer vision approaches based on template matching to update the keypoint position throughout the whole matching pipeline. In order to improve the accuracy of the template matching, the usage of the coarse-to-fine refinement is explored and a novel normalization strategy for the local keypoint patches is designed. Specifically, the proposed patch normalization assumes a local piece-wise planar approximation of the scene and warps the corresponding patches according to a “middle homography”, so that, after normalization, patch distortion is roughly equally distributed within the two original patches. The experimental comparison of the considered approaches, mainly focused on cultural heritage scenes but straightforwardly generalizable to other common scenarios, shows the strengths and limitations of each evaluated method. This analysis indicates promising and interesting results for the investigated approaches, which can effectively be deployed to design better image matching solutions
21-gen-2024
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi Di Elaborazione Delle Informazioni
978-3-031-51025-0
978-3-031-51026-7
Bellavia, F., Morelli, L., Colombo, C., Remondino, F. (2024). Progressive Keypoint Localization and Refinement in Image Matching. In G.L. Foresti, A. Fusiello, E. Hancock (a cura di), Image Analysis and Processing - ICIAP 2023 Workshops Udine, Italy, September 11–15, 2023, Proceedings, Part II (pp. 322-334). Springer [10.1007/978-3-031-51026-7_28].
File in questo prodotto:
File Dimensione Formato  
FAPER2023.pdf

Solo gestori archvio

Tipologia: Versione Editoriale
Dimensione 1.82 MB
Formato Adobe PDF
1.82 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
paper.pdf

accesso aperto

Tipologia: Pre-print
Dimensione 1.25 MB
Formato Adobe PDF
1.25 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/622555
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact