Two-step multi-spectral registration via key-point detector and gradient similarity. Application to agronomic scenes for proxy-sensing - Institut Agro Dijon
Communication Dans Un Congrès Année : 2020

Two-step multi-spectral registration via key-point detector and gradient similarity. Application to agronomic scenes for proxy-sensing

Jehan-Antoine Vayssade
Gawain Jones
Jean-Noël Paoli
Christelle Gée

Résumé

The potential of multi-spectral images is growing rapidly in precision agriculture, and is currently based on the use of multi-sensor cameras. However, their development usually concerns aerial applications and their parameters are optimized for high altitudes acquisition by drone (UAV ≈ 50 meters) to ensure surface coverage and reduce technical problems. With the recent emergence of terrestrial robots (UGV), their use is diverted for nearby agronomic applications. Making it possible to explore new agronomic applications, maximizing specific traits extraction (spectral index, shape, texture …) which requires high spatial resolution. The problem with these cameras is that all sensors are not aligned and the manufacturers’ methods are not suitable for close-field acquisition, resulting in offsets between spectral images and degrading the quality of extractable informations. We therefore need a solution to accurately align images in such condition. In this study we propose a two-steps method applied to the six-bands Airphen multi-sensor camera with (i) affine correction using pre-calibrated matrix at different heights, the closest transformation can be selected via internal GPS and (ii) perspective correction to refine the previous one, using key-points matching between enhanced gradients of each spectral bands. Nine types of key-point detection algorithms (ORB, GFTT, AGAST, FAST, AKAZE, KAZE, BRISK, SURF, MSER) with three different modalities of parameters were evaluated on their speed and performances, we also defined the best reference spectra on each of them. The results show that GFTT is the most suitable methods for key-point extraction using our enhanced gradients, and the best spectral reference was identified to be the band centered on 570 nm for this one. Without any treatment the initial error is about 62 px, with our method, the remaining residual error is less than 1 px, where the manufacturer’s involves distortions and loss of information with an estimated residual error of approximately 12 px
Fichier principal
Vignette du fichier
airphen-multispectral-registration-v16.pdf (1.07 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02499730 , version 1 (05-03-2020)

Identifiants

Citer

Jehan-Antoine Vayssade, Gawain Jones, Jean-Noël Paoli, Christelle Gée. Two-step multi-spectral registration via key-point detector and gradient similarity. Application to agronomic scenes for proxy-sensing. Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Feb 2020, La Valette, Malta. ⟨10.5220/0009169301030110⟩. ⟨hal-02499730⟩
234 Consultations
295 Téléchargements

Altmetric

Partager

More