ETL for the integration of remote sensing data

Modern in-orbit satellites and other available remote sensing tools have generated a huge availability of public data waiting to be exploited in different formats hosted on different servers. In this context, ETL formalism becomes relevant for the integration and analysis of the combined information...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Romero Jure, Paula Verónica, Cabral, Juan Bautista, Masuelli, Sergio
Formato: Objeto de conferencia
Lenguaje:Inglés
Publicado: 2023
Materias:
ETL
Acceso en línea:http://sedici.unlp.edu.ar/handle/10915/165724
Aporte de:
id I19-R120-10915-165724
record_format dspace
spelling I19-R120-10915-1657242024-05-07T20:05:12Z http://sedici.unlp.edu.ar/handle/10915/165724 ETL for the integration of remote sensing data Romero Jure, Paula Verónica Cabral, Juan Bautista Masuelli, Sergio 2023-09 2023 2024-05-07T17:45:12Z en Ciencias Informáticas ETL Satellite Imagery Data Processing Modern in-orbit satellites and other available remote sensing tools have generated a huge availability of public data waiting to be exploited in different formats hosted on different servers. In this context, ETL formalism becomes relevant for the integration and analysis of the combined information from all these sources. Throughout this work, we present the theoretical and practical foundations to build a modular analysis infrastructure that allows the creation of ETLs to download, transform and integrate data coming from different instruments in different formats. Part of this work is already implemented in a Python library which is intended to be integrated into already available workflow management tools based on acyclic-directed graphs which also have different adapters to impact the combined data in different warehouses. Los satélites modernos que están en órbita y otras herramientas de teledetección disponibles han generado una enorme disponibilidad de datos públicos a la espera de ser explotados, los cuales están alojados en diferentes servidores y en distintos formatos. En este contexto, el formalismo ETL  (Extracción, Transformación y Carga, por sus siglas en inglés) cobra relevancia para la integración y análisis de la información combinada de todas estas fuentes. A lo largo de este trabajo se presentan los fundamentos teóricos y prácticos para construir una infraestructura de análisis modular que permita la creación de ETLs para descargar, transformar e integrar datos procedentes de diferentes instrumentos en distintos formatos. Parte de este trabajo ya está implementado en una librería Python que se pretende integrar en herramientas de gestión de flujos de trabajo ya disponibles basadas en grafos acíclicos-dirigidos que también disponen de diferentes adaptadores para impactar los datos combinados en diferentes warehouses. Sociedad Argentina de Informática e Investigación Operativa Objeto de conferencia Objeto de conferencia http://creativecommons.org/licenses/by-nc-sa/4.0/ Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) application/pdf
institution Universidad Nacional de La Plata
institution_str I-19
repository_str R-120
collection SEDICI (UNLP)
language Inglés
topic Ciencias Informáticas
ETL
Satellite Imagery
Data Processing
spellingShingle Ciencias Informáticas
ETL
Satellite Imagery
Data Processing
Romero Jure, Paula Verónica
Cabral, Juan Bautista
Masuelli, Sergio
ETL for the integration of remote sensing data
topic_facet Ciencias Informáticas
ETL
Satellite Imagery
Data Processing
description Modern in-orbit satellites and other available remote sensing tools have generated a huge availability of public data waiting to be exploited in different formats hosted on different servers. In this context, ETL formalism becomes relevant for the integration and analysis of the combined information from all these sources. Throughout this work, we present the theoretical and practical foundations to build a modular analysis infrastructure that allows the creation of ETLs to download, transform and integrate data coming from different instruments in different formats. Part of this work is already implemented in a Python library which is intended to be integrated into already available workflow management tools based on acyclic-directed graphs which also have different adapters to impact the combined data in different warehouses.
format Objeto de conferencia
Objeto de conferencia
author Romero Jure, Paula Verónica
Cabral, Juan Bautista
Masuelli, Sergio
author_facet Romero Jure, Paula Verónica
Cabral, Juan Bautista
Masuelli, Sergio
author_sort Romero Jure, Paula Verónica
title ETL for the integration of remote sensing data
title_short ETL for the integration of remote sensing data
title_full ETL for the integration of remote sensing data
title_fullStr ETL for the integration of remote sensing data
title_full_unstemmed ETL for the integration of remote sensing data
title_sort etl for the integration of remote sensing data
publishDate 2023
url http://sedici.unlp.edu.ar/handle/10915/165724
work_keys_str_mv AT romerojurepaulaveronica etlfortheintegrationofremotesensingdata
AT cabraljuanbautista etlfortheintegrationofremotesensingdata
AT masuellisergio etlfortheintegrationofremotesensingdata
_version_ 1807223034150387712