Data quality in a big data context: about Twitter’s data quality

"In each of the phases of a Big Data analysis process, Data Quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods, based on quality dimensions and metrics, must be adapted and extended, in order to capture the new characteristics tha...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autor principal: Arolfo, Franco A.
Otros Autores: Vaisman, Alejandro Ariel
Formato: Proyecto final de Grado
Lenguaje:Inglés
Publicado: 2018
Materias:
CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
Acceso en línea:http://ri.itba.edu.ar/handle/123456789/1172
Aporte de:
Repositorio Institucional Instituto Tecnológico de Buenos Aires (ITBA) de Instituto Tecnológico de Buenos Aires (ITBA)
id I32-R138-123456789-1172
record_format dspace
spelling I32-R138-123456789-11722022-12-07T14:30:37Z Data quality in a big data context: about Twitter’s data quality Arolfo, Franco A. Vaisman, Alejandro Ariel CALIDAD DE DATOS ANALISIS DE DATOS REDES SOCIALES "In each of the phases of a Big Data analysis process, Data Quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods, based on quality dimensions and metrics, must be adapted and extended, in order to capture the new characteristics that Big Data introduces. This paper dives into this problem, re-defining the DQ dimensions and metrics for a Big Data scenario, where the data arrives, in this particular case, as unstructured documents in real time, such as JSON objects. This general scenario is instantiated to study the concrete case of Twitter feeds. Further, the paper also describes the implementation of a system that acquires tweets in real time, and computes the quality of each tweet, applying the quality metrics that are defined formally in the paper. The implementation includes a web user interface that allows filtering the tweets, for example, by keywords, and visualizing the quality of a data stream in many different ways. Experiments are performed and their results discussed." Proyecto final Ingeniería Informática (grado) - Instituto Tecnológico de Buenos Aires, Buenos Aires, 2018 2018-05-04T18:22:30Z 2018-05-04T18:22:30Z 2018 Proyecto final de Grado http://ri.itba.edu.ar/handle/123456789/1172 en application/pdf
institution Instituto Tecnológico de Buenos Aires (ITBA)
institution_str I-32
repository_str R-138
collection Repositorio Institucional Instituto Tecnológico de Buenos Aires (ITBA)
language Inglés
topic CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
spellingShingle CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
Arolfo, Franco A.
Data quality in a big data context: about Twitter’s data quality
topic_facet CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
description "In each of the phases of a Big Data analysis process, Data Quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods, based on quality dimensions and metrics, must be adapted and extended, in order to capture the new characteristics that Big Data introduces. This paper dives into this problem, re-defining the DQ dimensions and metrics for a Big Data scenario, where the data arrives, in this particular case, as unstructured documents in real time, such as JSON objects. This general scenario is instantiated to study the concrete case of Twitter feeds. Further, the paper also describes the implementation of a system that acquires tweets in real time, and computes the quality of each tweet, applying the quality metrics that are defined formally in the paper. The implementation includes a web user interface that allows filtering the tweets, for example, by keywords, and visualizing the quality of a data stream in many different ways. Experiments are performed and their results discussed."
author2 Vaisman, Alejandro Ariel
author_facet Vaisman, Alejandro Ariel
Arolfo, Franco A.
format Proyecto final de Grado
author Arolfo, Franco A.
author_sort Arolfo, Franco A.
title Data quality in a big data context: about Twitter’s data quality
title_short Data quality in a big data context: about Twitter’s data quality
title_full Data quality in a big data context: about Twitter’s data quality
title_fullStr Data quality in a big data context: about Twitter’s data quality
title_full_unstemmed Data quality in a big data context: about Twitter’s data quality
title_sort data quality in a big data context: about twitter’s data quality
publishDate 2018
url http://ri.itba.edu.ar/handle/123456789/1172
work_keys_str_mv AT arolfofrancoa dataqualityinabigdatacontextabouttwittersdataquality
_version_ 1765660706982592512

Ejemplares similares