Filtering Useless Data at the Source

Mostrar todas las versiones(2)

There are some processing environments where an application reads remote sequential files with a large number of records only to use some of them. Examples of those environments are servers, proxies, firewall and intrusion detection log analysis tools, sensor log analysis, large scientific datasets...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Pessolani, Pablo Andrés, Quaglia, Constanza, Nou, Ramón
Formato: Objeto de conferencia
Lenguaje:Inglés
Publicado: 2019
Materias:
Ciencias Informáticas
Logging
Network File System (NFS) protocol
NFS
Acceso en línea:http://sedici.unlp.edu.ar/handle/10915/90693
Aporte de:
SEDICI (UNLP) de Universidad Nacional de La Plata
id I19-R120-10915-90693
record_format dspace
institution Universidad Nacional de La Plata
institution_str I-19
repository_str R-120
collection SEDICI (UNLP)
language Inglés
topic Ciencias Informáticas
Logging
Network File System (NFS) protocol
NFS
spellingShingle Ciencias Informáticas
Logging
Network File System (NFS) protocol
NFS
Pessolani, Pablo Andrés
Quaglia, Constanza
Nou, Ramón
Filtering Useless Data at the Source
topic_facet Ciencias Informáticas
Logging
Network File System (NFS) protocol
NFS
description There are some processing environments where an application reads remote sequential files with a large number of records only to use some of them. Examples of those environments are servers, proxies, firewall and intrusion detection log analysis tools, sensor log analysis, large scientific datasets processing, etc. To be processed, all file records must be transferred through the network, and all of them must be processed by the application. Some of the transferred records would be discarded immediately by the application because it has no interest in them, but they just consumed network bandwidth and operating system’s cache buffers. This article proposes to filter records from the source of data but without changing the application. Those records of interest will be transferred without modifications but only references to the other records will be transferred from the source to the consuming application. At the application side, the sequence of records is rebuilt, keeping the content of records of interest and filling the others with dummy values which will be discarded by the application. As the number and length of records are preserved (and therefore the file size too), it is not necessary to modify the application. Once a filtering rule is applied to a file, only the useful records and references to unuseful ones will be transferred to the application side reducing network usage, transfer time, and cache utilization. A modified (but compatible) version of NFS protocol was developed as a proof of concept.
format Objeto de conferencia
Objeto de conferencia
author Pessolani, Pablo Andrés
Quaglia, Constanza
Nou, Ramón
author_facet Pessolani, Pablo Andrés
Quaglia, Constanza
Nou, Ramón
author_sort Pessolani, Pablo Andrés
title Filtering Useless Data at the Source
title_short Filtering Useless Data at the Source
title_full Filtering Useless Data at the Source
title_fullStr Filtering Useless Data at the Source
title_full_unstemmed Filtering Useless Data at the Source
title_sort filtering useless data at the source
publishDate 2019
url http://sedici.unlp.edu.ar/handle/10915/90693
work_keys_str_mv AT pessolanipabloandres filteringuselessdataatthesource
AT quagliaconstanza filteringuselessdataatthesource
AT nouramon filteringuselessdataatthesource
bdutipo_str Repositorios
_version_ 1764820490313007104

Ejemplares similares