Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool

In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Monge, David A., García Garino, Carlos
Formato: Objeto de conferencia
Lenguaje:Inglés
Publicado: 2010
Materias:
Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
Acceso en línea:http://sedici.unlp.edu.ar/handle/10915/152727
http://39jaiio.sadio.org.ar/sites/default/files/39jaiio-hpc-09.pdf
Aporte de:
SEDICI (UNLP) de Universidad Nacional de La Plata
id I19-R120-10915-152727
record_format dspace
spelling I19-R120-10915-1527272023-05-10T20:03:03Z http://sedici.unlp.edu.ar/handle/10915/152727 http://39jaiio.sadio.org.ar/sites/default/files/39jaiio-hpc-09.pdf issn:1851-9326 Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool Monge, David A. García Garino, Carlos 2010 2010 2023-05-10T16:44:06Z en Ciencias Informáticas Workflow Scheduling DAGMan Performance Optimization In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach. Sociedad Argentina de Informática e Investigación Operativa Objeto de conferencia Objeto de conferencia http://creativecommons.org/licenses/by-nc-sa/4.0/ Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) application/pdf 3271-3285
institution Universidad Nacional de La Plata
institution_str I-19
repository_str R-120
collection SEDICI (UNLP)
language Inglés
topic Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
spellingShingle Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
Monge, David A.
García Garino, Carlos
Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
topic_facet Ciencias Informáticas
Workflow
Scheduling
DAGMan
Performance
Optimization
description In several scientific and business environments, the magnitude of problems require the execution of complex applications, like work-flows. Condor includes DAGMan extension in order to manage workflows. Such kind of applications are very popular because jobs can be reused and distributed. Scheduling is a central issue in the assignation of resources to workflows. It can be seen as the process of assigning the resources to the workflow's jobs in a convenient way. This work presents a performance-driven approach to make these assignments (also known as mappings). The mappings generated determine in which resources the jobs must be executed. The execution stage is delegated to the DAGMan Workflow System. This approach is compared with the standalone execution of the workflow over DAGMan. Experimental results show that the performance-driven approach improves the execution time of workflows in comparison with the standalone DAGMan approach.
format Objeto de conferencia
Objeto de conferencia
author Monge, David A.
García Garino, Carlos
author_facet Monge, David A.
García Garino, Carlos
author_sort Monge, David A.
title Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_short Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_full Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_fullStr Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_full_unstemmed Improving Workflows Execution on DAGMan by a Perfomance-driven Scheduling Tool
title_sort improving workflows execution on dagman by a perfomance-driven scheduling tool
publishDate 2010
url http://sedici.unlp.edu.ar/handle/10915/152727
http://39jaiio.sadio.org.ar/sites/default/files/39jaiio-hpc-09.pdf
work_keys_str_mv AT mongedavida improvingworkflowsexecutionondagmanbyaperfomancedrivenschedulingtool
AT garciagarinocarlos improvingworkflowsexecutionondagmanbyaperfomancedrivenschedulingtool
_version_ 1765660141794885632

Ejemplares similares