Reuse-based optimization for pig Latin

Jesús Camacho-Rodríguez; Dario Colazzo; Melanie Herschel; Ioana Manolescu; Soudip Roy Chowdhury

doi:10.1145/2983323.2983669

Reuse-based optimization for pig Latin

Jesús Camacho-Rodríguez
, Dario Colazzo
, Melanie Herschel
, Ioana Manolescu
, Soudip Roy Chowdhury

Hortonworks
Université Paris Dauphine
University of Suttgart
Fractal Analytics

Résultats de recherche: Le chapitre dans un livre, un rapport, une anthologie ou une collection › Contribution à une conférence › Revue par des pairs

Résumé

Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

langue originale	Anglais
titre	CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management
Editeur	Association for Computing Machinery
Pages	2215-2220
Nombre de pages	6
ISBN (Electronique)	9781450340731
Les DOIs	https://doi.org/10.1145/2983323.2983669
état	Publié - 24 oct. 2016
Evénement	25th ACM International Conference on Information and Knowledge Management, CIKM 2016 - Indianapolis, États-Unis Durée: 24 oct. 2016 → 28 oct. 2016

Série de publications

Nom	International Conference on Information and Knowledge Management, Proceedings
Volume	24-28-October-2016

Une conférence

Une conférence	25th ACM International Conference on Information and Knowledge Management, CIKM 2016
Pays/Territoire	États-Unis
La ville	Indianapolis
période	24/10/16 → 28/10/16

Accès au document

10.1145/2983323.2983669

Autres fichiers et liens

Lien vers la publication dans Scopus

Contient cette citation

Camacho-Rodríguez, J., Colazzo, D., Herschel, M., Manolescu, I., & Chowdhury, S. R. (2016). Reuse-based optimization for pig Latin. Dans CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management (p. 2215-2220). (International Conference on Information and Knowledge Management, Proceedings; Vol 24-28-October-2016). Association for Computing Machinery. https://doi.org/10.1145/2983323.2983669

@inproceedings{2f7dc7e2437a47ea90d1353586f26dc3,

title = "Reuse-based optimization for pig Latin",

abstract = "Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.",

keywords = "Linear programming, PigLatin, Reuse-based optimization",

author = "Jes{\'u}s Camacho-Rodr{\'i}guez and Dario Colazzo and Melanie Herschel and Ioana Manolescu and Chowdhury, \{Soudip Roy\}",

note = "Publisher Copyright: {\textcopyright} 2016 ACM.; 25th ACM International Conference on Information and Knowledge Management, CIKM 2016 ; Conference date: 24-10-2016 Through 28-10-2016",

year = "2016",

month = oct,

day = "24",

doi = "10.1145/2983323.2983669",

language = "English",

series = "International Conference on Information and Knowledge Management, Proceedings",

publisher = "Association for Computing Machinery",

pages = "2215--2220",

booktitle = "CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management",

}

Camacho-Rodríguez, J, Colazzo, D, Herschel, M, Manolescu, I & Chowdhury, SR 2016, Reuse-based optimization for pig Latin. Dans CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. International Conference on Information and Knowledge Management, Proceedings, VOL. 24-28-October-2016, Association for Computing Machinery, p. 2215-2220, 25th ACM International Conference on Information and Knowledge Management, CIKM 2016, Indianapolis, États-Unis, 24/10/16. https://doi.org/10.1145/2983323.2983669

Reuse-based optimization for pig Latin. / Camacho-Rodríguez, Jesús; Colazzo, Dario; Herschel, Melanie et al.
CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. Association for Computing Machinery, 2016. p. 2215-2220 (International Conference on Information and Knowledge Management, Proceedings; Vol 24-28-October-2016).

Résultats de recherche: Le chapitre dans un livre, un rapport, une anthologie ou une collection › Contribution à une conférence › Revue par des pairs

TY - GEN

T1 - Reuse-based optimization for pig Latin

AU - Camacho-Rodríguez, Jesús

AU - Colazzo, Dario

AU - Herschel, Melanie

AU - Manolescu, Ioana

AU - Chowdhury, Soudip Roy

PY - 2016/10/24

Y1 - 2016/10/24

N2 - Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

AB - Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

KW - Linear programming

KW - PigLatin

KW - Reuse-based optimization

UR - https://www.scopus.com/pages/publications/84996593452

U2 - 10.1145/2983323.2983669

DO - 10.1145/2983323.2983669

M3 - Conference contribution

AN - SCOPUS:84996593452

T3 - International Conference on Information and Knowledge Management, Proceedings

SP - 2215

EP - 2220

BT - CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management

PB - Association for Computing Machinery

T2 - 25th ACM International Conference on Information and Knowledge Management, CIKM 2016

Y2 - 24 October 2016 through 28 October 2016

ER -

Camacho-Rodríguez J, Colazzo D, Herschel M, Manolescu I, Chowdhury SR. Reuse-based optimization for pig Latin. Dans CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. Association for Computing Machinery. 2016. p. 2215-2220. (International Conference on Information and Knowledge Management, Proceedings). doi: 10.1145/2983323.2983669

Reuse-based optimization for pig Latin

Résumé

Série de publications

Une conférence

Accès au document

Autres fichiers et liens

Empreinte digitale

Contient cette citation