Reuse-based optimization for pig Latin

Jesús Camacho-Rodríguez; Dario Colazzo; Melanie Herschel; Ioana Manolescu; Soudip Roy Chowdhury

doi:10.1145/2983323.2983669

Reuse-based optimization for pig Latin

Jesús Camacho-Rodríguez
, Dario Colazzo
, Melanie Herschel
, Ioana Manolescu
, Soudip Roy Chowdhury

Hortonworks
Université Paris Dauphine
University of Suttgart
Fractal Analytics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

Original language	English
Title of host publication	CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management
Publisher	Association for Computing Machinery
Pages	2215-2220
Number of pages	6
ISBN (Electronic)	9781450340731
DOIs	https://doi.org/10.1145/2983323.2983669
Publication status	Published - 24 Oct 2016
Event	25th ACM International Conference on Information and Knowledge Management, CIKM 2016 - Indianapolis, United States Duration: 24 Oct 2016 → 28 Oct 2016

Publication series

Name	International Conference on Information and Knowledge Management, Proceedings
Volume	24-28-October-2016

Conference

Conference	25th ACM International Conference on Information and Knowledge Management, CIKM 2016
Country/Territory	United States
City	Indianapolis
Period	24/10/16 → 28/10/16

Keywords

Linear programming
PigLatin
Reuse-based optimization

Access to Document

10.1145/2983323.2983669

Cite this

Camacho-Rodríguez, J., Colazzo, D., Herschel, M., Manolescu, I., & Chowdhury, S. R. (2016). Reuse-based optimization for pig Latin. In CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management (pp. 2215-2220). (International Conference on Information and Knowledge Management, Proceedings; Vol. 24-28-October-2016). Association for Computing Machinery. https://doi.org/10.1145/2983323.2983669

@inproceedings{2f7dc7e2437a47ea90d1353586f26dc3,

title = "Reuse-based optimization for pig Latin",

abstract = "Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.",

keywords = "Linear programming, PigLatin, Reuse-based optimization",

author = "Jes{\'u}s Camacho-Rodr{\'i}guez and Dario Colazzo and Melanie Herschel and Ioana Manolescu and Chowdhury, \{Soudip Roy\}",

note = "Publisher Copyright: {\textcopyright} 2016 ACM.; 25th ACM International Conference on Information and Knowledge Management, CIKM 2016 ; Conference date: 24-10-2016 Through 28-10-2016",

year = "2016",

month = oct,

day = "24",

doi = "10.1145/2983323.2983669",

language = "English",

series = "International Conference on Information and Knowledge Management, Proceedings",

publisher = "Association for Computing Machinery",

pages = "2215--2220",

booktitle = "CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management",

}

Camacho-Rodríguez, J, Colazzo, D, Herschel, M, Manolescu, I & Chowdhury, SR 2016, Reuse-based optimization for pig Latin. in CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. International Conference on Information and Knowledge Management, Proceedings, vol. 24-28-October-2016, Association for Computing Machinery, pp. 2215-2220, 25th ACM International Conference on Information and Knowledge Management, CIKM 2016, Indianapolis, United States, 24/10/16. https://doi.org/10.1145/2983323.2983669

Reuse-based optimization for pig Latin. / Camacho-Rodríguez, Jesús; Colazzo, Dario; Herschel, Melanie et al.
CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. Association for Computing Machinery, 2016. p. 2215-2220 (International Conference on Information and Knowledge Management, Proceedings; Vol. 24-28-October-2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Reuse-based optimization for pig Latin

AU - Camacho-Rodríguez, Jesús

AU - Colazzo, Dario

AU - Herschel, Melanie

AU - Manolescu, Ioana

AU - Chowdhury, Soudip Roy

PY - 2016/10/24

Y1 - 2016/10/24

N2 - Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

AB - Pig Latin is a popular language which is widely used for parallel processing of massive data sets. Currently, subexpressions occurring repeatedly in Pig Latin scripts are executed as many times as they appear, and the current Pig Latin optimizer does not identify reuse opportunities. We present a novel optimization approach aiming at identifying and reusing repeated subexpressions in Pig Latin scripts. Our optimization algorithm, named PigReuse, identifies subexpression merging opportunities, selects the best ones to execute based on a cost function, and reuses their results as needed in order to compute exactly the same output as the original scripts. Our experiments demonstrate the effectiveness of our approach.

KW - Linear programming

KW - PigLatin

KW - Reuse-based optimization

UR - https://www.scopus.com/pages/publications/84996593452

U2 - 10.1145/2983323.2983669

DO - 10.1145/2983323.2983669

M3 - Conference contribution

AN - SCOPUS:84996593452

T3 - International Conference on Information and Knowledge Management, Proceedings

SP - 2215

EP - 2220

BT - CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management

PB - Association for Computing Machinery

T2 - 25th ACM International Conference on Information and Knowledge Management, CIKM 2016

Y2 - 24 October 2016 through 28 October 2016

ER -

Camacho-Rodríguez J, Colazzo D, Herschel M, Manolescu I, Chowdhury SR. Reuse-based optimization for pig Latin. In CIKM 2016 - Proceedings of the 2016 ACM Conference on Information and Knowledge Management. Association for Computing Machinery. 2016. p. 2215-2220. (International Conference on Information and Knowledge Management, Proceedings). doi: 10.1145/2983323.2983669

Reuse-based optimization for pig Latin

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this