Conference paper (in proceedings)

Towards dynamic SQL compilation in Apache Spark

  • 2020
Published in:
  • Companion Proceedings of the 4th International Conference on the Art, Science, and Engineering of Programming (<Programming’20> Companion), March 23–26, 2020, Porto, Portugal. - 2020, p. 4 p.
English Big-data systems have gained significant momentum, and Apache Spark is becoming a de-facto standard for modern data analytics. Spark relies on code generation to optimize the execution performance of SQL queries on a variety of data sources. Despite its already efficient runtime, Spark’s code generation suffers from significant runtime overheads related to data de-serialization during query execution. Such performance penalty can be significant, especially when applications operate on human-readable data formats such as CSV or JSON.
  • English
Computer science and technology
License undefined
Open access status
Persistent URL

Document views: 14 File downloads:
  • Schiavio_2020_ACM_Programming20.pdf: 16