Loading…
Friday, November 13 • 3:15pm - 3:45pm
Optimizing Latency-Sensitive Queries for Presto at Facebook

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
For many latency-sensitive SQL workloads, Presto is often bound by retrieving distant data. In this talk, Rohit Jain, James Sun from Facebook and Bin Fan from Alluxio will introduce their teams’ collaboration on adding a local on-SSD Alluxio cache inside Presto workers to improve unsatisfied Presto latency. This talk will focus on: -Insights of the Presto workloads at Facebook w.r.t. cache effectiveness -API and internals of the Alluxio local cache, from design trade-offs (e.g. caching granularity, concurrency level and etc) to performance optimizations. -Initial performance analysis and timeline to deliver this feature for general Presto users. -Discussion on our future work to optimize cache performance with deeper integration with Presto

Speakers
avatar for Rohit Jain

Rohit Jain

Software Engineer, Facebook
Technologist. Specializes in building large scale distributed systems. Loves solving real-world complex problems. 
avatar for Bin Fan

Bin Fan

Alluxio
Bin Fan is VP of open source at Alluxio and the PMC maintainer of Alluxio open source. Prior to joining Alluxio as a founding engineer, he worked for Google to build the next-generation storage infrastructure. Bin received his Ph.D. in computer science from Carnegie Mellon University... Read More →


Friday November 13, 2020 3:15pm - 3:45pm PST
cloud