Loading…
Back To Schedule
Friday, November 13 • 3:15pm - 3:45pm
Optimizing Latency-Sensitive Queries for Presto at Facebook

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
For many latency-sensitive SQL workloads, Presto is often bound by retrieving distant data. In this talk, Rohit Jain, James Sun from Facebook and Bin Fan from Alluxio will introduce their teams’ collaboration on adding a local on-SSD Alluxio cache inside Presto workers to improve unsatisfied Presto latency. This talk will focus on: -Insights of the Presto workloads at Facebook w.r.t. cache effectiveness -API and internals of the Alluxio local cache, from design trade-offs (e.g. caching granularity, concurrency level and etc) to performance optimizations. -Initial performance analysis and timeline to deliver this feature for general Presto users. -Discussion on our future work to optimize cache performance with deeper integration with Presto

Speakers
avatar for Rohit Jain

Rohit Jain

Software Engineer, Facebook
Technologist. Specializes in building large scale distributed systems. Loves solving real-world complex problems. 
avatar for Bin Fan

Bin Fan

VP of Open Source, Founding Engineer, Alluxio, Inc.
Bin Fan is the founding member of Alluxio Inc and the PMC member of Alluxio open source project. Prior to Alluxio, he worked for Google to build the next-generation storage infrastructure and won Google’s Technical Infrastructure award. Bin got his Ph.D. in Computer Science from... Read More →


Friday November 13, 2020 3:15pm - 3:45pm PST
cloud