Scale By the Bay 2020

Python is the dominant language for data science today with a plethora of machine learning and scientific computing libraries. Scala, on the other hand, is the dominant language for big data processing. What if we could bring these two worlds together? ScalaPy enables Scala applications to use Python libraries with a seamless interop layer. With support for core Python features including native bindings, ScalaPy can be used anywhere from training neural networks on GPUs with TensorFlow to making astronomical calculations with Astropy. In addition, ScalaPy supports creating type definitions to enable type-safe interactions with Python libraries. In this talk, we’ll explore how ScalaPy works and how it can be used in different applications. We’ll also look at support in environments like Jupyter notebooks and ways to optimize interop performance.