Luciano Resende is an Architect at IBM Spark Technology Center. He has been contributing to open source at The ASF for over 10 years, he is a member of ASF and is currently contributing to various big data related Apache projects including Apache Spark, Apache Zeppelin, Apache Bahir, Apache Toree and Apache SystemML. Luciano is the project chair for Apache Bahir, and also spend time mentoring newly created Apache Incubator projects. Recently, Luciano has started contributing to Jupyter Ecosystem projects around Enterprise Notebook Platform. At IBM, he contributed to several IBM big data offerings, including BigInsights, IOP and its respective Bluemix Cloud services.

Topic: An Enterprise Analytics Platform with Jupyter Notebooks and Apache Spark

IBM has built a “Data Science Experience” cloud service that exposes Notebook services at web scale. Behind this service, there are various components that power this platform, including Jupyter Notebooks, an enterprise gateway that manages the execution of the Jupyter Kernels and an Apache Spark cluster that power the computation. In this session we will describe our experience and best practices putting together this analytical platform as a service based on Jupyter Notebooks and Apache Spark, in particular how we built the Enterprise Gateway that enables all the Notebooks to share the Spark cluster computational resources.