Biography

Emanuil is a Community Engineer with Elastic, the company behind the open source Elastic Stack (Elasticsearch, APM, Kibana, Beats, and Logstash). He’s based in London. He used to be a freelance web developer + ops lead and ran a small open science web dev consultancy with partners for several years. Interested in mentorship, inclusion, small businesses, archery and always curious about how the world works in detail.

Talk

Better Data Exploration and Visualisation with Elasticsearch and Kibana

Data science has incredibly sophisticated analysis tools which are very effective, but rarely very convenient for their operators. In this live demo we will focus primarily on the prototyping and exploration phase of a data scientist’s workflow.

We’ll push a slice of a bigger dataset held in pandas into Elasticsearch. We’ll then use Kibana to build on the fly visualisations and dashboards, allowing us to explore and discover the data’s features in a more intuitive, faster way than writing commands in a jupyter notebook. As Elasticsearch itself is a highly scalable datastore, we’ll discuss how you could take its many abilities beyond prototyping into production if it makes sense for a particular dataset. This demo only includes open source tools or tools free for all use, including commercial.

Session Keywords