SPARK Summit Europe 2016
The premier big data event for the Apache Spark community brings together thousands of developers, scientists, analysts, researchers and executives from around the globe to better understand how big data, machine learning and data science can deliver new insights.
At Realeyes, we believe that we can assess the quality and relevance of video content by capturing and analysing an individual’s facial expressions and emotions as they watch it. Every day, we collect terabytes of video recordings across multiple countries, devices and web platforms, to determine how people feel while they watch video content. In this presentation, we will discuss how we use Spark and Databricks to enhance our data analytics and collection processes, and lean on predictive models that leverage facial expressions, behavioural cues and other metadata to predict business KPIs. We will also show how we combine Spark and Python libraries to build scalable validation and production pipelines in order to increase the robustness of our predictive models.