Ryan Knight has 15 years of experience with building and architecting large-scale distributed systems and data centric applications with Cassandra, Spark, Kafka, Java, Scala and Akka. He frequently does training and presentations at conferences around the world, such as JavaOne, Devoxx, JavaZone, Cassandra Summit and many other meetups and has spoken in over 15 countries. He first started Java Consulting in 1999 at the Sun Java Center and has since worked at a wide variety of companies such as DataStax, Typesafe (now LightBend), Oracle, IBM, Intel, Tomax, Family Search and Riot Games. He now works as an Enterprise Architect for Starbucks.
In this workshop we will walk through building this type of large scale, mission critical data pipeline using Kafka, Spark Streaming and Cassandra. The workshop will start by looking at the individual technologies that make up the data pipeline. Then we will discuss the overall architecture of the data pipeline and how to address these core principles. Attendees will get hands on with exercises that walk through each of the pieces of the architecture.