The goal of Spark Developer In Real World course is to take someone with zero experience in Spark and turn them into a confident Spark developer who can tackle complex production real world problems in today’s challenging Spark environments.
How do we achieve that?
This course is designed to address 2 key issues that we even see in Spark developers who work in Spark day to day and also someone who is new to Spark.
1. Lack of behind the scenes or deeper understanding in concepts
Why understanding what’s going on behind the scenes is important? Because that’s when you uncover a lot of things, that is when you get to you know the pitfalls in the tools and that is when we will understand how to perform optimizations and how to troubleshoot issues when things go bad. When we go deep, we will learn the tips and tricks that are available for us to take advantage of the full offering of the tool.
2. Most don’t have a 360 degree view of what Spark has to offer
Most aspiring and experienced developers in Spark don’t realize the full potential of Spark, they are focussed on a certain area of Spark and most don’t have a good 360 degree view of what Spark can offer. Spark is not just a tool for in-memory computation. Spark offers a lot more and has dedicated modules for topics like machine learning and streaming and a project named tungsten dedicated to optimize spark for years to come. Spark is aiming to be the go-to platform for data processing, learning and analytics. There is so much development and effort going in to Spark and it is one of the fastest evolving tool in the big data ecosystem.
In this course, we go deep in the concepts. We don’t just say Spark is faster because it does in-memory computing, we go deep in explaining what are the other reasons that enable Spark to be faster. We cover how projects in Spark like Spark SQL (Catalyst Optimizer) or Project Tungten enables Spark to achieve efficiency. We show you how to read logical and physical plans produced by Spark. We talk about resource management, memory structures etc.
This course doesn’t stop with the basic concepts like RDD and DataFrames, we go beyond that. We go in to areas of Machine Learning and Spark Streaming giving you a 360 degree view of what Spark has to offer there by enabling you to become a confident developer in Spark. When you have both in-depth understanding and a 360 degree view of Spark you will be capable of handling complex production problems and managing real world Spark applications and clusters with confidence.
