Udemy – Taming Big Data with Apache Spark 4 and Python – Hands On!

“Big data” analysis is a hot and highly valuable skill – and this course will teach you the hottest technology in big data: Apache Spark and specifically PySpark. Employers including Amazon, EBay, NASA JPL, and Yahoo all use Spark to quickly extract meaning from massive data sets across a fault-tolerant Hadoop cluster. You’ll learn those same techniques, using your own Windows system right at home. It’s easier than you might think.

Learn and master the art of framing data analysis problems as Spark problems through over 20 hands-on examples, and then scale them up to run on cloud computing services in this course. You’ll be learning from an ex-engineer and senior manager from Amazon and IMDb.

• Learn the concepts of Spark’s DataFrames and Resilient Distributed Datastores
• Develop and run Spark jobs quickly using Python and pyspark
• Translate complex analysis problems into iterative or multi-stage Spark scripts
• Scale up to larger data sets using Amazon’s Elastic MapReduce service
• Understand how Hadoop YARN distributes Spark across computing clusters
• Learn about other Spark technologies, like Spark SQL, Spark Streaming, and GraphX
• Practice using Spark’s latest features, including Pandas-On-Spark, Spark Connect, and User-Defined Table Functions (UDTFs).