Data Engineering Using Kafka And Spark Structured Streaming

Data Engineering Using Kafka And Spark Structured Streaming
MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz

A comprehensive Data Engineering course on building streaming pipelines using Kafka and Spark Structured Streaming

What you’ll learn
Setting up self support lab with Hadoop (HDFS and YARN), Hive, Spark, and Kafka
Overview of Kafka to build streaming pipelines
Data Ingestion to Kafka topics using Kafka Connect using File Source
Data Ingestion to HDFS using Kafka Connect using HDFS 3 Connector Plugin
Incremental Data Processing using Spark Structured Streaming using File Source and File Target
Integration of Kafka and Spark Structured Streaming – Reading Data from Kafka Topics

Requirements
Laptop with decent configuration
Decent internet speed to watch the lessons
Knowledge about Functional Programming (preferably Python or Scala)
Knowledge or experience using Spark

Description
Who this course is for:
Experienced ETL Developers who want to learn Kafka and Spark to build streaming pipelines,Experienced PL/SQL Developers who want to learn Kafka and Spark to build streaming pipelines,Beginner or Experienced Data Engineers who want to learn Kafka and Spark to build streaming pipelines

For More Courses Visit & Bookmark Your Preferred Language Blog
From Here: – – – – – – – –