Tech & IT
Business
Coding & Developer
Finance & Accounting
Academics
Office Applications
Art & Design
Marketing
Health & Wellness
Sounds & Music
Lifestyle
Photography
Free
3 days left at this price!
This plan includes
- Limited free courses access
- Play & Pause Course Videos
- Video Recorded Lectures
- Learn on Mobile/PC/Tablet
- Quizzes and Real Projects
- Lifetime Course Certificate
- Email & Chat Support
Get Unlimited Learning Access
$29
3 days left at this price!
30-Day Money-Back Guarantee
This plan includes
- Access to 11,000+ Courses
- Ads free experience Courses
- Play & Pause Course Videos
HD Video Recorded Lectures- Learn on Mobile/PC/Tablet
- Quizzes and Real Projects
- Lifetime Course Certificate
- Instructor Direct Support
- Email & Chat Support
- Cancel Anytime
$29
$29
What you'll learn?
- In Depth exploration of Spark Structured Streaming 3.0 using Python API. We'll also introduce you to Apache Kafka on a high level in the process.
Course Overview
Getting faster action from the data is the need of many industries and Stream Processing helps doing just that. But it comes with its own set of theories, challenges and best practices.
Apache Spark has seen tremendous development being in stream processing. The rich features of Spark Structured Streaming introduces a learning curve and this course is aimed at bringing all those concepts in a friendly and easy to reflect manner.
You will learn the differences between batch & stream processing and the challenges specific to stream processing. Quickly we'll move to understand the concepts of stream processing with wide varieties of examples & hands-on, dealing with inner working and taking a use case towards the end. All of this activity will be on cloud using Spark 3.0.
Pre-requisites
- Understanding of Spark SQL and Python (or pyspark) will be beneficial
Target Audience
- Data Engineers looking to expand their skill set, Data Scientists who wish want hands on working with stream processing and Technical Architects who want to evaluate the Spark Structured Streaming for their use cases
Curriculum 14 Lectures 02:43:11
-
Section 1 : First Steps with Spark Structured Streaming
- Lecture 2 :
- Concepts of Spark Structured Streaming
- Lecture 3 :
- Structure of Spark Structured Streaming Application
- Lecture 4 :
- Writing the first Structured Streaming Application
-
Section 2 : Resources
- Lecture 1 :
- Links to resources
-
Section 3 : Deep dive into the structured streaming
- Lecture 1 :
- Understanding output modes
- Lecture 2 :
- Windows in stream processing
- Lecture 3 :
- Watermarking in stream processing
- Lecture 4 :
- Quick Introduction to Kafka
-
Section 4 : Integrating Spark Structured Streaming with Kafka
- Lecture 1 :
- Watermarking with Kafka Sourc
- Lecture 2 :
- Use Case: Get materialized advertisements by joining Kafka topics
-
Section 5 : Applying Structured Streaming in Production and Road to Expertise
- Lecture 1 :
- Structured Streaming in Production
- Lecture 2 :
- System Designs involving Spark Structured Streaming
- Lecture 3 :
- Road to Expertise
Our learners work at
Frequently Asked Questions
-
How do i access the course after purchase?
It's simple. When you sign up, you'll immediately have unlimited viewing of thousands of expert courses, paths to guide your learning, tools to measure your skills and hands-on resources like exercise files. There’s no limit on what you can learn and you can cancel at any time. -
Are these video based online self-learning courses?
Yes. All of the courses comes with online video based lectures created by certified instructors. Instructors have crafted these courses with a blend of high quality interactive videos, lectures, quizzes & real world projects to give you an indepth knowledge about the topic. -
Can i play & pause the course as per my convenience?
Yes absolutely & thats one of the advantage of self-paced courses. You can anytime pause or resume the course & come back & forth from one lecture to another lecture, play the videos mulitple times & so on. -
How do i contact the instructor for any doubts or questions?
Most of these courses have general questions & answers already covered within the course lectures. However, if you need any further help from the instructor, you can use the inbuilt Chat with Instructor option to send a message to an instructor & they will reply you within 24 hours. You can ask as many questions as you want. -
Do i need a pc to access the course or can i do it on mobile & tablet as well?
Brilliant question? Isn't it? You can access the courses on any device like PC, Mobile, Tablet & even on a smart tv. For mobile & a tablet you can download the Learnfly android or an iOS app. If mobile app is not available in your country, you can access the course directly by visting our website, its fully mobile friendly. -
Do i get any certificate for the courses?
Yes. Once you complete any course on our platform along with provided assessments by the instructor, you will be eligble to get certificate of course completion.
-
For how long can i access my course on the platform?
You require an active subscription to access courses on our platform. If your subscription is active, you can access any course on our platform with no restrictions. -
Is there any free trial?
Currently, we do not offer any free trial. -
Can i cancel anytime?
Yes, you can cancel your subscription at any time. Your subscription will auto-renew until you cancel, but why would you want to?
