9788169646116_

Turn Data in Motion into Decisions in Real

Key Features

? Get a free one-month digital subscription to www.avaskillshelf.com.

? Master Spark Structured Streaming from windowed aggregations and stateful processing to sub-second latency.

? Build production ingestion pipelines using Kafka, Kinesis, Event Hubs, and Auto Loader at scale.

? Deploy, monitor, and integrate ML inference into streaming workflows using CI/CD and Declarative Automation Bundles.

Book Description

The Next Generation of Data Platforms Will Be Real-Time, Intelligent, and Always On

Real-time Analytics with Apache Spark is your complete, comprehensive guide to building production-grade streaming systems using Apache Spark Structured Streaming on the Databricks platform, from first principles to enterprise-scale deployment.

You begin with Spark fundamentals and streaming concepts, then progressively advance through windowed aggregations, stateful processing with transformWithState, stream-stream joins, and the new Real-time Mode for sub-second latency. Every chapter combines clear explanations with production-ready code, preparing you to handle real-world challenges including late data, state management, and performance tuning across Kafka, Kinesis, Event Hubs, and Auto Loader.

What you will learn

? Build fault-tolerant streaming pipelines with exactly-once guarantees on Apache Spark.

? Apply windowed aggregations, watermarks, and stateful processing for real-time data workflows.

? Ingest streaming data from Kafka, Kinesis, Event Hubs, and Auto Loader at scale.

? Deploy streaming pipelines using Declarative Automation Bundles and CI/CD on Databricks.

Table of Contents

n
Real-Time Analytics Landscape and Use Cases
n
n
Apache Spark Fundamentals (with a Streaming Mindset)
n
n
Structured Streaming
n
n
Deep Dive into Sources and Sinks
n
n
Windowed and Stateful Operations
n
n
Writing Streaming Queries with Spark SQL
n
n
Low-Latency Streaming with Spark Real-Time Mode
n
n
Machine Learning for Streaming Applications
n
n
Monitoring, Debugging, and Performance Tuning
n
n
Packaging, Orchestration, and CI/CD Using Declarative Automation Bundles.
n
n
End-to-End Real-Time Analytics Project
n

Index

Real-Time Analytics with Apache Spark

Comentarios