Apache Spark™ and Scala Workshops
-
Updated
Jul 29, 2024 - HTML
#
spark-structured-streaming
Here are 102 public repositories matching this topic...
Kinesis Connector for Structured Streaming
-
Updated
Jul 2, 2024 - Scala
A real-time reddit data streaming pipeline for sentiment analysis of various subreddits
-
Updated
Aug 23, 2023 - HCL
Custom state store providers for Apache Spark
spark apache-spark state apache spark-streaming stateful structured-streaming state-store spark-structured-streaming
-
Updated
Feb 14, 2025 - Scala
A curated list of Pulsar tools, integrations and resources.
spark apache-spark messaging prometheus apache-storm apache-flink apache-kafka pub-sub grafana-dashboard spark-sql elastic-beats spark-structured-streaming apache-bookkeeper apache-pulsar
-
Updated
Dec 29, 2020
Azure Databricks - Advent of 2020 Blogposts
python machine-learning scala sql spark notebook pyspark data-analytics mllib r-language notebooks sparkr databricks azure-data-factory databricks-notebooks spark-structured-streaming azure-databricks mlflow azure-machine-learnning data-engineerg
-
Updated
Sep 22, 2022 - Jupyter Notebook
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
python twitter kafka spark apache-spark sentiment-analysis twitter-api pyspark apache-kafka afinn twitter-sentiment-analysis spark-sql spark-structured-streaming pykafka twitter-topic
-
Updated
Dec 12, 2018 - Python
Extensible streaming ingestion pipeline on top of Apache Spark
streaming framework kafka spark apache-spark pipeline ingestion streaming-etl spark-structured-streaming
-
Updated
Jul 17, 2025 - Scala
Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
python data kafka analytics apache-flink apache-kafka kafka-streams streaming-data spark-structured-streaming kstreams
-
Updated
Dec 28, 2022 - Python
Spark structured streaming examples with using of version 3.5.1
-
Updated
Apr 27, 2024 - Scala
spark structured streaming via HTTP communication
-
Updated
Jul 7, 2022 - Scala
This repository includes supervised and unsupervised machine learning methods which are used to detect anomalies on network datasets. Decision Tree, Random Forest, Gradient Boost Tree, Naive Bayes, and Logistic Regression were used for supervised learning. K-Means was used for unsupervised learning.
machine-learning clustering pyspark spark-streaming supervised-learning classification intrusion-detection unsupervised-learning decision-tree anomaly-detection spark-structured-streaming
-
Updated
Jun 24, 2019 - Jupyter Notebook
Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe
mysql elasticsearch kafka spark spark-streaming jedis dataframe spark-sql spark-example spark-structured-streaming
-
Updated
Jan 28, 2018 - Scala
An naive anomaly detection and data visualization tool for F1 on board telemetry data.
kafka spark telemetry spark-streaming kafka-consumer kafka-streams spark-sql anomaly-detection spark-structured-streaming kafka-consumers streamlit streamlit-dashboard streamlit-webapp streamlit-application fastf1
-
Updated
Jun 17, 2022 - Python
Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps
python scala kafka spark mongodb twitter4j google-maps pymongo trends dataframe coordinates ipywidgets spark-structured-streaming
-
Updated
Sep 30, 2021 - HTML
Spark Structured Streaming data pipeline that processes movie ratings data in real-time.
streaming real-time kafka spark apache-spark etl pyspark data-engineering apache-kafka spark-structured-streaming apache-iceberg
-
Updated
Oct 1, 2025 - Python
Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams
docker distributed-systems scala kafka akka spark message-queue spark-streaming akka-streams akka-actors spark-streaming-kafka spark-structured-streaming
-
Updated
Sep 6, 2017 - Scala
Real-time streaming data pipeline for Twitter Tweets
-
Updated
Jan 31, 2022 - Scala
A library having Java and Scala examples for Spark 2.x
scala spark apache-spark spark-streaming java-8 rdd spark-sql spark-mllib spark-dataframes spark-ml knoldus spark-dataset spark-structured-streaming
-
Updated
Dec 29, 2016 - Java
Analytics for IoT devices using Apache Spark Structured Streaming 2.4.0
-
Updated
Mar 14, 2019 - Scala
Improve this page
Add a description, image, and links to the spark-structured-streaming topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the spark-structured-streaming topic, visit your repo's landing page and select "manage topics."