Skip to content

Structured Streaming from Kafka #988

Answered by kstage
kstage asked this question in Q&A
Discussion options

You must be logged in to vote

According to the Microsoft site Spark 3.0.1 is the latest supported. I used that, but Maven was pointing to a later release of org.apache.spark:spark-sql-kafka-0-10_2.12:3.0.1 when running submit. Adding --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.0.1 to the spark-submit fixed this issue.

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Answer selected by kstage
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant