Skip to content

Commit

Permalink
Updated reading links
Browse files Browse the repository at this point in the history
  • Loading branch information
GraemeMalcolm committed Dec 16, 2024
1 parent 9ec145f commit 8502c76
Show file tree
Hide file tree
Showing 6 changed files with 8 additions and 8 deletions.
6 changes: 3 additions & 3 deletions Instructions/Exercises/DE-01-Real-time-ingestion.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
---
lab:
title: 'Real-time Ingestion and Processing with Spark Structured Streaming and Delta Lake with Azure Databricks'
title: 'Real-time data processing with Spark Structured Streaming and Delta Lake with Azure Databricks'
---

# Real-time Ingestion and Processing with Spark Structured Streaming and Delta Lake with Azure Databricks
# Real-time data processing with Spark Structured Streaming and Delta Lake with Azure Databricks

Spark Structured Streaming allows you to process data in real-time with end-to-end fault tolerance. Delta Lake enhances this by providing a storage layer with ACID transactions, ensuring data integrity and consistency. You can ingest data from cloud storage into Delta Lake, and use Delta Live Tables to manage and optimize your streaming data pipelines.

Expand Down Expand Up @@ -41,7 +41,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Query streaming data](https://learn.microsoft.com/azure/databricks/query/streaming) article in the Azure Databricks documentation.
## Create a cluster
Expand Down
2 changes: 1 addition & 1 deletion Instructions/Exercises/DE-02-End-to-end-streaming.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Streaming and incremental ingestion](https://learn.microsoft.com/azure/databricks/ingestion/streaming) article in the Azure Databricks documentation.
## Create a cluster
Expand Down
2 changes: 1 addition & 1 deletion Instructions/Exercises/DE-03-Optimize-data-pipelines.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [What is Auto Loader?](https://learn.microsoft.com/azure/databricks/ingestion/cloud-object-storage/auto-loader/) and [Optimize data file layout](https://learn.microsoft.com/azure/databricks/delta/optimize) articles in the Azure Databricks documentation.
## Create a cluster
Expand Down
2 changes: 1 addition & 1 deletion Instructions/Exercises/DE-04-Implement-CI-CD-pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Run a CI/CD workflow with a Databricks Asset Bundle and GitHub Actions](https://learn.microsoft.com/azure/databricks/dev-tools/bundles/ci-cd-bundles) article in the Azure Databricks documentation.
## Create a cluster
Expand Down
2 changes: 1 addition & 1 deletion Instructions/Exercises/DE-05-Automate-data-ingestion.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Schedule and orchestrate workflows](https://learn.microsoft.com/azure/databricks/jobs/) article in the Azure Databricks documentation.
## Create a cluster
Expand Down
2 changes: 1 addition & 1 deletion Instructions/Exercises/DE-06-Implement-data-privacy.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ This exercise includes a script to provision a new Azure Databricks workspace. T
6. If prompted, choose which subscription you want to use (this will only happen if you have access to multiple Azure subscriptions).
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Introduction to Delta Lake](https://docs.microsoft.com/azure/databricks/delta/delta-intro) article in the Azure Databricks documentation.
7. Wait for the script to complete - this typically takes around 5 minutes, but in some cases may take longer. While you are waiting, review the [Data governance with Unity Catalog](https://learn.microsoft.com/azure/databricks/data-governance/) article in the Azure Databricks documentation.
## Create a cluster
Expand Down

0 comments on commit 8502c76

Please sign in to comment.