Skip to content

Commit

Permalink
docs: update website synapse info and fabric installation (#2000)
Browse files Browse the repository at this point in the history
  • Loading branch information
JessicaXYWang authored Jun 28, 2023
1 parent 63491dd commit aa2a0b2
Showing 1 changed file with 38 additions and 3 deletions.
41 changes: 38 additions & 3 deletions website/src/pages/index.js
Original file line number Diff line number Diff line change
Expand Up @@ -249,15 +249,16 @@ function Home() {
and cloud native.
</p>
<p>
Note: SynapseML will be built-in for{" "}
<a href="https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-3-runtime">
Azure Synapse soon.
Note: SynapseML is built-in for{" "}
<a href="https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-33-runtime">
Azure Synapse Analytics.
</a>
</p>
<Tabs
defaultValue="Synapse"
values={[
{ label: "Synapse", value: "Synapse" },
{ label: "Fabric", value: "Fabric" },
{ label: "Spark Packages", value: "Spark Packages" },
{ label: "Databricks", value: "Databricks" },
{ label: "Docker", value: "Docker" },
Expand Down Expand Up @@ -296,6 +297,40 @@ function Home() {
"spark.sql.parquet.enableVectorizedReader": "false",
"spark.sql.legacy.replaceDatabricksSparkAvro.enabled": "true"
}
}`}
lang="bash"
></CodeSnippet>
</TabItem>
<TabItem value="Fabric">
<p>SynapseML is preinstalled on Fabric. To install a different version, adding the following to the first cell of a notebook:</p>
For Spark3.3 pool:
<CodeSnippet
snippet={`%%configure -f
{
"name": "synapseml",
"conf": {
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:0.11.1-spark3.3",
"spark.jars.repositories": "https://mmlspark.azureedge.net/maven",
"spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind",
"spark.yarn.user.classpath.first": "true",
"spark.sql.parquet.enableVectorizedReader": "false"
}
}`}
lang="bash"
></CodeSnippet>
For Spark3.2 pool:
<CodeSnippet
snippet={`%%configure -f
{
"name": "synapseml",
"conf": {
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:0.11.1,org.apache.spark:spark-avro_2.12:3.3.1",
"spark.jars.repositories": "https://mmlspark.azureedge.net/maven",
"spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind",
"spark.yarn.user.classpath.first": "true",
"spark.sql.parquet.enableVectorizedReader": "false",
"spark.sql.legacy.replaceDatabricksSparkAvro.enabled": "true"
}
}`}
lang="bash"
></CodeSnippet>
Expand Down

0 comments on commit aa2a0b2

Please sign in to comment.