#Introduction

In this set of exercises we will walk through the process of loading data into Cassandra using Spark. The process will be broken down into several parts that build upon one another. Please review these in order. If something does not work in one section it may be due to pieces that were built in a previous session.

#Prerequisites These exercises were all built using DSE 4.6. At a minimum you should be using that version of DSE. For this series of exercises we will be running all of the examples against a single node cluster.

All interactions within these exercises will use Scala. Some familiarity with Scala will be very beneficial but is not an absolute requirement. All the exercises could be completed using the DSE Python Spark integration. That effort is left as an exercise to the reader.

##1. First Steps: Basic interaction with Cassandra using the Spark Command Line (REPL)

The goal of this exercise is to familiarize your with using the DSE Spark REPL. To use the REPL to interact with cassandra using both the native connection to Cassandra as well as SparkSQL.

In this exercise you will use the Spark Command Line REPL that is part of DSE to interact with Cassandra using Spark/Scala. Specifically you will perform the following activities:

• Start DSE/cassandra with Spark enabled and connect to the Spark command line REPL
• Prepare a Cassandra keyspace and table for new data
• Create a Spark RDD with data and validate that information
• Insert the contents of the RDD into the Cassandra table

Please proceed to the file FirstSteps.md

##2. Use Spark Command Line (REPL) to load and manipulate local file data using Spark and SparkSQL

The goal of this exercise is to load a set of data from a local file into a Cassandra table using the DSE Spark REPL.

In this exercise you will perform the following steps:

• Locate and review the source data for the new tables
• Prepare a Cassandra table in the spark_cass keyspace for the new data
• Create a spark RDD from the data in the file and load it into the Cassandra table
• Query the table to ensure that data was correctly loaded

Please proceed to the file LoadFromLocalFileREPL.md

##3. Build and run a Scala program that reads local files and loads them into native Cassandra tables.

The goal of this exercise is to build and run a Spark program using Scala that will read several local files and load them into native cassandra tables on a Spark enabled Cassandra cluster.

In this exercise you will perform the following steps:

• Clone a GitHub repository to your local machine
• Ensure that you have sbt installed and accessible on your machine
• Find and edit the Scala code example to ensure it is configured for your environment
• Use sbt to build and run the example on your Cassandra/Spark cluster
• Use SparkSQL from the DSE Spark REPL to validate the data loaded into your cluster

Please proceed to the file LoadFromLocalFileScala.md