You can’t add/change configuration variables during runtime once it’s already been passed to create the SparkContext.
Make sure you use cassandra connector compatible with spark version
Deploy jar dependencies along with packaged code to spark cluster manager.
Manually download correct version of sbt-launch.jar if the sbt compile script in the datastax-connecter distro fails (as it did for me).
Try out the Datastax Cassandra demos
Cassandra Connector Implementation Documentation (Data Stax)
DataStax Java Driver for Apache Cassandra – Binary distribution 2.0.12 API (Data Stax)
Getting Started with Cassandra and Spark (Code Mentor)
Getting Started with Apache Spark and Cassandra (Datastax Academy)
Build and Deploy a Spark Cassandra App (koeninger.org)
Introduction to Spark & Cassandra (Rustyrazorblade)