A tool for testing the DataStax Spark Cassandra Connector against both Apache Cassandra (TM) and DataStax Enterprise (DSE) with either bundled libraries from DSE, Maven, or the connector built from source!
This project is built using Gradle and can be built in three exciting ways:
The jar can be built using
./gradlew jar -Pagainst=[type]
Where type is one of
DSE libraries are located by looking for the installation of DSE on your machine.
Change environment variables
DSE_RESOURCES if your installation
differs from the default.
When getting libraries from Maven we need to specify the Connector version and
Spark Version libraries to compile against. Change environment variables
SPARK_VERSION to the artifacts you would like to
Gradle will attempt to clean and build the assembly jar for the Spark Connector
looking for the repository in environment variable
SPARKCC_HOME. This will
build whatever commit the connector is currently at.
There are many options which can be used to configure your run of
Spark Cassandra Stress but the two main invocations are either using
dse spark-submit or
run.sh script for examples or use it to launch the program.
./run.sh [dse|apache] --help
Will bring up the built in help.
© 2020 Anant Corporation, All Rights Reserved. All logos, trademarks and registered trademarks are the property of their respective owners. .