Awesome

Clojure Spark API

SparkPlug is a Clojure API for Apache Spark.

Installation

Library releases are published on Clojars. To use the latest version with Leiningen, add the following dependency to your project:

This will pull in the omnibus package, which in turn depends on each subproject of the same version. You may instead depend on the subprojects directly if you wish to omit some functionality, such as Spark SQL or Machine Learning dependencies.

Usage

The sparkplug-core package provides functions for working with RDDs, broadcasts, and accumulators with the classic Spark context API. See the cljdoc for API docs.

License

Licensed under the Apache License, Version 2.0. See the LICENSE file for rights and restrictions.