Awesome

Goose

Simple. Pluggable. Reliable. Extensible. Scalable.

A powerful background job processing library for Clojure. Goose is named after LT Nick 'Goose' Bradshaw, the sidekick to Captain Pete 'Maverick' Mitchell in Top Gun.

Announcement 🔈

We are excited to announce that five companies are successfully and reliably using Goose in production environments. With the release of a Jobs Management Console, Goose has reached a level of maturity, offering a feature-rich, stable, and production-ready background job processing solution.

We plan to release Goose 1.0.0 on February 1st, 2025, marking API stability and ensuring backward-compatibility, with no downtime during upgrades.

We welcome feedback from current and new users, especially if you’d like to request features or suggest changes to the API or implementation before the 1.0.0 release. Please review our Architecture Decisions and Wiki for more context, and share your thoughts via GitHub Issues or the Clojurians Slack.

Features

Reliable - Code/Hardware/Network failure won't cause data loss
Native support for RabbitMQ & Redis queues
Pluggable Message Broker & Metrics Backend
Jobs management Console
Scheduled Jobs
Batch Jobs
Cron Jobs
Error Handling & Retries
Extensible using Middlewares
Performant and scalable (refer performance benchmarks)
Concurrency & Parallelism friendly
... more details in Goose Wiki

Companies using Goose in Production

Getting Started

Add Goose as a dependency

;;; Clojure CLI/deps.edn
com.nilenso/goose {:mvn/version "0.6.0"}

;;; Leiningen/Boot
[com.nilenso/goose "0.6.0"]

Client

(ns my-app
  (:require
    [goose.brokers.rmq.broker :as rmq]
    [goose.client :as c]))

(defn my-fn
  [arg1 arg2]
  (println "my-fn called with" arg1 arg2))

(let [rmq-producer (rmq/new-producer rmq/default-opts)
      ;; Along with RabbitMQ, Goose supports Redis as well.
      client-opts (assoc c/default-opts :broker rmq-producer)]
  ;; Supply a fully-qualified function symbol for enqueuing.
  ;; Args to perform-async are variadic.
  (c/perform-async client-opts `my-fn "foo" :bar)
  (c/perform-in-sec client-opts 900 `my-fn "foo" :bar)
  ;; When shutting down client...
  (rmq/close rmq-producer))

Worker

(ns my-worker
  (:require
    [goose.brokers.rmq.broker :as rmq]
    [goose.worker :as w]))

;;; 'my-app' namespace should be resolvable by worker.
(let [rmq-consumer (rmq/new-consumer rmq/default-opts)
      ;; Along with RabbitMQ, Goose supports Redis as well.
      worker-opts (assoc w/default-opts :broker rmq-consumer)
      worker (w/start worker-opts)]
  ;; When shutting down worker...
  (w/stop worker) ; Performs a graceful shutsdown.
  (rmq/close rmq-consumer))

Refer to wiki for Redis queue, Jobs management Console, Batch Jobs, Cron Jobs, Error Handling, Monitoring, Production Readiness and more.