Awesome
<a href="https://liberapay.com/benz0li/donate"><img src="https://liberapay.com/assets/widgets/donate.svg" alt="Donate using Liberapay" height="20"></a>
See the CUDA-based JupyterLab Julia docker stack for GPU accelerated docker images. |
---|
JupyterLab Julia docker stack
Multi-arch (linux/amd64
, linux/arm64/v8
) docker images:
glcr.b-data.ch/jupyterlab/julia/base
glcr.b-data.ch/jupyterlab/julia/ver
(1.7.3 ≥ version > 1.5.4)
glcr.b-data.ch/jupyterlab/julia/pubtools
Images considered stable for Julia versions ≥ 1.7.3.
:point_right: The current state may eventually be backported to versions ≥
1.5.4.
:microscope: Check out jupyterlab/julia/pubtools
at
https://demo.jupyter.b-data.ch.
Build chain
base → pubtools
Features
- JupyterLab: A web-based interactive development environment for Jupyter
notebooks, code, and data. The images include
- code-server:
Code - OSS
in the browser. - Git: A distributed version-control system for tracking changes in source code.
- Git LFS: A Git extension for versioning large files.
- Julia: A high-level, high-performance dynamic language for technical computing.
- Neovim: Vim-fork focused on extensibility and usability. (1.10.5+)
- Pandoc: A universal markup converter.
- Python: An interpreted, object-oriented, high-level programming language with dynamic semantics.
- Quarto: A scientific and technical publishing system built on Pandoc.
:information_source: pubtools image - TinyTeX: A lightweight, cross-platform, portable, and easy-to-maintain
LaTeX distribution based on TeX Live.
:information_source: pubtools image - Zsh: A shell designed for interactive use, although it is also a powerful scripting language.
- code-server:
:point_right: See the Version Matrix for detailed information.
The following extensions are pre-installed for code-server:
- .gitignore Generator
- Black Formatter
:information_source: devtools subtags - Docker
:information_source: docker subtags - EditorConfig (1.8.5+)
- ESLint
:information_source: devtools subtags - Git Graph
- GitHub Pull Requests and Issues (1.9.3+)
- GitLab Workflow
- GitLens — Git supercharged
:information_source: Pinned to version 11.7.0 due to unsolicited AI content (1.9.2+) - Excel Viewer
- hadolint
:information_source: docker subtags (1.9.2+) - Julia
- Jupyter
- LaTeX Workshop
:information_source: pubtools image - markdownlint (1.9.3+)
- Path Intellisense
- Prettier - Code formatter
:information_source: devtools subtags - Project Manager
- Python
- Quarto
:information_source: pubtools image - Resource Monitor (1.9.1+)
- ShellCheck
:information_source: devtools and docker subtags (1.9.2+) - YAML
Subtags
{JULIA_VERSION,latest}-root
(versions ≥ 1.7.3): Container runs asroot
{JULIA_VERSION,latest}-devtools
(versions ≥ 1.8.2): Includes the requirements according to{JULIA_VERSION,latest}-devtools-root
: The combination of both{JULIA_VERSION,latest}-docker
(versions ≥ 1.8.5): Includesdocker-ce-cli
docker-buildx-plugin
docker-compose-plugin
docker-scan-plugin
(amd64 only)
{JULIA_VERSION,latest}-docker-root
: The combination of both{JULIA_VERSION,latest}-devtools-docker
: The combination of both{JULIA_VERSION,latest}-devtools-docker-root
: The combination of all three
Table of Contents
Prerequisites
This projects requires an installation of docker.
Install
To install docker, follow the instructions for your platform:
- Install Docker Engine | Docker Documentation > Supported platforms
- Post-installation steps for Linux
Usage
Build image (base)
latest:
cd base && docker build \
--build-arg JULIA_VERSION=1.11.2 \
-t jupyterlab/julia/base \
-f latest.Dockerfile .
version:
cd base && docker build \
-t jupyterlab/julia/base:MAJOR.MINOR.PATCH \
-f MAJOR.MINOR.PATCH.Dockerfile .
For MAJOR.MINOR.PATCH
≥ 1.7.3
.
Create home directory
Create an empty directory using docker:
docker run --rm \
-v "${PWD}/jupyterlab-jovyan":/dummy \
alpine chown 1000:100 /dummy
It will be bind mounted as the JupyterLab user's home directory and
automatically populated.
:exclamation: Bind mounting a subfolder of the home directory is only possible
for images with Julia version ≥ 1.10.1.
Run container
self built:
docker run -it --rm \
-p 8888:8888 \
-u root \
-v "${PWD}/jupyterlab-jovyan":/home/jovyan \
-e NB_UID=$(id -u) \
-e NB_GID=$(id -g) \
-e CHOWN_HOME=yes \
-e CHOWN_HOME_OPTS='-R' \
jupyterlab/julia/base[:MAJOR.MINOR.PATCH]
from the project's GitLab Container Registries:
docker run -it --rm \
-p 8888:8888 \
-u root \
-v "${PWD}/jupyterlab-jovyan":/home/jovyan \
-e NB_UID=$(id -u) \
-e NB_GID=$(id -g) \
-e CHOWN_HOME=yes \
-e CHOWN_HOME_OPTS='-R' \
IMAGE[:MAJOR[.MINOR[.PATCH]]]
IMAGE
being one of
The use of the -v
flag in the command mounts the empty directory on the host
(${PWD}/jupyterlab-jovyan
in the command) as /home/jovyan
in the container.
-e NB_UID=$(id -u) -e NB_GID=$(id -g)
instructs the startup script to switch
the user ID and the primary group ID of ${NB_USER}
to the user and group ID of
the one executing the command.
-e CHOWN_HOME=yes -e CHOWN_HOME_OPTS='-R'
instructs the startup script to
recursively change the ${NB_USER}
home directory owner and group to the
current value of ${NB_UID}
and ${NB_GID}
.
:information_source: This is only required for the first run.
The server logs appear in the terminal.
Using Podman (rootless mode, 1.9.4+)
Create an empty home directory:
mkdir "${PWD}/jupyterlab-root"
Use the following command to run the container as root
:
podman run -it --rm \
-p 8888:8888 \
-u root \
-v "${PWD}/jupyterlab-root":/home/root \
-e NB_USER=root \
-e NB_UID=0 \
-e NB_GID=0 \
-e NOTEBOOK_ARGS="--allow-root" \
IMAGE[:MAJOR[.MINOR[.PATCH]]]
Using Docker Desktop
Creating a home directory might not be required. Also
docker run -it --rm \
-p 8888:8888 \
-v "${PWD}/jupyterlab-jovyan":/home/jovyan \
IMAGE[:MAJOR[.MINOR[.PATCH]]]
might be sufficient.
Credential storage
:exclamation: Keyring services are not available due to the difficulties of
setting them up in containers.
Therefore, provide login credentials for the following extensions as
environment variables (-e
):
Extension | Environment variable |
---|---|
GitHub Pull Requests and Issues | GITHUB_TOKEN : Personal access token with scopes repo and user .1 |
GitLab Workflow | GITLAB_WORKFLOW_INSTANCE_URL : GitLab instance URL (e.g. https://gitlab.com).<br>GITLAB_WORKFLOW_TOKEN : Personal access token with scopes api and read_user . |
Misc
Pluto
To add a JupyterLab Launcher icon for Pluto:
-
Terminal: Install Pluto
julia -e 'Pkg.add("Pluto")'
-
Terminal: Install jupyter-pluto-proxy
pip install jupyter-pluto-proxy
-
Restart the container
marimo
To add a JupyterLab Launcher icon for marimo:
-
Terminal: Install marimo and click
pip install marimo click
-
Terminal: Install jupyter-marimo-proxy
pip install git+https://github.com/b-data/jupyter-marimo-proxy.git@jupyterlab-docker-stack
-
Restart the container
Similar project
What makes this project different:
- Multi-arch:
linux/amd64
,linux/arm64/v8
:point_right: Since Julia 1.5.4 (2021-03-11)
:information_source: Runs on Apple M series using Docker Desktop. - Base image: Debian instead of
Ubuntu
:information_source: CUDA-based images use Ubuntu. - IDE: code-server next to
JupyterLab
:information_source: code-server =Code - OSS
in the browser. - Just Python – no Conda / Mamba
See Notes for tweaks, settings, etc.
Contributing
PRs accepted. Please submit to the GitLab repository.
This project follows the Contributor Covenant Code of Conduct.
Support
Community support: Open a new discussion here. Commercial support: Contact b-data by email.
b-data tailors the JupyterLab images to your needs, e.g.
- Integration of self-signed CA certificates to enable communication with web services on the intranet.
- Setting up the necessary environment variables so that everything works behind a corporate proxy server.
Additionally, the JupyterHub setup can be customised to allow
- authentication with AD/LDAP
- mounting CIFS/SMB file shares
and much more.
License
Copyright © 2020 b-data GmbH
Distributed under the terms of the MIT License, with exceptions.
Footnotes
-
Device activation may require a one-time login from the extension's sidebar. ↩