Awesome
Bazel rules for JavaScript
This ruleset is a high-performance Bazel integration for JavaScript, based on the pnpm package manager.
- Lazy: only fetches/installs npm packages needed for the requested build/test targets.
- Correct: works seamlessly with node.js module resolution. For example there are no pathMapping issues with TypeScript
rootDirs
. - Fast: Bazel's sandbox only sees npm packages as directories, not individual files. https://blog.aspect.build/rulesjs-npm-benchmarks shows benchmarks for fetching, installing, and linking packages under rules_js as well as typical alternatives like npm and yarn.
- Supports npm "workspaces": nested npm packages in a monorepo.
Many companies are successfully building with rules_js. If you're getting value from the project, please let us know! Just comment on our Adoption Discussion.
rules_js is just a part Aspect's monorepo developer platform:
- Aspect Workflows delivers on Bazel's promises of speed and cost-savings. It provides Continuous Integration and Delivery, including Remote Cache and Remote Build Execution (RBE). Best of all, it includes all the expertise that you expect from the team at Aspect!
- Need help?
- Best-effort community support is available on the #javascript channel on Bazel Slack
- Commercial support as a Slack Connect channel is offered by https://aspect.build/services.
- See our other Bazel rules, especially those built for rules_js:
- rules_ts - Bazel rules for TypeScript
- rules_swc - Bazel rules for swc
- rules_jest - Bazel rules to run tests using Jest
- rules_esbuild - Bazel rules for esbuild JS bundler
- rules_webpack - Bazel rules for Webpack
- rules_rollup - Bazel rules for Rollup - a JavaScript bundler
- rules_jasmine - Bazel rules to run tests using Jasmine
- rules_terser - Bazel rules for Terser - a JavaScript minifier
- rules_cypress - Bazel rules to run tests using Cypress
- rules_lint includes eslint support.
Bazel compatibility
The ruleset is known to work with:
- Bazel 7 using WORKSPACE and Bzlmod (tested on CI)
- Bazel 6 using WORKSPACE and Bzlmod (tested on CI)
[!NOTE] Remote Execution (RBE) requires at least Bazel 6.0.
Known issues
- ESM imports escape the runfiles tree and the sandbox due to https://github.com/aspect-build/rules_js/issues/362
Installation
Follow instructions from the release you wish to use: https://github.com/aspect-build/rules_js/releases.
To use a commit rather than a release, you can point at any SHA of the repo.
For example, to use commit abc123
with WORKSPACE
:
- Replace
url = "https://github.com/aspect-build/rules_js/releases/download/v0.1.0/rules_js-v0.1.0.tar.gz"
with a GitHub-provided source archive likeurl = "https://github.com/aspect-build/rules_js/archive/abc123.tar.gz"
- Replace
strip_prefix = "rules_js-0.1.0"
withstrip_prefix = "rules_js-abc123"
- Update the
sha256
. The easiest way to do this is to comment out the line, then Bazel will print a message with the correct value.
Note that GitHub source archives don't have a strong guarantee on the sha256 stability, see https://github.blog/2023-02-21-update-on-the-future-stability-of-source-code-archives-and-hashes
Usage
See the documentation in the docs folder.
Examples
Basic usage examples can be found under the examples folder.
Note that the examples also rely on code in the
/WORKSPACE
file in the root of this repo.
The e2e folder also has a few useful examples such as js_image_layer for containerizing a js_binary and js_run_devserver, a generic rule for running a devserver in watch mode with ibazel.
Larger examples can be found in our bazel-examples repository including:
- Next.js / rules_ts
- Angular (cli/architect)
- Angular (ngc) / rules_ts
- React (create-react-app)
- Vue
- Jest / rules_jest
- NestJS / rules_ts, rules_swc
Relationship to rules_nodejs
rules_js is an alternative to the build_bazel_rules_nodejs
Bazel module and
accompanying npm packages hosted in https://github.com/bazelbuild/rules_nodejs,
which is now unmaintained. All users are recommended to use rules_js instead.
rules_js replaces some parts of bazelbuild/rules_nodejs and re-uses other parts:
Layer | Legacy | Modern |
---|---|---|
Custom rules | npm:@bazel/typescript , etc. | aspect_rules_ts , etc. |
Package manager and Basic rules | build_bazel_rules_nodejs | aspect_rules_js |
Toolchain and core providers | rules_nodejs | rules_nodejs |
The common layer here is the rules_nodejs
Bazel module, documented as the "core" in
https://bazel-contrib.github.io/rules_nodejs/:
It is currently useful for Bazel Rules developers who want to make their own JavaScript support.
That's what rules_js
does! It's a completely different approach to making JS tooling work under Bazel.
First, there's dependency management.
build_bazel_rules_nodejs
uses existing package managers by callingnpm install
oryarn install
on a wholepackage.json
.rules_js
uses Bazel's downloader to fetch only the packages needed for the requested targets, then mimicspnpm
to lay out anode_modules
tree.
Then, there's how a Node.js tool can be executed:
build_bazel_rules_nodejs
follows the Bazel idiom: sources in one folder, outputs in another.rules_js
follows the npm idiom: sources and outputs together in a common folder.
There are trade-offs involved here, but we think the rules_js
approach is superior for all users,
especially those at large scale. Read below for more in-depth discussion of the design differences
and trade-offs you should be aware of.
Also see the slides for our Bazel eXchange talk
Design
The authors of rules_js
spent four years writing and re-writing build_bazel_rules_nodejs
.
We learned a lot from that project, as well as from discussions with Rush maintainer @octogonz.
There are two core problems:
- How do you install third-party dependencies?
- How does a running Node.js program resolve those dependencies?
And there's a fundamental trade-off: make it fast and deterministic, or support 100% of existing use cases.
Over the years we tried a number of solutions and each end of the trade-off spectrum.
Installing third-party libraries
Downloading packages should be Bazel's job. It has a full featured remote downloader, with a content-address-cached (confusingly called the "repository cache"). We now mirror pnpm's lock file into starlark code, then use only Bazel repository rules to perform fetches and translate the dependency graph into Bazel's representation.
For historical context, we started thinking about this in February 2021 in a (now outdated) design doc and have been working through the details since then.
Running Node.js programs
Fundamentally, Bazel operates out of a different filesystem layout than Node. Bazel keeps outputs in a distinct tree outside of the sources.
Our first attempt was based on what Yarn PnP and Google-internal Node.js rules do:
monkey-patch the implementation of require
in NodeJS itself,
so that every resolution can be aware of the source/output tree difference.
The main downside to this is compatibility: many packages on npm make their own assumptions about
how to resolve dependencies without asking the require
implementation, and you can't patch them all.
Unlike Google, most of us don't want to re-write all the npm packages we use to be compatible.
Our second attempt was essentially to run npm link
before running a program, using a runtime linker.
This was largely successful at papering over the filesystem layout differences without disrupting
execution of programs. However, it required a lot of workarounds anytime a JS tool wanted to be
aware of the input and output locations on disk. For example, many tools like react-scripts (the
build system used by Create React App aka. CRA) insist on writing their outputs relative to the
working directory. Such programs were forced to be run with Bazel's output folder as the working
directory, and their sources copied to that location.
rules_js
takes a better approach, where we follow that react-scripts-prompted workaround to the
extreme. We always run JS tools with the working directory in Bazel's output tree.
We can use a pnpm
-style layout tool to create a node_modules
under bazel-out
, and all resolutions
naturally work.
This third approach has trade-offs.
- The benefit is that very intractable problems like TypeScript's
rootDirs
just go away. In that example, we filed https://github.com/microsoft/TypeScript/issues/37378 but it probably won't be solved, so many users trip over issues like this and this. Now this just works, plus results like sourcemaps look like users expect: just like they would if the tool had written outputs in the source tree. - The downside is that Bazel rules/macro authors (even
genrule
authors) must re-path inputs and outputs to account for the working directory underbazel-out
, and must ensure that sources are copied there first. This forces users to pass aBAZEL_BINDIR
in the environment of every node action. https://github.com/bazelbuild/bazel/issues/15470 suggests a way to improve that, avoiding that imposition on users.