Home

Awesome

Spider

Build Status Crates.io Documentation Rust Discord chat

Website | Guides | API Docs | Chat

A web crawler and scraper, building blocks for data curation workloads.

Getting Started

The simplest way to get started is to use the Spider Cloud hosted service. View the spider or spider_cli directory for local installations. You can also use spider with Node.js using spider-nodejs and Python using spider-py.

Benchmarks

See BENCHMARKS.

Examples

See EXAMPLES.

License

This project is licensed under the MIT license.

Contributing

See CONTRIBUTING.