Awesome
Flipper
Allows scraping ERC721 tokens for their metadata and images, flipping images and uploading new metadata to IPFS.
Metadata retrieval:
- Supports both IPFS and centralized metadata stores
- Supports retrieving and storing images from IPFS and centralized sources in source quality
- You can stop Flipper at any time and pick back up where you left off, in the future.
Usage
# Install dependencies
npm install
# Copy environment variables
cp .env.sample .env
# Edit environment variables
vim .env
# Run flipper
npm run start
IPFS
A majority of Ethereum NFT metadata is stored via IPFS. While you can use a public IPFS gateway with these scripts, you will be quickly rate-limited.
As such, it is recommended to run your own local node (<1m setup time):
# Install ipfs
# Mac:
brew install ipfs
# Debian
apt install ipfs -y
# Initialize
ipfs init
# Start daemon
ipfs daemon
Or, to get a private gateway from a provider like Pinata ($20/month).
Flipped metadata is also stored on IPFS. It is recommended to use a gateway from a pinning service, so you do not lose your metadata upon killing your local daemon.
Potential expansions
- Support retrieving metadata and images from Arweave (comply with
ar://
standard) - Support storing flipped metadata and images on Arweave (bulk upload w/ private key)
- Parallelize retrieval (fast enough to scrape ~10K collection in <5m with local IPFS node + erigon, but can be faster with hosted nodes)