Awesome
SD-Hub
an Extension for Stable Diffusion WebUI and Forge.<br> You can Download, Upload, Archive files and that's it.<br>
Changelog
2024-09-30 v4.8.4
- Gradio 4 Compatibility Update for Forge Webui.<br>
- Added support for downloading from Civitai using webpage URLs directly.<br>
- Added support for Windows.
- Added venv support.
- Added an optional argument <code>-</code> for the Scrape button to filter specific extension instead of using the default extension list.
https://huggingface.co/ckpt/controlnet-sdxl-1.0/tree/main - pth md txt safetensors
- Added an optional argument <code>--</code> for the Uploader input box to exclude specific file extension instead of uploading all files.
$ext/sd-hub -- json txt py
- Moved <code>Token.json</code> to the Stable Diffusion root directory and renamed to <code>sd-hub-token.json</code>.
- Added a <code>Split by</code> radio button for the Archiver to split compressed files based on the total number of files if input is pointing to a folder.
- Added Scrape Button to return a list of Resolve URL from Huggingface repository, and Pastebin.
- Improved Compress and Decompress logic for Archiver.
Usage
<h3>Downloader</h3>● Input box
Similar to batchlink, you use tag then URL:
$tag
URL
Tag should begin with <code>$</code><br>
Tag is mandatory and there is no default path.<br>
For available tags, refer to the [Tag List] at the bottom of the extension.<br>
You can also add subdirectories to the tag if you have any:
$ckpt/tmp_ckpt
https://civitai.com/api/download/models/403131
To add an optional path:
$ckpt
https://civitai.com/api/download/models/403131 /kaggle/working/stable-diffusion-webui/zzzzz
To download with custom filename, add <code>-</code> after the URL or optional path (if provided):
# Without optional path
$ckpt
https://civitai.com/api/download/models/403131 - imagine-anime-XL.safetensors
# With optional path
$ckpt
https://civitai.com/api/download/models/403131 /kaggle/working/stable-diffusion-webui/zzzzz - imagine-anime-XL.safetensors
● Token box
<br>
Enter your Huggingface token with the role READ to download from your private repo, get one Here.<br> Enter your Civitai API key if you encounter an Authorization failed error. Get your key Here.<br> Save = To automatically load token upon Reload UI or Webui launch.<br> Load = Load token.
● Scrape Button
For Huggingface repository:<br> By default it will return a list of resolve URLs that match these extensions <code>.safetensors .bin .pth .pt .ckpt .yaml</code><br> add <code>-</code> to return only a specific file extension.<br>
Paste the repository URL in the following format:<br>
# To scrape everything in the branch tree list (folders and subfolders won't be included)
htttps://huggingface.co/user_name/repo_name/tree/branch_name
# To filter specific extension
htttps://huggingface.co/user_name/repo_name/tree/branch_name - pth safetensors
# To Scrape a folder
htttps://huggingface.co/user_name/repo_name/tree/branch_name/folder
# or
htttps://huggingface.co/user_name/repo_name/tree/branch_name/folder/sub_folder
Enter your Hugginface READ token into Token box if you want to Scrape your private repo.<br>
And Pastebin:<br> Simply paste the pastebin URL<br>
https://pastebin.com/696969
And it will return a list of whatever is available at the pastebin URL.<br> If it has a hashtag from batchlink, it will automatically be replaced with SD-Hub Tags.<br>
● Insert TXT Button
To upload a TXT file from your device, simply select it and upload it into the input box.<br>
<code>Supported Domains for Downloader: Civitai Huggingface Github Drive.Google</code>
<h3>Uploader</h3>● Input
Username = Your username at huggingface.co.<br> Repository = Your model repository at huggingface.co, it will automatically create a new repository if reponame does not exist.<br> Branch = Defaults to main. You can change the branch name to create a new branch.<br> Visibility = Defaults to Private and will only take effect if you are creating a new repository; otherwise, it will be ignored.<br> Token = Obtain your huggingface token with the role WRITE from Here.<br>
For the input box, you can either provide a path pointing to a folder or a single file.<br> You can also use <code>$tag</code> to skip the long path name.<br> You can rename the upload (file or folder) by adding <code>-</code> after the input path.<br> You can exclude specific file extension from being uploaded by adding <code>--</code>.<br>
# Folder as input, so all the files inside the folder with its folder uploaded to your repository
/kaggle/working/stable-diffusion-webui/models/Stable-diffusion
# With tag
$ckpt
# To rename the folder
$ckpt - my-merge
# To rename and exclude specific file extension
$ext/sd-hub - mymodel -- json txt py
# File as input, so only the file gets uploaded to your repository
/kaggle/working/stable-diffusion-webui/models/Stable-diffusion/animagineXLV31_v31.safetensors
# with tag
$ckpt/animagineXLV31_v31.safetensors
# to rename the uploaded file
$ckpt/animagineXLV31_v31.safetensors - XL-imagine-animeV31.txt
<code>Supported Format: tar.lz4 tar.gz zip</code>
Archive:<br> <code>Name</code> Name for the compressed file (excluding the file extension).<br> <code>Input Path</code> Path pointing a single file or folder containing multiple files.<br> <code>Output Path</code> Path where the compressed file will be saved.<br> <code>Create Directory</code> Automatically creates a new folder at the Output Path if not already existing.<br> <code>Split by</code> Divide the compression into multiple files based on number of files in Input Path.<br>
Extract:<br> <code>Input Path</code> Path pointing to a compressed file.<br> <code>Output Path</code> Path where the compressed file will be saved.<br> <code>Create Directory</code> Automatically creates a new folder at the Output Path if not already existing.<br>
You can use <code>$tag</code> for the path in Input and Output Path.<br>
# if input as a file, to compress a single file
/kaggle/working/stable-diffusion-webui/models/Stable-diffusion/animagineXLV31_v31.safetensors
# else input as a folder, to compress the whole files inside the input folder
/kaggle/working/stable-diffusion-webui/models/Stable-diffusion
# with Tag if input as a file
$ckpt/animagineXLV31_v31.safetensors
# with Tag if input as a folder
$ckpt
Credits
camenduru Thanks for the extension<br> etherealxx Thanks for the inspiration<br> Thanks to my Discord friends DEX-1101, VeonN4, kokomif, for always being there in the middle of the night.<br> Especially to cupang-afk, who helped me a lot with Python, thank you.