Awesome
Update
This repo won't be updated anymore. Please refer to https://github.com/pytorch/builder/tree/main/windows for PyTorch building scripts and https://pytorch.org for PyTorch installation.
Original Content
It is a repo that contains scripts that makes using PyTorch on Windows easier.
Easy Installation
Update: Starting from 0.4.0, you can go to the official site for installation steps. The packages here will not be updated. If you just want to install PyTorch as soon as possible, you can try this one out. The current version of the conda package for PyTorch is 0.3.1. You'll need Anaconda first. And then type in the following commands.
# If your main Python version is not 3.5 or 3.6
conda create -n test python=3.6 numpy pyyaml mkl
# for CPU only packages
conda install -c peterjc123 pytorch-cpu
# for Windows 10 and Windows Server 2016, CUDA 8
conda install -c peterjc123 pytorch
# for Windows 10 and Windows Server 2016, CUDA 9
conda install -c peterjc123 pytorch cuda90
# for Windows 7/8/8.1 and Windows Server 2008/2012, CUDA 8
conda install -c peterjc123 pytorch_legacy
Plus: The support for old NV cards (Compute Capability <= 5.0) is over. There're mainly two ways to resolve this:
- You can install legacy packages. See description in this section below.
- Install CI packages. However, you have to handle the dependencies by yourself. See About CI packages for details.
If there's conflict against vc14, you may see workground here. Sometimes the new packages may not work, when that happens, you may try the legacy packages here. If you are from China, then the files are stored in Baidu Netdisk. You can access them through this link.
About CI packages
There may be chances that the conda package is stale and you want to try out new features. For this purpose, the CI packages are generated.
| System | All |
|---|---|
| Windows CPU (master) | |
| Windows GPU (master) | |
| Windows CPU (0.4.0) | |
| Windows GPU (0.4.0) | |
| Windows CPU (0.4.1) | |
| Windows GPU (0.4.1) |
About the nightly packages
An additional CI is setup to run every night so that you can also get the latest packages. The installation steps can be seen here.
| Configuration / Python version | 3.5 | 3.6 | 3.7 |
|---|---|---|---|
| Windows x64 CPU (Conda) | |||
| Windows x64 CPU (Wheels) | |||
| Windows x64 CUDA 9.2 (Conda) | |||
| Windows x64 CUDA 9.2 (Wheels) | |||
| Windows x64 CUDA 10.0 (Conda) | |||
| Windows x64 CUDA 10.0 (Wheels) |
And here are the libtorch packages. Only shared build is supported now. Please click the badge to download the latest package for a specific configuration.
| Configuration / LibTorch version | Shared library |
|---|---|
| Windows x64 CPU (Release) | |
| Windows x64 CPU (Debug) | |
| Windows x64 CUDA 9.2 (Release) | |
| Windows x64 CUDA 9.2 (Debug) | |
| Windows x64 CUDA 10.0 (Release) | |
| Windows x64 CUDA 10.0 (Debug) |
How to find the package and install?
You can first click the icon to get to the main page of the CI system for a certain package. You can see a few jobs under that page. There're several variables that is used to distinguish the packages.
-
PYTHON_VERSION : This one indicates the python version it use.
-
TORCH_CUDA_ARCH_LIST : It implies the architecture of the GPU, only Pascal, Maxwell and Kepler is supported.
After the choice of the jobs, you can see the generated package if you click on Artifact on the navigation bar in the middle of the page.
Installation is simple, but there're some requirements.
# For all versions
# Windows x64
# Python x64 3.5 / 3.6
# MKL/Numpy/PyYAML
# For GPU versions
# CUDA 9 / 9.1
# cuDNN 7
# NVTX (Visual Studio Integration in CUDA. if it fails to be installed, you can extract
# the CUDA installer exe and found the NVTX installer under the CUDAVisualStudioIntegration)
pip install numpy mkl intel-openmp
pip install pytorch-[version]-cp[pyversion]-cp[pyversion]m-win-amd64.whl
# Add [PythonRoot]\Library\bin into environment variable `PATH` and restart command prompt before using.
Note: You may face with the following issue. First, check that all the dependencies are installed. Second, try if a fresh virtual environment helps. If it helps, it may be an issue of the python version. And you can install VC 2017 Redist. Finally, you may have to manually compile PyTorch from source.
C:\Anaconda2\lib\site-packages\torch\__init__.pyc in <module>()
39 os.environ['PATH'] = os.path.dirname(__file__) + '\\lib\\;' + os.environ['PATH']
40
---> 41 from torch._C import *
42 __all__ += [name for name in dir(_C)
43 if name[0] != '_' and
ImportError: DLL load failed: The specified procedure could not be found.
Compiling Examples
You can download it and put it in the PyTorch directory or use it in a standalone way. There're more details about MSVC 2017 setup in #23.
################################################################################
# These are the flags that you can set before running the scripts.
################################################################################
# You can specify which version you want to build
# If you omit it, it will build for the master branch on default
set PYTORCH_BUILD_VERSION=0.4.1
# If you want to build your own fork of PyTorch
set PYTORCH_REPO=pytorch
# If you want to build for a specific branch
# Note: If you specify PYTORCH_BUILD_VERSION too, it won't be used.
set PYTORCH_BRANCH=master
# If you want to skip the confirmation of the flags configured by our script
set NO_PROMPT=1
# If you want to continue build without a verified VS version (Safe for CPU builds)
set SKIP_VS_VER_CHECK=1
# If you want to skip prompt for building for Python 2.7 (Not recommended)
set SKIP_PY_VER_CHECK=1
# If you want to build for LibTorch
set BUILD_PYTHONLESS=1
################################################################################
# These are the available scripts that you can use.
################################################################################
# If you don't want to override the default settings
auto.bat
# If you don't want to compile with CUDA
cpu.bat
# If you want to compile with CUDA 8
cuda80.bat
# If you want to compile with CUDA 9
cuda90.bat
# If you want to compile with CUDA 9.1
cuda91.bat
# If you want to compile with CUDA 9.2
cuda92.bat
# If you want to compile with CUDA 10.0
cuda100.bat
Using Examples
# The main difference in Python between Windows and Unix systems is multiprocessing
# So please refactor your code into the following structure if you use DataLoader
import torch
def main():
for i, (x, y) in dataloader:
# do something here
if __name__ == '__main__':
main()