Awesome

Pytorch Highway network

Highway network implemented in PyTorch.

Usage

highway = Highway(input_size, num_layers, f=torch.nn.functional.relu)

# input is [batch_size, input_size] shaped tensor
out = highway(input)