Home

Awesome

Pose-Warping for View Synthesis / DIBR

Code to warp a frame from a source view to the target view, given the depth map of source view, camera poses of both views and camera intrinsic matrix.

Features:

  1. The warping is implemented in python using numpy/pytorch package and has been vectorized.
  2. It uses inverse bilinear interpolation (which can be considered as a trivial form of splatting).
  3. Pytorch implementation is differentiable.
  4. Also contains splatting/interpolation code given flow and/or depth.
  5. Supports warping of masked frame/flow i.e. if frame/flow is unknown at certain pixels.

Other implementations:

  1. Reference View Synthesizer (RVS)
  2. Open MVS
  3. A splatting based differential warping has been implemented by PyTorch 3D which has been used in SynSin
  4. Softmax Splatting

Citation

If you find this work useful, please cite it as

@misc{somraj2020posewarping,
    title = {Pose-Warping for View Synthesis / {DIBR}},
    author = {Somraj, Nagabhushan},
    year = {2020},
    url = {https://github.com/NagabhushanSN95/Pose-Warping}
}