Home

Awesome

AllSight_Sim

Overview

This package offers a simulation environment for a small 3D structured vision-based finger sensor called AllSight. It includes the integration of the AllSight model with the TACTO API simulation, allowing for data collection and simulation of robotic in-hand manipulation scenarios. For more information refer to the corresponding paper

Update Sep. 20, 2023

The codebase for SightGAN can be found in allsight_sim2real. Additionally, we plan to provide extensive documentation for this repository, stay tuned!

<div align="center"> <img src="https://github.com/osheraz/allsight_sim/blob/main/website/gif/allsight_demo_gan.gif?raw=true" width="60%"> </div>

Update

IsaacGym support has been added, you can access it by following this link.

<div align="center"> <img src="https://github.com/osheraz/allsight_sim/blob/main/website/gif/isaac.gif?raw=true" width="60%"> </div> ---

Installation

The code has been tested on:

Clone the repository:

git clone git@github.com:osheraz/allsight_sim.git
cd allsight_sim

Install the dependencies:

pip install -r requirements/requirements.txt

Usage

<div align="center"> <img src="https://github.com/osheraz/allsight_sim/blob/main/website/gif/allsight_demo.gif?raw=true" width="60%"> </div> <div align="center"> <img src="https://github.com/osheraz/allsight_sim/blob/main/website/gif/allsight_demo_rect.gif?raw=true" width="60%"> </div> <div align="center"> <img src="https://github.com/osheraz/allsight_sim/blob/main/website/gif/allsight_collect_data.gif?raw=true" width="60%"> </div>

NOTE: Adjust simulation parameters on experiments/conf folder.


License

This project is licensed under MIT license, as found in the LICENSE file.