About ObjectFolder-Real

The ObjectFolder Real dataset contains multisensory data collected from 100 real-world household objects. The visual data for each object include three high-quality 3D meshes of different resolutions and an HD video recording of the object rotating in a lightbox; The acoustic data for each object include impact sound recordings recorded at 30–50 points of the object, each of which is 6s long and is accompanied by the coordinate of the striking location on the object mesh, ground-truth contact force profile, and the accompanying video for the impact. The tactile data for each object include tactile readings at the same 30–50 points of the object, with each tactile reading as a video of the tactile RGB images that record the entire gel deformation process and is accompanied by two videos of the contact process from an in-hand camera and a third-view camera.

Dataset Download and Preparation

Use the following command to download the 3D meshes of the 100 objects (you may choose original or simplified versions):

# ~16K faces per mesh
wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/mesh/mesh_16k.tar.gz
tar -xvf mesh_16k.tar.gz
# ~64K faces per mesh
wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/mesh/mesh_64k.tar.gz
tar -xvf mesh_64k.tar.gz
# Full
wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/mesh/mesh_full.tar.gz
tar -xvf mesh_full.tar.gz

Use the following command to download the visual videos of the 100 objects:

wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/vision/videos_1_100.tar.gz
tar -xvf videos_1_100.tar.gz

Use the following command to download the acoustic data of the first 10 objects:

wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/audio/audio_data_1_10.tar.gz
tar -xvf audio_data_1_10.tar.gz

Use the following command to download the tactile data of the first 10 objects:

wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/tactile/tactile_data_1_10.tar.gz
tar -xvf tactile_data_1_10.tar.gz

Similarly, use the following command to download acoustic/tactile data from 11-100:

# replace X with a value in [10,20,30,40,50,60,70,80,90]
wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/audio/audio_data_[X+1]_[X+10].tar.gz
tar -xvf audio_data_[X+1]_[X+10].tar.gz
wget https://download.cs.stanford.edu/viscam/ObjectFolder_Real/tactile/tactile_data_[X+1]_[X+10].tar.gz
tar -xvf tactile_data_[X+1]_[X+10].tar.gz

Full List of ObjectFolder Real