Amazon Berkeley Objects (ABO) dataset check

Prerequisites

• Python 3.10
• conda 25.3.1

Setup

conda create --name abo_dataset --file requirenments.txt
conda activate abo_dataset

Usage

Scripts to identify and resolve data discrepancies, including:

• duplicate record detection,
• missing metadata validation,
• structural integrity audits of nested JSON files.

Dowloading the dataset

bash run_separate_download.sh

Check data consistency

bash run.sh