Skip to content

Latest commit

 

History

History
37 lines (24 loc) · 1.23 KB

File metadata and controls

37 lines (24 loc) · 1.23 KB

CS6476-TermProject

Project Website

https://akrishna77.github.io/visual-relationships/

Running the Notebook

Create a virtual environment, to avoid dependency mismatches.

conda create -n cvproj python=3.7.4
conda activate cvproj

Install dependencies from requirements.txt.

pip install -r requirements.txt

Implemented so far

Faster-RCNN - Satya Mallick's Blog

Spacy for S-P-O extraction - Peter's Github - Sticking with this!

NLTK approach - Poor performance!

Stanford Parser approach - Poor Performance!

Triplet Mining from Dataset

Few-shot learning based approach for Visual Relationship detection - triplet loss function. (Ongoing)

Things to explore

Object pair filtering.

Misc

If you're having trouble viewing the notebook, copy the link to the .ipynb file into Jupyter Notebook Viewer!