The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

Last update: Oct 23, 2021

Related tags

Deep Learning SCOT

Overview

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

@article{lan2021discobox,
  title={DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision},
  author={Lan, Shiyi and Yu, Zhiding and Choy, Christopher and Radhakrishnan, Subhashree and Liu, Guilin and Zhu, Yuke and Davis, Larry S and Anandkumar, Anima},
  journal={arXiv preprint arXiv:2105.06464},
  year={2021}
}

[ Paper ]

Introduction

This repository is the implementation of evaluating DiscoBox on PF-Pascal dataset.

This implementation is based on SCOT

Installation

Conda environment settings

conda create -n scot python=3.6
conda activate scot

cat /usr/local/cuda/version.txt
conda install pytorch=1.4.0 torchvision cudatoolkit=10.0 -c pytorch (if CUDA 10) 
conda install pytorch=1.4.0 torchvision cudatoolkit=9.0 -c pytorch (if CUDA 9) 

conda install -c anaconda scikit-image
conda install -c anaconda pandas
conda install -c anaconda requests
pip install gluoncv-torch

Pretrained Weights

Download the pretrained weights from this link.

Evaluation

Results on PF-PASCAL with res101:

    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.05
    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.10
    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.15

All results

Method	Backbone	[email protected]	[email protected]	[email protected]
SCOT	ResNet-101	63.2	85.4	92.8
DiscoBox	ResNet-101	62.7	85.6	93.5

Training

Please look at this link for more details

The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

Related tags

Overview

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

Introduction

Installation

Conda environment settings

Pretrained Weights

Evaluation

All results

Training

Owner

Shiyi Lan

A more easy-to-use implementation of KPConv based on PyTorch.

[NeurIPS 2021 Spotlight] Code for Learning to Compose Visual Relations

The author's officially unofficial PyTorch BigGAN implementation.

Learning to Estimate Hidden Motions with Global Motion Aggregation

A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrieval

Real life contra a deep learning project built using mediapipe and openc

Official implementation of "A Unified Objective for Novel Class Discovery", ICCV2021 (Oral)

A project studying the influence of communication in multi-objective normal-form games

Plugin for Gaffer providing direct acess to asset from PolyHaven.com. Only HDRIs at the moment, Cycles and Arnold supported

Python Rapid Artificial Intelligence Ab Initio Molecular Dynamics

PyTorch implementation of deep GRAph Contrastive rEpresentation learning (GRACE).

[CoRL 2021] A robotics benchmark for cross-embodiment imitation.

Advantage Actor Critic (A2C): jax + flax implementation

Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces

Official repository for CVPR21 paper "Deep Stable Learning for Out-Of-Distribution Generalization".

A toolset for creating Qualtrics-based IAT experiments

JAXMAPP: JAX-based Library for Multi-Agent Path Planning in Continuous Spaces

Show-attend-and-tell - TensorFlow Implementation of "Show, Attend and Tell"

ML models implementation practice

Methods to get the probability of a changepoint in a time series.