[ICCV 2021] Official PyTorch implementation for Deep Relational Metric Learning.

Last update: Dec 10, 2022

Related tags

Deep Learning DRML

Overview

Deep Relational Metric Learning

This repository is the official PyTorch implementation of Deep Relational Metric Learning.

Framework

Datasets

CUB-200-2011

Download from here.

Organize the dataset as follows:

- cub200
    |- train
    |   |- class0
    |   |   |- image0_1
    |   |   |- ...
    |   |- ...
    |- test
        |- class100
        |   |- image100_1
        |   |- ...
        |- ...

Cars196

Download from here.

Organize the dataset as follows:

- cars196
    |- train
    |   |- class0
    |   |   |- image0_1
    |   |   |- ...
    |   |- ...
    |- test
        |- class98
        |   |- image98_1
        |   |- ...
        |- ...

Requirements

To install requirements:

pip install -r requirements.txt

Training

Baseline models

To train the baseline model with the ProxyAnchor loss on CUB200, run this command:

CUDA_VISIBLE_DEVICES=0 python examples/train/main.py \
--save_name <experiment-name> \
--data_path <path-of-data> \
--phase train \
--device 0 \
--setting proxy_baseline \
--dataset cub200 \
--num_classes 100 \
--batch_size 120 \
--delete_old

To train the baseline model with the ProxyAnchor loss on Cars196, run this command:

CUDA_VISIBLE_DEVICES=0 python examples/train/main.py \
--save_name <experiment-name> \
--data_path <path-of-data> \
--phase train \
--device 0 \
--setting proxy_baseline \
--dataset cars196 \
--num_classes 98 \
--batch_size 120 \
--delete_old

DRML models

To train the proposed DRML model using the ProxyAnchor loss on CUB200 in the paper, run this command:

CUDA_VISIBLE_DEVICES=0 python examples/train/main.py \
--save_name <experiment-name> \
--data_path <path-of-data> \
--phase train \
--device 0 \
--setting proxy \
--dataset cub200 \
--num_classes 100 \
--batch_size 120 \
--delete_old

To train the proposed DRML model using the ProxyAnchor loss on Cars196 in the paper, run this command:

CUDA_VISIBLE_DEVICES=0 python examples/train/main.py \
--save_name <experiment-name> \
--data_path <path-of-data> \
--phase train \
--device 0 \
--setting proxy \
--dataset cars196 \
--num_classes 98 \
--batch_size 120 \
--delete_old

Device

We tested our code on a linux machine with an Nvidia RTX 3090 GPU card. We recommend using a GPU card with a memory > 8GB (BN-Inception + batch-size of 120 ).

Results

The baseline models achieve the following performances:

Model name	Recall @ 1	Recall @ 2	Recall @ 4	Recall @ 8	NMI
cub200-ProxyAnchor-baseline	67.3	77.7	85.7	91.4	68.7
cars196-ProxyAnchor-baseline	84.4	90.7	94.3	96.8	69.7

Our models achieve the following performances:

Model name	Recall @ 1	Recall @ 2	Recall @ 4	Recall @ 8	NMI
cub200-ProxyAnchor-ours	68.7	78.6	86.3	91.6	69.3
cars196-ProxyAnchor-ours	86.9	92.1	95.2	97.4	72.1

COMING SOON

We will upload the code for cross-validation setting soon.
We will update the optimal hyper-parameters of the experiments soon.

[ICCV 2021] Official PyTorch implementation for Deep Relational Metric Learning.

Related tags

Overview

Deep Relational Metric Learning

Framework

Datasets

CUB-200-2011

Cars196

Requirements

Training

Baseline models

DRML models

Device

Results

COMING SOON

Owner

Borui Zhang

Code accompanying the paper Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs (Chen et al., CVPR 2020, Oral).

A library for answering questions using data you cannot see

[NeurIPS 2021] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

Exploit ILP to learn symmetry breaking constraints of ASP programs.

基于pytorch构建cyclegan示例

Tensorflow-seq2seq-tutorials - Dynamic seq2seq in TensorFlow, step by step

Img-process-manual - Utilize Python Numpy and Matplotlib to realize OpenCV baisc image processing function

MlTr: Multi-label Classification with Transformer

SysWhispers Shellcode Loader

GitHub repository for "Improving Video Generation for Multi-functional Applications"

The official implementation of our CVPR 2021 paper - Hybrid Rotation Averaging: A Fast and Robust Rotation Averaging Approach

Single-step adversarial training (AT) has received wide attention as it proved to be both efficient and robust.

Experiments on Flood Segmentation on Sentinel-1 SAR Imagery with Cyclical Pseudo Labeling and Noisy Student Training

Improving Non-autoregressive Generation with Mixup Training

Code of the lileonardo team for the 2021 Emotion and Theme Recognition in Music task of MediaEval 2021

Autoregressive Models in PyTorch.

The hippynn python package - a modular library for atomistic machine learning with pytorch.

A simple rest api that classifies pneumonia infection weather it is Normal, Pneumonia Virus or Pneumonia Bacteria from a chest-x-ray image.

Easily benchmark PyTorch model FLOPs, latency, throughput, max allocated memory and energy consumption

deep-prae