Skip to content

Mi-Dora/PDVR_HKUST

Repository files navigation

Partial Duplicate Video Retrieval based on Deep Metric Learning

This repository contains the implementation of the term project for 21 Fall-HKUST CSIT 5910.

We use one publicly available dataset namely CC_WEB_VIDEO , to download this dataset, you can use our developed tools in CC_WEB_VIDEO Downloader.

And we also use one self-made dataset, which is made up of videos from Bilibili and can be downloaded here.

pipeline_overview

Getting started

Installation

  • Clone this repo:
git clone https://github.com/Mi-Dora/PDVR_HKUST
cd PDVR_HKUST
  • You can install all the dependencies by
conda install --file requirements.txt

Run PDVR Demo

python run_demo.py

DML training

  • Triplets from the CC_WEB_VIDEO can be injected if the global features and triplet of the evaluation set are provide.
python train_dml.py --evaluation_set output_data/cc_web_video_features.npy --evaluation_triplets output_data/cc_web_video_triplets.npy --train_set output_data/vcdb_features.npy --triplets output_data/vcdb_triplets.npy --model_path model/

Evaluation

  • Evaluate the performance of the system by providing the trained model path and the global features of the CC_WEB_VIDEO.
python evaluation.py --fusion Early --evaluation_set output_data/cc_vgg_features.npy --model_path model/

OR

python evaluation.py --fusion Late --evaluation_features cc_web_video_feature_files.txt --evaluation_set output_data/cc_vgg_features.npy --model_path model/
  • The mAP and PR-curve are returned

Related Project

CC_WEB_VIDEO Downloader

Reference Projects

Near-Duplicate Video Retrieval with Deep Metric Learning

Intermediate CNN Features

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages