Object detection evaluation metrics using Python.

Last update: Sep 06, 2022

Overview

Object detection evaluation metrics

Prerequisites
How to use
Author

Current features

Prerequisites

Python
Numpy pip install numpy

How to use

Prepare ground truth and prediction files

Each "image" should have separate text files.
Use same names for both ground truth and predictions.
Use separate folder for both ground truth and predictions.
Each file should be in this format: xmin ymin xmax ymax label_id
Example (label id starts with 0):

1 2 3 4 0
1 2 3 4 1
1 2 3 4 1

Example code

>> pred_dir = Path(Path.cwd(), "examples", "pred") >>> odem = ObjectDetectionEval(true_dir, pred_dir, labels=["cat", "dog"]) >>> odem.confusion_matrix() >>> odem.classification_report() predictions true cat dog None Total cat 1 0 0 1 dog 0 1 3 4 None 2 0 0 2 Total 3 1 3 precision recall f1-score cat 1.00 0.33 0.50 dog 0.25 1.00 0.40">

>>> from pathlib import Path
>>> from odem import ObjectDetectionEval

>>> true_dir = Path(Path.cwd(), "examples", "true")
>>> pred_dir = Path(Path.cwd(), "examples", "pred")

>>> odem = ObjectDetectionEval(true_dir, pred_dir, labels=["cat", "dog"])
>>> odem.confusion_matrix()
>>> odem.classification_report()
        predictions
true     cat       dog       None      Total
cat       1         0         0         1
dog       0         1         3         4
None      2         0         0         2

Total     3         1         3
      precision     recall    f1-score
cat       1.00      0.33      0.50
dog       0.25      1.00      0.40

Author

Louis Philippe Facun

You might also like...

Python Single Object Tracking Evaluation

pysot-toolkit The purpose of this repo is to provide evaluation API of Current Single Object Tracking Dataset, including VOT2016 VOT2018 VOT2018-LT OT

348 Dec 22, 2022

Tools to create pixel-wise object masks, bounding box labels (2D and 3D) and 3D object model (PLY triangle mesh) for object sequences filmed with an RGB-D camera.

Tools to create pixel-wise object masks, bounding box labels (2D and 3D) and 3D object model (PLY triangle mesh) for object sequences filmed with an RGB-D camera. This project prepares training and testing data for various deep learning projects such as 6D object pose estimation projects singleshotpose, as well as object detection and instance segmentation projects.

305 Dec 16, 2022

[CVPR 2021] MiVOS - Mask Propagation module. Reproduced STM (and better) with training code :star2:. Semi-supervised video object segmentation evaluation.

MiVOS (CVPR 2021) - Mask Propagation Ho Kei Cheng, Yu-Wing Tai, Chi-Keung Tang [arXiv] [Paper PDF] [Project Page] [Papers with Code] This repo impleme

106 Jan 3, 2023

This project deals with the detection of skin lesions within the ISICs dataset using YOLOv3 Object Detection with Darknet.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Skin Lesion detection using YOLO This project deal

1 Nov 22, 2021

A collection of metrics for evaluating timbre dissimilarity using the TorchMetrics API

Timbre Dissimilarity Metrics A collection of metrics for evaluating timbre dissimilarity using the TorchMetrics API Installation pip install -e . Usag

21 Jan 5, 2022

Using Streamlit to host a multi-page tool with model specs and classification metrics, while also accepting user input values for prediction.

Predicitng_viability Using Streamlit to host a multi-page tool with model specs and classification metrics, while also accepting user input values for

1 Nov 8, 2021

Official PyTorch implementation of Joint Object Detection and Multi-Object Tracking with Graph Neural Networks

This is the official PyTorch implementation of our paper: "Joint Object Detection and Multi-Object Tracking with Graph Neural Networks". Our project website and video demos are here.

443 Dec 6, 2022

CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detection

CLOCs is a novel Camera-LiDAR Object Candidates fusion network. It provides a low-complexity multi-modal fusion framework that improves the performance of single-modality detectors. CLOCs operates on the combined output candidates of any 3D and any 2D detector, and is trained to produce more accurate 3D and 2D detection results.

254 Dec 16, 2022

Object Detection and Multi-Object Tracking

1.6k Jan 4, 2023

Object detection evaluation metrics using Python.

Related tags

Overview

Object detection evaluation metrics

Table of contents

Current features

Prerequisites

How to use

Author

You might also like...

Python Single Object Tracking Evaluation

Tools to create pixel-wise object masks, bounding box labels (2D and 3D) and 3D object model (PLY triangle mesh) for object sequences filmed with an RGB-D camera.

[CVPR 2021] MiVOS - Mask Propagation module. Reproduced STM (and better) with training code :star2:. Semi-supervised video object segmentation evaluation.

This project deals with the detection of skin lesions within the ISICs dataset using YOLOv3 Object Detection with Darknet.

A collection of metrics for evaluating timbre dissimilarity using the TorchMetrics API

Using Streamlit to host a multi-page tool with model specs and classification metrics, while also accepting user input values for prediction.

Official PyTorch implementation of Joint Object Detection and Multi-Object Tracking with Graph Neural Networks

CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detection

Object Detection and Multi-Object Tracking

Releases(v1.0.0)

Owner

Louis Facun

Weakly Supervised Segmentation with Tensorflow. Implements instance segmentation as described in Simple Does It: Weakly Supervised Instance and Semantic Segmentation, by Khoreva et al. (CVPR 2017).

Implementation of "With a Little Help from my Temporal Context: Multimodal Egocentric Action Recognition, BMVC, 2021" in PyTorch

Generate Contextual Directory Wordlist For Target Org

Spatial Contrastive Learning for Few-Shot Classification (SCL)

Summary of related papers on visual attention

A Unified Generative Framework for Various NER Subtasks.

Code for AutoNL on ImageNet (CVPR2020)

Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"

CLNTM - Contrastive Learning for Neural Topic Model

Analysis code and Latex source of the manuscript describing the conditional permutation test of confounding bias in predictive modelling.

Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering

Source code for our paper "Improving Empathetic Response Generation by Recognizing Emotion Cause in Conversations"

Source Code and data for my paper titled Linguistic Knowledge in Data Augmentation for Natural Language Processing: An Example on Chinese Question Matching

Probabilistic Tensor Decomposition of Neural Population Spiking Activity

Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.

[CVPR2021] De-rendering the World's Revolutionary Artefacts

Project looking into use of autoencoder for semi-supervised learning and comparing data requirements compared to supervised learning.

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.

DIT is a DTLS MitM proxy implemented in Python 3. It can intercept, manipulate and suppress datagrams between two DTLS endpoints and supports psk-based and certificate-based authentication schemes (RSA + ECC).