DeepMind Robotics

Libraries, tools and tasks created and used at DeepMind Robotics.

Package overview

Package	Summary
Transformations	Rigid body transformations
Geometry	Scene and Robot geometry primitives
Vision	Visual blob detection and tracking
AgentFlow	Reinforcement Learning agent composition library
Manipulation	"RGB" object meshes for manipulation tasks
MoMa	Manipulation environment definition library, for simulated and real robots
Controllers	QP-optimization based cartesian controller
Controller Bindings	Python bindings for the controller
Least Squares QP	QP task definition and solver

Installation

These libraries are distributed on PyPI, the packages are:

dm_robotics-transformations
dm_robotics-geometry
dm_robotics-vision
dm_robotics-agentflow
dm_robotics-manipulation
dm_robotics-moma
dm_robotics-controllers

Dependencies

MoMa, Manipulation and Controllers depend on MuJoCo, the other packages do not. See the individual packages for more information on their dependencies.

Building

To build and test the libraries, run build.sh. This script assumes:

MuJoCo is installed and licensed.
dm_control is installed.
cmake version >= 3.20.2 is installed.
Python 3.6 ,3.7 or 3.8 and system headers are installed.
GCC version 9 or later is installed.
numpy is installed.

The Python libraries are tested with tox, the C++ code is built and tested with cmake.

Tox's distshare mechanism is used to share the built source distribution packages between the packages.

Libraries, tools and tasks created and used at DeepMind Robotics.

Related tags

Overview

DeepMind Robotics

Package overview

Installation

Dependencies

Building

Owner

DeepMind

AI Virtual Calculator: This is a simple virtual calculator based on Artificial intelligence.

Tool for live presentations using manim

Face Transformer for Recognition

Predicting path with preference based on user demonstration using Maximum Entropy Deep Inverse Reinforcement Learning in a continuous environment

A PyTorch implementation of Implicit Q-Learning

This is a JAX implementation of Neural Radiance Fields for learning purposes.

Predicting 10 different clothing types using Xception pre-trained model.

SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches

Code for CVPR2021 paper "Learning Salient Boundary Feature for Anchor-free Temporal Action Localization"

[ICCV'2021] "SSH: A Self-Supervised Framework for Image Harmonization", Yifan Jiang, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Kalyan Sunkavalli, Simon Chen, Sohrab Amirghodsi, Sarah Kong, Zhangyang Wang

Code for EmBERT, a transformer model for embodied, language-guided visual task completion.

SpineAI Bilsky Grading With Python

Sinkformers: Transformers with Doubly Stochastic Attention

LogDeep is an open source deeplearning-based log analysis toolkit for automated anomaly detection.

It's a powerful version of linebot

FedScale: Benchmarking Model and System Performance of Federated Learning

Plato: A New Framework for Federated Learning Research

Build a medical knowledge graph based on Unified Language Medical System (UMLS)

PyTorch implementation of Neural Dual Contouring.

Predicting lncRNA–protein interactions based on graph autoencoders and collaborative training