Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

Related tags

Machine Learningmachine-learningdeep-learninghealthcareautomlautomated-machine-learning
Overview

AutoML in Healthcare Review

Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

Selected highlights from the 2020 AutoML Review [https://doi.org/10.1016/j.artmed.2020.101822] that reviewed over 2,160 works related to the field of automated machine learning.

The curated list of automated feature engineering tools for Automated Machine Learning

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0005

Method Work Feature Engineering Technique Used by how many works
Deep Feature Synthesis LINK Expand-Reduce 151
Explore Kit LINK Expand-Reduce 53
One Button Machine LINK Expand-Reduce 32
AutoLearn LINK Expand-Reduce 16
GP Feature Construction LINK Genetic Programming 68
Cognito LINK Hierarchical Greedy Search 38
RLFE LINK Reinforcement Learning 21
LFE LINK Meta-Learning 34

Automated machine learning pipeline optimizers

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0010

Method Work Optimization Algorithm Data Pre-Processing Feature Engineering Model Selection Hyperparameter Optimization Ensemble Learning Meta-Learning Used by how many works
Auto-Weka LINK Bayesian Optimization (SMAC) ✔️ ✔️ ✔️ 703
Auto-Sklearn LINK Joint Bayesian Optimization and Bandit Search (BOHB) ✔️ ✔️ ✔️ ✔️ ✔️ 542
TPOT LINK Evolutionary Algorithm ✔️ ✔️ ✔️ ✔️ 84
TuPAQ LINK Bandit Search ✔️ ✔️ 94
ATM LINK Joint Bayesian Optimization and Bandit Search ✔️ ✔️ ✔️ 29
Automatic Frankensteining LINK Bayesian Optimization ✔️ ✔️ ✔️ 12
ML-Plan LINK Hierarchical Task Networks (HTN) ✔️ ✔️ ✔️ 24
Autostacker LINK Evolutionary Algorithm ✔️ ✔️ ✔️ 18
AlphaD3M LINK Reinforcement Learning/Monte Carlo Tree Search ✔️ ✔️ ✔️ 8
Collaborative Filtering LINK Probabilistic Matrix Factorization ✔️ ✔️ ✔️ ✔️ 29

Neural Architecture Search algorithms, based on performance on the CIFAR-10 dataset

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0015

NAS Algorithm Work Search Space Search Strategy Performance Estimation Strategy Number of Parameters Search Time (GPU-days) Test Error (%)
Large-scale Evolution LINK Feed-Forward Networks Evolutionary Algorithm Naive Training and Validation 5.4M 2600 5.4
EAS LINK Feed-Forward Networks Reinforcement Learning and Network Morphism Short Training and Validation 23.4M 10 4.23
Hierarchical Evolution LINK Cell Motifs Evolutionary Algorithm Training and Validation on proposed CNN Cell 15.7M 300 3.75
NAS v3 LINK Multi-branched Networks Reinforcement Learning Naive Training and Validation 37.4M 22400 3.65
PNAS LINK Cell Motifs Sequential Model-Based Optimization (SMBO) Performance Prediction 3.2M 225 3.41
ENAS LINK Cell Motifs Reinforcement Learning One Shot 4.6M 0.45 2.89
ResNet + Regularization LINK HUMAN BASELINE HUMAN BASELINE HUMAN BASELINE 26.2M - 2.86
DARTS LINK Cell Motifs Gradient-Based Optimization Training and Validation on proposed CNN Cell 3.4M 4 2.83
NASNet-A LINK Cell Motifs Reinforcement Learning Naive Training and Validation 3.3M 2000 2.65
EENA LINK Cell Motifs Evolutionary Algorithm Performance Prediction 8.5M 0.65 2.56
Path-Level EAS LINK Cell Motifs Reinforcement Learning Short Training and Validation 14.3M 200 2.30
NAO LINK Cell Motifs Gradient-Based Optimization Performance Prediction 128M 200 2.11
Owner
GitHub Repository https://doi.org/10.1016/j.artmed.2020.101822
(3D): LeGO-LOAM, LIO-SAM, and LVI-SAM installation and application

SLAM-application: installation and test (3D): LeGO-LOAM, LIO-SAM, and LVI-SAM Tested on Quadruped robot in Gazebo ● Results: video, video2 Requirement

EungChang-Mason-Lee 203 Dec 26, 2022
MLflow App Using React, Hooks, RabbitMQ, FastAPI Server, Celery, Microservices

Katana ML Skipper This is a simple and flexible ML workflow engine. It helps to orchestrate events across a set of microservices and create executable

Tom Xu 8 Nov 17, 2022
A Multipurpose Library for Synthetic Time Series Generation in Python

TimeSynth Multipurpose Library for Synthetic Time Series Please cite as: J. R. Maat, A. Malali, and P. Protopapas, “TimeSynth: A Multipurpose Library

278 Dec 26, 2022
PySpark ML Bank Churn Prediction

PySpark-Bank-Churn Surname: corresponds to the record (row) number and has no effect on the output. CreditScore: contains random values and has no eff

kemalgunay 2 Nov 11, 2021
Pytools is an open source library containing general machine learning and visualisation utilities for reuse

pytools is an open source library containing general machine learning and visualisation utilities for reuse, including: Basic tools for API developmen

BCG Gamma 26 Nov 06, 2022
PyPOTS - A Python Toolbox for Data Mining on Partially-Observed Time Series

A python toolbox/library for data mining on partially-observed time series, supporting tasks of forecasting/imputation/classification/clustering on incomplete multivariate time series with missing va

Wenjie Du 179 Dec 31, 2022
Machine Learning for RC Cars

Suiron Machine Learning for RC Cars Prediction visualization (green = actual, blue = prediction) Click the video below to see it in action! Dependenci

Kendrick Tan 706 Jan 02, 2023
Responsible Machine Learning with Python

Examples of techniques for training interpretable ML models, explaining ML models, and debugging ML models for accuracy, discrimination, and security.

ph_ 624 Jan 06, 2023
DaCeML - Machine learning powered by data-centric parallel programming.

Data-centric machine learning powered by DaCe

SPCL 48 Dec 12, 2022
Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

Intel(R) Extension for Scikit-learn* Installation | Documentation | Examples | Support | FAQ With Intel(R) Extension for Scikit-learn you can accelera

Intel Corporation 858 Dec 25, 2022
This project used bitcoin, S&P500, and gold to construct an investment portfolio that aimed to minimize risk by minimizing variance.

minvar_invest_portfolio This project used bitcoin, S&P500, and gold to construct an investment portfolio that aimed to minimize risk by minimizing var

1 Jan 06, 2022
Module for statistical learning, with a particular emphasis on time-dependent modelling

Operating system Build Status Linux/Mac Windows tick tick is a Python 3 module for statistical learning, with a particular emphasis on time-dependent

X - Data Science Initiative 410 Dec 14, 2022
Send rockets to Mars with artificial intelligence(Genetic algorithm) in python.

Send Rockets To Mars With AI Send rockets to Mars with artificial intelligence(Genetic algorithm) in python. Tools Python 3 EasyDraw How to Play Insta

Mohammad Dori 3 Jul 15, 2022
High performance implementation of Extreme Learning Machines (fast randomized neural networks).

High Performance toolbox for Extreme Learning Machines. Extreme learning machines (ELM) are a particular kind of Artificial Neural Networks, which sol

Anton Akusok 174 Dec 07, 2022
Provide an input CSV and a target field to predict, generate a model + code to run it.

automl-gs Give an input CSV file and a target field you want to predict to automl-gs, and get a trained high-performing machine learning or deep learn

Max Woolf 1.8k Jan 04, 2023
Ml based project which uses regression technique to predict the price.

Price-Predictor Ml based project which uses regression technique to predict the price. I have used various regression models and finds the model with

Garvit Verma 1 Jul 09, 2022
Cool Python features for machine learning that I used to be too afraid to use. Will be updated as I have more time / learn more.

python-is-cool A gentle guide to the Python features that I didn't know existed or was too afraid to use. This will be updated as I learn more and bec

Chip Huyen 3.3k Jan 05, 2023
Scikit-learn compatible wrapper of the Random Bits Forest program written by (Wang et al., 2016)

sklearn-compatible Random Bits Forest Scikit-learn compatible wrapper of the Random Bits Forest program written by Wang et al., 2016, available as a b

Tamas Madl 8 Jul 24, 2021
Accelerating model creation and evaluation.

EmeraldML A machine learning library for streamlining the process of (1) cleaning and splitting data, (2) training, optimizing, and testing various mo

Yusuf 0 Dec 06, 2021
A Pythonic framework for threat modeling

pytm: A Pythonic framework for threat modeling Introduction Traditional threat modeling too often comes late to the party, or sometimes not at all. In

Izar Tarandach 644 Dec 20, 2022