A Lucid Framework for Transparent and Interpretable Machine Learning Models.

Last update: Aug 12, 2022

Overview

Currently a Beta-Version

lucidmode is an open-source, low-code and lightweight Python framework for transparent and interpretable machine learning models. It has built in machine learning methods optimized for visual interpretation of some of the most relevant calculations.

Documentation

Oficial Website: https://www.lucidmode.org
Documentation: https://lucidmode.readthedocs.io
Python Package Index (PyPI) repository: https://pypi.org/project/lucidmode/
Github repository: https://github.com/lucidmode/lucidmode

Installation

With package manager (coming soon)

Install by using pip package manager:

pip install lucidmode

Cloning repository

Clone entire github project

[email protected]:lucidmode/lucidmode.git

and then install dependencies

pip install -r requirements.txt

Models

Artificial Neural Network

Feedforward Multilayer perceptron with backpropagation.

fit: Fit model to data
predict: Prediction according to model

Initialization, Activations, Cost functions, regularization, optimization

Weights Initialization: With 4 types of criterias (zeros, xavier, common, he)
Activation Functions: sigmoid, tanh, ReLU
Cost Functions: Sum of Squared Error, Binary Cross-Entropy, Multi-Class Cross-Entropy
Regularization: L1, L2, ElasticNet for weights in cost function and in gradient updating
Optimization: Weights optimization with Gradient Descent (GD, SGD, Batch) with learning rate
Execution: Callback (metric threshold), History (Cost and metrics)
Hyperparameter Optimization: Random Grid Search with Memory

Complementary

Metrics: Accuracy, Confusion Matrix (Binary and Multiclass), Confusion Tensor (Multiclass OvR)
Visualizations: Cost evolution
Public Datasets: MNIST, Fashion MNIST
Special Datasets: OHLCV + Symbolic Features of Cryptocurrencies (ETH, BTC)

Important Links

Release notes: https://github.com/lucidmode/lucidmode/releases
Issues: https://github.com/lucidmode/lucidmode/issues
Example Notebooks: https://github.com/lucidmode/lucidmode/tree/main/notebooks
Documentation: https://lucidmode.readthedocs.io
Python Package Index (PyPI) repository: https://pypi.org/project/lucidmode/

Author/Principal Maintainer

Francisco Munnoz (IFFranciscoME) Is an associate professor of financial engineering and financial machine learning ITESO (Western Institute of Technology and Higher Education)

License

GNU General Public License v3.0

Permissions of this strong copyleft license are conditioned on making available complete source code of licensed works and modifications, which include larger works using a licensed work, under the same license. Copyright and license notices must be preserved. Contributors provide an express grant of patent rights.

Contact: For more information in reggards of this repo, please contact [email protected]

Implementations of Machine Learning models, Regularizers, Optimizers and different Cost functions.

Linear Models Implementations of LinearRegression, LassoRegression and RidgeRegression with appropriate Regularizers and Optimizers. Linear Regression

1 Nov 22, 2021

Tangram makes it easy for programmers to train, deploy, and monitor machine learning models.

Tangram Website | Discord Tangram makes it easy for programmers to train, deploy, and monitor machine learning models. Run tangram train to train a mo

1.4k Jan 5, 2023

SageMaker Python SDK is an open source library for training and deploying machine learning models on Amazon SageMaker.

SageMaker Python SDK SageMaker Python SDK is an open source library for training and deploying machine learning models on Amazon SageMaker. With the S

1.8k Jan 1, 2023

Model Validation Toolkit is a collection of tools to assist with validating machine learning models prior to deploying them to production and monitoring them after deployment to production.

25 Dec 28, 2022

easyNeuron is a simple way to create powerful machine learning models, analyze data and research cutting-edge AI.

5 Jun 18, 2022

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Light Gradient Boosting Machine LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed a

14.5k Jan 7, 2023

Automated modeling and machine learning framework FEDOT

This repository contains FEDOT - an open-source framework for automated modeling and machine learning (AutoML). It can build custom modeling pipelines for different real-world processes in an automated way using an evolutionary approach. FEDOT supports classification (binary and multiclass), regression, clustering, and time series prediction tasks.

National Center for Cognitive Research of ITMO University

148 Jul 5, 2021

machine learning model deployment project of Iris classification model in a minimal UI using flask web framework and deployed it in Azure cloud using Azure app service

This is a machine learning model deployment project of Iris classification model in a minimal UI using flask web framework and deployed it in Azure cloud using Azure app service. We initially made this project as a requirement for an internship at Indian Servers. We are now making it open to contribution.

73 Dec 1, 2022

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

152 Jan 2, 2023

Releases(v0.4-beta1.0)

v0.4-beta1.0(Apr 29, 2021)
Metrics

Calculation of several metrics for classification sensitivity (TPR), specificity (TNR), accuracy (acc), likelihood ratio (positive), likelihood ratio (negative), confusion matrix (binary and multiclass) confusion tensor (binary for every class in multi-class)

Sequential Class

Move the cost_f and cost_r parameters to be specified from the formation method, leave the class instantiation with just the model architecture

Move the init_weights method to be specified from the formation method

Execution

Create formation method in the Sequential Class, with the following parameters init, cost, metrics, optimizer

Store selected metrics in Train and Validation History

Visualizations

Select metrics for verbose output

Source code(tar.gz)
Source code(zip)
v0.3-beta1.0(Apr 27, 2021)
Regularization:

On weights and biases, location: gradients

L1, L2 and ElasticNet

On weights and biases, location: cost function

L1, L2 and ElasticNet

Numerical Stability:

in functions.py, in cost, added a 1e-25 value to A, to avoid a divide by zero and invalid multiply cases in computations of np.log(A)

Data Handling:

train and validation cost

Visualization:

print: verbose of cost evolution

Documentation:

Improve README

Source code(tar.gz)
Source code(zip)
v0.2-beta1.0(Apr 27, 2021)
Files:

complete data set: MNIST

complete data set: 'fashion-MNIST'

Tests passed:

fashion MNIST

previous release tests

Topology

single hidden layer (tested)

1 - 2 hidden layers (tested)

different activation functions among hidden layer

Activation functions:

For hidden -> Sigmoid, Tanh, ReLU (tested and not working)

For output -> Softmax

Cost Functions:

'binary-logloss' (Binary-class Cross-Entropy)

'multi-logloss' (Multi-class Cross-Entropy)

Metrics:

Confusion matrix (Multi-class)

Accuracy (Multi-class)

Source code(tar.gz)
Source code(zip)
v0.1-beta1.0(Apr 26, 2021)
First release!

Tests passed:

Random XOR data classification

Sequential model:

hidden_l: Number of neurons per hidden layer (list of int, with a length of l_hidden)

hidden_a: Activation of hidden layers (list of str, with length l_hidden)

output_n: Number of neurons in the output layer (1)

output_a: Activation of output layer (str)

Layer transformations:

linear

Activation functions:

For hidden -> Sigmoid, Tanh

For output -> Sigmoid (Binary)

Weights Initialization:

Xavier normal, Xavier uniform, common uniform, according to [1]

Training Schemes:

Gradient Descent

Cost Functions:

Sum of Squared Error (SSE) or Residual Sum of Squares (RSS)

Metrics:

Accuracy (Binary)

Source code(tar.gz)
Source code(zip)
LucidNet_v0.1-beta1.0.zip(111.97 MB)

Owner

lucidmode

A lucid framework for interpretable machine learning models

GitHub Repository https://www.lucidmode.org

This is a curated list of medical data for machine learning

Medical Data for Machine Learning This is a curated list of medical data for machine learning. This list is provided for informational purposes only,

5.4k Dec 26, 2022

A machine learning model for Covid case prediction

CovidcasePrediction A machine learning model for Covid case prediction Problem Statement Using regression algorithms we can able to track the active c

1 Feb 02, 2022

Mixing up the Invariant Information clustering architecture, with self supervised concepts from SimCLR and MoCo approaches

Self Supervised clusterer Combined IIC, and Moco architectures, with some SimCLR notions, to get state of the art unsupervised clustering while retain

9 Feb 13, 2022

MBTR is a python package for multivariate boosted tree regressors trained in parameter space.

61 Dec 19, 2022

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and many other libraries. Documenta

2.5k Jan 07, 2023

Model search (MS) is a framework that implements AutoML algorithms for model architecture search at scale.

Model Search Model search (MS) is a framework that implements AutoML algorithms for model architecture search at scale. It aims to help researchers sp

1 Dec 13, 2021

Forecasting prices using Facebook/Meta's Prophet model

CryptoForecasting using Machine and Deep learning (Part 1) CryptoForecasting using Machine Learning The main aspect of predicting the stock-related da

1 Nov 27, 2021

customer churn prediction prevention in telecom industry using machine learning and survival analysis

Telco Customer Churn Prediction - Plotly Dash Application Description This dash application allows you to predict telco customer churn using machine l

3 Nov 20, 2021

2D fluid simulation implementation of Jos Stam paper on real-time fuild dynamics, including some suggested extensions.

Fluid Simulation Usage Download this repo and store it in your computer. Open a terminal and go to the root directory of this folder. Make sure you ha

5 Dec 02, 2022

Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.

Prophet: Automatic Forecasting Procedure Prophet is a procedure for forecasting time series data based on an additive model where non-linear trends ar

15.4k Jan 07, 2023

A Lucid Framework for Transparent and Interpretable Machine Learning Models.

Related tags

Overview

Documentation

Installation

Models

Artificial Neural Network

Initialization, Activations, Cost functions, regularization, optimization

Complementary

Important Links

Author/Principal Maintainer

License

You might also like...

Implementations of Machine Learning models, Regularizers, Optimizers and different Cost functions.

Tangram makes it easy for programmers to train, deploy, and monitor machine learning models.

SageMaker Python SDK is an open source library for training and deploying machine learning models on Amazon SageMaker.

Model Validation Toolkit is a collection of tools to assist with validating machine learning models prior to deploying them to production and monitoring them after deployment to production.

easyNeuron is a simple way to create powerful machine learning models, analyze data and research cutting-edge AI.

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Automated modeling and machine learning framework FEDOT

machine learning model deployment project of Iris classification model in a minimal UI using flask web framework and deployed it in Azure cloud using Azure app service

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

Releases(v0.4-beta1.0)

v0.4-beta1.0(Apr 29, 2021)

v0.3-beta1.0(Apr 27, 2021)

v0.2-beta1.0(Apr 27, 2021)

v0.1-beta1.0(Apr 26, 2021)

Owner

lucidmode

This is a curated list of medical data for machine learning

A machine learning model for Covid case prediction

Mixing up the Invariant Information clustering architecture, with self supervised concepts from SimCLR and MoCo approaches

MBTR is a python package for multivariate boosted tree regressors trained in parameter space.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

Model search (MS) is a framework that implements AutoML algorithms for model architecture search at scale.

Forecasting prices using Facebook/Meta's Prophet model

customer churn prediction prevention in telecom industry using machine learning and survival analysis

2D fluid simulation implementation of Jos Stam paper on real-time fuild dynamics, including some suggested extensions.

Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.

A Python library for detecting patterns and anomalies in massive datasets using the Matrix Profile

MIT-Machine Learning with Python–From Linear Models to Deep Learning

PyPOTS - A Python Toolbox for Data Mining on Partially-Observed Time Series

Official code for HH-VAEM

Scikit-Garden or skgarden is a garden for Scikit-Learn compatible decision trees and forests.

A quick reference guide to the most commonly used patterns and functions in PySpark SQL

XGBoost-Ray is a distributed backend for XGBoost, built on top of distributed computing framework Ray.

flexible time-series processing & feature extraction

Implementation of different ML Algorithms from scratch, written in Python 3.x

A library of sklearn compatible categorical variable encoders