Repo for flood prediction using LSTMs and HAND

Overview

Abstract

Every year, floods cause billions of dollars’ worth of damages to life, crops, and property. With a proper early flood warning system in place, decision-makers can take the necessary steps to prevent or at least mitigate the damage caused by floods. Although various flood prediction models exist, a majority of them fail to be fast, reliable, and detailed simultaneously. Our proposed system presents a novel hybrid flood prediction model using Long Short Term Memory(LSTM) for multivariate time series forecasting of water depth based on meteorological conditions and Height Above Nearest Drainage(HAND) to predict river stage in real-time and map the inundated areas for the corresponding water depth using enhanced HAND. Unlike traditional flood forecasting models, this hybrid approach is resource efficient and easy to implement making it highly practicable for real-time flood inundation mapping.

Methodology

The proposed system prioritizes quick development and real-time predictions without compromising on the accuracy. A range of factors affect the occurrences of riverine floods. However, climatological conditions are the major driving force behind them. Factors such as land use/land change and deforestation, although important, only affect flooding in the watershed over a long period of time. Hence, the proposed system used only meteorological conditions and DEM rasters for predicting floods over the next few days.

The relation between weather conditions and flood inundation is simplified by breaking the system into two modules. The first module being estimation of river stage height and the second one being flood inundation mapping. The system uses LSTMs, a data-driven empirical approach, to model the dependence of stage height on meteorological data and HAND, a simplified conceptual approach, to generate flood inundation maps based on the terrain of the watershed and the river stage height predicted by the first module.

Modules :

  1. Inundation Mapping - HAND algorithm to map inundated areas for a given stage height(as proposed in this paper).
  2. River Stage Estimation - Recurring neural networks (LSTMs) to predict the maximum stage height based on weather conditions of the last 3 days.
  3. Deforestation Analysis - Land use classification to identify the changing features of the area over time and identify the areas affected by deforestation.

Datasets

The proposed system uses different data for the three modules. Each of these are collected from different sources and processed separately. The module-wise requirements of data are as follows :

  1. Inundation Mapping:
    1. Digital Elevation Maps from United States Geological Survey
  2. River Stage Estimation:
    1. Meteorological data from National Climatic Data Center
    2. River stage height data from United States Army Corps of Engineers’ river gage data.
  3. Deforestation Analysis:
    1. Satellite images - Landsat 8, Landsat 5 from USGS Earth Explorer

Results

Stage Height Estimation

We tested our proposed system for Cedar Rapids, Iowa. Our experiments showed that features such as vegetation and soil type have little effect on short term flooding and can be disregarded for the prediction module. Testing multiple models showed that single output LSTM models perform better than single shot models. These models are stable upto lead times of 4 days with a Nash-Sutcliffe Efficiency greater than 0.5.

Flood Mapping

Each pixel of the inundation map raster is compared with a reference map created by ground-truthing to identify how many points were incorrectly classified as not flooded. The red areas in the image depict false negatives generated by the proposed system.

N-Person-Check-Checker-Splitter - A calculator app use to divide checks

N-Person-Check-Checker-Splitter This is my from-scratch programmed calculator ap

2 Feb 15, 2022
Python/Rust implementations and notes from Proofs Arguments and Zero Knowledge

What is this? This is where I'll be collecting resources related to the Study Group on Dr. Justin Thaler's Proofs Arguments And Zero Knowledge Book. T

Thor 66 Jan 04, 2023
Combining Diverse Feature Priors

Combining Diverse Feature Priors This repository contains code for reproducing the results of our paper. Paper: https://arxiv.org/abs/2110.08220 Blog

Madry Lab 5 Nov 12, 2022
🔅 Shapash makes Machine Learning models transparent and understandable by everyone

🎉 What's new ? Version New Feature Description Tutorial 1.6.x Explainability Quality Metrics To help increase confidence in explainability methods, y

MAIF 2.1k Dec 27, 2022
A mini lib that implements several useful functions binding to PyTorch in C++.

Torch-gather A mini library that implements several useful functions binding to PyTorch in C++. What does gather do? Why do we need it? When dealing w

maxwellzh 8 Sep 07, 2022
Code to reproduce the experiments in the paper "Transformer Based Multi-Source Domain Adaptation" (EMNLP 2020)

Transformer Based Multi-Source Domain Adaptation Dustin Wright and Isabelle Augenstein To appear in EMNLP 2020. Read the preprint: https://arxiv.org/a

CopeNLU 36 Dec 05, 2022
An official implementation of "Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentation" (CVPR 2021) in PyTorch.

BANA This is the implementation of the paper "Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentation". For more inf

CV Lab @ Yonsei University 59 Dec 12, 2022
Code related to the manuscript "Averting A Crisis In Simulation-Based Inference"

Abstract We present extensive empirical evidence showing that current Bayesian simulation-based inference algorithms are inadequate for the falsificat

Montefiore Artificial Intelligence Research 3 Nov 14, 2022
A python library for highly configurable transformers - easing model architecture search and experimentation.

A python library for highly configurable transformers - easing model architecture search and experimentation.

Anthony Fuller 51 Nov 20, 2022
Automate issue discovery for your projects against Lightning nightly and releases.

Automated Testing for Lightning EcoSystem Projects Automate issue discovery for your projects against Lightning nightly and releases. You get CPUs, Mu

Pytorch Lightning 41 Dec 24, 2022
Multimodal Descriptions of Social Concepts: Automatic Modeling and Detection of (Highly Abstract) Social Concepts evoked by Art Images

MUSCO - Multimodal Descriptions of Social Concepts Automatic Modeling of (Highly Abstract) Social Concepts evoked by Art Images This project aims to i

0 Aug 22, 2021
Code for "Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency" paper

UNICORN 🦄 Webpage | Paper | BibTex PyTorch implementation of "Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency" pap

118 Jan 06, 2023
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Website | Documentation | Tutorials | Installation | Release Notes CatBoost is a machine learning method based on gradient boosting over decision tree

CatBoost 6.9k Jan 04, 2023
OpenPCDet Toolbox for LiDAR-based 3D Object Detection.

OpenPCDet OpenPCDet is a clear, simple, self-contained open source project for LiDAR-based 3D object detection. It is also the official code release o

OpenMMLab 3.2k Dec 31, 2022
Bootstrapped Representation Learning on Graphs

Bootstrapped Representation Learning on Graphs This is the PyTorch implementation of BGRL Bootstrapped Representation Learning on Graphs The main scri

NerDS Lab :: Neural Data Science Lab 55 Jan 07, 2023
Implementation of Multistream Transformers in Pytorch

Multistream Transformers Implementation of Multistream Transformers in Pytorch. This repository deviates slightly from the paper, where instead of usi

Phil Wang 47 Jul 26, 2022
Semi-Supervised Signed Clustering Graph Neural Network (and Implementation of Some Spectral Methods)

SSSNET SSSNET: Semi-Supervised Signed Network Clustering For details, please read our paper. Environment Setup Overview The project has been tested on

Yixuan He 9 Nov 24, 2022
MLPs for Vision and Langauge Modeling (Coming Soon)

MLP Architectures for Vision-and-Language Modeling: An Empirical Study MLP Architectures for Vision-and-Language Modeling: An Empirical Study (Code wi

Yixin Nie 27 May 09, 2022
Generative Adversarial Networks for High Energy Physics extended to a multi-layer calorimeter simulation

CaloGAN Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks. This repository c

Deep Learning for HEP 101 Nov 13, 2022
Using CNN to mimic the driver based on training data from Torcs

Behavioural-Cloning-in-autonomous-driving Using CNN to mimic the driver based on training data from Torcs. Approach First, the data was collected from

Sudharshan 2 Jan 05, 2022