Repo for flood prediction using LSTMs and HAND

Overview

Abstract

Every year, floods cause billions of dollars’ worth of damages to life, crops, and property. With a proper early flood warning system in place, decision-makers can take the necessary steps to prevent or at least mitigate the damage caused by floods. Although various flood prediction models exist, a majority of them fail to be fast, reliable, and detailed simultaneously. Our proposed system presents a novel hybrid flood prediction model using Long Short Term Memory(LSTM) for multivariate time series forecasting of water depth based on meteorological conditions and Height Above Nearest Drainage(HAND) to predict river stage in real-time and map the inundated areas for the corresponding water depth using enhanced HAND. Unlike traditional flood forecasting models, this hybrid approach is resource efficient and easy to implement making it highly practicable for real-time flood inundation mapping.

Methodology

The proposed system prioritizes quick development and real-time predictions without compromising on the accuracy. A range of factors affect the occurrences of riverine floods. However, climatological conditions are the major driving force behind them. Factors such as land use/land change and deforestation, although important, only affect flooding in the watershed over a long period of time. Hence, the proposed system used only meteorological conditions and DEM rasters for predicting floods over the next few days.

The relation between weather conditions and flood inundation is simplified by breaking the system into two modules. The first module being estimation of river stage height and the second one being flood inundation mapping. The system uses LSTMs, a data-driven empirical approach, to model the dependence of stage height on meteorological data and HAND, a simplified conceptual approach, to generate flood inundation maps based on the terrain of the watershed and the river stage height predicted by the first module.

Modules :

  1. Inundation Mapping - HAND algorithm to map inundated areas for a given stage height(as proposed in this paper).
  2. River Stage Estimation - Recurring neural networks (LSTMs) to predict the maximum stage height based on weather conditions of the last 3 days.
  3. Deforestation Analysis - Land use classification to identify the changing features of the area over time and identify the areas affected by deforestation.

Datasets

The proposed system uses different data for the three modules. Each of these are collected from different sources and processed separately. The module-wise requirements of data are as follows :

  1. Inundation Mapping:
    1. Digital Elevation Maps from United States Geological Survey
  2. River Stage Estimation:
    1. Meteorological data from National Climatic Data Center
    2. River stage height data from United States Army Corps of Engineers’ river gage data.
  3. Deforestation Analysis:
    1. Satellite images - Landsat 8, Landsat 5 from USGS Earth Explorer

Results

Stage Height Estimation

We tested our proposed system for Cedar Rapids, Iowa. Our experiments showed that features such as vegetation and soil type have little effect on short term flooding and can be disregarded for the prediction module. Testing multiple models showed that single output LSTM models perform better than single shot models. These models are stable upto lead times of 4 days with a Nash-Sutcliffe Efficiency greater than 0.5.

Flood Mapping

Each pixel of the inundation map raster is compared with a reference map created by ground-truthing to identify how many points were incorrectly classified as not flooded. The red areas in the image depict false negatives generated by the proposed system.

Fast, flexible and easy to use probabilistic modelling in Python.

Please consider citing the JMLR-MLOSS Manuscript if you've used pomegranate in your academic work! pomegranate is a package for building probabilistic

Jacob Schreiber 3k Dec 29, 2022
Python script to download the celebA-HQ dataset from google drive

download-celebA-HQ Python script to download and create the celebA-HQ dataset. WARNING from the author. I believe this script is broken since a few mo

133 Dec 21, 2022
FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.

Detectron is deprecated. Please see detectron2, a ground-up rewrite of Detectron in PyTorch. Detectron Detectron is Facebook AI Research's software sy

Facebook Research 25.5k Jan 07, 2023
Histocartography is a framework bringing together AI and Digital Pathology

Documentation | Paper Welcome to the histocartography repository! histocartography is a python-based library designed to facilitate the development of

155 Nov 23, 2022
This is a project based on retinaface face detection, including ghostnet and mobilenetv3

English | 简体中文 RetinaFace in PyTorch Chinese detailed blog:https://zhuanlan.zhihu.com/p/379730820 Face recognition with masks is still robust---------

pogg 59 Dec 21, 2022
PyTorch implementation of Munchausen Reinforcement Learning based on DQN and SAC. Handles discrete and continuous action spaces

Exploring Munchausen Reinforcement Learning This is the project repository of my team in the "Advanced Deep Learning for Robotics" course at TUM. Our

Mohamed Amine Ketata 10 Mar 10, 2022
A modified version of DeepMind's Alphafold2 to divide CPU part (MSA and template searching) and GPU part (prediction model)

ParallelFold Author: Bozitao Zhong This is a modified version of DeepMind's Alphafold2 to divide CPU part (MSA and template searching) and GPU part (p

Bozitao Zhong 77 Dec 22, 2022
PSGAN running with ncnn⚡妆容迁移/仿妆⚡Imitation Makeup/Makeup Transfer⚡

PSGAN running with ncnn⚡妆容迁移/仿妆⚡Imitation Makeup/Makeup Transfer⚡

WuJinxuan 144 Dec 26, 2022
AQP is a modular pipeline built to enable the comparison and testing of different quality metric configurations.

Audio Quality Platform - AQP An Open Modular Python Platform for Objective Speech and Audio Quality Metrics AQP is a highly modular pipeline designed

Jack Geraghty 24 Oct 01, 2022
Keras implementation of Deeplab v3+ with pretrained weights

Keras implementation of Deeplabv3+ This repo is not longer maintained. I won't respond to issues but will merge PR DeepLab is a state-of-art deep lear

1.3k Dec 07, 2022
Nvdiffrast - Modular Primitives for High-Performance Differentiable Rendering

Nvdiffrast – Modular Primitives for High-Performance Differentiable Rendering Modular Primitives for High-Performance Differentiable Rendering Samuli

NVIDIA Research Projects 675 Jan 06, 2023
[CVPR'21] DeepSurfels: Learning Online Appearance Fusion

DeepSurfels: Learning Online Appearance Fusion Paper | Video | Project Page This is the official implementation of the CVPR 2021 submission DeepSurfel

Online Reconstruction 52 Nov 14, 2022
DeepFaceLive - Live Deep Fake in python, Real-time face swap for PC streaming or video calls

DeepFaceLive - Live Deep Fake in python, Real-time face swap for PC streaming or video calls

8.3k Dec 31, 2022
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.

Jittor: a Just-in-time(JIT) deep learning framework Quickstart | Install | Tutorial | Chinese Jittor is a high-performance deep learning framework bas

2.7k Jan 03, 2023
Construct a neural network frame by Numpy

本项目的CSDN博客链接:https://blog.csdn.net/weixin_41578567/article/details/111482022 1. 概览 本项目主要用于神经网络的学习,通过基于numpy的实现,了解神经网络底层前向传播、反向传播以及各类优化器的原理。 该项目目前已实现的功

24 Jan 22, 2022
Cookiecutter PyTorch Lightning

Cookiecutter PyTorch Lightning Instructions # install cookiecutter pip install cookiecutter

Mazen 8 Nov 06, 2022
Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency[ECCV 2020]

Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency(ECCV 2020) This is an official python implementati

304 Jan 03, 2023
A data-driven approach to quantify the value of classifiers in a machine learning ensemble.

Documentation | External Resources | Research Paper Shapley is a Python library for evaluating binary classifiers in a machine learning ensemble. The

Benedek Rozemberczki 188 Dec 29, 2022
Code of PVTv2 is released! PVTv2 largely improves PVTv1 and works better than Swin Transformer with ImageNet-1K pre-training.

Updates (2020/06/21) Code of PVTv2 is released! PVTv2 largely improves PVTv1 and works better than Swin Transformer with ImageNet-1K pre-training. Pyr

1.3k Jan 04, 2023
PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages

PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages Abstract NLP applications for code-mixed (CM) or mix-li

Mohsin Ali, Mohammed 1 Nov 12, 2021