MEDS: Enhancing Memory Error Detection for Large-Scale Applications

Last update: Dec 14, 2022

Related tags

Deep Learning MEDS

Overview

MEDS: Enhancing Memory Error Detection for Large-Scale Applications

Prerequisites

cmake and clang

Build MEDS supporting compiler

$ make

Build Using Docker

# build docker image
$ docker build -t meds .

# run docker image
$ docker run --cap-add=SYS_PTRACE -it meds /bin/bash

Testing MEDS

MEDS's testing runs original ASAN's testcases as well as MEDS specific testcases.
- Copied ASAN's testcases in llvm/projects/compiler-rt/test/meds/TestCases/ASan
- MEDS specific testcases in llvm/projects/compiler-rt/test/meds/TestCases/Meds
To run the test,

$ make test

Testing Time: 30.70s
 Expected Passes    : 183
 Expected Failures  : 1
 Unsupported Tests  : 50

Build applications with MEDS heap allocation and ASan stack and global

Given a test program test.cc,

$ cat > test.cc

int main(int argc, char **argv) {
  int *a = new int[10];
  a[argc * 10] = 1;
  return 0;
}

test.cc can be built using the option, -fsanitize=meds.

$ build/bin/clang++ -fsanitize=meds test.cc -o test
$ ./test

==90589==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x43fff67eb078 at pc 0x0000004f926d bp 0x7fffffffe440 sp 0x7fffffffe438
WRITE of size 4 at 0x43fff67eb078 thread T0
    #0 0x4f926c in main (/home/wookhyun/release/meds-release/a.out+0x4f926c)
    #1 0x7ffff6b5c82f in __libc_start_main /build/glibc-bfm8X4/glibc-2.23/csu/../csu/libc-start.c:291
    #2 0x419cb8 in _start (/home/wookhyun/release/meds-release/a.out+0x419cb8)

Address 0x43fff67eb078 is a wild pointer.
SUMMARY: AddressSanitizer: heap-buffer-overflow (/home/wookhyun/release/meds-release/a.out+0x4f926c) in main
Shadow bytes around the buggy address:
  0x08807ecf55b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x08807ecf55c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x08807ecf55d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x08807ecf55e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x08807ecf55f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
=>0x08807ecf5600: fa fa fa fa fa fa fa fa fa fa 00 00 00 00 00[fa]
  0x08807ecf5610: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x08807ecf5620: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x08807ecf5630: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x08807ecf5640: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x08807ecf5650: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
Shadow byte legend (one shadow byte represents 8 application bytes):
  Addressable:           00
  Partially addressable: 01 02 03 04 05 06 07
  Heap left redzone:       fa
  Freed heap region:       fd
  Stack left redzone:      f1
  Stack mid redzone:       f2
  Stack right redzone:     f3
  Stack after return:      f5
  Stack use after scope:   f8
  Global redzone:          f9
  Global init order:       f6
  Poisoned by user:        f7
  Container overflow:      fc
  Array cookie:            ac
  Intra object redzone:    bb
  ASan internal:           fe
  Left alloca redzone:     ca
  Right alloca redzone:    cb
==90589==ABORTING

Options

-fsanitize=meds: Enable heap protection using MEDS (stack and global are protected using ASAN)
-mllvm -meds-stack=1: Enable stack protection using MEDS
-mllvm -meds-global=1 -mcmodel=large: Enable global protection using MEDS
- This also requires --emit-relocs in LDFLAGS
Example: to protect heap/stack using MEDS and global using ASAN

$ clang -fsanitize=meds -mllvm -meds-stack=1 test.c -o test

Example: to protect heap/global using MEDS and stack using ASAN

$ clang -fsanitize=meds -mllvm -meds-global=1 -mcmodel=large -Wl,-emit-relocs test.c -o test

Example: to protect heap/stack/global using MEDS

$ clang -fsanitize=meds -mllvm -meds-stack=1 -mllvm -meds-global=1 -mcmodel=large -Wl,--emit-relocs

Contributors

Wookhyun Han ([email protected])
Byunggil Joe ([email protected])
Byoungyougn Lee ([email protected])
Chengyu Song ([email protected])
Insik Shin ([email protected])

MEDS: Enhancing Memory Error Detection for Large-Scale Applications

Related tags

Overview

MEDS: Enhancing Memory Error Detection for Large-Scale Applications

Prerequisites

Build MEDS supporting compiler

Build Using Docker

Testing MEDS

Build applications with MEDS heap allocation and ASan stack and global

Options

Contributors

Owner

Secomp Lab at Purdue University

Unofficial implementation of Fast-SCNN: Fast Semantic Segmentation Network

Deep Q Learning with OpenAI Gym and Pokemon Showdown

Official PyTorch implementation of Data-free Knowledge Distillation for Object Detection, WACV 2021.

PyTorch implementation for ACL 2021 paper "Maria: A Visual Experience Powered Conversational Agent".

TLDR: Twin Learning for Dimensionality Reduction

This is the repository for paper NEEDLE: Towards Non-invertible Backdoor Attack to Deep Learning Models.

Deploy pytorch classification model using Flask and Streamlit

Spectralformer: Rethinking hyperspectral image classification with transformers

A PyTorch-centric hybrid classical-quantum machine learning framework

Clustergram - Visualization and diagnostics for cluster analysis in Python

Out-of-distribution detection using the pNML regret. NeurIPS2021

[AAAI 2022] Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification

classification task on dataset-CIFAR10,by using Tensorflow/keras

An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.

Directed Greybox Fuzzing with AFL

Facial recognition project

Train a state-of-the-art yolov3 object detector from scratch!

Learning to Draw: Emergent Communication through Sketching

Metadata-Extractor - Metadata Extractor Script can be used to read in exif metadata

PyTorch implementation code for the paper MixCo: Mix-up Contrastive Learning for Visual Representation