CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

Vaex library for Big Data Analytics of an Airline dataset

A Streamlit web-app for a data-science project that aims to evaluate if the answer to a question is helpful.

Python Practicum - prepare for your Data Science interview or get a refresher.

Data Science Environment Setup in single line

Yet Another Workflow Parser for SecurityHub

ELFXtract is an automated analysis tool used for enumerating ELF binaries

An Integrated Experimental Platform for time series data anomaly detection.

A notebook to analyze Amazon Recommendation Review Dataset.

MDAnalysis is a Python library to analyze molecular dynamics simulations.

Python Library for learning (Structure and Parameter) and inference (Statistical and Causal) in Bayesian Networks.

A probabilistic programming library for Bayesian deep learning, generative models, based on Tensorflow

Office365 (Microsoft365) audit log analysis tool

Gaussian processes in TensorFlow

We're Team Arson and we're using the power of predictive modeling to combat wildfires.

Bamboolib - a GUI for pandas DataFrames

Port of dplyr and other related R packages in python, using pipda.

Exploratory data analysis

EOD Historical Data Python Library (Unofficial)

Python utility to extract differences between two pandas dataframes.

Python Project on Pro Data Analysis Track