CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

BioMASS - A Python Framework for Modeling and Analysis of Signaling Systems

Basis Set Format Converter

Using Python to scrape some basic player information from www.premierleague.com and then use Pandas to analyse said data.

This project is the implementation template for HW 0 and HW 1 for both the programming and non-programming tracks

Analyze the Gravitational wave data stored at LIGO/VIRGO observatories

Code for the DH project "Dhimmis & Muslims – Analysing Multireligious Spaces in the Medieval Muslim World"

Pyspark Spotify ETL

A simple and efficient tool to parallelize Pandas operations on all available CPUs

Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.

Find exposed data in Azure with this public blob scanner

Pandas and Spark DataFrame comparison for humans

Create HTML profiling reports from pandas DataFrame objects

DenseClus is a Python module for clustering mixed type data using UMAP and HDBSCAN

Repositori untuk menyimpan material Long Course STMKGxHMGI tentang Geophysical Python for Seismic Data Analysis

A pipeline that creates consensus sequences from a Nanopore reads. I

Template for a Dataflow Flex Template in Python

GWpy is a collaboration-driven Python package providing tools for studying data from ground-based gravitational-wave detectors

Projects that implement various aspects of Data Engineering.

First steps with Python in Life Sciences

A tool to compare differences between dataframes and create a differences report in Excel