CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks

Analyzing Covid-19 Outbreaks in Ontario

Mining the Stack Overflow Developer Survey

Mortgage-loan-prediction - Show how to perform advanced Analytics and Machine Learning in Python using a full complement of PyData utilities

Python Library for learning (Structure and Parameter) and inference (Statistical and Causal) in Bayesian Networks.

Python reader for Linked Data in HDF5 files

Python Project on Pro Data Analysis Track

A data parser for the internal syncing data format used by Fog of World.

Spaghetti: an open-source Python library for the analysis of network-based spatial data

CSV database for chihuahua (HUAHUA) blockchain transactions

A forecasting system dedicated to smart city data

Sample code for Harry's Airflow online trainng course

Pyspark project that able to do joins on the spark data frames.

A script to "SHUA" H1-2 map of Mercenaries mode of Hearthstone

General Assembly's 2015 Data Science course in Washington, DC

Synthetic data need to preserve the statistical properties of real data in terms of their individual behavior and (inter-)dependences

Display the behaviour of a realtime program with a scope or logic analyser.

Tuplex is a parallel big data processing framework that runs data science pipelines written in Python at the speed of compiled code

💬 Python scripts to parse Messenger, Hangouts, WhatsApp and Telegram chat logs into DataFrames.

Data-sets from the survey and analysis