Silky smooth profiling for Django

Overview

Silk

GitHub Actions GitHub Actions PyPI Download PyPI Python Versions Supported Django versions Jazzband

Silk is a live profiling and inspection tool for the Django framework. Silk intercepts and stores HTTP requests and database queries before presenting them in a user interface for further inspection:

Contents

Requirements

Silk has been tested with:

  • Django: 2.2, 3.0, 3.1, 3.2
  • Python: 3.6, 3.7, 3.8, 3.9

Installation

Via pip into a virtualenv:

pip install django-silk

In settings.py add the following:

MIDDLEWARE = [
    ...
    'silk.middleware.SilkyMiddleware',
    ...
]

INSTALLED_APPS = (
    ...
    'silk'
)

Note: The middleware placement is sensitive. If the middleware before silk.middleware.SilkyMiddleware returns from process_request then SilkyMiddleware will never get the chance to execute. Therefore you must ensure that any middleware placed before never returns anything from process_request. See the django docs for more information on this.

Note: If you are using django.middleware.gzip.GZipMiddleware, place that before silk.middleware.SilkyMiddleware, otherwise you will get an encoding error.

If you want to use custom middleware, for example you developed the subclass of silk.middleware.SilkyMiddleware, so you can use this combination of settings:

# Specify the path where is the custom middleware placed
SILKY_MIDDLEWARE_CLASS = 'path.to.your.middleware.MyCustomSilkyMiddleware'

# Use this variable in list of middleware
MIDDLEWARE = [
    ...
    SILKY_MIDDLEWARE_CLASS,
    ...
]

To enable access to the user interface add the following to your urls.py:

urlpatterns += [url(r'^silk/', include('silk.urls', namespace='silk'))]

before running migrate:

python manage.py makemigrations

python manage.py migrate

python manage.py collectstatic

Silk will automatically begin interception of requests and you can proceed to add profiling if required. The UI can be reached at /silk/

Alternative Installation

Via github tags:

pip install https://github.com/jazzband/silk/archive/<version>.tar.gz

You can install from master using the following, but please be aware that the version in master may not be working for all versions specified in requirements

pip install -e git+https://github.com/jazzband/django-silk.git#egg=django-silk

Features

Silk primarily consists of:

  • Middleware for intercepting Requests/Responses
  • A wrapper around SQL execution for profiling of database queries
  • A context manager/decorator for profiling blocks of code and functions either manually or dynamically.
  • A user interface for inspection and visualisation of the above.

Request Inspection

The Silk middleware intercepts and stores requests and responses in the configured database. These requests can then be filtered and inspecting using Silk's UI through the request overview:

It records things like:

  • Time taken
  • Num. queries
  • Time spent on queries
  • Request/Response headers
  • Request/Response bodies

and so on.

Further details on each request are also available by clicking the relevant request:

SQL Inspection

Silk also intercepts SQL queries that are generated by each request. We can get a summary on things like the tables involved, number of joins and execution time (the table can be sorted by clicking on a column header):

Before diving into the stack trace to figure out where this request is coming from:

Profiling

Turn on the SILKY_PYTHON_PROFILER setting to use Python's built-in cProfile profiler. Each request will be separately profiled and the profiler's output will be available on the request's Profiling page in the Silk UI.

SILKY_PYTHON_PROFILER = True

If you would like to also generate a binary .prof file set the following:

SILKY_PYTHON_PROFILER_BINARY = True

When enabled, a graph visualisation generated using gprof2dot and viz.js is shown in the profile detail page:

A custom storage class can be used for the saved generated binary .prof files:

SILKY_STORAGE_CLASS = 'path.to.StorageClass'

The default storage class is silk.storage.ProfilerResultStorage, and when using that you can specify a path of your choosing. You must ensure the specified directory exists.

# If this is not set, MEDIA_ROOT will be used.
SILKY_PYTHON_PROFILER_RESULT_PATH = '/path/to/profiles/'

A download button will become available with a binary .prof file for every request. This file can be used for further analysis using snakeviz or other cProfile tools

Silk can also be used to profile specific blocks of code/functions. It provides a decorator and a context manager for this purpose.

For example:

from silk.profiling.profiler import silk_profile


@silk_profile(name='View Blog Post')
def post(request, post_id):
    p = Post.objects.get(pk=post_id)
    return render_to_response('post.html', {
        'post': p
    })

Whenever a blog post is viewed we get an entry within the Silk UI:

Silk profiling not only provides execution time, but also collects SQL queries executed within the block in the same fashion as with requests:

Decorator

The silk decorator can be applied to both functions and methods

from silk.profiling.profiler import silk_profile


# Profile a view function
@silk_profile(name='View Blog Post')
def post(request, post_id):
    p = Post.objects.get(pk=post_id)
    return render_to_response('post.html', {
        'post': p
    })


# Profile a method in a view class
class MyView(View):
    @silk_profile(name='View Blog Post')
    def get(self, request):
        p = Post.objects.get(pk=post_id)
        return render_to_response('post.html', {
            'post': p
        })

Context Manager

Using a context manager means we can add additional context to the name which can be useful for narrowing down slowness to particular database records.

def post(request, post_id):
    with silk_profile(name='View Blog Post #%d' % self.pk):
        p = Post.objects.get(pk=post_id)
        return render_to_response('post.html', {
            'post': p
        })

Dynamic Profiling

One of Silk's more interesting features is dynamic profiling. If for example we wanted to profile a function in a dependency to which we only have read-only access (e.g. system python libraries owned by root) we can add the following to settings.py to apply a decorator at runtime:

SILKY_DYNAMIC_PROFILING = [{
    'module': 'path.to.module',
    'function': 'MyClass.bar'
}]

which is roughly equivalent to:

class MyClass(object):
    @silk_profile()
    def bar(self):
        pass

The below summarizes the possibilities:

"""
Dynamic function decorator
"""

SILKY_DYNAMIC_PROFILING = [{
    'module': 'path.to.module',
    'function': 'foo'
}]

# ... is roughly equivalent to
@silk_profile()
def foo():
    pass

"""
Dynamic method decorator
"""

SILKY_DYNAMIC_PROFILING = [{
    'module': 'path.to.module',
    'function': 'MyClass.bar'
}]

# ... is roughly equivalent to
class MyClass(object):

    @silk_profile()
    def bar(self):
        pass

"""
Dynamic code block profiling
"""

SILKY_DYNAMIC_PROFILING = [{
    'module': 'path.to.module',
    'function': 'foo',
    # Line numbers are relative to the function as opposed to the file in which it resides
    'start_line': 1,
    'end_line': 2,
    'name': 'Slow Foo'
}]

# ... is roughly equivalent to
def foo():
    with silk_profile(name='Slow Foo'):
        print (1)
        print (2)
    print(3)
    print(4)

Note that dynamic profiling behaves in a similar fashion to that of the python mock framework in that we modify the function in-place e.g:

""" my.module """
from another.module import foo

# ...do some stuff
foo()
# ...do some other stuff

,we would profile foo by dynamically decorating my.module.foo as opposed to another.module.foo:

SILKY_DYNAMIC_PROFILING = [{
    'module': 'my.module',
    'function': 'foo'
}]

If we were to apply the dynamic profile to the functions source module another.module.foo after it has already been imported, no profiling would be triggered.

Custom Logic for Profiling

Sometimes you may want to dynamically control when the profiler runs. You can write your own logic for when to enable the profiler. To do this add the following to your settings.py:

This setting is mutually exclusive with SILKY_PYTHON_PROFILER and will be used over it if present. It will work with SILKY_DYNAMIC_PROFILING.

def my_custom_logic(request):
    return 'profile_requests' in request.session

SILKY_PYTHON_PROFILER_FUNC = my_custom_logic # profile only session has recording enabled.

You can also use a lambda.

# profile only session has recording enabled.
SILKY_PYTHON_PROFILER_FUNC = lambda request: 'profile_requests' in request.session

Code Generation

Silk currently generates two bits of code per request:

Both are intended for use in replaying the request. The curl command can be used to replay via command-line and the python code can be used within a Django unit test or simply as a standalone script.

Configuration

Authentication/Authorisation

By default anybody can access the Silk user interface by heading to /silk/. To enable your Django auth backend place the following in settings.py:

SILKY_AUTHENTICATION = True  # User must login
SILKY_AUTHORISATION = True  # User must have permissions

If SILKY_AUTHORISATION is True, by default Silk will only authorise users with is_staff attribute set to True.

You can customise this using the following in settings.py:

def my_custom_perms(user):
    return user.is_allowed_to_use_silk

SILKY_PERMISSIONS = my_custom_perms

You can also use a lambda.

SILKY_PERMISSIONS = lambda user: user.is_superuser

Request/Response bodies

By default, Silk will save down the request and response bodies for each request for future viewing no matter how large. If Silk is used in production under heavy volume with large bodies this can have a huge impact on space/time performance. This behaviour can be configured with the following options:

SILKY_MAX_REQUEST_BODY_SIZE = -1  # Silk takes anything <0 as no limit
SILKY_MAX_RESPONSE_BODY_SIZE = 1024  # If response body>1024 bytes, ignore

Meta-Profiling

Sometimes it is useful to be able to see what effect Silk is having on the request/response time. To do this add the following to your settings.py:

SILKY_META = True

Silk will then record how long it takes to save everything down to the database at the end of each request:

Note that in the above screenshot, this means that the request took 29ms (22ms from Django and 7ms from Silk)

Recording a Fraction of Requests

On high-load sites it may be helpful to only record a fraction of the requests that are made. To do this add the following to your settings.py:

Note: This setting is mutually exclusive with SILKY_INTERCEPT_FUNC.

SILKY_INTERCEPT_PERCENT = 50 # log only 50% of requests

Custom Logic for Recording Requests

On high-load sites it may also be helpful to write your own logic for when to intercept requests. To do this add the following to your settings.py:

Note: This setting is mutually exclusive with SILKY_INTERCEPT_PERCENT.

def my_custom_logic(request):
    return 'record_requests' in request.session

SILKY_INTERCEPT_FUNC = my_custom_logic # log only session has recording enabled.

You can also use a lambda.

# log only session has recording enabled.
SILKY_INTERCEPT_FUNC = lambda request: 'record_requests' in request.session

Limiting request/response data

To make sure silky garbage collects old request/response data, a config var can be set to limit the number of request/response rows it stores.

SILKY_MAX_RECORDED_REQUESTS = 10**4

The garbage collection is only run on a percentage of requests to reduce overhead. It can be adjusted with this config:

SILKY_MAX_RECORDED_REQUESTS_CHECK_PERCENT = 10

Enable query analysis

To enable query analysis when supported by the dbms a config var can be set in order to execute queries with the analyze features.

SILKY_ANALYZE_QUERIES = True

Clearing logged data

A management command will wipe out all logged data:

python manage.py silk_clear_request_log

Contributing

Jazzband

This is a Jazzband project. By contributing you agree to abide by the Contributor Code of Conduct and follow the guidelines.

Development Environment

Silk features a project named project that can be used for silk development. It has the silk code symlinked so you can work on the sample project and on the silk package at the same time.

In order to setup local development you should first install all the dependencies for the test project. From the root of the project directory:

pip install -r requirements.txt

You will also need to install silk's dependencies. From the root of the git repository:

pip install -e .

At this point your virtual environment should have everything it needs to run both the sample project and silk successfully.

Before running, you must set the DB_ENGINE and DB_NAME environment variables:

export DB_ENGINE=sqlite3
export DB_NAME=db.sqlite3

For other combinations, check tox.ini.

Now from the root of the sample project apply the migrations

python manage.py migrate

Now from the root of the sample project directory start the django server

python manage.py runserver

Running the tests

cd project
./tests/test_migrations.sh
python manage.py test --noinput

Happy profiling!

Comments
  • IntegrityError: duplicate key value violates unique constraint

    IntegrityError: duplicate key value violates unique constraint "silk_response_request_id_key"

    After activating silk certain urls began erring with:

    IntegrityError: duplicate key value violates unique constraint "silk_response_request_id_key" DETAIL: Key (request_id)=(1166) already exists.

    Sentry stack trace: http://toolbox1.tedc.de:9000/bidev/esldj/group/131/

    bug 
    opened by synotna 90
  • Support Django 3.2

    Support Django 3.2

    Currently, support for Django 3.2 is broken, as per ~~this issue.~~ (EDIT: the linked issue isn't related to Django 3.2, though support was broken before the PR I have submitted, and I now believe it is fixed)

    Therefore, I created this issue to track progress on fixing django-silk in Django 3.2

    opened by Jorl17 37
  • Create new release of silk

    Create new release of silk

    I think once the jazzband migration is complete, it would be a good time to make a new release of silk, either manually or by setting up automatic releases.

    opened by albertyw 25
  • Prepare Release 4.0

    Prepare Release 4.0

    Since this is a major release as we are dropping python 2 support, we will move to 4.x instead of 3.x.

    • [x] Check the support with Django 3.0
    • [x] Test django silk if its working fine.
    • [x] Prepare a change log
    opened by nasirhjafri 22
  • `apps.py` added with `default_auto_field` set

    `apps.py` added with `default_auto_field` set

    This is to avoid unnecessary migrations caused by default "id" field type change from AutoField -> BigAutoField in Django 3.2.

    new test added

    • testing if proper AppConfig class is loaded by Django
    • testing if package has no pending migrations and will not generate new migrations when running makemigrations on user-end.
    opened by daadu 19
  • Migrations not working w/ Django 1.6.11

    Migrations not working w/ Django 1.6.11

    Traceback (most recent call last):
      File "manage.py", line 13, in <module>
        execute_from_command_line(sys.argv)
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/django/core/management/__init__.py", line 399, in execute_from_command_line
        utility.execute()
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/django/core/management/__init__.py", line 392, in execute
        self.fetch_command(subcommand).run_from_argv(self.argv)
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/django/core/management/base.py", line 242, in run_from_argv
        self.execute(*args, **options.__dict__)
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/django/core/management/base.py", line 285, in execute
        output = self.handle(*args, **options)
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/management/commands/migrate.py", line 111, in handle
        ignore_ghosts = ignore_ghosts,
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/__init__.py", line 173, in migrate_app
        Migrations.calculate_dependencies()
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 229, in calculate_dependencies
        migration.calculate_dependencies()
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 363, in calculate_dependencies
        for migration in self._get_dependency_objects("depends_on"):
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 343, in _get_dependency_objects
        for app, name in getattr(self.migration_class(), attrname, []):
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 315, in migration_class
        return self.migration().Migration
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/utils/__init__.py", line 62, in method
        value = function(self)
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 304, in migration
        raise exceptions.UnknownMigration(self, sys.exc_info())
    south.exceptions.UnknownMigration: Migration 'silk:0001_initial' probably doesn't exist.
    Traceback (most recent call last):
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/south/migration/base.py", line 302, in migration
        migration = __import__(full_name, {}, {}, ['Migration'])
      File "/Users/matthew/.virtualenvs/nauman/lib/python2.7/site-packages/silk/migrations/0001_initial.py", line 4, in <module>
        from django.db import models, migrations
    ImportError: cannot import name migrations
    

    The solution from https://github.com/django-silk/silk/issues/64 did not fix this.

    opened by sgtsquiggs 17
  • Profiling is not working

    Profiling is not working

    I'm trying to profile a api of this project. I had followed the instructions of the readme of django-silk, but the profiling page was empty, though i could see files generated under profiles directory which i configured.

    The project's address is https://github.com/bluven/py-perf, it's a simple project, the method i profiled is api/views/UserViewSet.list

    settings.py

    INSTALLED_APPS = [
        'django.contrib.admin',
        'django.contrib.auth',
        'django.contrib.contenttypes',
        'django.contrib.sessions',
        'django.contrib.messages',
        'django.contrib.staticfiles',
        'silk'
    ]
    
    MIDDLEWARE = [
        'silk.middleware.SilkyMiddleware',
        'django.middleware.cache.UpdateCacheMiddleware',
        'django.middleware.security.SecurityMiddleware',
        'django.contrib.sessions.middleware.SessionMiddleware',
        'django.middleware.common.CommonMiddleware',
        'django.middleware.csrf.CsrfViewMiddleware',
        'django.contrib.auth.middleware.AuthenticationMiddleware',
        'django.contrib.messages.middleware.MessageMiddleware',
        'django.middleware.clickjacking.XFrameOptionsMiddleware',
        'django.middleware.cache.FetchFromCacheMiddleware',
    ]
    
    SILKY_PYTHON_PROFILER = True
    SILKY_PYTHON_PROFILER_BINARY = True
    SILKY_PYTHON_PROFILER_RESULT_PATH = os.path.join(BASE_DIR, "profiles")
    

    api/views.py

    class UserViewSet(ModelViewSet):
        queryset = User.objects.all()
        serializer_class = UserSerializer
        lookup_field = 'username'
    
        @silk_profile()
        def list(self, request, *args, **kwargs):
            print('*')
            return super(UserViewSet, self).list(request, *args, **kwargs)
    
    

    Thanks in advance.

    bug good first issue 
    opened by bluven 14
  • NoReverseMatch: Reverse for 'summary' with arguments '()' and keyword arguments '{}' not found. 0 pattern(s) tried: []

    NoReverseMatch: Reverse for 'summary' with arguments '()' and keyword arguments '{}' not found. 0 pattern(s) tried: []

    I am getting NoReverseMatch error. I tried placing middleware at top but its giving same error.

    These are my middleware classes:

    MIDDLEWARE_CLASSES = (
        'django.contrib.sessions.middleware.SessionMiddleware',
        'subdomains.middleware.SubdomainURLRoutingMiddleware',
        'corsheaders.middleware.CorsMiddleware',
        'django.middleware.common.CommonMiddleware',
        'django.middleware.csrf.CsrfViewMiddleware',
        'django.contrib.auth.middleware.AuthenticationMiddleware',
        'django.contrib.messages.middleware.MessageMiddleware',
        'django.middleware.clickjacking.XFrameOptionsMiddleware',
        'social.apps.django_app.middleware.SocialAuthExceptionMiddleware',
        'django_mobile.middleware.MobileDetectionMiddleware',
        'django_mobile.middleware.SetFlavourMiddleware',
    )
    

    and its the traceback-

    Traceback (most recent call last):
      File "/usr/lib/python2.7/wsgiref/handlers.py", line 85, in run
        self.result = application(self.environ, self.start_response)
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/contrib/staticfiles/handlers.py", line 64, in __call__
        return self.application(environ, start_response)
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/core/handlers/wsgi.py", line 168, in __call__
        self.load_middleware()
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 44, in load_middleware
        mw_class = import_string(middleware_path)
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/utils/module_loading.py", line 26, in import_string
        module = import_module(module_path)
      File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
        __import__(name)
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/silk/middleware.py", line 31, in <module>
        fpath = silky_reverse('summary')
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/silk/middleware.py", line 27, in silky_reverse
        r = reverse(name, *args, **kwargs)
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/core/urlresolvers.py", line 551, in reverse
        return iri_to_uri(resolver._reverse_with_prefix(view, prefix, *args, **kwargs))
      File "/home/ashish/.virtualenvs/myapp/local/lib/python2.7/site-packages/django/core/urlresolvers.py", line 468, in _reverse_with_prefix
        (lookup_view_s, args, kwargs, len(patterns), patterns))
    NoReverseMatch: Reverse for 'summary' with arguments '()' and keyword arguments '{}' not found. 0 pattern(s) tried: []
    [24/Aug/2015 14:15:14] "GET /silk HTTP/1.1" 500 59
    

    Is this error due to middleware placement or its some other issue ?

    opened by a1Gupta 14
  • Django 2.0 support

    Django 2.0 support

    I have this error after update:

     File "/Users/izvr/Projects/bet/env/lib/python3.6/site-packages/silk/models.py", line 135, in Response
        request = OneToOneField(Request, related_name='response', db_index=True)
    TypeError: __init__() missing 1 required positional argument: 'on_delete'
    
    opened by volodchenkov 13
  • DB Deadlock when stress testing with silk

    DB Deadlock when stress testing with silk

    I got a deadlock error when testing with the latest version of silk (1.1.0).

    Here is the DB output:

            Process 149: DELETE FROM "silk_response" WHERE "silk_response"."request_id" IN ('629f685a-26dc-41ca-ba9d-cc8af1998ef9', '8336effc-217c-47a7-8cc2-6944b8aede7f', 'aa12852b-5f5b-40fa-a647-cc3ddd2ef4ba', '2b2d5e84-e595-4ccf-b06c-78db181b4f24', '3f94c00d-f0c3-4021-8def-703e363e4f8f', 'e88b9162-0455-4e78-ba7b-029694b493d8')
            Process 150: DELETE FROM "silk_response" WHERE "silk_response"."request_id" IN ('629f685a-26dc-41ca-ba9d-cc8af1998ef9', '9ad245bb-4b6a-49cf-b32c-1a547ee8c11f', '93c50572-f6ec-416c-a9d6-42798f1631dd', '1ffd6a86-f93e-48f8-a593-86184e26c417', '3f94c00d-f0c3-4021-8def-703e363e4f8f')
            Process 151: DELETE FROM "silk_response" WHERE "silk_response"."request_id" IN ('629f685a-26dc-41ca-ba9d-cc8af1998ef9', '9ad245bb-4b6a-49cf-b32c-1a547ee8c11f', 'aa12852b-5f5b-40fa-a647-cc3ddd2ef4ba', '8336effc-217c-47a7-8cc2-6944b8aede7f', '2b2d5e84-e595-4ccf-b06c-78db181b4f24', '93c50572-f6ec-416c-a9d6-42798f1631dd', '1ffd6a86-f93e-48f8-a593-86184e26c417', '3f94c00d-f0c3-4021-8def-703e363e4f8f', 'e88b9162-0455-4e78-ba7b-029694b493d8')
            Process 144: DELETE FROM "silk_response" WHERE "silk_response"."request_id" IN ('629f685a-26dc-41ca-ba9d-cc8af1998ef9', '9ad245bb-4b6a-49cf-b32c-1a547ee8c11f', 'aa12852b-5f5b-40fa-a647-cc3ddd2ef4ba', '8336effc-217c-47a7-8cc2-6944b8aede7f', '2b2d5e84-e595-4ccf-b06c-78db181b4f24', '93c50572-f6ec-416c-a9d6-42798f1631dd', '1ffd6a86-f93e-48f8-a593-86184e26c417', '3f94c00d-f0c3-4021-8def-703e363e4f8f', 'e88b9162-0455-4e78-ba7b-029694b493d8')
    2018-01-26 01:03:55.996 UTC [148] HINT:  See server log for query details.
    2018-01-26 01:03:55.996 UTC [148] STATEMENT:  DELETE FROM "silk_response" WHERE "silk_response"."request_id" IN ('629f685a-26dc-41ca-ba9d-cc8af1998ef9', '9ad245bb-4b6a-49cf-b32c-1a547ee8c11f', 'aa12852b-5f5b-40fa-a647-cc3ddd2ef4ba', '8336effc-217c-47a7-8cc2-6944b8aede7f', '2b2d5e84-e595-4ccf-b06c-78db181b4f24', '1ffd6a86-f93e-48f8-a593-86184e26c417', '3f94c00d-f0c3-4021-8def-703e363e4f8f', 'e88b9162-0455-4e78-ba7b-029694b493d8')
    2018-01-26 01:03:56.024 UTC [144] ERROR:  deadlock detected
    2018-01-26 01:03:56.024 UTC [144] DETAIL:  Process 144 waits for AccessExclusiveLock on tuple (443,8) of relation 16579 of database 12994; blocked by process 149.
            Process 149 waits for ShareLock on transaction 152027; blocked by process 150.
            Process 150 waits for AccessExclusiveLock on tuple (440,10) of relation 16579 of database 12994; blocked by process 151.
            Process 151 waits for ShareLock on transaction 152109; blocked by process 144.
    

    Output from pip freeze:

    amqp==2.2.2
    autopep8==1.3.4
    billiard==3.5.0.3
    blessings==1.6.1
    bpython==0.17
    cached-property==1.3.1
    celery==4.1.0
    certifi==2018.1.18
    chardet==3.0.4
    coreapi==2.3.3
    coreschema==0.0.4
    coverage==4.4.2
    curtsies==0.2.11
    Django==1.11.9
    django-auth-ldap==1.3.0
    django-cachalot==1.5.0
    django-extensions==1.9.9
    django-model-utils==3.1.1
    django-prettyjson==0.3.0
    django-rest-swagger==2.1.2
    django-silk==1.1.0
    django-url-filter==0.3.4
    djangorestframework==3.7.7
    drf-extensions==0.3.1
    drf-nested-routers==0.90.0
    enum-compat==0.0.2
    gevent==1.2.2
    gprof2dot==2016.10.13
    greenlet==0.4.12
    gunicorn==19.7.1
    idna==2.6
    itypes==1.1.0
    Jinja2==2.10
    kombu==4.1.0
    Markdown==2.6.11
    MarkupSafe==1.0
    mercury==1.0.0
    mock==2.0.0
    openapi-codec==1.3.2
    pbr==3.1.1
    psycopg2==2.7.3.2
    pycodestyle==2.3.1
    Pygments==2.2.0
    pyldap==2.4.45
    python-dateutil==2.6.1
    python-memcached==1.59
    pytz==2017.3
    requests==2.18.4
    simplejson==3.13.2
    six==1.11.0
    sqlparse==0.2.4
    standardjson==0.3.1
    stevedore==1.28.0
    typing==3.6.4
    uritemplate==3.0.0
    urllib3==1.22
    vine==1.1.4
    wcwidth==0.1.7
    Werkzeug==0.14.1
    

    Thanks -Selim

    opened by selimt 12
  • Quality of life improvements in Requests tab

    Quality of life improvements in Requests tab

    I'm using you're package quite often and wanted to give something back to this project 😄

    This PR focuses on improving experience on Request tab - one improvement per commit:

    • Add message when there are no requests to display: when there are no matches instead of displaying an empty page, let user know that there are no filter results
    • Add 'Clear all filters' button - when user fills in a few filters, clearing them is rather tedious task so I thought it would be nice to have a button to clear filters.
    • Add small margin for filter selects: I think this change makes filter section looks much better.

    This branch is based off 4.2.0 tag, please let me know if I need to rebase.

    opened by glujan 11
  • Run django-upgrade manually

    Run django-upgrade manually

    Debugging the failures in #620 , I ran django-upgrade manually to find what it was doing to files to cause the tests to fail. This PR contains the changes from running django-upgrade manually (and matches #620) except for the below change from django-upgrade which breaks tests and therefore is not included in this PR:

    diff --git a/silk/model_factory.py b/silk/model_factory.py
    index ba21fed..9a091c0 100644
    --- a/silk/model_factory.py
    +++ b/silk/model_factory.py
    @@ -74,7 +74,7 @@ class RequestModelFactory:
             self.request = request
    
         def content_type(self):
    -        content_type = self.request.META.get('CONTENT_TYPE', '')
    +        content_type = self.request.headers.get('content-type', '')
             return _parse_content_type(content_type)
    
         def encoded_headers(self):
    

    After this PR is landed, pre-commit CI can regenerate #620 and the auto-linter can continue to work. https://github.com/albertyw/django-silk/blob/master/.pre-commit-config.yaml#L54-L58 may need to be commented out though to prevent the above change from reappearing.

    opened by albertyw 1
  • Allow to generate more informative profile file name

    Allow to generate more informative profile file name

    The aim of this pull request is to generate a more informative profile file name. This would allow us to identify the endpoint that generates a profile file without the need to open it.

    To avoid breaking any existent use case I set this behavior behind the setting SILKY_PYTHON_PROFILER_EXTENDED_FILE_NAME that by default is disabled.

    If you think we can change the generated filename without worry we can simply apply this change always without the need to introduce the new settings.

    opened by k4rl85 2
  • RecursionError

    RecursionError

    Hi folks,

    thanks a lot for this great tool!

    When use it in drf project got RecursionError after some time. More deeper analysis showed that some functions get called recursively more and more times and after standard recursion depth = 1000 we see error 500.

    Restarting of python manage.py runserver Resets this "counter".

    What can it be?

    2022-12-17 13:00:35,666-ERROR-catalog_logger::middleware|56:: [email protected] GET /api/catalogs/medicine_groups/ occurred exception
    Traceback (most recent call last):
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 161, in wrapped_target
        result = target(*args, **kwargs)
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 159, in wrapped_target
        self._start_queries()
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 78, in _start_queries
        self._queries_before = self._query_identifiers_from_collector()
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 74, in _query_identifiers_from_collector
        return [x for x in DataCollector().queries]
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 68, in queries
        return self._get_objects(TYP_QUERIES)
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 75, in _get_objects
        objects = self.objects
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 64, in objects
        return getattr(self.local, 'objects', None)
    RecursionError: maximum recursion depth exceeded in comparison
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "/usr/local/lib/python3.10/site-packages/rest_framework/views.py", line 506, in dispatch
        response = handler(request, *args, **kwargs)
      File "/opt/app/utils/mixins.py", line 74, in list
        return super().list(request, *args, **kwargs)
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 161, in wrapped_target
        result = target(*args, **kwargs)
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 161, in wrapped_target
        result = target(*args, **kwargs)
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 161, in wrapped_target
        result = target(*args, **kwargs)
      [Previous line repeated 941 more times]
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 168, in wrapped_target
        self._finalise_queries()
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 109, in _finalise_queries
        self._end_queries()
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 82, in _end_queries
        self._queries_after = self._query_identifiers_from_collector()
      File "/usr/local/lib/python3.10/site-packages/silk/profiling/profiler.py", line 74, in _query_identifiers_from_collector
        return [x for x in DataCollector().queries]
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 68, in queries
        return self._get_objects(TYP_QUERIES)
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 75, in _get_objects
        objects = self.objects
      File "/usr/local/lib/python3.10/site-packages/silk/collector.py", line 64, in objects
        return getattr(self.local, 'objects', None)
    RecursionError: maximum recursion depth exceeded in comparison
    

    Can dynamic profiling of generic DRF views mixins be involdev?

    SILKY_DYNAMIC_PROFILING = [
        {
            'module': 'rest_framework.mixins.RetrieveModelMixin',
            'function': 'retrieve'
        },
        {
            'module': 'rest_framework.mixins.CreateModelMixin',
            'function': 'create'
        },
        {
            'module': 'rest_framework.mixins.ListModelMixin',
            'function': 'list'
        },
        {
            'module': 'rest_framework.mixins.UpdateModelMixin',
            'function': 'update'
        },
        {
            'module': 'rest_framework.mixins.DestroyModelMixin',
            'function': 'destroy'
        },
    ]
    
    
    opened by sergun 0
  • Allow to delete some requests

    Allow to delete some requests

    In development, I let silk live in the background and I often spawn its summary page to see page that takes the most time/queries.

    Now I sometimes use pdb on some requests so the time calculated for these is not relevant, and it would be nice to have a button to remove them from the DB so that the summary page can be updated.

    feature good first issue 
    opened by SebCorbin 0
Releases(5.0.2)
  • 5.0.2(Oct 29, 2022)

    5.0.2 (2022-10-12)

    :release-by: Albert Wang (@albertyw) Full Changelog

    Fixes:

    • Multipart forms and RawPostDataException (#592)
    • Decrease unnecessary database hits (#587) (#588)

    Features/Enhancements:

    • Remove unneeded pytz package (#603)
    • Use contextlib in test_profile_parser (#590)
    • Add support for storages, that don't implement full filesystem path (#596)
    Source code(tar.gz)
    Source code(zip)
  • 5.0.1(Jul 3, 2022)

  • 4.4.1(Jul 3, 2022)

  • 5.0.0(Jun 27, 2022)

  • 4.4.0(Jun 27, 2022)

    4.4.0 (2022-06-20)

    :release-by: Albert Wang (@albertyw) Full Changelog

    Features/Enhancements:

    • Switch 'Apply' and 'Clear all filters' ordering
    • Make filters on Requests tab more visible
    • Add small margin for filter selects
    • Add 'Clear all filters' button
    • Add message when there are no requests to display
    • Making the error logging more accurate and explicit
    • Fixing #530 - Adding support for SILKY_EXPLAIN_FLAGS

    Maintenance and Cleanup:

    • Remove unused js compilation pipeline (#561)
    • Fix pre-commit-config

    Dependencies:

    • Update jquery to 3.6.0 and jquery-ui to 1.13.1 [#508]
    • [pre-commit.ci] pre-commit autoupdate (#560, #571)
    • Add django-upgrade to pre-commit hooks (#566)

    Moved to 5.0.0

    • Drop support for Django 2.2 (EOL) (#567)
    Source code(tar.gz)
    Source code(zip)
  • 4.3.0(Mar 5, 2022)

    What's Changed

    • Jazzband: Synced file(s) with jazzband/.github by @jazzband-bot in https://github.com/jazzband/django-silk/pull/518
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/520
    • Fix installation instructions in README by @side2k in https://github.com/jazzband/django-silk/pull/521
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/523
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/524
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/526
    • Add Python 3.10 compatibility by @hramezani in https://github.com/jazzband/django-silk/pull/527
    • Django main by @hramezani in https://github.com/jazzband/django-silk/pull/528
    • Remove unneeded dependency Pygments by @jayvdb in https://github.com/jazzband/django-silk/pull/532
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/533
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/535
    • Replace assertDictContainsSubset by @albertyw in https://github.com/jazzband/django-silk/pull/536
    • Use correct db in a multi db setup by @glujan in https://github.com/jazzband/django-silk/pull/538
    • Update django version by @eduzen in https://github.com/jazzband/django-silk/pull/544
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/552
    • Some tests misusing assertTrue for comparisons fix by @code-review-doctor in https://github.com/jazzband/django-silk/pull/550
    • Standardize supported django versions by @albertyw in https://github.com/jazzband/django-silk/pull/553
    • Drop support for python 3.6 by @albertyw in https://github.com/jazzband/django-silk/pull/554
    • Remove duplicate requirements.txt dependencies by @albertyw in https://github.com/jazzband/django-silk/pull/555
    • Pin dependencies in requirements.txt by @albertyw in https://github.com/jazzband/django-silk/pull/556
    • Release version v4.3.0 by @albertyw in https://github.com/jazzband/django-silk/pull/557

    New Contributors

    • @jazzband-bot made their first contribution in https://github.com/jazzband/django-silk/pull/518
    • @side2k made their first contribution in https://github.com/jazzband/django-silk/pull/521
    • @jayvdb made their first contribution in https://github.com/jazzband/django-silk/pull/532
    • @glujan made their first contribution in https://github.com/jazzband/django-silk/pull/538
    • @eduzen made their first contribution in https://github.com/jazzband/django-silk/pull/544
    • @code-review-doctor made their first contribution in https://github.com/jazzband/django-silk/pull/550

    Full Changelog: https://github.com/jazzband/django-silk/compare/4.2.0...4.3.0

    Source code(tar.gz)
    Source code(zip)
  • 4.2.0(Oct 23, 2021)

    What's Changed

    • #427 Passed WSGI request to SILKY_PYTHON_PROFILER_FUNC by @nasirhjafri in https://github.com/jazzband/django-silk/pull/438
    • Added Django 3.1 to Travis test matrix by @smithdc1 in https://github.com/jazzband/django-silk/pull/441
    • Do not crash when silk app is not included in urls by @asalahli in https://github.com/jazzband/django-silk/pull/443
    • Add the SILKY_JSON_ENSURE_ASCII configuration item to support Chinese by @eshxcmhk in https://github.com/jazzband/django-silk/pull/420
    • Add row view for requests page by @mierz00 in https://github.com/jazzband/django-silk/pull/440
    • RequestModelFactory: fallback if request body too large, fix #162 by @ge0rg in https://github.com/jazzband/django-silk/pull/451
    • Add query execution plan to sql_detail by @MRoci in https://github.com/jazzband/django-silk/pull/452
    • Add Python 3.9 compatibility by @tirkarthi in https://github.com/jazzband/django-silk/pull/404
    • Replace url with path for Django 4.0 by @MuslimBeibytuly in https://github.com/jazzband/django-silk/pull/445
    • Migrate to GitHub Actions. by @jezdez in https://github.com/jazzband/django-silk/pull/460
    • Rename Django's dev branch to main. by @jezdez in https://github.com/jazzband/django-silk/pull/463
    • Fix transaction error for mysql by @yuekui in https://github.com/jazzband/django-silk/pull/464
    • Fix django 3.2 support by @Jorl17 in https://github.com/jazzband/django-silk/pull/466
    • parse query when counting joins by @MRoci in https://github.com/jazzband/django-silk/pull/453
    • Update django support by @hramezani in https://github.com/jazzband/django-silk/pull/467
    • Temporary fix for testing Django 2.2 by @Andrew-Chen-Wang in https://github.com/jazzband/django-silk/pull/486
    • Fix egg metadata error by @Archmonger in https://github.com/jazzband/django-silk/pull/485
    • DOC: Remove outdated security notice by @MT-Cash in https://github.com/jazzband/django-silk/pull/491
    • fix incorrectly made decorator by @Archmonger in https://github.com/jazzband/django-silk/pull/492
    • Fixed a bug that the profile tab could not be opened when the source … by @Taikono-Himazin in https://github.com/jazzband/django-silk/pull/490
    • Generate missing row.css from sass file by @przxmek in https://github.com/jazzband/django-silk/pull/480
    • Ensure sorting between most db queries requests by @ErwinJunge in https://github.com/jazzband/django-silk/pull/484
    • Don't return null values when computing "Most Time Overall" summary by @ErwinJunge in https://github.com/jazzband/django-silk/pull/482
    • fix: DB connection to ClearDB when multiple databases by @prayashm in https://github.com/jazzband/django-silk/pull/469
    • Don't return null values when computing "Most Time Overall" summary by @ErwinJunge in https://github.com/jazzband/django-silk/pull/483
    • fix: DataCollector sql_queries model not found on filter(request=self… by @armanjtehrani in https://github.com/jazzband/django-silk/pull/476
    • Add tests that access the actual DB by @marius-mather in https://github.com/jazzband/django-silk/pull/493
    • Update Django Support in the README.md by @starryrbs in https://github.com/jazzband/django-silk/pull/474
    • apps.py added with default_auto_field set by @daadu in https://github.com/jazzband/django-silk/pull/495
    • Make sensitive keys set configurable by @jeffrey-effendy in https://github.com/jazzband/django-silk/pull/494
    • Revert "apps.py added with default_auto_field set" by @auvipy in https://github.com/jazzband/django-silk/pull/497
    • remove python 2 style super() call from models by @auvipy in https://github.com/jazzband/django-silk/pull/499
    • remove python 2 style codes from across the codebase by @auvipy in https://github.com/jazzband/django-silk/pull/500
    • doc(readme): minor correction by @daadu in https://github.com/jazzband/django-silk/pull/501
    • Fix broken test on Windows 10 (SQLite) by @Archmonger in https://github.com/jazzband/django-silk/pull/504
    • Remove Make Migrations by @Archmonger in https://github.com/jazzband/django-silk/pull/503
    • Support Simple Pre-Commit CI by @Archmonger in https://github.com/jazzband/django-silk/pull/507
    • Add isort to CI by @Archmonger in https://github.com/jazzband/django-silk/pull/509
    • Remove garbage files by @Archmonger in https://github.com/jazzband/django-silk/pull/510
    • Add pyupgrade to CI by @Archmonger in https://github.com/jazzband/django-silk/pull/511
    • Add flake8, autopep8, and pycln to CI by @Archmonger in https://github.com/jazzband/django-silk/pull/512
    • Remove obsolete files by @Archmonger in https://github.com/jazzband/django-silk/pull/513
    • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/jazzband/django-silk/pull/516
    • Docln by @auvipy in https://github.com/jazzband/django-silk/pull/519

    New Contributors

    • @smithdc1 made their first contribution in https://github.com/jazzband/django-silk/pull/441
    • @asalahli made their first contribution in https://github.com/jazzband/django-silk/pull/443
    • @mierz00 made their first contribution in https://github.com/jazzband/django-silk/pull/440
    • @ge0rg made their first contribution in https://github.com/jazzband/django-silk/pull/451
    • @MRoci made their first contribution in https://github.com/jazzband/django-silk/pull/452
    • @tirkarthi made their first contribution in https://github.com/jazzband/django-silk/pull/404
    • @MuslimBeibytuly made their first contribution in https://github.com/jazzband/django-silk/pull/445
    • @jezdez made their first contribution in https://github.com/jazzband/django-silk/pull/460
    • @yuekui made their first contribution in https://github.com/jazzband/django-silk/pull/464
    • @Jorl17 made their first contribution in https://github.com/jazzband/django-silk/pull/466
    • @hramezani made their first contribution in https://github.com/jazzband/django-silk/pull/467
    • @Andrew-Chen-Wang made their first contribution in https://github.com/jazzband/django-silk/pull/486
    • @Archmonger made their first contribution in https://github.com/jazzband/django-silk/pull/485
    • @MT-Cash made their first contribution in https://github.com/jazzband/django-silk/pull/491
    • @Taikono-Himazin made their first contribution in https://github.com/jazzband/django-silk/pull/490
    • @przxmek made their first contribution in https://github.com/jazzband/django-silk/pull/480
    • @ErwinJunge made their first contribution in https://github.com/jazzband/django-silk/pull/484
    • @prayashm made their first contribution in https://github.com/jazzband/django-silk/pull/469
    • @armanjtehrani made their first contribution in https://github.com/jazzband/django-silk/pull/476
    • @marius-mather made their first contribution in https://github.com/jazzband/django-silk/pull/493
    • @starryrbs made their first contribution in https://github.com/jazzband/django-silk/pull/474
    • @daadu made their first contribution in https://github.com/jazzband/django-silk/pull/495
    • @jeffrey-effendy made their first contribution in https://github.com/jazzband/django-silk/pull/494
    • @pre-commit-ci made their first contribution in https://github.com/jazzband/django-silk/pull/516

    Full Changelog: https://github.com/jazzband/django-silk/compare/4.1.0...4.2.0

    Source code(tar.gz)
    Source code(zip)
  • 4.1.0(Aug 7, 2020)

    4.1.0 (2020-08-07)

    Full Changelog

    New features/Implemented enhancements:

    Fixed bugs:

    Closed issues:

    • _mask_credentials uses UGC in a regex substitution #410 (barm)
    • Django Silk is not compatible with Django 3.1: EmptyResultSet is removed in Django 3.1 #431 (Tirzono)

    Merged pull requests:

    • Wrap re.sub() in try-except #412 (bambookchos)
    • Replace the call to re.findall with re.sub in _mask_credentials so matched values are not treated as regex patterns #413 (ThePumpingLemma)
    • Capture entire key name during cleansing in _mask_credentials #414 (ThePumpingLemma)
    • Clear DB error when configuring silk to use a non-' default' database #417 (eshxcmhk)
    • Fix force_text RemovedInDjango40Warning #422 (justinmayhew)
    • Make compatible with Django 3.1 #432 (Tirzono)
    • Update README.md django-silk is tested with Django 3.1 #433 (Tirzono)
    Source code(tar.gz)
    Source code(zip)
  • 4.0.1(Mar 12, 2020)

    4.0.1 (2020-03-12)

    Full Changelog

    New features/Implemented enhancements:

    Fixed bugs:

    Closed issues:

    • The "Clear DB" page doesn't work with PostgreSQL #395 (Ikalou)

    Merged pull requests:

    Source code(tar.gz)
    Source code(zip)
  • 4.0.0(Jan 21, 2020)

    New features/Implemented enhancements:

    Fixed bugs:

    Closed issues:

    • Ability to clean up all requests/queries #365
    • Use bulk_create to save number of queries #369
    • Headers are not sanitized #375
    • Django 3 support #382
    • Support functional cProfile enable #390

    Merged pull requests:

    Source code(tar.gz)
    Source code(zip)
  • 3.0.4(Sep 5, 2019)

    Implemented enhancements:

    • templates: limit select width to its container one #351 (xrmx)
    • Clean up RemovedInDjango30Warning with {% load staticfiles %} #353 (devmonkey22)
    • Simplify pattern masking and handle dicts #355 (Chris7)

    Fixed bugs:

    Closed issues:

    • Clean up RemovedInDjango30Warning warning re load staticfiles in Django 2.1+ #352

    Merged pull requests:

    • Fix masking sensitive data in batch JSON request #342 (nikolaik)
    • Fix project url on PyPi #343 (luzfcb)
    • templates: limit select width to its container one #351 (xrmx)
    • Clean up RemovedInDjango30Warning with {% load staticfiles %} #353 (devmonkey22)
    • Simplify pattern masking and handle dicts #355 (Chris7)
    Source code(tar.gz)
    Source code(zip)
  • 3.0.3(Aug 13, 2019)

    Implemented enhancements:

    • templates: limit select width to its container one #351 (xrmx)
    • Clean up RemovedInDjango30Warning with {% load staticfiles %} #353 (devmonkey22)
    • Simplify pattern masking and handle dicts #355 (Chris7)

    Fixed bugs:

    Closed issues:

    • Clean up RemovedInDjango30Warning warning re load staticfiles in Django 2.1+ #352

    Merged pull requests:

    • Fix masking sensitive data in batch JSON request #342 (nikolaik)
    • Fix project url on PyPi #343 (luzfcb)
    • templates: limit select width to its container one #351 (xrmx)
    • Clean up RemovedInDjango30Warning with {% load staticfiles %} #353 (devmonkey22)
    • Simplify pattern masking and handle dicts #355 (Chris7)
    Source code(tar.gz)
    Source code(zip)
  • 3.0.2(Apr 23, 2019)

    Implemented enhancements:

    Fixed bugs:

    • Long url path causes Http 500 #312

    Closed issues:

    • Permission checking is skipped due to order of silk_profile decorator #336
    • Support gprof2dot 2017.09.19 #332
    • Duplicate #310 #328
    • Profiling management commands #327
    • NoReverseMatch at /cart/detail/ Reverse for 'cart_add' with arguments not found. #324
    • Request body sanitization #305
    • How to profile middleware? #303
    • Disabling Silk for specific URLs #292
    • silk_clear_request_log fails on Postgres #290
    • silk profile is not work, with dango-version 2.0.2 and django-silk version 2.0.0 #277
    • DataError: value too long for type character varying(190) #179

    Merged pull requests:

    Source code(tar.gz)
    Source code(zip)
  • 3.0.1(Jul 3, 2018)

  • 3.0.0(May 28, 2018)

    • Dropped support for Django<1.11.0
    • Dropped support for python 3.3
    • Fix string/byte typing (#268)
    • Fix collecting meta profiling in Django > 2 (#274)
    • Fix FORCE_SCRIPT_NAME (#278)
    • Revert opening sql queries in new tab
    Source code(tar.gz)
    Source code(zip)
  • 2.0.0(Jan 28, 2018)

    • Fix migration for request.prof_file field (#245)
    • Dropped support for Django 1.5
    • Dropped support for Django 1.6
    • Dropped support for Django 1.7 (#247)
    • Updated documentation (#250)
    Source code(tar.gz)
    Source code(zip)
  • 1.1.0(Dec 27, 2017)

    • Support for Django 2 and Python 3.6
    • Support garbage collecting old profiling data
    • Moved project to jazzband
    • Better data visualizations (#194)
    • Added ability to filter requests by http verb (#192)
    • Various UI fixes
    • Various bug and testing fixes
    Source code(tar.gz)
    Source code(zip)
  • 1.0.0(Mar 25, 2017)

    • Improved MySQL support (#167 , #38)
      • Changes length of Request.path and Request.view_name fields
      • Length changes accounts for utf8bm4
    • Updates travis matrix and requirements dependencies versions (#165)
      • Drops Django 1.7 Support & starts Django 1.11 testing
    • Fixes scenario where ValueError exception is raised therefore causing no profiling to register (#161 , #164)
    • Adds configuration for wheels support (#168 , #149)
    • Adds Code style improvements for readability (#166)

    IMPORTANT As a major version release, expect some unintended quirks over existing installations. @smaccona highlighted a couple MySQL scenario's here . PostgreSQL users should be fine. Upgrade accordingly.

    Thanks to ( @auvipy, @smaccona , @PeRDy )

    Source code(tar.gz)
    Source code(zip)
  • 0.7.3(Feb 13, 2017)

    • Improves profile storage location (#152, #151 )
      • ProfileDownloadView now available.
    • Stores cProfiler into threaded local storage (#153, #155)
    • Upgrades testing library.

    Thanks to ( @r3m0t , @Drache91).

    Source code(tar.gz)
    Source code(zip)
  • 0.7.2(Dec 3, 2016)

    • Fixes Django 1.10 middleware instantiation issue #148
    • Fixes Middleware exception handling to be SQL agnostic #142, #144, #146, #150
    • Adds TravisCI testing of various SQL backends #145

    Thanks to ( @mattjegan , @hanleyhansen , @lockie )

    Source code(tar.gz)
    Source code(zip)
  • 0.7.1(Oct 1, 2016)

    • In the event of an SQL OperationalError while trying to process a request due to a large query, a try catch was introduced to retry the processing (#140).

    Thanks to @hanleyhansen.

    Source code(tar.gz)
    Source code(zip)
  • 0.7.0(Sep 21, 2016)

    • You can now choose to save binary profile to a path/location of your choosing. (#131)
    • Middleware update to SilkyMiddleware allows for Django 1.10 compatibility. (#138)
    • csrf imports in requests.py have been swapped to avoid emitting errors. (#136)
    • Manifest file update to allow compilation of project on Windows machines. (#139)
    • Logging has been namespaced for finer-grained control of logging output across Silk components. (#133)

    Thanks to (@javaguirre, @blag, @shanx, @leifdenby, @aehlke )

    Source code(tar.gz)
    Source code(zip)
  • 0.6.2(Jul 28, 2016)

  • 0.6.1(Jul 13, 2016)

    • Fix for install issue via setup.py file (#125, #126 , #127 , #128 ).
      • Manifest file includes all readme files.

    Thanks to (@hanleyhansen, @chid, @SzySteve)

    Source code(tar.gz)
    Source code(zip)
  • 0.6.0(Jul 12, 2016)

    • Ability to export .profile as binary downloads
    • Fixes to local development project to allow continued development
    • Fixes to all unit tests for a green TravisCI build
    • Usage of Django's six module versus a statically imported version
    • Upgrade of Pillow requirement for successful installation

    Thanks to: ( @hanleyhansen, @auvipy, @chrono, @svisser )

    Source code(tar.gz)
    Source code(zip)
  • 0.5.7(Mar 21, 2016)

    • Django 1.9 support
    • Base64 encoding of raw request body for support of binary responses. (i.e. images)
    • Ability to sort ascending/descending order in the RequestsView.
    • Unit test enhancements.
    • Stability tweaks and small performance improvements.

    Thanks to ( @Alkalit , @trik , @blag , @Wrhector , @digitaldavenyc )

    Source code(tar.gz)
    Source code(zip)
  • 0.5.6(Sep 6, 2015)

  • 0.5.2(Apr 15, 2015)

  • 0.5.1(Apr 8, 2015)

  • 0.5(Apr 8, 2015)

Owner
Jazzband
We are all part of this
Jazzband
Pyccel stands for Python extension language using accelerators.

Pyccel stands for Python extension language using accelerators.

Pyccel 242 Jan 02, 2023
Cinder is Instagram's internal performance-oriented production version of CPython

Cinder is Instagram's internal performance-oriented production version of CPython 3.8. It contains a number of performance optimizations, including bytecode inline caching, eager evaluation of corout

Facebook Incubator 2.2k Dec 30, 2022
Sampling profiler for Python programs

py-spy: Sampling profiler for Python programs py-spy is a sampling profiler for Python programs. It lets you visualize what your Python program is spe

Ben Frederickson 9.5k Jan 01, 2023
Django query profiler - one profiler to rule them all. Shows queries, detects N+1 and gives recommendations on how to resolve them

Django Query Profiler This is a query profiler for Django applications, for helping developers answer the question "My Django code/page/API is slow, H

Django Query Profiler 116 Dec 15, 2022
PerfSpect is a system performance characterization tool based on linux perf targeting Intel microarchitectures

PerfSpect PerfSpect is a system performance characterization tool based on linux perf targeting Intel microarchitectures. The tool has two parts perf

Intel Corporation 139 Dec 30, 2022
guapow is an on-demand and auto performance optimizer for Linux applications.

guapow is an on-demand and auto performance optimizer for Linux applications. This project's name is an abbreviation for Guarana powder (Guaraná is a fruit from the Amazon rainforest with a highly ca

Vinícius Moreira 19 Nov 18, 2022
Rip Raw - a small tool to analyse the memory of compromised Linux systems

Rip Raw Rip Raw is a small tool to analyse the memory of compromised Linux systems. It is similar in purpose to Bulk Extractor, but particularly focus

Cado Security 127 Oct 28, 2022
A low-impact profiler to figure out how much memory each task in Dask is using

dask-memusage If you're using Dask with tasks that use a lot of memory, RAM is your bottleneck for parallelism. That means you want to know how much m

Itamar Turner-Trauring 23 Dec 09, 2022
Pearpy - a Python package for writing multithreaded code and parallelizing tasks across CPU threads.

Pearpy The Python package for (pear)allelizing your tasks across multiple CPU threads. Installation The latest version of Pearpy can be installed with

MLH Fellowship 5 Nov 01, 2021
Python compiler that massively increases Python's code performance without code changes.

Flyable - A python compiler for highly performant code Flyable is a Python compiler that generates efficient native code. It uses different techniques

Flyable 35 Dec 16, 2022
Shrapnel is a scalable, high-performance cooperative threading library for Python.

This Python library was evolved at IronPort Systems and has been provided as open source by Cisco Systems under an MIT license. Intro Shrapnel is a li

216 Nov 06, 2022
Silky smooth profiling for Django

Silk Silk is a live profiling and inspection tool for the Django framework. Silk intercepts and stores HTTP requests and database queries before prese

Jazzband 3.7k Jan 01, 2023
This tool allows to gather statistical profile of CPU usage of mixed native-Python code.

Sampling Profiler for Python This tool allows to gather statistical profile of CPU usage of mixed native-Python code. Currently supported platforms ar

Intel Corporation 13 Oct 04, 2022