Rate-limit-semaphore - Semaphore implementation with rate limit restriction for async-style (any core)

Last update: Jun 21, 2022

Related tags

Overview

Rate Limit Semaphore

Rate limit semaphore for async-style (any core)

There are two implementations of rate limit semaphore. Live demo shows how FixedNewPreviousDelaySemaphore and FixedNewFirstDelaySemaphore work

Overview

import datetime
import ralisem

# Or another implementation
sem = ralisem.FixedNewPreviousDelaySemaphore(
    access_times=3, per=datetime.timedelta(seconds=1)
)
async with sem:
    ...

Difference:

FixedNewPreviousDelaySemaphore: Sures the last and a new access have a fixed required delay (per / access_times)
FixedNewFirstDelaySemaphore: Sures first and last in series (serias is access_times) have a fixed delay (per)

Methods

All of these implementations are inherited from one base TimeRateLimitSemaphoreBase. Check out full methods here

Installation

Via PyPI:

python -m pip install ralisem

Or via GitHub

python -m pip install https://github.com/deknowny/rate-limit-semaphore/archive/main.zip

Contributing

Check out Contributing section

You might also like...

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Poisson Image Editing - A Parallel Implementation Jiayi Weng (jiayiwen), Zixu Chen (zixuc) Poisson Image Editing is a technique that can fuse two imag

110 Dec 27, 2022

PyTorch implementation of Advantage async actor-critic Algorithms (A3C) in PyTorch

Advantage async actor-critic Algorithms (A3C) in PyTorch @inproceedings{mnih2016asynchronous, title={Asynchronous methods for deep reinforcement lea

111 Dec 8, 2022

Implementation of "Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner"

Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner This repository is the official implementation of Meta-rPPG: Remote Heart Ra

137 Dec 13, 2022

PyTorch implementation of the paper Deep Networks from the Principle of Rate Reduction

Deep Networks from the Principle of Rate Reduction This repository is the official PyTorch implementation of the paper Deep Networks from the Principl

459 Dec 27, 2022

PyTorch implementation of some learning rate schedulers for deep learning researcher.

pytorch-lr-scheduler PyTorch implementation of some learning rate schedulers for deep learning researcher. Usage WarmupReduceLROnPlateauScheduler Visu

59 Dec 8, 2022

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

Deep Networks from the Principle of Rate Reduction This repository is the official NumPy implementation of the paper Deep Networks from the Principle

49 Dec 16, 2022

A Pytorch Implementation of a continuously rate adjustable learned image compression framework.

GainedVAE A Pytorch Implementation of a continuously rate adjustable learned image compression framework, Gained Variational Autoencoder(GainedVAE). N

39 Dec 24, 2022

Pytorch implementation of Learning Rate Dropout.

Learning-Rate-Dropout Pytorch implementation of Learning Rate Dropout. Paper Link: https://arxiv.org/pdf/1912.00144.pdf Train ResNet-34 for Cifar10: r

42 Nov 25, 2022

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks. Bayesian-Torch is designed to be flexible and seamless in extending a deterministic deep neural network architecture to corresponding Bayesian form by simply replacing the deterministic layers with Bayesian layers.

210 Jan 4, 2023

Releases(v0.1.0)

v0.1.0(Feb 15, 2022)

A few words…

Если вы, как и я, уже устали писать что-то под API, имеющее rate limit на запросы, и постоянно делать костыли, чтобы этот rate limit не превысить, то эта библиотека именно для вас

ralisem предоставляет две имплементации семафора с ограничением по частоте исполнения вместо ограничения по количеству исполняемых одновременно задач, что предоставляет стандартный asyncio.Semaphore. Одна из них ожидает равное количество времени между каждыми исполняемыми задачами, другая проверяет, чтобы 1 и последняя задача в серии имели заданный промежуток ожидания (прикрепил две лайв демки). Сделано на anyio, поэтому будет работать как на asyncio, так и на trio

Да, будет заюзано в квике для ограничения частоты обращений к API (собственно, это и послужило поводом)

Если кто подскажет, как на такое писать юнит тесты — буду рад (думал как-то через моки текущего времени, но жутко лень). Сейчас работает на честном слове

Доки здесь не нужно, чисто пара слов в ридми. На PyPI залита
Source code(tar.gz)
Source code(zip)

Rate-limit-semaphore - Semaphore implementation with rate limit restriction for async-style (any core)

Related tags

Overview

Rate Limit Semaphore

Overview

Methods

Installation

Contributing

You might also like...

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

PyTorch implementation of Advantage async actor-critic Algorithms (A3C) in PyTorch

Implementation of "Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner"

PyTorch implementation of the paper Deep Networks from the Principle of Rate Reduction

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

A Pytorch Implementation of a continuously rate adjustable learned image compression framework.

Pytorch implementation of Learning Rate Dropout.

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks

Releases(v0.1.0)

v0.1.0(Feb 15, 2022)

A few words…

Owner

Yan Kurbatov

Implementation for the paper: Invertible Denoising Network: A Light Solution for Real Noise Removal (CVPR2021).

Co-mining: Self-Supervised Learning for Sparsely Annotated Object Detection, AAAI 2021.

code for Fast Point Cloud Registration with Optimal Transport

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in Tensorflow Lite.

A Strong Baseline for Image Semantic Segmentation

Minimal diffusion models - Minimal code and simple experiments to play with Denoising Diffusion Probabilistic Models (DDPMs)

This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.

This implements one of result networks from Large-scale evolution of image classifiers

PyTea: PyTorch Tensor shape error analyzer

Official Pytorch implementation of MixMo framework

Deep Learning Slide Captcha

FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.

Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

Do Neural Networks for Segmentation Understand Insideness?

Official codebase for "B-Pref: Benchmarking Preference-BasedReinforcement Learning" contains scripts to reproduce experiments.

realsense d400 -> jpg + csv

Library for 8-bit optimizers and quantization routines.

Parameterized Explainer for Graph Neural Network

Dictionary Learning with Uniform Sparse Representations for Anomaly Detection

NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥