Pyeventbus: a publish/subscribe event bus

Last update: Apr 21, 2022

Overview

pyeventbus

pyeventbus is a publish/subscribe event bus for Python 2.7.

simplifies the communication between python classes
decouples event senders and receivers
performs well threads, greenlets, queues and concurrent processes
avoids complex and error-prone dependencies and life cycle issues
makes code simpler
has advanced features like delivery threads, workers and spawning different processes, etc.
is tiny (3KB archive)

pyeventbus in 3 steps:

Define events:

class MessageEvent:
    # Additional fields and methods if needed
    def __init__(self):
        pass

Prepare subscribers: Declare and annotate your subscribing method, optionally specify a thread mode:

from pyeventbus import *

@subscribe(onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

from pyeventbus import *

class MyClass:
    def __init__(self):
        pass

    def register(self, myclass):
        PyBus.Instance().register(myclass, self.__class__.__name__)

# then during initilization

myclass = MyClass()
myclass.register(myclass)

Post events:

from pyeventbus import *

class MyClass:
    def __init__(self):
        pass

    def register(self, myclass):
        PyBus.Instance().register(myclass, self.__class__.__name__)

    def postingAnEvent(self):
        PyBus.Instance().post(MessageEvent())

 myclass = MyClass()
 myclass.register(myclass)
 myclass.postingAnEvent()

Modes: pyeventbus can run the subscribing methods in 5 different modes

POSTING:

Runs the method in the same thread as posted. For example, if an event is posted from main thread, the subscribing method also runs in the main thread. If an event is posted in a seperate thread, the subscribing method runs in the same seperate method

This is the default mode, if no mode has been provided::

@subscribe(threadMode = Mode.POSTING, onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

PARALLEL:

Runs the method in a seperate python thread::

@subscribe(threadMode = Mode.PARALLEL, onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

GREENLET:

Runs the method in a greenlet using gevent library::

@subscribe(threadMode = Mode.GREENLET, onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

BACKGROUND:

Adds the subscribing methods to a queue which is executed by workers::

@subscribe(threadMode = Mode.BACKGROUND, onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

CONCURRENT:

Runs the method in a seperate python process::

@subscribe(threadMode = Mode.CONCURRENT, onEvent=MessageEvent)
def func(self, event):
    # Do something
    pass

Adding pyeventbus to your project:

pip install pyeventbus

Example:

git clone https://github.com/n89nanda/pyeventbus.git

cd pyeventbus

virtualenv venv

source venv/bin/activate

pip install pyeventbus

python example.py

Benchmarks and Performance:

Refer /pyeventbus/tests/benchmarks.txt for performance benchmarks on CPU, I/O and networks heavy tasks.

Run /pyeventbus/tests/test.sh to generate the same benchmarks.

Performance comparison between all the modes with Python and Cython

Inspiration

Inspired by Eventbus from greenrobot: https://github.com/greenrobot/EventBus

You might also like...

Code for the paper "Unsupervised Contrastive Learning of Sound Event Representations", ICASSP 2021.

Unsupervised Contrastive Learning of Sound Event Representations This repository contains the code for the following paper. If you use this code or pa

81 Dec 22, 2022

Repo for "Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks"

Summary This is the code for the paper Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks by Yanxiang Wang, Xian Zh

54 Jan 3, 2023

Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)

Cross-media Structured Common Space for Multimedia Event Extraction Table of Contents Overview Requirements Data Quickstart Citation Overview The code

49 Nov 21, 2022

CVPRW 2021: How to calibrate your event camera

E2Calib: How to Calibrate Your Event Camera This repository contains code that implements video reconstruction from event data for calibration as desc

104 Nov 16, 2022

Repository relating to the CVPR21 paper TimeLens: Event-based Video Frame Interpolation

TimeLens: Event-based Video Frame Interpolation This repository is about the High Speed Event and RGB (HS-ERGB) dataset, used in the 2021 CVPR paper T

544 Dec 19, 2022

An implementation for `Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction`

Text2Event An implementation for Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction Please contact Yaojie Lu (@

153 Jan 7, 2023

Official PyTorch implementation of N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Cameras (ICCV 2021)

N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Cameras Official PyTorch implementation of N-ImageNet: Towards Robust, Fine-Gra

32 Dec 26, 2022

SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data

SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data Au

14 Nov 28, 2022

Weakly Supervised Dense Event Captioning in Videos, i.e. generating multiple sentence descriptions for a video in a weakly-supervised manner.

WSDEC This is the official repo for our NeurIPS paper Weakly Supervised Dense Event Captioning in Videos. Description Repo directories ./: global conf

96 Nov 1, 2022

Comments

Same method name for multiple subscribers bug

Please see the code below. To summarize:

Define one event
Define two subscriber listening for the event above. Each subscriber has a listener method with the name on_event
Each of the subscriber classes above defines an instance field, but with unique name (self.something in the first class, self.something2 in the second class)
Define another class that posts an event

Run this scenario and get the error below:

Exception in thread thread-on_event:
Traceback (most recent call last):
  File "C:\Anaconda2\envs\python\lib\threading.py", line 801, in __bootstrap_inner
    self.run()
  File "C:\Anaconda2\envs\python\lib\site-packages\pyeventbus\pyeventbus.py", line 112, in run
    self.method(self.subscriber, self.event)
  File "C:/FractureID/projects/python/ui/spectraqc/PyEventBusBug.py", line 16, in on_event
    print (self.something)
AttributeError: Subscriber2 instance has no attribute 'something'

Exception in thread thread-on_event:
Traceback (most recent call last):
  File "C:\Anaconda2\envs\python\lib\threading.py", line 801, in __bootstrap_inner
    self.run()
  File "C:\Anaconda2\envs\python\lib\site-packages\pyeventbus\pyeventbus.py", line 112, in run
    self.method(self.subscriber, self.event)
  File "C:/FractureID/projects/python/ui/spectraqc/PyEventBusBug.py", line 26, in on_event
    print (self.something_else)
AttributeError: Subscriber1 instance has no attribute 'something_else'

It complains about the variable in class two not having the attribute in the first class and the other way around.

If I change on of the on_event to something else like on_event2 then the issue is gone.

from pyeventbus import *


class SomeEvent:
    def __init__(self):
        pass


class Subscriber1:
    def __init__(self):
        self.something = 'First subscriber'
        PyBus.Instance().register(self, self.__class__.__name__)

    @subscribe(threadMode=Mode.PARALLEL, onEvent=SomeEvent)
    def on_event(self, event):
        print (self.something)


class Subscriber2:
    def __init__(self):
        self.something_else = 'Second subscriber'
        PyBus.Instance().register(self, self.__class__.__name__)

    @subscribe(threadMode=Mode.PARALLEL, onEvent=SomeEvent)
    def on_event(self, event):
        print (self.something_else)


class PyEventBusBug:

    def __init__(self):
        Subscriber1()
        Subscriber2()
        PyBus.Instance().post(SomeEvent())


if __name__ == "__main__":
    PyEventBusBug()

bug

opened by ddanny 0

Doesn't even start on Windows because 2000 threads is apparently too much

  File "C:\Python27\lib\site-packages\pyeventbus\pyeventbus.py", line 116, in subscribe
    bus = PyBus.Instance()
  File "C:\Python27\lib\site-packages\pyeventbus\Singleton.py", line 30, in Instance
    self._instance = self._decorated()
  File "C:\Python27\lib\site-packages\pyeventbus\pyeventbus.py", line 24, in __init__
    for worker in [lambda: self.startWorkers() for i in range(self.num_threads)]: worker()
  File "C:\Python27\lib\site-packages\pyeventbus\pyeventbus.py", line 24, in <lambda>
    for worker in [lambda: self.startWorkers() for i in range(self.num_threads)]: worker()
  File "C:\Python27\lib\site-packages\pyeventbus\pyeventbus.py", line 30, in startWorkers
    worker.start()
  File "C:\Python27\lib\threading.py", line 736, in start
    _start_new_thread(self.__bootstrap, ())
thread.error: can't start new thread

See also: https://stackoverflow.com/a/1835043/2583080

bug

opened by PawelTroka 4

Releases(0.2)

0.2(Feb 2, 2018)

added performance benchmarks and tests
Source code(tar.gz)
Source code(zip)
0.1(Feb 2, 2018)

first stable release
Source code(tar.gz)
Source code(zip)

Owner

GitHub Repository

Unofficial pytorch implementation of 'Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization'

pytorch-AdaIN This is an unofficial pytorch implementation of a paper, Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization [Hua

873 Jan 06, 2023

An image base contains 490 images for learning (400 cars and 90 boats), and another 21 images for testingAn image base contains 490 images for learning (400 cars and 90 boats), and another 21 images for testing

SVM Données Une base d’images contient 490 images pour l’apprentissage (400 voitures et 90 bateaux), et encore 21 images pour fait des tests. Prétrait

3 Nov 30, 2021

Code for Fully Context-Aware Image Inpainting with a Learned Semantic Pyramid

SPN: Fully Context-Aware Image Inpainting with a Learned Semantic Pyramid Code for Fully Context-Aware Image Inpainting with a Learned Semantic Pyrami

12 Jun 27, 2022

A Demo server serving Bert through ONNX with GPU written in Rust with <3

Demo BERT ONNX server written in rust This demo showcase the use of onnxruntime-rs on BERT with a GPU on CUDA 11 served by actix-web and tokenized wit

28 Jan 01, 2023

Object-Centric Learning with Slot Attention

Slot Attention This is a re-implementation of "Object-Centric Learning with Slot Attention" in PyTorch (https://arxiv.org/abs/2006.15055). Requirement

72 Jan 02, 2023

Human Pose estimation with TensorFlow framework

Human Pose Estimation with TensorFlow Here you can find the implementation of the Human Body Pose Estimation algorithm, presented in the DeeperCut and

1.1k Dec 29, 2022

Collection of sports betting AI tools.

sports-betting sports-betting is a collection of tools that makes it easy to create machine learning models for sports betting and evaluate their perf

109 Dec 31, 2022

This is a re-implementation of TransGAN: Two Pure Transformers Can Make One Strong GAN (CVPR 2021) in PyTorch.

TransGAN: Two Transformers Can Make One Strong GAN [YouTube Video] Paper Authors: Yifan Jiang, Shiyu Chang, Zhangyang Wang CVPR 2021 This is re-implem

79 Jan 05, 2023

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

ARES This repository contains the code for ARES (Adversarial Robustness Evaluation for Safety), a Python library for adversarial machine learning rese

377 Dec 20, 2022

Learning High-Speed Flight in the Wild

Learning High-Speed Flight in the Wild This repo contains the code associated to the paper Learning Agile Flight in the Wild. For more information, pl

391 Dec 29, 2022

Official implementation of "DSP: Dual Soft-Paste for Unsupervised Domain Adaptive Semantic Segmentation"

DSP Official implementation of "DSP: Dual Soft-Paste for Unsupervised Domain Adaptive Semantic Segmentation". Accepted by ACM Multimedia 2021. Authors

20 Oct 24, 2022

Code for Blind Image Decomposition (BID) and Blind Image Decomposition network (BIDeN).

arXiv, porject page, paper Blind Image Decomposition (BID) Blind Image Decomposition is a novel task. The task requires separating a superimposed imag

64 Dec 20, 2022

Age Progression/Regression by Conditional Adversarial Autoencoder

Age Progression/Regression by Conditional Adversarial Autoencoder (CAAE) TensorFlow implementation of the algorithm in the paper Age Progression/Regre

603 Dec 22, 2022

Unrolled Variational Bayesian Algorithm for Image Blind Deconvolution

unfoldedVBA Unrolled Variational Bayesian Algorithm for Image Blind Deconvolution This repository contains the Pytorch implementation of the unrolled

2 Jul 10, 2022

Pose Detection and Machine Learning for real-time body posture analysis during exercise to provide audiovisual feedback on improvement of form.

Posture: Pose Tracking and Machine Learning for prescribing corrective suggestions to improve posture and form while exercising. This repository conta

10 Nov 11, 2022

The official repo for OC-SORT: Observation-Centric SORT on video Multi-Object Tracking. OC-SORT is simple, online and robust to occlusion/non-linear motion.

OC-SORT Observation-Centric SORT (OC-SORT) is a pure motion-model-based multi-object tracker. It aims to improve tracking robustness in crowded scenes

325 Jan 05, 2023

We evaluate our method on different datasets (including ShapeNet, CUB-200-2011, and Pascal3D+) and achieve state-of-the-art results, outperforming all the other supervised and unsupervised methods and 3D representations, all in terms of performance, accuracy, and training time.

An Effective Loss Function for Generating 3D Models from Single 2D Image without Rendering Papers with code | Paper Nikola Zubić Pietro Lio University

213 Dec 27, 2022