MPLogger
Multi-processing capable print-like logger for Python
Requirements and Installation
Python 3.8+ is required
Pip
pip install mplogger
Manual
Poetry and (optionally) GNU Make are required.
git clone https://github.com/ELTE-DH/webarticlecurator.git- Run
make
On Windows or without Make (after cloning the repository):
poetry install --no-rootpoetry buildpoetry run pip install --upgrade dist/*.whl(the correct filename must be specified on Windows)
Usage
Single-process
from MLPlogger import Logger
# Initialize logger (default: STDERR only with INFO level)
logger = Logger(log_filename, logfile_mode, logfile_encoding, logfile_level, console_stream, console_level, console_format, file_format)
logger.log('INFO', 'First argument log level as string')
logger.log('WARNING', 'THIS IS A WARNING!', 'In multiple lines', 'just like print()', sep='\n')
logger.log('CRITICAL', 'Can also set line endings!', end='\r\n')
Multi-process
from itertools import repeat
from multiprocessing import Pool, Manager, current_process
from MLPlogger import Logger
def worker_process(par):
state, lq = par
retl = []
for n in range(100):
lq.log('WARNING', f'{current_process().name} message{state} {n}')
lq.log('WARNING', f'{current_process().name} finished')
return retl
log_obj = Logger('test.log', 'w') # Apply all parameters for logger here!
log_obj.log('INFO', 'NORMAL LOG BEGIN') # Normal logging
with Manager() as man:
log_queue = man.Queue()
with log_obj.init_mp_logging_context(log_queue) as mplogger, Pool() as p:
# Here one can log parallel from all processes!
return_queue = p.imap(worker_process, zip(range(10), repeat(mplogger)), chunksize=3)
for _ in return_queue:
pass
log_obj.log('INFO', 'NORMAL LOG END') # Normal logging
Licence
This project is licensed under the terms of the GNU LGPL 3.0 license.
2 Oct 2, 2022
3 Jan 10, 2022
1.5k Jan 6, 2023
365 Nov 11, 2022
43 Dec 27, 2022
17 Jul 17, 2022
795 Dec 18, 2022
13.7k Jan 2, 2023
1.4k Dec 31, 2022
69 Nov 01, 2022
38 Jul 20, 2022
102 Dec 22, 2022
![Heart[BOT]](https://avatars.githubusercontent.com/u/43449017?v=4&s=60)
0 Nov 20, 2022
824 Jan 08, 2023
1k Jan 04, 2023
111 Dec 31, 2022
17 May 03, 2022
5 May 02, 2022
4 Nov 08, 2021
3 Nov 15, 2022
1 Nov 23, 2022
2 Nov 03, 2022
15 Dec 16, 2022
2 Dec 04, 2021
1 Jan 19, 2022