MPLogger
Multi-processing capable print-like logger for Python
Requirements and Installation
Python 3.8+ is required
Pip
pip install mplogger
Manual
Poetry and (optionally) GNU Make are required.
git clone https://github.com/ELTE-DH/webarticlecurator.git- Run
make
On Windows or without Make (after cloning the repository):
poetry install --no-rootpoetry buildpoetry run pip install --upgrade dist/*.whl(the correct filename must be specified on Windows)
Usage
Single-process
from MLPlogger import Logger
# Initialize logger (default: STDERR only with INFO level)
logger = Logger(log_filename, logfile_mode, logfile_encoding, logfile_level, console_stream, console_level, console_format, file_format)
logger.log('INFO', 'First argument log level as string')
logger.log('WARNING', 'THIS IS A WARNING!', 'In multiple lines', 'just like print()', sep='\n')
logger.log('CRITICAL', 'Can also set line endings!', end='\r\n')
Multi-process
from itertools import repeat
from multiprocessing import Pool, Manager, current_process
from MLPlogger import Logger
def worker_process(par):
state, lq = par
retl = []
for n in range(100):
lq.log('WARNING', f'{current_process().name} message{state} {n}')
lq.log('WARNING', f'{current_process().name} finished')
return retl
log_obj = Logger('test.log', 'w') # Apply all parameters for logger here!
log_obj.log('INFO', 'NORMAL LOG BEGIN') # Normal logging
with Manager() as man:
log_queue = man.Queue()
with log_obj.init_mp_logging_context(log_queue) as mplogger, Pool() as p:
# Here one can log parallel from all processes!
return_queue = p.imap(worker_process, zip(range(10), repeat(mplogger)), chunksize=3)
for _ in return_queue:
pass
log_obj.log('INFO', 'NORMAL LOG END') # Normal logging
Licence
This project is licensed under the terms of the GNU LGPL 3.0 license.
2 Oct 2, 2022
3 Jan 10, 2022
1.5k Jan 6, 2023
365 Nov 11, 2022
43 Dec 27, 2022
17 Jul 17, 2022
795 Dec 18, 2022
13.7k Jan 2, 2023
1.4k Dec 31, 2022
2 Dec 04, 2021
23 Oct 26, 2022
2 Mar 27, 2022
11 May 16, 2022
1 Apr 24, 2022
176 Jan 01, 2023
11 Jul 05, 2022
824 Jan 08, 2023
0 Mar 28, 2022
2 Nov 05, 2021
39 Aug 26, 2022
102 Dec 22, 2022
2 Mar 05, 2022
2 Nov 03, 2022
3 Sep 28, 2021
7 Nov 30, 2022
4 Nov 08, 2021
4 Nov 17, 2021
1 Nov 15, 2021