This PR adds madmax support to the plot manager. It creates a new key in the config called backend. There you can define which plotter backend you want to use (it defaults to chia).

If the madmax backend is provided, it parses all required logs, binaries and others according to madmax structure.

How to use it

After cloning my branch, install the plot manager as you're used to, and change the config file by adding the following:

chia_location: <path-to-your-madmax-compiled-binary>
backend: madmax

progress:
  phase1_line_end: 20
  phase2_line_end: 34
  phase3_line_end: 48
  phase4_line_end: 53

I've also added the progress config in the config.yaml.default file.

IMPORTANT

While using madmax backend, your tmp, tmp2 and final dir configs must end with a trailing slash (/ for Linux and \ for Windows)

After that, just launch the manager as you're used to.

Also , Swar's plot manager fetches the running plots by the process name. Because of that, your executable file must be named chia_plot (chia_plot.exe in Windows)

When I start view in powershell I get this error:

PS C:\Swar-Chia-Plot-Manager> python manager.py view python : Traceback (most recent call last): In Zeile:1 Zeichen:1

• python manager.py view

•   + CategoryInfo          : NotSpecified: (Traceback (most recent call last)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
  
  File "C:\Swar-Chia-Plot-Manager\manager.py", line 36, in <module>
    view()
  File "C:\Swar-Chia-Plot-Manager\plotmanager\library\utilities\commands.py", line 80, in view
    drive = job.temporary_directory.split('\\')[0]
  

AttributeError: 'NoneType' object has no attribute 'split'

Here is my "config.yaml" >> config.txt

OS: Windows 10 Pro CPU: AMD Ryzen x5950 RAM: Patriot Viper 32GB 3600 MHz Motherboard: ASUS Prime x570 Pro OS SSD: Seagate FireCuda 520, NVMe PCIe X4, 500 GB SSD: 3,84TB 2,5 Micron 5300 PRO Enterprise Plot final directory is on my WD Book external HDD

I really don't know what I should do. I lost my plots with the chia GUI because of wrong settings twice now. I really need help please.

I installed everything on an ubuntu server 20.04, but when I start the manager viewer (python manager.py view) after 2 refreshes it crashes with this error. If I put the refresh time for 60sec, i will refresh once, but the second time it stops. Same for any refresh value.

Restarting view due to psutil going stale... Traceback (most recent call last): File "manager.py", line 36, in view() File "/chia/chia-manager/Swar-Chia-Plot-Manager/plotmanager/library/utilities/commands.py", line 123, in view os.execv(sys.executable, system_args) FileNotFoundError: [Errno 2] No such file or directory

I downloaded the latest version (v0.1.0b) tonight and had a few errors, some of my own making. But Skip_full_destinations: True fails (stops the manager starting) when specified in the UNC format such as \\server\Completed plots 1

I believe it fails because it can't get the size/free space on the drive. Perhaps it will work if I map the drive to a drive letter, but I thought I read someone had issues with mapped drives???

From the CMD window:

(venv) C:\Users\ChiaMining\Swar-Chia-Plot-Manager-main>python manager.py start Traceback (most recent call last): File "C:\Users\ChiaMining\Swar-Chia-Plot-Manager-main\manager.py", line 30, in start_manager() File "C:\Users\ChiaMining\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\commands.py", line 55, in start_manager raise ManagerError('Failed to start Manager. Please look at debug.log for more details on the error. It is in the same folder as manager.py.') plotmanager.library.utilities.exceptions.ManagerError: Failed to start Manager. Please look at debug.log for more details on the error. It is in the same folder as manager.py.

Setting Skip_full_destinations: False solved the problem, but it would have been a nice feature to have.

debug.log

notify_discord will successfully send an initial 'Plot Manager has started on....' message when the plot manager is started. However, no further notifications will occur. Plots are completing but I'm not getting any further subsequent messages for plot completion.

Hi,

I have a problem with starting the manager v0.1.0 (debug.log below). Worked fine in previous version.

2021-05-20 13:59:44 [ERROR]: Failed to get disk_usage of drive None. Traceback (most recent call last): File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\jobs.py", line 173, in monitor_jobs_to_start free_space = psutil.disk_usage(drive).free File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\psutil_init_.py", line 1995, in disk_usage return _psplatform.disk_usage(path) File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\psutil_pswindows.py", line 265, in disk_usage total, free = cext.disk_usage(path) TypeError: argument 1 must be str, not None Traceback (most recent call last): File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\stateless-manager.py", line 94, in jobs, running_work, next_job_work, next_log_check = monitor_jobs_to_start( File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\jobs.py", line 258, in monitor_jobs_to_start job, work = start_work( File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\jobs.py", line 284, in start_work get_target_directories(job, drives_free_space=drives_free_space) File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\jobs.py", line 26, in get_target_directories job = check_valid_destinations(job, drives_free_space) File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\jobs.py", line 53, in check_valid_destinations drive = identify_drive(file_path=directory, drives=drives) File "C:\Chia\scripts\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\processes.py", line 136, in identify_drive if drive not in file_path: TypeError: 'in ' requires string as left operand, not NoneType

PS D:\Swar-Chia-Plot-Manager-main> python .\manager.py start Traceback (most recent call last): File "D:\Swar-Chia-Plot-Manager-main\manager.py", line 29, in start_manager() File "D:\Swar-Chia-Plot-Manager-main\plotmanager\library\utilities\commands.py", line 32, in start_manager notification_settings, debug_level, view_settings = get_config_info() File "D:\Swar-Chia-Plot-Manager-main\plotmanager\library\parse\configuration.py", line 102, in get_config_info config = _get_config() File "D:\Swar-Chia-Plot-Manager-main\plotmanager\library\parse\configuration.py", line 16, in get_config config = yaml.load(stream=f, Loader=yaml.Loader) File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml_init.py", line 114, in load return loader.get_single_data() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\constructor.py", line 49, in get_single_data node = self.get_single_node() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\composer.py", line 36, in get_single_node document = self.compose_document() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\composer.py", line 58, in compose_document self.get_event() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\parser.py", line 118, in get_event self.current_event = self.state() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\parser.py", line 193, in parse_document_end token = self.peek_token() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\scanner.py", line 129, in peek_token self.fetch_more_tokens() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\scanner.py", line 223, in fetch_more_tokens return self.fetch_value() File "C:\Users\ShopComputer\AppData\Local\Programs\Python\Python39\lib\site-packages\yaml\scanner.py", line 577, in fetch_value raise ScannerError(None, None, yaml.scanner.ScannerError: mapping values are not allowed here in "D:\Swar-Chia-Plot-Manager-main\config.yaml", line 9, column 8

Thanks

not sure what Im doing wrong, Ive got the manager running and it shows jobs I start through the GUI but the manager doesnt seem to be starting new jobs.

• name: M2-1 max_plots: 999 farmer_public_key: ..... pool_public_key: temporary_directory: A:
  temporary2_directory: destination_directory: D:\Plots size: 32 bitfield: true threads: 30 buckets: 128 memory_buffer: 5000 max_concurrent: 3 max_concurrent_with_start_early: 6 stagger_minutes: 5 max_for_phase_1: 3 concurrency_start_early_phase: 4 concurrency_start_early_phase_delay: 0 temporary2_destination_sync: false

Tried letting it run twice so far with no results.

Greetings,

Could anyone confirm that copying over the network to a shared folder is possible?

Edit: Using windows 10

destination_directory: \myComputer\chiaSharedFolder

So far the file is not being copied but I'm not sure if there is some other factor involved.

Thank you,

The new pool_url variable allows the use of Pool Contract Address Refer to https://github.com/Chia-Network/chia-blockchain/wiki/Pooling-FAQ#how-do-i-assign-portable-plots-to-a-pool

Tested and working on linux and windows

Possibly fixes #42

It looks like calling the executable as a quoted string is doing something when executed to lose the venv context, which is causing all of the module not found errors.

File "manager.py", line 41, in view(loop=False) File "/home/Swar-Chia-Plot-Manager/plotmanager/library/utilities/commands.py", line 160, in view analysis = analyze_log_dates(log_directory=log_directory, analysis=analysis) File "/home/Swar-Chia-Plot-Manager/plotmanager/library/utilities/log.py", line 88, in analyze_log_dates data = _analyze_log_end_date(contents, file_path) File "/home/Swar-Chia-Plot-Manager/plotmanager/library/utilities/log.py", line 36, in _analyze_log_end_date file_date = dateparser.parse(time.strftime('%Y-%m-%d %H:%M:%S', time.localtime(parsed_date))) File "/usr/local/lib/python3.8/dist-packages/dateparser/conf.py", line 89, in wrapper return f(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/dateparser/init.py", line 54, in parse data = parser.get_date_data(date_string, date_formats) File "/usr/local/lib/python3.8/dist-packages/dateparser/date.py", line 421, in get_date_data parsed_date = _DateLocaleParser.parse( File "/usr/local/lib/python3.8/dist-packages/dateparser/date.py", line 178, in parse return instance._parse() File "/usr/local/lib/python3.8/dist-packages/dateparser/date.py", line 182, in _parse date_data = self._parsersparser_name File "/usr/local/lib/python3.8/dist-packages/dateparser/date.py", line 196, in _try_freshness_parser return freshness_date_parser.get_date_data(self._get_translated_date(), self._settings) File "/usr/local/lib/python3.8/dist-packages/dateparser/date.py", line 234, in _get_translated_date self._translated_date = self.locale.translate( File "/usr/local/lib/python3.8/dist-packages/dateparser/languages/locale.py", line 131, in translate relative_translations = self._get_relative_translations(settings=settings) File "/usr/local/lib/python3.8/dist-packages/dateparser/languages/locale.py", line 158, in _get_relative_translations self._generate_relative_translations(normalize=True)) File "/usr/local/lib/python3.8/dist-packages/dateparser/languages/locale.py", line 172, in _generate_relative_translations pattern = DIGIT_GROUP_PATTERN.sub(r'?P\d+', pattern) File "/usr/local/lib/python3.8/dist-packages/regex/regex.py", line 710, in _compile_replacement_helper is_group, items = _compile_replacement(source, pattern, is_unicode) File "/usr/local/lib/python3.8/dist-packages/regex/_regex_core.py", line 1737, in _compile_replacement raise error("bad escape \%s" % ch, source.string, source.pos) regex._regex_core.error: bad escape \d at position 7

Newest version of MadMax now includes support for K33 & K34. When running K34, viewer still shows K32. Seems to be just a display error. Progress and phase detection does not seem to be correct either.

Hello, I am running Swar with MadMax with 60 destination hard drives while plotting 60 concurrent plots. I want one plot to go to one destination drive, so that multiple plots don't queue up on a single destination.

Sometimes the plots assign themselves to different drives, but most of the time all the plots are assigned to only 1 hard drive. How do I make it so Swar divides up the plots evenly amongst the destinations?

Thanks.

I am running on Windows, using 14TB drives. When I get within 1TB of a drive being full, I add a new drive, add to config.yaml, and restart the manager. The manager correctly sees the new drive and starts assigning plots to it. The problem is that the last two plots that were assigned to the almost full drive can't fit on it by the time they are ton, and the manager doesn't know what to do with them. Instead of retargeting them to the new drive and copying there, they just get hung indefinitely. I have to manually kill the last two plots on every drive every time when it fills up. Then I have to manually copy the tmp files to the new drive and rename them.

It seems like there needs to be better logic to calculate how full drives are going to be based on all of the active jobs, and/or there needs to be a process to retarget plots to a drive with free space if they can't fit on the intended drive. I can provide logs if needed, this is a fully repeatable issue, it occurs every single time.

It doesn't happen every time, but it happens every day, causing the main program to exit

Code file: stateless-manager.py

Occurrence code line: if psutil.Process(pid).status() != 'zombie':

Code snippet:

    logging.info(f'Clearing zombies')

    for job in jobs:
        non_zombie_work = []
        for pid in job.running_work:
            if psutil.Process(pid).status() != 'zombie':
                non_zombie_work.append(pid)
            else:
                del running_work[pid]
                job.total_running = job.total_running - 1

        job.running_work = non_zombie_work

Debug file:

 Traceback (most recent call last):
  File "C:\Program Files\Python37\lib\site-packages\psutil\_pswindows.py", line 679, in wrapper
    return fun(self, *args, **kwargs)
  File "C:\Program Files\Python37\lib\site-packages\psutil\_pswindows.py", line 1054, in status
    suspended = cext.proc_is_suspended(self.pid)
ProcessLookupError: [Errno 3] assume no such process (originated from NtQuerySystemInformation (no PID found))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\auto-chia\Swar-Chia-Plot-Manager-main\stateless-manager.py", line 99, in <module>
    if psutil.Process(pid).status() != 'zombie':
  File "C:\Program Files\Python37\lib\site-packages\psutil\__init__.py", line 682, in status
    return self._proc.status()
  File "C:\Program Files\Python37\lib\site-packages\psutil\_pswindows.py", line 681, in wrapper
    raise convert_oserror(err, pid=self.pid, name=self._name)
psutil.NoSuchProcess: psutil.NoSuchProcess process no longer exists (pid=12184)