Tracking down an issue between 0.6.19 and 0.7.0b and subsequent versions, where MacVim freezes when the autocompletion is initiated.

Debugging suggestions appreciated - I tried following the directions in the README but nothing jumped out at me when I tried the -u flag to the debug.vim file.

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

So, I have a lot of stuff in my home directory (as I think many do) but I also occasionally write small Python scripts in ~ (as many, I think, do).

Is there any way to stop rope from regenerating the autoimport cache for a specific target directory?

Edit: Also happens on simple :w

Two colleagues of mine have told me that thei vim segfaults regularly. But only on save/quit (:wq). I tried to find out why, but could not find the culprit. We all have pretty much the same plugins installed. In any case, we have rules out plugins for a while. After all I have all those installed as well, and have no seg-faults.

Recently I upgraded python-mode. Since then I get the same problem.

I cannot tell you much more other than it seems to happen only on write+quit.

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

Hi All!

I'm creating this issue in order to concentrate all issues that we are facing in python-mode that are caused by the import machinery.

This includes imp module deprecation (replaced by importlib), "wrong" usage of find_spec and find_module, different compatibilities among python versions and so on.

Currently, I'm with very restricted free time to dedicate to the project, so any help is very welcome!

We have plenty of python modules that are used in python-mode that are not from standard python. Because of that, in the past, these modules source code were copied into python-mode repo. As time passed, they became old, and we started to update them as "git submodules". This resulted in lot's of improvements, but also resulted in new problems, that we still need to fix.

Our current official branch is the develop from this repository, the master branch is unmaintained.

Before going on with the attempt of solving our current problems, I would like to kindly ask everyone that want to help me, by testing new versions of the code, to do some simple steps in order to make sure your environment is "renewed":

• Clear all python cache (__pycache__) directories and compiled files (*.pyc and *.pyo). Do it by running, in Linux-like systems and from python-mode root dir:
  • find . -type f -name '*.pyc' -delete
  • find . -type d -name '__pycache__' -delete
• Update all submodules with the latest version from the branch you want to test:
  • git submodule sync --recursive
  • git submodule update --init --recursive

Back to our current issue, it looks like we have several combinations that work and another bunch that does not work correctly, depending on python version and also vim version, so I'll ask you all some patience! Some times I cannot reproduce the errors that you are presenting, so your help will be fundamental for us to find the best fix.

One of the modules that were not updated is the pkg_resources, it is still a copy from some point in the past, and it may be one of the most impacted for this specific issue.

So, I'll try to update it to see if a newer version of pkg_resources fix most of the problems. Then we can go ahead and try to work on other "modules/packages/files".

I'll try to keep the test code for this issue under the branch issue_971_import_machinery from this repo ok?

Thank you all for your patience!

When I use vim to open test.py , the Python-mode doesn't work. I have no idea about how to solve the problem(>_<) Here are my python mode debug file:

Error detected while processing function pymode#init: line 2: /must>not&exist/foo:1: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

pymode debug msg 1: Starting debug on: 2018-07-03 18:57:46 with file /var/folders/zg/q4yfxyj93nxbrd7f0sygsdmh0000gn/T/pymode_debug_file.txt

pymode debug msg 2: Operating system: Darwin

pymode debug msg 3: Scriptnames:

pymode debug msg 4: Pymode variables: pymode #1 pymode_breakpoint #1 pymode_breakpoint_bind b pymode_breakpoint_cmd import pdb; pdb.set_trace() # XXX BREAKPOINT pymode_debug #1 pymode_debug_counter #3 pymode_debug_tempfile /var/folders/zg/q4yfxyj93nxbrd7f0sygsdmh0000gn/T/pymode_debug_file.txt pymode_doc #1 pymode_doc_bind K pymode_doc_vertical #0 pymode_folding #0 pymode_folding_nest_limit #1000 pymode_folding_regex ^\s*%(class|def|async\s+def) .+(:\s+\w)@! pymode_indent #1 pymode_init #1 pymode_lint #1 pymode_lint_async #1 pymode_lint_async_updatetime #1000 pymode_lint_checkers ['pyflakes', 'pep8', 'mccabe'] pymode_lint_comment_symbol CC pymode_lint_cwindow #1 pymode_lint_docs_symbol DD pymode_lint_error_symbol EE pymode_lint_ignore [] pymode_lint_info_symbol II

While editing inside a long fold (in my case an init function composed of ~150 LOC) VIM freezes and becomes really sloppy. Command mode works fine as usual instead. After profiling it I managed to discover that setting g:pymode_folding = 0 solves my problem. Any way I can solve this while keeping the folding functionality?

This is the output of PymodeTroubleshooting:

Pymode diagnostic
===================
VIM:704, OS: Darwin, multi_byte:1, pymode: 0.8.1, pymode-python: python


+python: 1
+python3: 0

VIM python paths:
-----------------
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/waitress
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/requests
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/OmniSharpServer
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/jedi
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/frozendict
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/bottle
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd/third_party/argparse
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/ycmd
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/retries
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/requests-futures
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/requests
/Users/aldur/.vim/bundle/YouCompleteMe/third_party/pythonfutures
/Users/aldur/.vim/bundle/YouCompleteMe/autoload/../third_party/ycmd
/Users/aldur/.vim/bundle/YouCompleteMe/autoload/../python
/Users/aldur/.vim/bundle/python-mode/pymode/libs2
/Users/aldur/.vim/bundle/python-mode/pymode/libs
/Users/aldur/.vim/bundle/python-mode
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/setuptools-8.0-py2.7.egg
/Library/Python/2.7/site-packages/pip-1.5.2-py2.7.egg
/usr/local/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg
/usr/local/lib/python2.7/site-packages/setuptools-8.0-py2.7.egg
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python27.zip
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-darwin
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac/lib-scriptpackages
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-tk
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-old
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload
/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages
/Library/Python/2.7/site-packages
/usr/local/lib/python2.7/site-packages
_vim_path_

Pymode variables:
-------------------
let pymode = 1
let pymode_breakpoint = 0
let pymode_breakpoint_bind = '<leader>b'
let pymode_doc = 1
let pymode_doc_bind = 'K'
let pymode_folding = 0
let pymode_indent = 1
let pymode_lint = 1
let pymode_lint_checkers = ['pyflakes', 'pep8', 'mccabe']
let pymode_lint_cwindow = 1
let pymode_lint_ignore = ''
let pymode_lint_message = 0
let pymode_lint_on_fly = 0
let pymode_lint_on_write = 0
let pymode_lint_select = ''
let pymode_lint_signs = 1
let pymode_motion = 1
let pymode_options = 1
let pymode_paths = []
let pymode_quickfix_maxheight = 6
let pymode_quickfix_minheight = 3
let pymode_rope = 1
let pymode_run = 1
let pymode_run_bind = '<leader>r'
let pymode_trim_whitespaces = 1
let pymode_virtualenv = 1
let pymode_virtualenv_enabled = ''
let pymode_virtualenv_path = ''

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

The issue in #600 still happens to me even if I am using the develop branch with python version 2.7.13:

Stacktrace: Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: Traceback (most recent call last): Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: File "", line 1, in Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: File "/Users/lyuan/.vim/bundle/python-mode/pymode/lint.py", line 9, in Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: from pylama.lint.extensions import LINTERS Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: File "/Users/lyuan/.vim/bundle/python-mode/pymode/libs/pylama/lint/extensions.py", line 30, in Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: from pkg_resources import iter_entry_points Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: File "/Users/lyuan/.vim/bundle/python-mode/pymode/libs/pkg_resources/init.py", line 21, in Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: import io Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/io.py ", line 51, in Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: import _io Error detected while processing /Users/lyuan/.vim/bundle/python-mode/autoload/pymode/lint.vim: line 1: ImportError: dlopen(/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/pyt hon2.7/lib-dynload/_io.so, 2): Symbol not found: __PyCodecInfo_GetIncrementalDecoder

Pythom-mode default mappings such as goto definition (<C-c>g) don't work in Vim 8. Every time you press <C-c>, Vim 8 will teach you the way to quit Vim: Type :qa! and press <Enter> to abandon all changes and exit Vim.

But I can still somehow map <C-c> in Vim 8 using :map command. If I execute :map <C-c> :qa! <Enter> I'm able to map <C-c> to force quit Vim.

Vim 7 seems to pop up that teaching only if I press <C-c> for successive two times so I can use python-mode default binding. This isn't the case in Vim 8.

Using python-mode within a python 3 virtualenv has an issue:

% vim Error detected while processing /Users/speno/.vimrc: line 224: Traceback (most recent call last): File "", line 8, in IOError: [Errno 2] No such file or directory: '/Users/speno/Documents/venvs/ pika/bin/activate_this.py'

It's true. The virtualenvs created using python3's pyvenv command do not have a bin/activate_this.py file.

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

I am using windows 10 and Plug 'python-mode/python-mode', { 'branch': 'develop' }. I get the following error every time I open a python file.

The folder looks like this:

Hi

I installed it on Win 10 X64 with python 3.7 support. It seems to work but with initial invokie I get this error below.

I also have "six" installed not sure

pip install six Requirement already satisfied: six in c:\app\python37\lib\site-packages (1.11.0)

Error detected while processing function pymode#breakpoint#init: line 29: Traceback (most recent call last): File "", line 2, in ModuleNotFoundError: No module named 'six'

I have mapped K to another action in my vimrc file and python-mode overrides my mapping and I don't want this, how to map K to another key for example L? let g:pymode_doc_bind = 'K' thanks.

Here's a report from me trying to use pymode with GVim on Windows so far, and few problems I had to solve. I'm rather unexperienced with doing anything more advanced in Vim, so this is from a noobish perspective.

First problem was during manual install - you have to give user rights to create symlinks. I've already made a separate PR to document how to solve that: https://github.com/python-mode/python-mode/compare/develop...vid512:python-mode:patch-1

After that, I had to manually rebuild help tags with :helptags <path-to-pymode>/doc. In the README, this is only mentioned in section for old-style manual install, but not in the section "Manually (according to vim's package structure)". If doing this manually is intended, maybe it should be added there too?

Then it took some time to figure out that my GVim couldn't find python310.dll in its path, so it had python3 functionality disabled. Until then any :Pymode*** command or advanced functionality I've tried didn't work. It wasn't enough to just run vim -i NONE -u <path_to_pymode>/debugvimrc.vim, as the README says. I had to actually open some .py file. This is not immediately obvious to someone who doesn't understand what goes on under the hood. I'd suggest changing the troubleshooting command to vim -i NONE -u <path_to_pymode>/debugvimrc.vim file.py.

It would also be helpful to have something in Windows section of FAQ prompting me to try :py3 print('hello'). This makes sure python3 functionality is working in GVim, otherwise GVim will display a helpful error message with name of python DLL it is missing.

Dear all, thanks a lot for maintaining this very useful plugin.

I recently started to experience problems (not sure if these depend on the fact that I recently moved to MacVim 9 on Mac OS 12.5.1. More specifically, my MacVim version is 9.0.65).

When I open a python file I get this error: Error detected while processing CursorMoved Autocommands for "<buffer=1>"..script /Users/mpagani/.vim/plugged/python-mode/autoload/pymode/lint.vim Following the instructions in the Troubleshooting section, I created a debug file that you find below. Thanks for any suggestion you might be able to share for solving this problem.

Messages maintainer: Bram Moolenaar <[email protected]>
"~/Documents/2022/diary/09/08_cms/utils.py" 11L, 264B
1662798522 let g:pymode_virtualenv_enabled = "/Users/mpagani/Repos/venv" []
-------------------------------------------------------------------------------
pymode debug msg 1: Starting debug on: 2022-09-10 10:28:42 with file /var/folders/j5/vpmn9x657d3gzwvrx2vryvc80000gn
/T/pymode_debug_file.txt
-------------------------------------------------------------------------------
pymode debug msg 2: Operating system: Darwin
-------------------------------------------------------------------------------
pymode debug msg 3: Scriptnames:
-------------------------------------------------------------------------------
pymode debug msg 4: Pymode variables:
pymode                #1
pymode_breakpoint     #1
pymode_breakpoint_bind  <leader>b
pymode_breakpoint_cmd  breakpoint()
pymode_debug          #1
pymode_debug_counter  #3
pymode_debug_tempfile  /var/folders/j5/vpmn9x657d3gzwvrx2vryvc80000gn/T/pymode_debug_file.txt
pymode_doc            #1
pymode_doc_bind        K
pymode_doc_vertical   #0
pymode_folding        #0
pymode_folding_nest_limit #1000
pymode_folding_regex   ^\s*\%(class\|def\|async\s\+def\) .\+\(:\s\+\w\)\@!
pymode_indent         #1
pymode_indent_hanging_width #-1
pymode_init           #1
pymode_lint           #1
pymode_lint_async     #1
pymode_lint_async_updatetime #1000
pymode_lint_checkers  ['pyflakes', 'pep8', 'mccabe']
pymode_lint_comment_symbol  CC
pymode_lint_cwindow   #1
pymode_lint_docs_symbol  DD
pymode_lint_error_symbol  EE
pymode_lint_ignore    []
pymode_lint_info_symbol  II
pymode_lint_message   #1
pymode_lint_on_fly    #0
pymode_lint_on_write  #1
pymode_lint_options_mccabe {'complexity': 12}
pymode_lint_options_pep257 {}
pymode_lint_options_pep8 {'max_line_length': 79}
pymode_lint_options_pyflakes {'builtins': '_'}
pymode_lint_options_pylint {'max-line-length': 79}
pymode_lint_pyflakes_symbol  FF
pymode_lint_select    []
pymode_lint_signs     #1
pymode_lint_sort      []
pymode_lint_todo_symbol  WW
pymode_lint_unmodified #0
pymode_lint_visual_symbol  RR
pymode_motion         #1
pymode_options        #1
pymode_options_colorcolumn #1
pymode_options_max_line_length #79
pymode_paths          []
pymode_preview_height #12
pymode_preview_position  botright
Error detected while processing BufRead Autocommands for "*.py"..FileType Autocommands for "*"..function <SNR>19_Lo
adFTPlugin[18]..script /Users/mpagani/.vim/plugged/python-mode/ftplugin/python/pymode.vim:
line  249:
Interrupted

Using the python project scheme suggested by the pytest documentation, pymode does not include the tests/ directory into its ropeproject when the “include method” of the src/ directory is done via an editable install (pip install -e .).

How do I add an additional source directory to PymodeRope, namely the tests/ directory?

Minimal working example

First create a venv virtual environment as well as a temporary directory. The abbreviation pmt stands for “pymode test”.

$ mkdir -p /tmp/pmt/{.venv,src/pmt,tests}
$ cd /tmp/pmt
$ python -m venv /tmp/pmt/.venv/pmt
$ source /tmp/pmt/.venv/pmt/bin/activate
(pmt) $ python -m pip install -U pip
(pmt) $ python -m pip install build pytest
(pmt) $ touch pyproject.toml src/pmt/__init__.py

Create the three source files with an editor of your choice, namely

• # ––– file /tmp/pmt/src/pmt/spam.py
  def spamfunc() -> int:
      return 1
  

• # ––– file /tmp/pmt/src/pmt/bacon.py
  from .spam import spamfunc
  
  
  def baconfunc() -> None:
      return 1 + spamfunc()
  

• # ––– file /tmp/pmt/tests/test_pmt.py
  from pmt.bacon import baconfunc
  from pmt.spam import spamfunc
  
  
  def test_baconfunc() -> None:
      assert 2 == baconfunc()
  
  
  def test_spamfunc() -> None:
      assert 1 == spamfunc()
  

The project directory will look like this:

.
├── pyproject.toml
├── src
│   └── pmt
│       ├── bacon.py
│       ├── __init__.py
│       └── spam.py
└── tests
    └── test_pmt.py

As suggested by pytest, install the editable version of the package and invoke pytest:

(pmt) $ python -m pip install -e .
(pmt) $ python -m pytest
================================ test session starts =================================
platform linux -- Python 3.10.6, pytest-7.1.3, pluggy-1.0.0
rootdir: /tmp/pmt
collected 2 items                                                                    

tests/test_pmt.py ..                                                           [100%]

================================= 2 passed in 0.01s ==================================

To finally reproduce the behaviour:

• open the source file with vim /tmp/pmt/src/pmt/spam.py
• move the cursor to spamfunc
• start function renaming by hitting <C-c>rr
• insert a different name, for instance hamfunc and press <Enter>
• perform the renaming by inserting 1<Enter>

After that, the renaming was successfully done in /tmp/pmt/src/pmt/spam.py and /tmp/pmt/src/pmt/bacon.py but not in tmp/pmt/tests/test_pmt.py (as I expect).

What I have tried

I tried to add manually the tests directory to the .ropeproject/config.py file

def set_prefs(prefs):
    # … more code of the default config.py file …

    # Custom source folders:  By default rope searches the project
    # for finding source folders (folders that should be searched
    # for finding modules).  You can add paths to that list.  Note
    # that rope guesses project source folders correctly most of the
    # time; use this if you have any problems.
    # The folders should be relative to project root and use '/' for
    # separating folders regardless of the platform rope is running on.
    # 'src/my_source_folder' for instance.
    prefs.add('source_folders', 'tests')

    # … more code of the default config.py file …

with no success.

When I change the import policy by

• uninstalling the module again with (pmt) $ python -m pip uninstall pmt
• change the imports of tmp/pmt/tests/test_pmt.py to

  from src.pmt.bacon import baconfunc
  from src.pmt.spam import spamfunc
  

then the renaming as suggested above does work, but that project structure is not as I or the pytest guys, respectively, want it to be.

Used versions

(pmt) $ python --version
Python 3.10.6
(pmt) $ python -m pip freeze | grep 'build\|pytest'
build==0.8.0
pytest==7.1.3

Pymode version: commit 85d2cd1a196ac1def79d4599b5be69395ed5b603 (HEAD → develop)

The following code prevents us from overriding the linter options per project.

https://github.com/python-mode/python-mode/blob/85d2cd1a196ac1def79d4599b5be69395ed5b603/pymode/lint.py#L52-L57

Here is what the pymode logs show (I have added some log line 53 to see what is set globally):

pymode debug msg 9: check code
1661433148 ['pyflakes', 'pep8'] []
1661433148 Namespace(paths=['/tmp/bla'], verbose=False, format='pycodestyle', select=[], sort=[], linters=[('pyflakes', <pylama.lint.pylama_pyflakes.Linter object at 0x7f177ab71870>), ('pep8', <pylama.lint.pylama_pycodestyle.Linter object
at 0x7f177ab71990>)], ignore=['W'], skip=[], report=None, hook=False, concurrent=False, options='/tmp/bla/pylama.ini', force=True, abspath=False, file_params={}, linters_params={'pep8': {'max_line_length': 101}}) []
1661433148 g:pymode_lint_options_pyflakes -> {'builtins': '_'} []
1661433148 g:pymode_lint_options_pep8 -> {'max_line_length': '79'} []
1661433148 Start code check:  [wrong.py]
Checking params: {'skip': False, 'ignore': {'W'}, 'select': set(), 'linters': []} - Namespace(paths=['/tmp/bla'], verbose=False, format='pycodestyle', select=[], sort=[], linters=[('pyflakes', <pylama.lint.pylama_pyflakes.Linter object at
0x7f177ab71870>), ('pep8', <pylama.lint.pylama_pycodestyle.Linter object at 0x7f177ab71990>)], ignore=['W'], skip=[], report=None, hook=False, concurrent=False, options='/tmp/bla/pylama.ini', force=True, abspath=False, file_params={}, lint
ers_params={'pep8': {'max_line_length': '79'}, 'pyflakes': {'builtins': '_'}})
Run pyflakes {'builtins': '_'}
Run pep8 {'max_line_length': '79'}

As you can see, pylama finds its custom settings inside the pylama.ini file, but they are then overridden.

I would have expected the pylama.ini settings to override the global ones but it's definitely not the case.

I'd suggest the code above to be replaced with:

        for linter in linters:
            opts = env.var('g:pymode_lint_options_%s' % linter, silence=True)
            if opts:
                opts_override = options.linters_params.get(linter, {})
                options.linters_params[linter] = opts
                options.linters_params[linter].update(opts_override)

I can open a PR if needed