Code-autocomplete, a code completion plugin for Python

Last update: Jan 07, 2023

Related tags

Text Data & NLP code-autocomplete

Overview

Code AutoComplete

code-autocomplete, a code completion plugin for Python.

code-autocomplete实现了Python代码行粒度和块粒度自动补全功能。

Guide

Feature
Install
Usage
Contact
Citation
Reference

Feature

Demo

http://42.193.145.218/product/short_text_sim/

Install

pip3 install -U code-autocomplete

git clone https://github.com/shibing624/code-autocomplete.git
cd code-autocomplete
python3 setup.py install

Usage

Code Completion

开源项目：code-autocomplete，可支持GPT2模型，通过如下命令调用：

from autocomplete.gpt2 import Infer
m = Infer(model_name="gpt2", model_dir="shibing624/code-autocomplete-gpt2-base", use_cuda=False)
i = m.predict('import torch.nn as')
print(i)

当然，你也可使用官方的huggingface/transformers调用：

Please use 'GPT2' related functions to load this model!

import os
import torch
from transformers import GPT2Tokenizer, GPT2LMHeadModel

os.environ["KMP_DUPLICATE_LIB_OK"] = "TRUE"
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

tokenizer = GPT2Tokenizer.from_pretrained("shibing624/code-autocomplete-gpt2-base")
model = GPT2LMHeadModel.from_pretrained("shibing624/code-autocomplete-gpt2-base")
model.to(device)
prompts = [
    """from torch import nn
    class LSTM(Module):
        def __init__(self, *,
                     n_tokens: int,
                     embedding_size: int,
                     hidden_size: int,
                     n_layers: int):""",
    """import numpy as np
    import torch
    import torch.nn as""",
    "import java.util.ArrayList",
    "def factorial(n):",
]
for prompt in prompts:
    input_ids = tokenizer.encode(prompt, add_special_tokens=False, return_tensors='pt').to(device)
    outputs = model.generate(input_ids=input_ids,
                             max_length=64 + len(prompt),
                             temperature=1.0,
                             top_k=50,
                             top_p=0.95,
                             repetition_penalty=1.0,
                             do_sample=True,
                             num_return_sequences=1,
                             length_penalty=2.0,
                             early_stopping=True)
    decoded = tokenizer.decode(outputs[0], skip_special_tokens=True)
    print(decoded)
    print("=" * 20)

Contact

Issue(建议)：
邮件我：xuming: [email protected]
微信我：加我微信号：xuming624, 备注：个人名称-公司-NLP 进NLP交流群。

Citation

如果你在研究中使用了code-autocomplete，请按如下格式引用：

@misc{code-autocomplete,
  author = {Xu Ming},
  title = {code-autocomplete: Code AutoComplete with GPT model},
  year = {2022},
  publisher = {GitHub},
  journal = {GitHub repository},
  url = {https://github.com/shibing624/code-autocomplete},
}

License

授权协议为 The Apache License 2.0，可免费用做商业用途。请在产品说明中附加code-autocomplete的链接和授权协议。

Contribute

项目代码还很粗糙，如果大家对代码有所改进，欢迎提交回本项目，在提交之前，注意以下两点：

在tests添加相应的单元测试
使用python setup.py test来运行所有单元测试，确保所有单测都是通过的

之后即可提交PR。

Reference

https://github.com/galois-autocompleter/galois-autocompleter

Code to use Augmented Shapiro Wilks Stopping, as well as code for the paper "Statistically Signifigant Stopping of Neural Network Training"

This codebase is being actively maintained, please create and issue if you have issues using it Basics All data files are included under losses and ea

32 Nov 9, 2021

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation This is the official PyTorch implementation

564 Jan 8, 2023

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2.

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2. It is trained (finetuned) on a curated list of approximately 45K Python (~470MB) files gathered from the Github. Currently, it just works properly on Python but not bad at other languages (thanks to GPT-2's power).

91 Sep 23, 2022

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

Ucto for Python This is a Python binding to the tokeniser Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task,

27 Dec 14, 2022

0.0.4(Mar 1, 2022)

Full Changelog: https://github.com/shibing624/code-autocomplete/compare/0.0.3...0.0.4
Source code(tar.gz)
Source code(zip)
source_code.zip(105.14 MB)
0.0.3(Feb 14, 2022)

python-source-code
Source code(tar.gz)
Source code(zip)
download.zip(41.44 MB)
0.0.1(Feb 11, 2022)

0.0.1 GPT2 code autocomplete.
Source code(tar.gz)
Source code(zip)

Code-autocomplete, a code completion plugin for Python

Related tags

Overview

Code AutoComplete

Feature

Demo

Install

Usage

Code Completion

Contact

Citation

License

Contribute

Reference

You might also like...

Code to use Augmented Shapiro Wilks Stopping, as well as code for the paper "Statistically Signifigant Stopping of Neural Network Training"

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2.

Simple python code to fix your combo list by removing any text after a separator or removing duplicate combos

A python project made to generate code using either OpenAI's codex or GPT-J (Although not as good as codex)

Repository of the Code to Chatbots, developed in Python

Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations

Converts python code into c++ by using OpenAI CODEX.

Releases(0.0.4)

0.0.4(Mar 1, 2022)

0.0.3(Feb 14, 2022)

0.0.1(Feb 11, 2022)

Owner

xuming

a chinese segment base on crf

BERT, LDA, and TFIDF based keyword extraction in Python

Quick insights from Zoom meeting transcripts using Graph + NLP

Chatbot with Pytorch, Python & Nextjs

Source code for the paper "TearingNet: Point Cloud Autoencoder to Learn Topology-Friendly Representations"

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

Modeling cumulative cases of Covid-19 in the US during the Covid 19 Delta wave using Bayesian methods.

Code of paper: A Recurrent Vision-and-Language BERT for Navigation

NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings

Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

Data preprocessing rosetta parser for python

Idea is to build a model which will take keywords as inputs and generate sentences as outputs.

Yet Another Neural Machine Translation Toolkit

Python port of Google's libphonenumber

Japanese NLP Library

Neural text generators like the GPT models promise a general-purpose means of manipulating texts.

Code for paper "Which Training Methods for GANs do actually Converge? (ICML 2018)"

This is a MD5 password/passphrase brute force tool

Official implementation of Meta-StyleSpeech and StyleSpeech