Finetune gpt-2 in google colab

Overview

gpt-2-colab

finetune gpt-2(https://github.com/openai/gpt-2) in google colab

sample result (117M) from retraining on A Tale of Two Cities by Charles Dickens

No, Jerry! Jerry! You're a nice man, Jerry!”

That was all too remarkable. It was not merely impressive, but it took me on a turning short cough, and then swelling and stiffening, and rising to be a nice man, and a man, and not at all strivenly, and wicked.

The wonderful corner for echoes, and the echoes not being the echoes of footsteps that had their shameful imparted on the other side alone, that the time and tide waited for Lucie were sufficiently near the room, that to the utmost remaining of the time, even though assisted off other carriages, and were always ready and drove away that they should not hear themselves, Jerry heard no cry, and were as quick as in the morning if they had to pull up their heads and cidled away together as they could.

The farrier had not been in the barrier when he stopped, for the moment, and was as quick as they could make him.

He was to roll up arms, to get the outer coat to and frolic. He could not have laid down his hand to do so without another rain of the summer drops on high, when he was requested to do so. But, the rain of the summer was very strong and few, and the rain of the autumn month afterwards was strong and warm by those intervals. The storm in the west was very rarely beering, and the storm in the light of the summer was very rarely without it. The storm was really falling, and he stood there for a moment with his hand to open the barrier.

He was so far apart, that he could not have looked at him at all then; for, it was already dark when he looked at this figure, and it looked at IV

(an) seemed to fall, and reappeared, as old as Adam, until the morning, of the hour before.

“I fear the best, well,” said Jerry, stopping in his story, and laying his hand on hers, “what are you?”

“The worst.”

Though he had no hope of saying it, he could have looked at him, and then frowned at another figure, whose surface furnished a kind of dark street before him, for a few jewels.

He looked at it, and glanced at it. The Spy and prison-keeper looked at it, and the Spy showed a broken-hearted look.

“I am very much obliged to them for their looks and faces,” said Jerry. “No, Jerry! They are all in animosity and submission. They are in the habitually consently bad. I know what you have to do with my business. Whether I wait for you under the obligation to do so is the assumption yours. It is little to keep them in their places, to keep them in their times too much, is it not? No, Jerry. It is to keep them in their places, to cost and cost as the like. So much would you cost and change to-do exactly? That is to say, without deigning to say anything that is not at all, and no harm is to be expected of, will you not? No. It will cost nothing to save you, if it wos so, refuse. But it is always in the nature of things, and it is the nature of things. What is it? What would you have to say to me at all as, or to that degree?”

“I would ask you, is it not?”

Hah!” said Jerry, as he paused for the moment to ask him questions.

“It is true,” repeated the last question. “Does it cost to show me no harm, me nothing, yet? No. It is without loss,” repeated the Law; in the resting-looked-down sentiment. “Will you be very soon as restored to you?”

At the Judge, again a Judgeyer.

“If it is not restored to you within a minute, who should shut out the proceedings, and then the prisoner must be put back advance, and then must be removed.”

The Judge, whose eyes had gone in the general direction, leaned back in his seat, and stood ready.

Mr. Attorney-General then, following his leader's guidance, examined his manner with great obsequiousness and closeness, and passing on to the bench and tools, and passing on to Mr. Lorry. After looking at

Gold standard corpus annotated with verb-preverb connections for Hungarian.

Hungarian Preverb Corpus A gold standard corpus manually annotated with verb-preverb connections for Hungarian. corpus The corpus consist of the follo

RIL Lexical Knowledge Representation Research Group 3 Jan 27, 2022
OpenChat: Opensource chatting framework for generative models

OpenChat is opensource chatting framework for generative models.

Hyunwoong Ko 427 Jan 06, 2023
A library for finding knowledge neurons in pretrained transformer models.

knowledge-neurons An open source repository replicating the 2021 paper Knowledge Neurons in Pretrained Transformers by Dai et al., and extending the t

EleutherAI 96 Dec 21, 2022
Refactored version of FastSpeech2

Refactored version of FastSpeech2. An implementation of Microsoft's "FastSpeech 2: Fast and High-Quality End-to-End Text to Speech"

ILJI CHOI 10 May 26, 2022
Graph4nlp is the library for the easy use of Graph Neural Networks for NLP

Graph4NLP Graph4NLP is an easy-to-use library for R&D at the intersection of Deep Learning on Graphs and Natural Language Processing (i.e., DLG4NLP).

Graph4AI 1.5k Dec 23, 2022
Programme de chiffrement et de déchiffrement inverse d'un message en python3.

Chiffrement Inverse En Python3 Programme de chiffrement et de déchiffrement inverse d'un message en python3. Explication du chiffrement inverse avec c

Malik Makkes 2 Mar 26, 2022
ProtFeat is protein feature extraction tool that utilizes POSSUM and iFeature.

Description: ProtFeat is designed to extract the protein features by employing POSSUM and iFeature python-based tools. ProtFeat includes a total of 39

GOKHAN OZSARI 5 Dec 16, 2022
🗣️ NALP is a library that covers Natural Adversarial Language Processing.

NALP: Natural Adversarial Language Processing Welcome to NALP. Have you ever wanted to create natural text from raw sources? If yes, NALP is for you!

Gustavo Rosa 21 Aug 12, 2022
JaQuAD: Japanese Question Answering Dataset

JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)

SkelterLabs 84 Dec 27, 2022
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

NLP-Models-Tensorflow, Gathers machine learning and tensorflow deep learning models for NLP problems, code simplify inside Jupyter Notebooks 100%. Tab

HUSEIN ZOLKEPLI 1.7k Dec 30, 2022
translate using your voice

speech-to-text-translator Usage translate using your voice description this project makes translating a word easy, all you have to do is speak and...

1 Oct 18, 2021
Задания КЕГЭ по информатике 2021 на Python

КЕГЭ 2021 на Python В этом репозитории мои решения типовых заданий КЕГЭ по информатике в 2021 году, БЕСПЛАТНО! Задания Взяты с https://inf-ege.sdamgia

8 Oct 13, 2022
This is a GUI program that will generate a word search puzzle image

Word Search Puzzle Generator Table of Contents About The Project Built With Getting Started Prerequisites Installation Usage Roadmap Contributing Cont

11 Feb 22, 2022
The aim of this task is to predict someone's English proficiency based on a text input.

English_proficiency_prediction_NLP The aim of this task is to predict someone's English proficiency based on a text input. Using the The NICT JLE Corp

1 Dec 13, 2021
xFormers is a modular and field agnostic library to flexibly generate transformer architectures by interoperable and optimized building blocks.

Description xFormers is a modular and field agnostic library to flexibly generate transformer architectures by interoperable and optimized building bl

Facebook Research 2.3k Jan 08, 2023
Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"

Structural Guidance for Transformer Language Models This repository accompanies the paper, Structural Guidance for Transformer Language Models, publis

International Business Machines 10 Dec 14, 2022
Implementaion of our ACL 2022 paper Bridging the Data Gap between Training and Inference for Unsupervised Neural Machine Translation

Bridging the Data Gap between Training and Inference for Unsupervised Neural Machine Translation This is the implementaion of our paper: Bridging the

hezw.tkcw 20 Dec 12, 2022
Creating a chess engine using GPT-3

GPT3Chess Creating a chess engine using GPT-3 Code for my article : https://towardsdatascience.com/gpt-3-play-chess-d123a96096a9 My game (white) vs GP

19 Dec 17, 2022
Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".

STEMM: Self-learning with Speech-Text Manifold Mixup for Speech Translation This is a PyTorch implementation for the ACL 2022 main conference paper ST

ICTNLP 29 Oct 16, 2022
Google's Meena transformer chatbot implementation

Here's my attempt at recreating Meena, a state of the art chatbot developed by Google Research and described in the paper Towards a Human-like Open-Domain Chatbot.

Francesco Pham 94 Dec 25, 2022