Neural machine translation between the writings of Shakespeare and modern English using TensorFlow

Last update: Dec 28, 2022

Overview

Shakespeare translations using TensorFlow

This is an example of using the new Google's TensorFlow library on monolingual translation going from modern English to Shakespeare based on research from Wei Xu.

Prepare

First download the TensorFlow library depending on your platform:

pip install https://storage.googleapis.com/tensorflow/mac/tensorflow-0.5.0-py2-none-any.whl # for mac
pip install https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.5.0-cp27-none-linux_x86_64.whl # for ubuntu

Grabs parallel data.
Gets train, dev split.
Builds vocabulary
Converts parallel data into ids

From the root directory:

python -m tensorshake.get_data
python -m tensorshake.prepare_corpus

Delete /cache to start anew.

Train

Use the example BASH script to train the model. This saves the check points in the --train_dir directory. If you run it again, the training process continues from the check point. To restart with fresh parameters, simply delete/rename the check points.

./run.sh

Results

Benchmarks from original paper. (Shakespeare -> Modern English)

Input	Output
i will bite thee by the ear for that jest .	i ’ ll bite you by the ear for that joke .
what further woe conspires against mine age ?	what ’ s true despair conspires against my old age ?
how doth my lady ?	how is my lady ?
hast thou slain tybalt ?	have you killed tybalt ?
an i might live to see thee married once , i have my wish .	if i could live to see you married, i ’ ve my wish .
benvolio , who began this bloody fray ?	benvolio , who started this bloody fight itself ?
what is your will ?	what do you want ?
call her forth to me .	bring her out to me .

Cherrypicked examples from this repo (Modern English -> Shakespeare)

Input	Output
but you’re not listening to me.	but you do not hear me .
Gregory, on my word, we will not be humiliated, like carrying coal.	regory , we 'll not carry coals .
but he got the promotion.	he is the friend .
i can hit quickly, if i'm motivated.	i strike , i am moved .
Did you just give us the finger, sir?	have you leave the thumb , sir ?
You don’t know what you’re doing!	you do not what you know you .
have you killed Tybalt?	hast thou slain tybalt ?
Why, Romeo, are you crazy?	why , art thou mad , mad ?

Pre-Trained Models

Here is a link for an example model: https://s3-us-west-2.amazonaws.com/foxtype-nlp/tensorshake/model_cache.zip

Possible improvements

word embeddings
beam search
language model reranking

Neural machine translation between the writings of Shakespeare and modern English using TensorFlow

Related tags

Overview

Shakespeare translations using TensorFlow

Prepare

Train

Results

Pre-Trained Models

Possible improvements

Owner

Motoki Wu

Checkout some cool self-projects you can try your hands on to curb your boredom this December!

Code for ICCV 2021 paper: ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators..

This is the implementation of GGHL (A General Gaussian Heatmap Labeling for Arbitrary-Oriented Object Detection)

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Implementation of CVAE. Trained CVAE on faces from UTKFace Dataset to produce synthetic faces with a given degree of happiness/smileyness.

Blind visual quality assessment on 360° Video based on progressive learning

MVSDF - Learning Signed Distance Field for Multi-view Surface Reconstruction

An Open Source Machine Learning Framework for Everyone

Implementation of the "Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos" paper.

Automated image registration. Registrationimation was too much of a mouthful.

Face Recognition & AI Based Smart Attendance Monitoring System.

TCube generates rich and fluent narratives that describes the characteristics, trends, and anomalies of any time-series data (domain-agnostic) using the transfer learning capabilities of PLMs.

On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))

GrabGpu_py: a scripts for grab gpu when gpu is free

Multivariate Time Series Forecasting with efficient Transformers. Code for the paper "Long-Range Transformers for Dynamic Spatiotemporal Forecasting."

implement of SwiftNet:Real-time Video Object Segmentation

Removing Inter-Experimental Variability from Functional Data in Systems Neuroscience

The official codes of "Semi-supervised Models are Strong Unsupervised Domain Adaptation Learners".

Build an Amazon SageMaker Pipeline to Transform Raw Texts to A Knowledge Graph

Pytorch implementation of AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks