The aim of this task is to predict someone's English proficiency based on a text input.

Last update: Dec 13, 2021

Overview

English_proficiency_prediction_NLP

The aim of this task is to predict someone's English proficiency based on a text input.

Using the The NICT JLE Corpus available here : https://alaginrc.nict.go.jp/nict_jle/index_E.html

The source of the corpus data is the transcripts of the audio-recorded speech samples of 1,281 participants (1.2 million words, 300 hours in total) of English oral proficiency interview test. Each participant got a SST (Standard Speaking Test) score between 1 (low proficiency) and 9 (high proficiency) based on this test.

The goal is to build a machine learning algorithm for predicting the SST score of each participant based on their transcript.

Steps:

1 - Pre-process the dataset: extract the participant transcript (all tags). Inside participant transcript, you can remove all other tags and extract only English words.

2 - Process the dataset: extract features with the Bag of Word (BoW) technique

3 - Train a classifier to predict the SST score

4 - Compute the accuracy of your system (the number of participant classified correctly) and plot the confusion matrix.

5 - Try to improve your system (for example you can try to use GloVe instead of BoW).

The aim of this task is to predict someone's English proficiency based on a text input.

Related tags

Overview

English_proficiency_prediction_NLP

Owner

This is a GUI program that will generate a word search puzzle image

Model parallel transformers in JAX and Haiku

nlabel is a library for generating, storing and retrieving tagging information and embedding vectors from various nlp libraries through a unified interface.

A paper list of pre-trained language models (PLMs).

Creating an LSTM model to generate music

Persian Bert For Long-Range Sequences

InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective

An easy-to-use Python module that helps you to extract the BERT embeddings for a large text dataset (Bengali/English) efficiently.

Python utility library for compositing PDF documents with reportlab.

Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge. Proceedings of EMNLP 2021

A Python 3.6+ package to run .many files, where many programs written in many languages may exist in one file.

Simple, Fast, Powerful and Easily extensible python package for extracting patterns from text, with over than 60 predefined Regular Expressions.

Creating a python chatbot that Starbucks users can text to place an order + help cut wait time of a normal coffee.

Shellcode antivirus evasion framework

Python library for interactive topic model visualization. Port of the R LDAvis package.

Generating new names based on trends in data using GPT2 (Transformer network)

Python api wrapper for JellyFish Lights

Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021

UniSpeech - Large Scale Self-Supervised Learning for Speech

LUKE -- Language Understanding with Knowledge-based Embeddings