The aim of this task is to predict someone's English proficiency based on a text input.

Last update: Dec 13, 2021

Overview

English_proficiency_prediction_NLP

The aim of this task is to predict someone's English proficiency based on a text input.

Using the The NICT JLE Corpus available here : https://alaginrc.nict.go.jp/nict_jle/index_E.html

The source of the corpus data is the transcripts of the audio-recorded speech samples of 1,281 participants (1.2 million words, 300 hours in total) of English oral proficiency interview test. Each participant got a SST (Standard Speaking Test) score between 1 (low proficiency) and 9 (high proficiency) based on this test.

The goal is to build a machine learning algorithm for predicting the SST score of each participant based on their transcript.

Steps:

1 - Pre-process the dataset: extract the participant transcript (all tags). Inside participant transcript, you can remove all other tags and extract only English words.

2 - Process the dataset: extract features with the Bag of Word (BoW) technique

3 - Train a classifier to predict the SST score

4 - Compute the accuracy of your system (the number of participant classified correctly) and plot the confusion matrix.

5 - Try to improve your system (for example you can try to use GloVe instead of BoW).

The aim of this task is to predict someone's English proficiency based on a text input.

Related tags

Overview

English_proficiency_prediction_NLP

Owner

:P Some basic stuff I'm gonna use for my upcoming Agile Software Development and Devops

The code for the Subformer, from the EMNLP 2021 Findings paper: "Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers", by Machel Reid, Edison Marrese-Taylor, and Yutaka Matsuo

Multilingual finetuning of Machine Translation model on low-resource languages. Project for Deep Natural Language Processing course.

Converts text into a PDF of handwritten notes

Create a machine learning model which will predict if the mortgage will be approved or not based on 5 variables

ChatBotProyect - This is an unfinished project about a simple chatbot.

OpenChat: Opensource chatting framework for generative models

A Japanese tokenizer based on recurrent neural networks

I can help you convert your images to pdf file.

A Fast Command Analyser based on Dict and Pydantic

The official repository of the ISBI 2022 KNIGHT Challenge

This repo contains simple to use, pretrained/training-less models for speaker diarization.

Extract Keywords from sentence or Replace keywords in sentences.

Code for our paper "Transfer Learning for Sequence Generation: from Single-source to Multi-source" in ACL 2021.

Grover is a model for Neural Fake News -- both generation and detectio

Official codebase for Can Wikipedia Help Offline Reinforcement Learning?

Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers

This repository consists of a complete guide on natural language processing (NLP) in Python where we'll learn various techniques for implementing NLP including parsing & text processing and understand how to use NLP for text feature engineering.

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

A Survey of Natural Language Generation in Task-Oriented Dialogue System (TOD): Recent Advances and New Frontiers