First Assignment - Entity Linking
Web Data Processing System Assignment 1 - 2021 - Group 26
- Zhining Bai
- Bowen Lyu
- Tianshi Chen
- Yiming Xu
Description
This is a Python program to Entity Linking by processing WARC files. We recognize entities from web pages and link them to a Knowledge Base(Wikidata). The pipeline for this program as below:
Read WARC
- Use
pysparkto read large-scale warc files, so the program supports parallel computing. - Extract text information from HTML files by using
beautifulsoup.
Named entity recognition
- Extract entities by using
recognize_entities_bertmodel fromsparknlp.
Disambiguation and NIL
We considered the popularity of the candidate page as well as the semantic similarity between the sentence where the entity is located and the candidate description to achieve Disambiguation.
- Popularity: Calculate popularity rankings using the
Elasticsearchscoring algorithm and the number of properties of the mention from the knowledge graph. - Sentence similarity: Measure the difference between text and description using the
Levenshtein distance.
NIL: Retain results with distances < 40.
Prerequisites
Codes are run on the DAS cluster at /var/scratch/wdps2106/wdps_2126, result1 is a conda virtual environment that has been created. Below are the packages installed to run the assignment.
# if you want to use pip(pip for python3) to install the packages, use the following command(python version 3.8)
pip install pyspark==3.1.2
pip install spark-nlp==3.3.3
pip install beautifulsoup4
pip install python-Levenshtein
pip install elasticsearch
# if you want to use conda to install the packages, use the following command(recommended)
conda create -n
python=3.8
conda install pyspark
conda install bs4
conda install elasticsearch
pip install python-Levenshtein
pip install sparknlp
Run
To run the program, you can simply use the command below. The parameter Keyname is the name of page ID in WARC files such as WARC_TREC_ID. You need to declare the name of the page ID using this parameter. Be aware that the result file will be renamed as result.tsv.
sh run.sh /path/to/warc/file.warc.gz /path/to/result/ Keyname
If you use DAS cluster, you also need to add this command before running:
export OPENBLAS_NUM_THREADS=10
To check the score of the result file, use the command below.
python3 score.py /sample/annotation/file/sample.tsv /generated/result/file/result.tsv
Result
We tested our entity linking code using sample.warc.gz. Since sample_annotations.tsv only contains the entities that page_id is less than 92, our test results only output entity links with page_id <= 92. The f1 score of the sample data is 0.1122.
| Metric | Value |
|---|---|
| Gold | 500 |
| Predicted | 480 |
| Correct | 55 |
| Precision | 0.1145 |
| Recall | 0.11 |
| F1 Score | 0.1122 |
21 Aug 12, 2022
2.1k Jan 1, 2023
652 Jan 6, 2023
1.2k Dec 21, 2022
19.5k Feb 13, 2021
77.3k Jan 3, 2023
12.3k Dec 31, 2022
8.4k Dec 26, 2022
3k Jan 5, 2023
40 Nov 25, 2022
364 Jan 06, 2023
34 Sep 08, 2022
9 Jul 21, 2022
318 Jan 04, 2023
[email protected]">
9 Oct 26, 2022
7 Dec 25, 2022
4 Oct 24, 2021
33 Dec 18, 2022
151 Jan 05, 2023
10 Dec 19, 2022
133 Dec 22, 2022
1 Jan 01, 2022
1 Jan 17, 2022
279 Dec 09, 2022
463 Dec 26, 2022
103 Dec 10, 2022
1 Feb 08, 2022