Skip to content

Code and data of WSDM 2023 paper "Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark".

Notifications You must be signed in to change notification settings

HITsz-TMG/Hansel

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 

Repository files navigation

Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark

This is the main page of our WSDM 2023 paper Hansel.

************************************* Updates *************************************

  • 13/03/2023: We release the knowledge base we use in our experiments.
  • 19/12/2022: We release the training and validation data of Hansel.
  • 27/07/2022: We release the test set of Hansel, consisting of Hansel-FS and Hansel-ZS. More training data, knowledge base and baselines are to come!

Contents

Overview

Hansel is a high-quality human-annotated Chinese entity linking (EL) dataset, aimed at testing Chinese EL systems' generalization ability to tail entities and emerging entities:

  • The test set contains Few-shot (FS) and zero-shot (ZS) slices, has 10K examples and uses Wikidata as the corresponding knowledge base.
  • The training and validation sets are from Wikipedia hyperlinks, useful for large-scale pretraining of Chinese EL systems.

Dataset

The data is available here. You can also download and use Hansel through the HuggingFace's datasets library 🤗.

The knowledge base (i.e., Wikidata) we use in our experiments is available here.

Data Statistics

# Mentions # Entities Domain
Train 9,879,813 541,058 Wikipedia
Validation 9,674 6,320 Wikipedia
Hansel-FS 5,260 2,720 News, Social Media
Hansel-ZS 4,715 4,046 News, Social Media, E-books, etc.

Data Format

{"id": "hansel-eval-zs-1463", 
 "text": "1905电影网讯 已经筹备了十余年的吉尔莫·德尔·托罗的《匹诺曹》,在上个月顺利被网飞公司买下,成为了流媒体巨头旗下的新片。近日,这部备受关注的影片确定了自己的档期:2021年。虽然具体时间未定,但影片却已经实实在在地向前迈出了一步。", 
 "start": 29, 
 "end": 32, 
 "mention": "匹诺曹", 
 "gold_id": "Q73895818", 
 "source": "https://www.1905.com/news/20181107/1325389.shtml", 
 "domain": "news"
}

Citation

If you use our dataset in your work, please cite us.

@inproceedings{xu2022hansel,
  author = {Xu, Zhenran and Shan, Zifei and Li, Yuxin and Hu, Baotian and Qin, Bing},
  title = {Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark},
  year = {2023},
  publisher = {Association for Computing Machinery},
  url = {https://doi.org/10.1145/3539597.3570418},
  booktitle = {Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining},
  pages = {832–840}
}

License

Hansel dataset is licensed under the Creative Commons Attribution-Share Alike License (CC-BY-SA).

About

Code and data of WSDM 2023 paper "Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark".

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published