izuna385 / entity-linking-tutorial Goto Github PK

How can I create my candidates.pkl file for another dataset. Your candidatesgenerator.py code just load candidates.pkl in the parameters, not generator I guess. Could you help me for this problem?

Thanks

Hi,

I ran this code on Colab. I also want to try it on my computer. I installed all required packages. I ran preprocess part without error, but the code was given an error when I ran main.py. This error: dll load failed module not found in tokenizer.py (line 4: from transformers import AutoTokenizer, AutoModel). I looked at this error, but I didn't fix yet. What can I do, what do you suggest to me?

Have a nice day

• SF-based and ANN-based
• Combining surface similarity.

Ref. https://arxiv.org/abs/1909.10506 https://arxiv.org/abs/1911.03814

implementation
https://github.com/izuna385/Zero-Shot-Entity-Linking/blob/master/src/hardnegative_searcher.py

Hi,

I ran your code successfully and some results are different, especially for batch_size: 48. I used your parameters, but accuracy and recall values' differences are overmuch. I wonder why, maybe you changed other parameters. Especially for batch size: 48, why accuracies and recalls values are quite different according to your results.

Also biobert model didn't run, I got an error

Have a nice day.

===PARAMETERS===
debug False
debug_data_num 200
dataset bc5cdr
dataset_dir ./dataset/
serialization_dir ./serialization_dir/
preprocessed_doc_dir ./preprocessed_doc_dir/
kb_dir ./mesh/
cached_instance False
lr 1e-05
weight_decay 0
beta1 0.9
beta2 0.999
epsilon 1e-08
amsgrad False
word_embedding_dropout 0.1
cuda_devices 0
scoring_function_for_model indexflatip
num_epochs 10
patience 10
batch_size_for_train 48
batch_size_for_eval 48 or 16, I tried this
bert_name bert-base-uncased
max_context_len 50
max_mention_len 12
max_canonical_len 12
max_def_len 36
model_for_training biencoder I tried other models
candidates_dataset ./candidates.pkl
max_candidates_num 10
search_method_for_faiss indexflatip
how_many_top_hits_preserved 50
===PARAMETERS END===

BioBERT error: