[Code-To-Text] Issues loading a re-trained model about codexglue

[guody5]

You also need to enter these command (including training command) in the inference:

lang=ruby #programming language
lr=5e-5
batch_size=32
beam_size=10
source_length=256
target_length=128
data_dir=../dataset
output_dir=model/$lang
train_file=$data_dir/$lang/train.jsonl
dev_file=$data_dir/$lang/valid.jsonl
epochs=10 
pretrained_model=microsoft/codebert-base #Roberta: roberta-base
batch_size=64
dev_file=$data_dir/$lang/valid.jsonl
test_file=$data_dir/$lang/test.jsonl
test_model=$output_dir/checkpoint-best-bleu/pytorch_model.bin #checkpoint for test

[lapplislazuli]

@guody5 thank your for your answer,
but if I run it with all parameters, I will have to do the training?

I want to run just inference, like in the Readme.
Training+Inference works, but just Inference for a trained model fails.

[guoday]

lang=ruby #programming language
lr=5e-5
batch_size=32
beam_size=10
source_length=256
target_length=128
data_dir=../dataset
output_dir=model/$lang
train_file=$data_dir/$lang/train.jsonl
dev_file=$data_dir/$lang/valid.jsonl
epochs=10 
pretrained_model=microsoft/codebert-base #Roberta: roberta-base
batch_size=64
dev_file=$data_dir/$lang/valid.jsonl
test_file=$data_dir/$lang/test.jsonl
test_model=$output_dir/checkpoint-best-bleu/pytorch_model.bin #checkpoint for test
python run.py --do_test --model_type roberta --model_name_or_path microsoft/codebert-base --load_model_path $test_model --dev_filename $dev_file --test_filename $test_file --output_dir $output_dir --max_source_length $source_length --max_target_length $target_length --beam_size $beam_size --eval_batch_size $batch_size

[guoday]

In your error logs:
model_name_or_path should be "microsoft/codebert-base" but get '/models/pytorch_model.bin'

[guoday]

According to your log, you should run the following command:

python run.py --do_test --model_type roberta --model_name_or_path microsoft/codebert-base --load_model_path /models/pytorch_model.bin --test_filename /dataset/test.jsonl --output_dir /experiment/output --max_source_length 256 --max_target_length 128 --beam_size 10 --eval_batch_size 32

[lapplislazuli]

@guoday Thank you very much!
Works like a charm. I did not read properly that pretrained model and load_model were seperate things.