Comments (10)
Hi,
I'm not sure I understand. How was the 'eval.1851915.scores' file created? Was is using train.py or tagger.py? If you used tagger.py, did you tokenize the file properly? Also note that the input file formats are different for train.py (one word by line) and tagger.py (one sentence by line).
from tagger.
When running python train.py --train dataset/eng.train --dev dataset/eng.testa --test dataset/eng.testb, after a few epochs i receive the same error:
File "train.py", line 220, in
dev_data, id_to_tag, dico_tags)
File "./tagger-master/utils.py", line 256, in evaluate
eval_lines = [l.rstrip() for l in codecs.open(scores_path, 'r', 'utf8')]
File "/usr/lib/python2.7/codecs.py", line 896, in open
file = builtin.open(filename, mode, buffering)
IOError: [Errno 2] No such file or directory: './evaluation/temp/eval.1740643.scores'
For the previous epochs there are .scores and .output files in temp, but i can't trace back the error. I'm using the provided training and test sets.
Regards,
rikuge
from tagger.
Maybe you have ran out of disk space?
Did you move the utils.py
to a subdirectory? This might be the case.
from tagger.
Neither.. i just downloaded the code and ran the it, changed nothing. After train.py creates a few .output and .scores files it is no longer able to create the .scores file (the .output file is present).
from tagger.
I've experienced the same issue during training, the recurrent evaluation failed also at some point with a: "No such file or directory: './evaluation/temp/eval.***.scores".
It happens on the vanilla version of the code after some iterations (at iteration 7000 during epoch 2 on my side). There is still a lot of space left on my drive.
It happens with the Theano-0.9.0 version and seems correlated to the RAM memory steady increase during training. It seems to work fine with Theano-0.7.0.
@glample, could you tell us which version of Theano you were using? I guess it wasn't the 0.9.0 since the code was committed last year.
from tagger.
Hi,
Yes, I was using theano 0.7 at the time. I think 0.8 came out at about the same time I released the code, and there was no issue back then. I'm surprised you observe a RAM memory increase with theano 0.9, if this happens I would imagine the problem is coming from this version of theano, maybe a temporary bug. If this is not a problem of theano I will need to fix the tagger code, but I'm really sorry I don't have time to investigate on this currently :(
from tagger.
Hi @glample
Indeed, I tested with theano-0.8.2
and it works as well.
It's most likely related to the issue identified and fixed here:
http://stackoverflow.com/q/43234170/4218883
Theano/Theano#5810
Theano/Theano#5832
So no problem in the code, it's in theano-0.9.0
apparently.
Cheers
from tagger.
Hi @glample
when I have trained model use Chinese data, I got the error information in epoch 15 :IOError: [Errno 2] No such file or directory: './evaluation/temp/eval.1742145.scores'.I'm sure my data formats are same as you require,but I can't track back the error.
Regards,
Woody
I find it in theano-0.8.* it is works as well too,thanks for share:) @marcevrard
from tagger.
Dear Glample,
I am trying to train my own model and I am not able to go through this error which is being generated ,
I am not able to figure it out why i am getting that error.
it seems like the below shell command we are trying to run utils.py has some issue
os.system("%s < %s > %s" % (eval_script, output_path, scores_path)).
But i am not sure what exactly we are trying to achieve here with this command
from tagger.
I am also facing the same issue. All my predictions are O, eventhough i am using theano-0.8*. Can anyone help me on whats wrong i might be doing.
from tagger.
Related Issues (20)
- utils.py issue line 303 list index out of range HOT 8
- Why my program goes into infinite loop? HOT 2
- Cuda and Theano Version HOT 4
- Can you
- Can my Chinese data be used in this program?(character-level) HOT 3
- Which tokenizer did you use? HOT 11
- Script for training embeddings HOT 9
- IOError "No such file or directory: './evaluation/temp/eval.1181043.scores " HOT 3
- SGD x Adam HOT 2
- Are you planning to release models in German, Spanish and Dutch as well? HOT 1
- Confidence score for the predicted entity HOT 4
- Data size and decoding time
- Pretrained word embedding HOT 5
- Confusion about lable conversion. HOT 2
- Inconsistent conversion for IOBES to IOB HOT 1
- Token level or Entity level? HOT 2
- Equations of LSTM
- transition scores HOT 1
- How to set the parameters of a small dataset? HOT 1
- . HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tagger.