Could not enable GPU for Bert based model about rat-sql

[senthurRam33]

After updating the CUDA package, this issue has been resolved. We can train the BERT in P100 but it may take upto a week

[mellahysf]

Hi @senthurRam33

Can you tel me please how to run RATSQL in Google colab? Precisely how to set up the environment based on docker ?

Thank you very much.

[senthurRam33]

I didn't implement docker on colab as it is nearly impossible to run docker in that. I installed all the packages by mounting google drive on colab and started training. If the training stops, then I started retraining from the previously saved model using checkpoints

[mellahysf]

Thank you @senthurRam33 four your replay.

you said 'I installed all the packages by mounting google drive on colab'
How did you do that?
I have the problem of setting up the environment !!

[senthurRam33]

Can you precisely tell me what's the problem??

[mellahysf]

Since it is impossible to use docker in colab, I want to set up manually the environment (installing packages and dependencies) in order to run RATSQL.

How to do that in colab?

[senthurRam33]

--> First clone the repo in the google drive
--> Then install all the packages required to run the repo
--> Then upload the datasets in the drive
--> Then run the commands given in the repo to start the training
I would recommend you to use colab pro for faster training

[mellahysf]

I have the problem just in the second step.
How to install all the packages required to run the repo ?
By simply running 'pip install -r requirements.txt' ?

sorry for the perturbation

[senthurRam33]

Yes. But in colab you run terminal commands like this "!pip install -r requirements.txt".
But there are some packages that needs to be installed separetely. In my case, jsonnet and attr packages

[mellahysf]

it requires only:
!pip install -r requirements.txt
!pip install jsonnet
!pip install attr
for setting up the environment?

[senthurRam33]

For me those are the ones that required.
Just try to run the repo using the command. It will tell you what are the packages that you are missing

[mellahysf]

Thank you very much @senthurRam33
Just one more remark, I think it requires also running Stanford corenlp server, is it true ? if yes how?

[senthurRam33]

Yes it requires that package too. Try installing with !pip install corenlp command

[mellahysf]

And I think also it requires python>=3.7 instead of the default python in colab which is 3.6.9

Thank you very much for all your help.

I will try to run it in colab.