Pytorch 2.1 on Runpod running Examples hangs with message about ragatouille

[bclavie]

HEy,

Thank you for the report! cc @Anmol6 this is another faiss+CUDA issue. Development/fixing for this family of issue is currently a bit slow (I'm stretched very thin at the moment). I see that you've got a very low number of documents, you could bypass this stage by using encode() and using in-memory encodings, or trying out the experimental (but functional & soon™️ to be released) full vectors index approach in #137 by installing directly from that branch.

[grahama1970]

On my end, I'm happy to test any patches/fixes, and send back a bug report :)
Also, re documents, I'm only using your Miyazaki example, to try to get things to work simply, first.

look forward to trying ragatouille out! Question: do the same issues occur on Colbertv2 without using Ragatouille? I haven't tried Colbert by itself.

[grahama1970]

Question to all--is there a runpod template that will run Ragatouille without error?

[bclavie]

On my end, I'm happy to test any patches/fixes, and send back a bug report :) Also, re documents, I'm only using your Miyazaki example, to try to get things to work simply, first.

look forward to trying ragatouille out! Question: do the same issues occur on Colbertv2 without using Ragatouille? I haven't tried Colbert by itself.

Sorry for the late response! This issue seems to be happening in upstream ColBERT code (specifically, the PLAID index code) rather than RAGatouille, so I think it'd also occur when using the base code.

I'm not currently using Runpod, but a strange thing is that I did use it when training JaColBERT (with PyTorch 2.1 template) and there didn't seem to be any major faiss issues like the ones you're experiencing.