Error uploading document(s): Memory Limit Exceeded about arcee-python

[tleyden]

Workaround: set the chunk size to 1 byte bigger than the file size. For example with this file:

$ ls -al
-rw-rw-r--  1 ubuntu ubuntu 3383113855 Oct 19 09:49 context_data_6fab4be1-6939-4b95-bd93-09d87c23cba0.csv

Set the chunk size to 1 byte larger:

arcee upload context --chunk-size 3383113856 patent-abstracts --file context_data_6fab4be1-6939-4b95-bd93-09d87c23cba0.csv
⠋ ✅ Listed 1 document path(s)
⠋ ✅ Validated 1 files(s)
⠋ Uploading 1 document(s)...

This isn't a great UX though. What should probably happen is that it just figures out the right chunk size to use based on the file size.