french and arabic csv files, invalid characters about tolatables

[tolabot]

[email protected] http://tola.work/helpdesk/view/?ticket=tt-261&[email protected] Received new French CSV file for uploading to Tables (attached to TW ticket) still receive an error on import:

InvalidStringData at /file/54/
strings in documents must be valid UTF-8
Request Method: POST
Request URL: https://tola-tables-demo.mercycorps.org/file/54/
Django Version: 1.8.2
Exception Type: InvalidStringData
Exception Value:
strings in documents must be valid UTF-8
Exception Location: /usr/local/lib/python2.7/site-packages/pymongo/collection.py in _insert, line 430

[mahmoodkhan]

The problem seems to be related to excel. When I download as CSV from google spreadsheet, it works. Also, if I download as Excel from Google Spreadsheet and use Apple Numbers to convert it to csv it still works. But when you use Excel to convert the file to CSV then it gets all scrambled.

It is not really a tola issue, as long as users have a valid csv file in whatever language tolatables is able to import it.