Rate limit to build package about quilt

[kevinemoore]

@AliferSales, you might want to try adding the encoding as a kwarg like this:
rj_bu_2014_1:
file: rj_bu_2014_1.csv
kwargs:
encoding: ISO-8559-1

If that doesn't work, you can use transform: id as @akarve suggested, to build a package with the raw csv file. You can then push that package with quilt push --public alifersales/<packagename> so we'll be able to reproduce the error. Thanks!

[akarve]

OK, temporary solution. Put transform: id underneath, and at the same level of indentation as, file: rj.... That will copy the file, and you can parse it in pandas.

There is probably a datetime or format/type change later in the full file that the Parquet serializer doesn't like. Later today I'll provide an upload link for the full file so we can see what's up. Thanks for reporting this.

[kevinemoore]

This looks like quilt build is failing to parse your csv. Build uses pandas read csv to read csv files into a DataFrame then serializes the DataFrame. You might need to pass some additional parameters to pandas, which you can do with a build file. Are you building from a buil file (e.g. build.yml)? Or, straight from a directory path?

[AliferSales]

Yes. The build.yaml that I'm using is:

$cat build.yaml
contents:
  README:
    file: README.md
  rj_bu_2014_1:
    file: rj_bu_2014_1.csv

I can open the file with Pandas and the only non-default specification is that enconding is "ISO-8559-1".

However, I create the another file with head of my csv:

$head rj_bu_2014_1.csv >> new_file.csv

Thus, I tried to build a package from this new file and the error don't occurred. Because of that I asked about rate limit.

[AliferSales]

Solved!

Really, the problem was with the pandas parsing. I didn't know that parser is made by pandas. I just needed to explicit the encoding (in the case, ISO-8559-1) and Bingo, as @kevinemoore suggested!

Thank @kevinemoore and @akarve. Quiltdata is a very good idea and looks very practical. I'm begining to use it and I'm very excited.

:D