Parsing issue reading from a stream >64KB on Windows about rapidcsv

[d99kris]

Hello,
Thanks for reporting the issue and providing the detailed analysis! It's a pretty bad bug and I'm surprised it's not been encountered (or detected) before.

I can confirm your test case reproduces the issue on MSVC for me as well. I'm preparing a fix in rapidcsv (incl. updates to documentation and test cases) and will likely get it in this weekend.

Meanwhile, if you need to work around it, I think there are two options:

1. Open the file using rapidcsv, i.e. change ReadFile() to:

void ReadFile()
{
   rapidcsv::Document doc(filename);
   std::cout << doc.GetRowCount() << std::endl;
}

2. Open the ifstream in binary mode, i.e. change ReadFile() to:

void ReadFile()
{
   std::ifstream file(filename, std::ios::binary);
   rapidcsv::Document doc(file);
   std::cout << doc.GetRowCount() << std::endl;
}

[ezemskov]

Thanks Kris,
rapidcsv 8.61 fixes our issue.

[RedBreadcat]

Great, thank you for the ergonomic suggestions to work around the issue in the meantime!

[d99kris]

Hello,
The reported issue has been addressed in above commit. Please let me know if you encounter any issues. Thanks!