tolik505 / split-csv Goto Github PK

hi Tolik505,

i am using your great split-csv lib for golang

but if i try to split a big csv into 50k files, lot of bigger files land in the destination folder (see screenshot)

Do you have an idea why ?

my setup looks like this

splitDir = "/tmp/split"
splitter = split_csv.New()
splitter.Separator = ";" // "," is by default
splitter.FileChunkSize = 50000
splitter.WithHeader = false

path := "/tmp/split/feed__" + fileID + "__.csv"
csvfile, err := os.Create(path)
defer csvfile.Close()

io.Copy(csvfile, reader)

splitter.Split(path, splitDir)

Adrian
(i attached a screenshot in the comment)

if we have:

"id";"name";"text"
"1222223";"тест";"Шла
Маша
по
шоссе"
123;Петя;Во какой

Found a bug.
If spliter.bufferSize < len(header). the field st.columnsCount will not be initialized correctly by countCompletedColumns causes st.header is unexpected and generate unexpected files

Multiline header ??? ))