Body is blank when response has no `Content-Length` about http

[bjeanes]

It's worth noting here that the socket content after the request has been made is:

HTTP/1.1 401 Unauthorized\r\nServer: nginx/1.4.3\r\nDate: Mon, 04 Nov 2013 22:12:01 GMT\r\nContent-Type: application/json; charset=utf-8\r\nTransfer-Encoding: chunked\r\nConnection: keep-alive\r\nStatus: 401 Unauthorized\r\nStrict-Transport-Security: max-age=31536000\r\nX-UA-Compatible: IE=Edge,chrome=1\r\nX-Request-Id: 0404cee81486a95569ab4e55c85daeea\r\nX-Runtime: 0.012569\r\nX-Rack-Cache: miss\r\n\r\n29\r\n{\"error\":\"Invalid authentication token.\"}\r\n0\r\n\r\n

Note the chunked encoding. In chunked encoding, one can't read Content-Length bytes, one has to read each chunk until you reach the empty chunk (length 0).

[tarcieri]

You might take a look at some of the existing discussion of this issue on #28 and #39. I don't see a specific ticket for this problem still open for this issue though (besides those tickets, which are vicariously related).

tl;dr: yes, the logic is buggy, it's the result of not enough diligence in merging patches, and at this point I was hoping to address it via a rewrite I haven't had enough time to complete.

That said, an interim fix is probably in order.

[tarcieri]

@bjeanes I merged #28. HEAD should at least give you different behavior now, although it's still not correct.

[bjeanes]

I'll have to pull it down in test it, but it seems that this will just mean the body will be nil instead of empty string, no? Definitely better than an empty string semantically, but unfortunately doesn't help me here.

I'll have a look at those #39 too to see if there is anything I can do to help.

[tarcieri]

Yep, #28 is not a fix :(

[schmurfy]

I suppose this also affects chunked encoded response, am I wrong ?
When such response is received the body is blanked which is not that helpful...

[tarcieri]

@schmurfy this should also be obsoleted by #39

[schmurfy]

so chunked response should work ? I will have a look again at my code tomorrow it may be on my side then.

[tarcieri]

Yes, and you can stream the chunks using HTTP::ResponseBody#readpartial

[schmurfy]

ok I got it, the latest stable release is so far behind master that ResponseBody does not even exists in it xD
I will try master thanks for helping figure this out xD