Support request body inflate and gunzip when Content-Encoding header is appropriately set

[bminer]

If a client sends an HTTP request with "Content-Encoding" header set, co-body should be able to quickly pipe that to zlib and inflate the compressed request body prior to parsing the body.

I'd be happy to help and submit a PR, but I'd like to discuss how to implement first. Any thoughts? Is this something that needs to be done in raw-body or another lib? raw-body needs the stream only, but each "buddy" in co-body needs the full HTTP request Object. Might require a bit of refactoring?

[bminer]

I should also mention that the old Express body-parser lib supports HTTP request inflation:

https://github.com/expressjs/body-parser/blob/master/lib/read.js#L143-L176

[haoxins]

SGTM

we can dep https://github.com/stream-utils/inflation

[bminer]

@coderhaoxin - I like it. I'll submit a PR that modifies each "buddy" (i.e. lib/json.js) to use the inflation lib.

[bminer]

Just waiting for this to be merged...
stream-utils/inflation#14

[felixsanz]

@bminer , @fengmk2

If a client sends an HTTP request with "Content-Encoding" header set, co-body should be able to quickly pipe that to zlib and inflate the compressed request body prior to parsing the body.

This PR should be reverted, as stated in #51, not all Content-Encodings are gzip. For example DeflateRaw and Brotli will make the parser fail and the body will not be available.

[fengmk2]

@bminer can you fix @felixsanz's bug too?

[felixsanz]

@fengmk2 I think the inflate/decompress thing should be bundled in it's own middleware, like this:

app.use(bodyparser)
app.use(decompressBody) // some inflate middleware
// or app.use(brotli) <- decompress brotli bodies

This is a bodyparser, and that is the only thing that it should do. If the body is compressed or not I don't think it has anything to do with this middleware. It'll be a mess to support all encodings here (and the upcoming ones like the facebook's zstd).

[bminer]

I'm not so sure that I agree. If the HTTP body is compressed, the bodyparser should be able to decompress it in order to parse it. I see the argument for separate middleware, but gzip is the "standard".

What is wrong about trying to support other inflation algorithms?

[bminer]

Also deflate and gzip are supported by the inflation lib. Maybe Brotli can be added?

[felixsanz]

and what about deflateRaw? and zopli? and zstd? :/

Anyway, supporting brotli is more than nothing. Hell, even if you don't support brotli i'm happy as long as you remove the default inflate() process that is giving me errors because i'm not using deflate :D

[bminer]

Hmm, what errors do you get with an unsupported content encoding?