Coder Social home page Coder Social logo

fq hangs when reading from STDIN about fq HOT 4 OPEN

wader avatar wader commented on May 18, 2024
fq hangs when reading from STDIN

from fq.

Comments (4)

wader avatar wader commented on May 18, 2024

Hey, thanks for the report. I think this boils down to that input behaves a bit differently forfq. Each input will read one full input file and not json fragments like jq, ex yes 1 | fq input also hangs.
The reason it behaves like this currently is that some formats does not have any signaling except EOF to know that it ends. In addition fq also does not concatenate all inputs into one stream of bytes, ex for jq a json value might span over multiple files, that would be tricky with fq, ex would fq . a.mp3 b.mp3 be one big mp3 file in some cases? also by default fq probes format per input file.

But that said it might be possible with some refactoring to allow more per format behaviour to get something that is closer to how jq behaves. I haven't given it that much thought yet, so any help thinking about it is appreciated.

Also this should probably be documented somehow.

from fq.

wader avatar wader commented on May 18, 2024

Maybe i will revisit this at some point if decoder can be generators etc. Ok to close this for now?

from fq.

pkoppstein avatar pkoppstein commented on May 18, 2024

Ok to close this for now?

Thanks for your consideration. It's your project, so you should do what makes sense for you, though it does seem to me that leaving it open would help keep the issue alive and perhaps invite ideas or even contributions.

from fq.

wader avatar wader commented on May 18, 2024

Yeah make sense, i don't have a strong opinion really about closing issues that are not active, but try to cleanup some from time to time. Let keep it open for now.

btw thanks for all the jq related things your active on, learned a lot from your documentation, code and comments!

from fq.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.