Comments (5)
Perhaps adding an example of how to do it, or else just stating that it won't work.
I wouldn't expect it to work. The way things are currently written the callback is passed the full response so would wait until everything is back before invoking it. It might be possible to rework things, maybe adding another streaming friendly callback, but I'm not 100% sure what that would look like.
from requests-futures.
That makes sense.
I think callback can't work with streaming, if requests-futures
only uses public API of request
: the only way intermediate results are exposed in the public API is through the blocking iterator iter_lines
. But I'm really not experienced in this at all, so maybe I just don't see something obvious.
from requests-futures.
Maybe if you describe your use case/reason for needing streaming in an async env I might be able to help. My intuition is that there's not a lot of cases where it'd buy much, but I wouldn't rule out that some could exist.
from requests-futures.
My use case is not too impressive. Just wanted to use Twitter streaming API to retrieve tweets in real-time, and then display update when something interesting happened - without blocking the main program.
from requests-futures.
My use case is not too impressive. Just wanted to use Twitter streaming API to retrieve tweets in real-time, and then display update when something interesting happened - without blocking the main program.
Ah. In that sort of setup you'd likely be better off directly using threading.Thread to create a (background) thread that makes the requests calls and does the stream processing. The futures paradigm pretty much just gets in the way there. Good luck.
from requests-futures.
Related Issues (20)
- No module named 'requests_futures.sessions' HOT 3
- OSError Issues when used within celery task (gevent) HOT 2
- Adding attribute to response via hook (as seen in examples) fails HOT 1
- Cannot switch to a different thread HOT 3
- Possibility to accept old SSL versions? HOT 1
- Problem with data field in header request HOT 1
- Making a future request and letting callback work with result - some are missing HOT 2
- Error When there is a large parallel Requests go. HOT 2
- Provide wheels on PyPI HOT 1
- How do we pass arguments to the hooks? HOT 3
- AttributeError: 'Future' object has no attribute 'status_code' HOT 1
- 1.0.0: missing git tag HOT 5
- Response for batched requests HOT 6
- Add type annotations HOT 4
- Not showing as updated on PyPI HOT 3
- On exception it returns xx (Caused By None), whereas the requests module returns xx (Caused By xx) HOT 4
- The elapsed time hook example does not work HOT 3
- 1.0.0: pytest is failing in two units HOT 6
- Use pytest-httpbin? HOT 8
- Attribute set via response hooks does not work with ProcessPoolExecutor HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from requests-futures.