Scraped tweets are the same for every request about search-tweets-python

[igorbrigadir]

I think it should work if you set max_results=500

collect_results already loops over pages / requests for you for convenience - so max_results is the thing to control how many tweets should be collected, and how many requests should be used up. So to get 500 tweets back, it will use 5 calls (returning 100 tweets in each "page" - set by results_per_call)

Hope that helps!

[fatimamb]

thank you it works

[jrmontag]

Hi @Arowain, pagination across multiple requests should be automatically handled automatically by both the collect_results() method ("the easy way") and the ResultsStream object. One quick check is to be check if you're setting the max_results kwarg to something unnecessarily low - that parameter sets the maximum total number of Tweets returned across all of the pagination.

Can you include some additional information about how you're currently making your requests (including interpreter and library version numbers)?

[Arowain]

Hi @jrmontag thanks for the response.

Here is the library I used:
Name: searchtweets
Version: 1.7.4
Build: pypi_0
Channel: pypi

and here is my code:

data_1 = gen_rule_payload("#home", results_per_call=100, 
                        from_date="2018-12-20", #UTC 2017-09-01 00:00
                        to_date="2018-12-20",)  #UTC 2017-10-30 00:00 # testing with a sandbox account
 
tweets_1 = collect_results(data_1,
                         max_results=100,
                         result_stream_args=premium_search_args) # change this if you need to

And what do you mean on using max_results ? do you mean that if I need 500 tweets on the same day (for example 2018-12-20) I should set results_per_call to 500? and when I run collect_results it will return 500 tweets for this day or should I use a for loop?

[andypiper]

Great, I'm going to close this out.