trevorhobenshield / twitter-api-client Goto Github PK

Collecting twitter-api-client
  Downloading twitter_api_client-0.4.0-py3-none-any.whl (31 kB)
Requirement already satisfied: requests in c:\users\smarotta\pycharmprojects\generic_scraper\my_env\lib\site-packages (from twitter-api-client) (2.28.2)
Collecting aiohttp
  Downloading aiohttp-3.8.4-cp310-cp310-win_amd64.whl (319 kB)
     |████████████████████████████████| 319 kB 3.3 MB/s
Collecting ujson
  Downloading ujson-5.7.0-cp310-cp310-win_amd64.whl (41 kB)
     |████████████████████████████████| 41 kB 3.2 MB/s
Collecting tqdm
  Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting nest-asyncio
  Using cached nest_asyncio-1.5.6-py3-none-any.whl (5.2 kB)
Collecting uvloop
  Downloading uvloop-0.17.0.tar.gz (2.3 MB)
     |████████████████████████████████| 2.3 MB ... 
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: 'C:\Users\smarotta\PycharmProjects\generic_scraper\my_env\Scripts\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_8
0bd716f8c204c2fa6bf4ca3acf4967e\\setup.py'"'"'; __file__='"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_80bd716f8c204c2fa6bf4ca3acf4967e\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__
file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-
base 'C:\Users\smarotta\AppData\Local\Temp\pip-pip-egg-info-vpoz9gkn'
       cwd: C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_80bd716f8c204c2fa6bf4ca3acf4967e\
  Complete output (5 lines):
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_80bd716f8c204c2fa6bf4ca3acf4967e\setup.py", line 8, in <module>
      raise RuntimeError('uvloop does not support Windows at the moment')
  RuntimeError: uvloop does not support Windows at the moment
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/ba/86/6dda1760481abf244cbd3908b79a4520d757040ca9ec37a79fc0fd01e2a0/uvloop-0.17.0.tar.gz#sha256=0ddf6baf9cf11a1a22c71487f39f15b2cf78eb5bde7e5b45fbb99e8a9d91b9e1 (from ht
tps://pypi.org/simple/uvloop/) (requires-python:>=3.7). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Downloading uvloop-0.16.0.tar.gz (2.1 MB)
     |████████████████████████████████| 2.1 MB 6.4 MB/s            
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: 'C:\Users\smarotta\PycharmProjects\generic_scraper\my_env\Scripts\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_e
0152b8be51f4e07a55d19c8d580f419\\setup.py'"'"'; __file__='"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_e0152b8be51f4e07a55d19c8d580f419\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__
file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-
base 'C:\Users\smarotta\AppData\Local\Temp\pip-pip-egg-info-y9b9bc6h'
       cwd: C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_e0152b8be51f4e07a55d19c8d580f419\
  Complete output (5 lines):
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_e0152b8be51f4e07a55d19c8d580f419\setup.py", line 8, in <module>
      raise RuntimeError('uvloop does not support Windows at the moment')
  RuntimeError: uvloop does not support Windows at the moment
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/ab/d9/22bbffa8f8d7e075ccdb29e8134107adfb4710feb10039f9d357db8b589c/uvloop-0.16.0.tar.gz#sha256=f74bc20c7b67d1c27c72601c78cf95be99d5c2cdd4514502b4f3eb0933ff1228 (from ht
tps://pypi.org/simple/uvloop/) (requires-python:>=3.7). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Downloading uvloop-0.15.3.tar.gz (2.1 MB)
     |████████████████████████████████| 2.1 MB 6.4 MB/s            
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: 'C:\Users\smarotta\PycharmProjects\generic_scraper\my_env\Scripts\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_2
849d00d40e641f6862db90b603cca78\\setup.py'"'"'; __file__='"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_2849d00d40e641f6862db90b603cca78\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__
file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-
base 'C:\Users\smarotta\AppData\Local\Temp\pip-pip-egg-info-5fxrrfsb'
       cwd: C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_2849d00d40e641f6862db90b603cca78\
  Complete output (5 lines):
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_2849d00d40e641f6862db90b603cca78\setup.py", line 8, in <module>
      raise RuntimeError('uvloop does not support Windows at the moment')
  RuntimeError: uvloop does not support Windows at the moment
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/41/49/d2cdac6450430f444d3df59ccd1abc8225ea51ffcecd9ac2e36b111074a4/uvloop-0.15.3.tar.gz#sha256=905f0adb0c09c9f44222ee02f6b96fd88b493478fffb7a345287f9444e926030 (from ht
tps://pypi.org/simple/uvloop/) (requires-python:>=3.7). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Downloading uvloop-0.15.2.tar.gz (2.1 MB)
     |████████████████████████████████| 2.1 MB 6.8 MB/s            
  Preparing metadata (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: 'C:\Users\smarotta\PycharmProjects\generic_scraper\my_env\Scripts\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_b
c66758d41254b98ad900842110ad588\\setup.py'"'"'; __file__='"'"'C:\\Users\\smarotta\\AppData\\Local\\Temp\\pip-install-nif41etr\\uvloop_bc66758d41254b98ad900842110ad588\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__
file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-
base 'C:\Users\smarotta\AppData\Local\Temp\pip-pip-egg-info-u7jkumt5'
       cwd: C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_bc66758d41254b98ad900842110ad588\
  Complete output (5 lines):
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\Users\smarotta\AppData\Local\Temp\pip-install-nif41etr\uvloop_bc66758d41254b98ad900842110ad588\setup.py", line 8, in <module>
      raise RuntimeError('uvloop does not support Windows at the moment')
  RuntimeError: uvloop does not support Windows at the moment
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/44/6e/0cb292e4e6ee1382e2ede458f90c94b4f990b261f738403ac45cb8183bc2/uvloop-0.15.2.tar.gz#sha256=2bb0624a8a70834e54dde8feed62ed63b50bad7a1265c40d6403a2ac447bce01 (from ht
tps://pypi.org/simple/uvloop/) (requires-python:>=

from twitter.search import search

search(
        '(#dogs OR #cats) min_retweets:500',
    )

2023-04-08 17:04:13,020.020 DEBUG: (#dogs OR #cats) min_retweets:500
2023-04-08 17:04:13,919.919 DEBUG: FAILED to combine search results, input length is 0: line 1 column 1 (char 0)
Traceback (most recent call last):
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\twittertest\main.py", line 31, in <module>
    main()
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\twittertest\main.py", line 25, in main
    search(
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\search.py", line 47, in search
    return asyncio.run(process(args, search_config, out_path))
  File "C:\Users\trevo\AppData\Local\Programs\Python\Python310\lib\asyncio\runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "C:\Users\trevo\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\search.py", line 53, in process
    return await asyncio.gather(*(paginate(q, s, config, out) for q in queries))
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\search.py", line 67, in paginate
    (out / f'raw/{time.time_ns()}.json').write_text(orjson.dumps(data, option=orjson.OPT_INDENT_2).decode())
  File "C:\Users\trevo\AppData\Local\Programs\Python\Python310\lib\pathlib.py", line 1155, in write_text
    return f.write(data)
  File "C:\Users\trevo\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\U0001f3e1' in position 284: character maps to <undefined>

Process finished with exit code 1

>>> email, username, password = '[email protected]','blah','password'
>>> account = Account(email, username, password, debug=2, save=True)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: __init__() got an unexpected keyword argument 'debug'
 

>>> account = Account(email, username, password)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: __init__() takes 3 positional arguments but 4 were given

    scraper = Scraper('x', 'x')
    following = scraper.following([2360121187])
    print(following)

  File "C:\Users\trevo\OneDrive\Desktop\twittertest\twittertest\main.py", line 22, in <module>
    main()
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\twittertest\main.py", line 17, in main
    following = scraper.following([2360121187])
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\scraper.py", line 65, in following
    return self.run(ids, Operation.Data.Following, limit)
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\scraper.py", line 102, in run
    res = self.query(ids, operation)
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\scraper.py", line 119, in query
    self.save_data(res, name)
  File "C:\Users\trevo\OneDrive\Desktop\twittertest\.venv\lib\site-packages\twitter\scraper.py", line 236, in save_data
    path = Path(f'data/raw/{d[ID]}')
TypeError: 'NoneType' object is not subscriptable
2023-04-08 16:51:23,711.711 DEBUG: failed to download (2360121187, 'https://api.twitter.com/graphql/wjvx62Hye2dGVvnvVco0xA/Following?queryId="wjvx62Hye2dGVvnvVco0xA"&variables={"userId":2360121187,"count":1000,"includePromotedContent":true,"withDownvotePerspective":false,"withReactionsMetadata":false,"withReactionsPerspective":false,"withSuperFollowsTweetFields":true,"withSuperFollowsUserFields":true}&features={"responsive_web_twitter_blue_verified_badge_is_enabled":true,"responsive_web_graphql_exclude_directive_enabled":true,"verified_phone_label_enabled":true,"responsive_web_graphql_timeline_navigation_enabled":true,"responsive_web_graphql_skip_user_profile_image_extensions_enabled":true,"tweetypie_unmention_optimization_enabled":true,"vibe_api_enabled":true,"responsive_web_edit_tweet_api_enabled":true,"graphql_is_translatable_rweb_tweet_is_translatable_enabled":true,"view_counts_everywhere_api_enabled":true,"longform_notetweets_consumption_enabled":true,"tweet_awards_web_tipping_enabled":true,"freedom_of_speech_not_reach_fetch_enabled":true,"standardized_nudges_misinfo":true,"tweet_with_visibility_results_prefer_gql_limited_actions_policy_enabled":true,"interactive_text_enabled":true,"responsive_web_text_conversations_enabled":true,"longform_notetweets_richtext_consumption_enabled":true,"responsive_web_enhance_cards_enabled":true}'): Cannot serialize non-str key None

2023-05-01 09:30:07,585.585 DEBUG: [�[31merror�[0m] 400
{
    "errors": [
        {
            "message": "Internal server error",
            "extensions": {
                "name": "InternalServerError",
                "source": "Server",
                "retry_after": 0,
                "code": 0,
                "kind": "Operational",
                "tracing": {"trace_id": "8d878e4f6abb553b"},
            },
            "code": 0,
            "kind": "Operational",
            "name": "InternalServerError",
            "source": "Server",
            "retry_after": 0,
            "tracing": {"trace_id": "8d878e4f6abb553b"},
        }
    ]
}

from twitter.search import Search
search = Search(EMAIL, USERNAME, PASSWORD)
search.run('(viralsweep.com or swee.ps)', limit=100, latest=True)

>>> latest_results = search.run(
...     'astrophysics since:2023-04-01 until:2023-04-02',
...     limit=50,
... )
2023-05-04 15:59:47,016.016 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:59:48,164.164 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:59:49,244.244 DEBUG: [success] returned 66 search results for astrophysics since:2023-04-01 until:2023-04-02

>>> latest_results = search.run(
...     'astrophysics since:2023-04-01 until:2023-04-02',
...     limit=200,
... )
2023-05-04 15:54:43,028.028 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:44,178.178 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:45,508.508 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:46,758.758 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:47,883.883 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:49,059.059 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:50,067.067 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:50,733.733 DEBUG: astrophysics since:2023-04-01 until:2023-04-02
2023-05-04 15:54:51,159.159 DEBUG: No data for: astrophysics since:2023-04-01 until:2023-04-02 | retrying in 1.45 seconds
2023-05-04 15:54:53,052.052 DEBUG: No data for: astrophysics since:2023-04-01 until:2023-04-02 | retrying in 2.13 seconds
2023-05-04 15:54:55,555.555 DEBUG: No data for: astrophysics since:2023-04-01 until:2023-04-02 | retrying in 4.80 seconds
(Retries almost lasts forever)
... 

from twitter.account import Account
    account = Account('myuser', 'mypass')
    account.tweet('hello')

[SUCCESS] myuser logged in successfully
2023-04-08 17:08:53,204.204 DEBUG: FAILED to combine search results, input length is 0: line 1 column 1 (char 0)

'flow_token'
[error] failed to update token at flow_duplication_check
'flow_token'
[error] [email protected] login failed
2023-05-02 14:52:48,524.524 DEBUG: [error] 200 {'errors': [{'message': 'Authorization: Denied by access control: unspecified reason', 'locations': [{'line': 7, 'column': 11}], 'path': ['user', 'result', 'timeline', 'timeline'], 'extensions': {'name': 'AuthorizationError', 'source': 'Client', 'code': 37, 'kind': 'Permissions', 'tracing': {'trace_id': 'd50ba310715d015f'}}, 'code': 37, 'kind': 'Permissions', 'name': 'AuthorizationError', 'source': 'Client', 'tracing': {'trace_id': 'd50ba310715d015f'}}], 'data': {'user': {'result': {'__typename': 'User', 'timeline': {}}}}}```

limit = 10
timelines = scraper.tweets(user_ids, limit=limit)

>>> account = Account(email, username, password, debug=2, save=True)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: Account.__init__() got an unexpected keyword argument 'debug'

>>> scraper = Scraper(email, username, password, debug=1, save=True)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: Scraper.__init__() got an unexpected keyword argument 'debug'

>>> from twitter.search import Search
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'Search' from 'twitter.search' (/usr/local/lib/python3.10/dist-packages/twitter/search.py)