singer-io / tap-impact

tap-impact

This is a Singer tap that produces JSON-formatted data following the Singer spec.

This tap:

• Pulls raw data from the following Impact Radius API catalogs:

  • Advertiser API
  • Agency API
  • Partner API

• Extracts the following resources:

  • API Submissions
  • Campaigns
    • Actions
    • Action Inquiries
    • Action Updates
    • Clicks
    • Contacts
    • Conversion Paths
    • Notes
    • Media Partner Groups
  • Ads
  • Catalogs
    • Catalog Items
  • Company Information
  • Deals
  • Exception Lists
    • Exception List Items
  • FTP File Submissions
  • Invoices
  • Media Partners
  • Phone Numbers
  • Promo Codes
  • Reports
    • Report Metadata
  • Tracking Value Requests
  • Unique URLs

• Outputs the schema for each resource

• Incrementally pulls data based on the input state

Streams

actions

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Actions
• Primary key fields: id
• Foreign key fields: ad_id, caller_id, campaign_id, customer_id, media_partner_id, shared_id, order_id
• Replication strategy: INCREMENTAL (Query filtered)
  • Filter: CampaignId (parent)
  • Filter: StartDate (event_date)
  • Bookmark: event_date
• Transformations: camelCase to snake_case, oid to order_id
• Parent: campaigns

action_inquiries

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/ActionInquiries
• Primary key fields: id
• Foreign key fields: action_id, campaign_id, media_partner_id, order_id
• Replication strategy: INCREMENTAL (Query filtered)
  • Filter: CampaignId (parent)
  • Filter: StartDate (creation_date)
  • Bookmark: creation_date
• Transformations: camelCase to snake_case, oid to order_id
• Parent: campaigns

action_updates

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/ActionUpdates
• Primary key fields: id
• Foreign key fields: action_id, ad_id, caller_id, campaign_id, customer_id, media_partner_id, shared_id
• Replication strategy: INCREMENTAL (Query filtered)
  • Filter: CampaignId (parent)
  • Filter: StartDate (update_date)
  • Bookmark: update_date
• Transformations: camelCase to snake_case
• Parent: campaigns

ads

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Ads
• Primary key fields: id
• Foreign key fields: campaign_id, deal_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

api_submissions

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/APISubmissions
• Primary key fields: batch_id
• Foreign key fields: account_id, campaign_id, media_partner_id, order_id
• Replication strategy: INCREMENTAL (query all, filter_results)
  • Bookmark: submission_date (date-time)
• Transformations: camelCase to snake_case

campaigns

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns
• Primary key fields: id
• Foreign key fields: none
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case
• Children: actions, action_inquiries, action_updates, clicks, contacts, notes, media_partner_groups

catalogs

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Catalogs
• Primary key fields: id
• Foreign key fields: campaign_id, advertiser_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case
• Children: catalog_items

catalog_items

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Catalogs/{catalog_id}/Items
• Primary key fields: catalog_item_id
• Foreign key fields: catalog_id
• Replication strategy: FULL_TABLE (ALL for parent Catalog)
• Transformations: camelCase to snake_case, add catalog_id (parent id)
• Parent: catalogs

clicks

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns/{campaign_id}/Clicks
• Primary key fields: id
• Foreign key fields: ad_id, campaign_id, media_id, shared_id
• Replication strategy: INCREMENTAL (Query filtered by Date for parent CampaignId)
  • Filter: CampaignId (parent)
  • Filter: Date (event_date)
  • Bookmark: event_date
• Transformations: camelCase to snake_case
• Parent: campaigns

contacts

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns/{campaign_id}/Contacts
• Primary key fields: id
• Foreign key fields: campaign_id, accounts > id
• Replication strategy: FULL_TABLE (ALL for parent Campaign)
• Transformations: camelCase to snake_case, add campaign_id (parent id)
• Parent: campaigns

conversion_paths

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns/{campaign_id}/Models/{model_id}/ConversionPaths
• Primary key fields: model_id, campaign_id, customer_id
• Foreign key fields: campaign_id, customer_id, events: ad_id, action_id, media_id, order_id
• Replication strategy: FULL_TABLE (ALL for parent Campaign)
• Transformations: camelCase to snake_case, oid to order_id
• Parent: campaigns

deals

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Deals
• Primary key fields: id
• Foreign key fields: campaign_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

exception_lists

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/ExceptionLists
• Primary key fields: id
• Foreign key fields: campaign_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case
• Children: exception_list_items

exception_list_items

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/ExceptionLists/{list_id}/Items
• Primary key fields: id
• Foreign key fields: list_id
• Replication strategy: FULL_TABLE (ALL for parent Exception List)
• Transformations: camelCase to snake_case
• Parent: exception_lists

ftp_file_submissions

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/FTPFileSubmissions
• Primary key fields: batch_id
• Foreign key fields: account_id
• Replication strategy: INCREMENTAL (query all, filter_results)
  • Bookmark: submission_date (date-time)
  • Sort: SubmissionDate ASC
• Transformations: camelCase to snake_case
• Children: exception_list_items

invoices w/ line_items

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Invoices
• Primary key fields: id
• Foreign key fields: campaign_id, media_id
• Replication strategy: INCREMENTAL (Query filtered)
  • Filter: StartDate (created_date)
  • Bookmark: created_date (date-time)
• Transformations: camelCase to snake_case

media_partners

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/MediaPartners
• Primary key fields: id
• Foreign key fields: campaign_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

media_partner_groups

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns/{campaign_id}/MediaPartnerGroups
• Primary key fields: id
• Foreign key fields: campaign_id, media_partners > id
• Replication strategy: FULL_TABLE (ALL for parent Campaign)
• Transformations: camelCase to snake_case, add campaign_id (parent id)
• Parent: campaigns

notes

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Campaigns/{campaign_id}/Notes
• Primary key fields: id
• Foreign key fields: campaign_id, media_id
• Replication strategy: INCREMENTAL (query all for parent campaign_id, filter_results)
  • Bookmark: modification_date (date-time)
  • Sort: ModificationDate ASC
• Transformations: camelCase to snake_case, add campaign_id (parent id)
• Parent: campaigns

phone_numbers

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/PhoneNumbers
• Primary key fields: id
• Foreign key fields: none
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

promo_codes

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/PromoCodes
• Primary key fields: id
• Foreign key fields: campaign_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

reports

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Reports
• Primary key fields: id
• Foreign key fields: none
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case
• Children: report_metadata

report_metadata

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/Reports/{report_id}/MetaData
• Primary key fields: id
• Foreign key fields: id (reports)
• Replication strategy: FULL_TABLE (ALL for parent report id)
• Transformations: camelCase to snake_case
• Parent: reports

tracking_value_requests

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/TrackingValueRequests
• Primary key fields: id
• Foreign key fields: campaign_id, deal_id, media_partner_id, phone_numbers > id, promo_codes > id, unique_urls > id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

unique_urls

• Endpoint: https://api.impact.com/{api_catalog}/{account_sid}/UniqueUrls
• Primary key fields: id
• Foreign key fields: campaign_id, media_partner_id
• Replication strategy: FULL_TABLE
• Transformations: camelCase to snake_case

Quick Start

1. Install

   Clone this repository, and then install using setup.py. We recommend using a virtualenv:

   > virtualenv -p python3 venv
   > source venv/bin/activate
   > python setup.py install
   OR
   > cd .../tap-impact
   > pip install .

2. Dependent libraries The following dependent libraries were installed.

   > pip install singer-python
   > pip install singer-tools
   > pip install target-stitch
   > pip install target-json
   

   • singer-tools
   • target-stitch

3. Create your tap's config.json file. The api_catalog is one of the following: Advertisers, Agencies, Partners. The account_sid and auth_token may be found in your user settings when API access is enabled. Contact Impact Support to get your model_id (for Conversion Paths endpoint).

   {
       "account_sid": "YOUR_API_ACCOUNT_SID",
       "auth_token": "YOUR_API_AUTH_TOKEN",
       "api_catalog": "YOUR_API_CATALOG",
       "model_id": "YOUR_MODEL_ID",
       "start_date": "2019-01-01T00:00:00Z",
       "user_agent": "tap-impact <api_user_email@your_company.com>"
   }

   Optionally, also create a state.json file. currently_syncing is an optional attribute used for identifying the last object to be synced in case the job is interrupted mid-stream. The next run would begin where the last job left off.

   {
       "currently_syncing": "ftp_file_submissions",
       "bookmarks": {
           "actions": "2019-09-21T01:05:17.000000Z",
           "action_inquiries": "2019-09-14T14:34:03.000000Z",
           "action_updates": "2019-09-21T02:27:16.000000Z",
           "clicks": "2019-09-21T00:54:26.000000Z",
           "api_submissions": "2019-09-21T00:47:35.000000Z",
           "ftp_submissions": "2019-09-20T00:42:39.000000Z",
           "invoices": "2019-09-03T10:02:01.000000Z"
       }
   }

4. Run the Tap in Discovery Mode This creates a catalog.json for selecting objects/fields to integrate:

   tap-impact --config config.json --discover > catalog.json

   See the Singer docs on discovery mode here.

5. Run the Tap in Sync Mode (with catalog) and write out to state file

   For Sync mode:

   > tap-impact --config tap_config.json --catalog catalog.json > state.json
   > tail -1 state.json > state.json.tmp && mv state.json.tmp state.json

   To load to json files to verify outputs:

   > tap-impact --config tap_config.json --catalog catalog.json | target-json > state.json
   > tail -1 state.json > state.json.tmp && mv state.json.tmp state.json

   To pseudo-load to Stitch Import API with dry run:

   > tap-impact --config tap_config.json --catalog catalog.json | target-stitch --config target_config.json --dry-run > state.json
   > tail -1 state.json > state.json.tmp && mv state.json.tmp state.json

6. Test the Tap

   While developing the impact tap, the following utilities were run in accordance with Singer.io best practices: Pylint to improve code quality:

   > pylint tap_impact -d missing-docstring -d logging-format-interpolation -d too-many-locals -d too-many-arguments

   Pylint test resulted in the following score:

   Your code has been rated at 9.79/10

   To check the tap and verify working:

   > tap-impact --config tap_config.json --catalog catalog.json | singer-check-tap > state.json
   > tail -1 state.json > state.json.tmp && mv state.json.tmp state.json

   Check tap resulted in the following:

   Checking stdin for valid Singer-formatted data
   The output is valid.
   It contained 80959 messages for 24 streams.
   
       135 schema messages
   80766 record messages
       58 state messages
   
   Details by stream:
   +-------------------------+---------+---------+
   | stream                  | records | schemas |
   +-------------------------+---------+---------+
   | tracking_value_requests | 0       | 1       |
   | ftp_file_submissions    | 0       | 1       |
   | api_submissions         | 345     | 1       |
   | unique_urls             | 0       | 1       |
   | invoices                | 34      | 1       |
   | ads                     | 54      | 1       |
   | phone_numbers           | 603     | 1       |
   | deals                   | 1       | 1       |
   | campaigns               | 1       | 1       |
   | notes                   | 0       | 1       |
   | media_partner_groups    | 10      | 1       |
   | action_updates          | 1389    | 1       |
   | actions                 | 1075    | 1       |
   | action_inquiries        | 1       | 1       |
   | clicks                  | 76213   | 1       |
   | contacts                | 383     | 1       |
   | exception_lists         | 0       | 1       |
   | promo_codes             | 20      | 1       |
   | media_partners          | 230     | 1       |
   | catalogs                | 1       | 1       |
   | catalog_items           | 181     | 1       |
   | reports                 | 112     | 1       |
   | report_metadata         | 112     | 1       |
   | company_information     | 1       | 1       |
   +-------------------------+---------+---------+
   

---

Copyright © 2019 Stitch

tap-impact's Issues

Error when syncing from 2 streams `clicks` and `catalogs`

Hi @jeffhuth-bytecode , I'm using Stitch to get data from Impact using this Singer tap. During the replication, this error happened (redacted Advertiser ID and Campaign ID). I'm getting the tables clicks, catalogs

clicks table error log is below (similar to issue #18):

2023-01-04 01:23:04,767Z    tap - INFO START Sync for Stream: clicks, parent_stream: campaigns, parent_id: xxxxx
2023-01-04 01:23:04,768Z target - INFO Serializing batch with 1928 messages for table action_updates
2023-01-04 01:23:04,768Z    tap - INFO Stream: clicks, Syncing bookmark_date = 2022-05-17
2023-01-04 01:23:04,768Z    tap - INFO URL for Stream clicks: https://api.impact.com/Advertisers/xxxxx/Campaigns/xxxx/Clicks.json?PageSize=1000&Date=2022-05-17
2023-01-04 01:23:04,822Z target - INFO Sending batch of 2103810 bytes to https://api.stitchdata.com/v2/import/batch
2023-01-04 01:23:04,824Z target - INFO replicated 1928 records from "action_updates" endpoint
2023-01-04 01:23:04,869Z    tap - INFO HTTP request to "clicks" endpoint took 0.100s, returned status code 404
2023-01-04 01:23:04,870Z    tap - ERROR ERROR 404: {"Status":"ERROR","Message":"Support for this endpoint has ended and has been replaced with the new /ClickExport endpoint. Please use /Advertisers/xxxxx/Programs/xxxxx/ClickExport.json?Date=2022-05-17&PageSize=1000 to access your data. Please also review the API documentation if you require additional information."}, REASON: Not Found
2023-01-04 01:23:04,870Z    tap - CRITICAL 404 Client Error: Not Found for url: https://api.impact.com/Advertisers/xxxxx/Campaigns/xxxxx/Clicks.json?PageSize=1000&Date=2022-05-17
2023-01-04 01:23:04,870Z    tap - Traceback (most recent call last):
2023-01-04 01:23:04,871Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 80, in raise_for_error
2023-01-04 01:23:04,871Z    tap -     response.raise_for_status()
2023-01-04 01:23:04,871Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/requests/models.py", line 940, in raise_for_status
2023-01-04 01:23:04,871Z    tap -     raise HTTPError(http_error_msg, response=self)
2023-01-04 01:23:04,871Z    tap - requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://api.impact.com/Advertisers/xxxxx/Campaigns/xxxxx/Clicks.json?PageSize=1000&Date=2022-05-17
2023-01-04 01:23:04,871Z    tap - 
2023-01-04 01:23:04,871Z    tap - During handling of the above exception, another exception occurred:
2023-01-04 01:23:04,871Z    tap - 
2023-01-04 01:23:04,871Z    tap - Traceback (most recent call last):
2023-01-04 01:23:04,871Z    tap -   File "/code/orchestrator/tap-env/bin/tap-impact", line 33, in <module>
2023-01-04 01:23:04,871Z    tap -     sys.exit(load_entry_point('tap-impact==1.0.0', 'console_scripts', 'tap-impact')())
2023-01-04 01:23:04,871Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/singer/utils.py", line 229, in wrapped
2023-01-04 01:23:04,871Z    tap -     return fnc(*args, **kwargs)
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/__init__.py", line 47, in main
2023-01-04 01:23:04,872Z    tap -     sync(client=client,
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/sync.py", line 406, in sync
2023-01-04 01:23:04,872Z    tap -     total_records = sync_endpoint(
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/sync.py", line 318, in sync_endpoint
2023-01-04 01:23:04,872Z    tap -     child_total_records = sync_endpoint(
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/sync.py", line 204, in sync_endpoint
2023-01-04 01:23:04,872Z    tap -     data = client.get(
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 208, in get
2023-01-04 01:23:04,872Z    tap -     return self.request('GET', path=path, **kwargs)
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/backoff/_sync.py", line 94, in retry
2023-01-04 01:23:04,872Z    tap -     ret = target(*args, **kwargs)
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/singer/utils.py", line 95, in wrapper
2023-01-04 01:23:04,872Z    tap -     return func(*args, **kwargs)
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 203, in request
2023-01-04 01:23:04,872Z    tap -     raise_for_error(response)
2023-01-04 01:23:04,872Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 96, in raise_for_error
2023-01-04 01:23:04,872Z    tap -     raise ImpactError(error)
2023-01-04 01:23:04,872Z    tap - tap_impact.client.ImpactError: 404 Client Error: Not Found for url: https://api.impact.com/Advertisers/xxxxx/Campaigns/xxxxx/Clicks.json?PageSize=1000&Date=2022-05-17
2023-01-04 01:23:05,658Z target - INFO Requests complete, stopping loop
2023-01-04 01:23:05,740Z   main - INFO Target exited normally with status 0
2023-01-04 01:23:05,743Z   main - INFO No tunnel subprocess to tear down
2023-01-04 01:23:05,743Z   main - INFO Exit status is: Discovery succeeded. Tap failed with code 1 and error message: "404 Client Error: Not Found for url: https://api.impact.com/Advertisers/xxxxx/Campaigns/xxxxx/Clicks.json?PageSize=1000&Date=2022-05-17". Target succeeded.

catalogs table error:

2023-01-04 01:32:49,905Z    tap - INFO START Syncing: catalogs
2023-01-04 01:32:49,905Z    tap - INFO URL for Stream catalogs: https://api.impact.com/Advertisers/xxxxx/Catalogs.json?PageSize=1000
2023-01-04 01:32:49,906Z   main - INFO State update: changing currently_syncing from "campaigns" to "catalogs"
2023-01-04 01:32:49,960Z    tap - INFO HTTP request to "catalogs" endpoint took 0.054s, returned status code 400
2023-01-04 01:32:49,960Z    tap - ERROR ERROR 400: {
2023-01-04 01:32:49,960Z    tap -   "Status": "ERROR",
2023-01-04 01:32:49,960Z    tap -   "Message": "This API version is no longer supported. Please upgrade to one of the supported API versions: v10"
2023-01-04 01:32:49,960Z    tap - }, REASON: Bad Request
2023-01-04 01:32:49,961Z    tap - CRITICAL 400 Client Error: Bad Request for url: https://api.impact.com/Advertisers/xxxxx/Catalogs.json?PageSize=1000
2023-01-04 01:32:49,961Z    tap - Traceback (most recent call last):
2023-01-04 01:32:49,961Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 80, in raise_for_error
2023-01-04 01:32:49,961Z    tap -     response.raise_for_status()
2023-01-04 01:32:49,961Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/requests/models.py", line 940, in raise_for_status
2023-01-04 01:32:49,961Z    tap -     raise HTTPError(http_error_msg, response=self)
2023-01-04 01:32:49,961Z    tap - requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://api.impact.com/Advertisers/xxxxx/Catalogs.json?PageSize=1000
2023-01-04 01:32:49,962Z    tap - 
2023-01-04 01:32:49,962Z    tap - During handling of the above exception, another exception occurred:
2023-01-04 01:32:49,962Z    tap - 
2023-01-04 01:32:49,962Z    tap - Traceback (most recent call last):
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/bin/tap-impact", line 33, in <module>
2023-01-04 01:32:49,962Z    tap -     sys.exit(load_entry_point('tap-impact==1.0.0', 'console_scripts', 'tap-impact')())
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/singer/utils.py", line 229, in wrapped
2023-01-04 01:32:49,962Z    tap -     return fnc(*args, **kwargs)
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/__init__.py", line 47, in main
2023-01-04 01:32:49,962Z    tap -     sync(client=client,
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/sync.py", line 406, in sync
2023-01-04 01:32:49,962Z    tap -     total_records = sync_endpoint(
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/sync.py", line 204, in sync_endpoint
2023-01-04 01:32:49,962Z    tap -     data = client.get(
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 208, in get
2023-01-04 01:32:49,962Z    tap -     return self.request('GET', path=path, **kwargs)
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/backoff/_sync.py", line 94, in retry
2023-01-04 01:32:49,962Z    tap -     ret = target(*args, **kwargs)
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/singer/utils.py", line 95, in wrapper
2023-01-04 01:32:49,962Z    tap -     return func(*args, **kwargs)
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 203, in request
2023-01-04 01:32:49,962Z    tap -     raise_for_error(response)
2023-01-04 01:32:49,962Z    tap -   File "/code/orchestrator/tap-env/lib/python3.9/site-packages/tap_impact/client.py", line 96, in raise_for_error
2023-01-04 01:32:49,962Z    tap -     raise ImpactError(error)
2023-01-04 01:32:49,963Z    tap - tap_impact.client.ImpactError: 400 Client Error: Bad Request for url: https://api.impact.com/Advertisers/xxxxx/Catalogs.json?PageSize=1000
2023-01-04 01:32:49,987Z target - INFO Requests complete, stopping loop
2023-01-04 01:32:50,023Z   main - INFO Target exited normally with status 0
2023-01-04 01:32:50,025Z   main - INFO No tunnel subprocess to tear down
2023-01-04 01:32:50,026Z   main - INFO Exit status is: Discovery succeeded. Tap failed with code 1 and error message: "400 Client Error: Bad Request for url: https://api.impact.com/Advertisers/xxxxx/Catalogs.json?PageSize=1000". Target succeeded.

Other than those 2 tables, the rest are working well. Please have a look.

update clicks endpoint

hello - according to the Impact support team, the clicks endpoint needs to be updated to ClickExport for 2022 data. can the code be updated to pull from ClickExport for anything prior 2023 and Clicks for 2023 onwards?

Actions table not being synced

I'm using this tap via Stitch to ingest data from Impact Radius into Snowflake. Most tables are successfully syncing but Actions does not.

I want to use this table to pull most of my Affiliate data, including partner name, spend, dates, etc.

Any advice?

Can't convert 'NoneType' object to str implicitly

Hi!

I am running into issues with my impact integration in stitch. I have been getting a series of errors since I integrated with the most recent one being -''Can't convert 'NoneType' object to str implicitly'.

What would be the best way to resolve this issue and ensure smooth ingestion going forward? thanks!

Sync fails if model_id is set to null in config

The tap will fail during the sync step if the model_id is set to null in config.

Steps to reproduce:

• Set "model_id": null in config.json
• Discover catalog with tap-impact --config config.json --discover > catalog.json
• Run the tap in sync mode tap-impact --config config.json --catalog catalog.json > state.json

Expected behavior:

• Sync completes successfully

Actual behavior:

• Raises TypeError when syncing a child stream of campaigns.

  File "/Users/jgdwyer/Desktop/tap-impact/tap_impact/sync.py", line 315, in sync_endpoint
    '<model_id>', model_id)
TypeError: replace() argument 2 must be str, not None

This happened to me while using the Tap with Singer. Initially I had not entered any value for model_id and the tap ran fine. Later I changed the integration frequency (but did not change the model_id) and the tap was failing. As best as I can tell, Singer is passing model_id: null in the config on updates to the settings (rather than an empty string or just omitting the field). As a temporarily workaround in Stitch I just entered a bogus numeric value for the model_id.

Can't connect Impact on Stitch

Is anyone able to connect to Impact on Stitch? I am just a data analyst and I wanted to get my company's Impact data through stitch, I have the Account SID and API Key ( I dont have the model Id, it I guess that's optional), but every attempt fails. giving me this error

tap - ERROR Error status_code = 403
tap - ERROR ERROR 403: {"Status":"ERROR","Message":"Access is denied"}, REASON: Forbidden

Is there anyone with a solution or faced a smilar issue? I am open to other options if there are any out there..

Thanks

Some Clicks are not being synced due to timezone mismatch

When using this Tap, I noticed that the daily clicks total were lower than the totals reported in the Impact web app. Further investigation revealed that I was not receiving any clicks that were happening towards the end of the day local time. This appears to be due to a mismatch between the bookmarking datetime value for the Clicks object (UTC datetime) and the expected argument to the Clicks endpoint in the API (date in timezone that the company timezone is set in).

Example:

• Company timezone set to (GMT -04:00) Eastern Time (US & Canada) in Impact
• Tap is run every 6 hours at 0Z, 6Z, 12Z, & 18Z
• During the 0Z run, the previous bookmark value is loaded as 2021-08-22T18:00:00Z. Since the current UTC time is 2021-08-23T00:00:00Z the Clicks endpoint will be called twice, once with date=2021-08-22 and once with date=2021-08-23. Because the endpoint interprets the dates in ET, only data before 2021-08-22 8pm ET will be returned.
• At the end of the 0Z run, the bookmark value for Clicks is stored as 2021-08-23T00:00:00Z
• During the 6Z run the bookmark value is loaded and sent to the Clicks endpoint as 2021-08-23. This will return any clicks that have so far occurred on 2021-08-23 ET. But it will exclude all clicks on 2021-08-22 after 8pm ET.

I've confirmed this behavior in the raw extraction logs.

No data pulling from API via Stitch Impact Integration

Set up a new integration in Stitch for Impact. No data is being returned. Per Stitch support: "I would let the Singer team know that it is not saving State (bookmark values) nor is it issuing requests to the API as far as I can tell. I hope this is helpful."

Extraction errors on Stitch

Hello! I recently tried to run the Impact integration on Stitch, and I'm getting two different (but possibly related?) errors each time I run an extraction. For reference, my Impact API version is V8, but would be willing to upgrade depending on what the tap requires.

I've redacted my Account SID for privacy. I also left the Model ID blank in the config (I couldn't find that anywhere on our account) but I'm not sure if that's needed.

Any idea how I can get this working? Thanks!

Error 1:

2022-07-09 00:19:27,819Z   main - INFO Running tap-impact version 1.0.0 and target-stitch version 3.2.0
2022-07-09 00:19:29,225Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobStarted ), use_ssl( true )
2022-07-09 00:19:29,228Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobFinished ), use_ssl( true )
2022-07-09 00:19:29,229Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.streamRecordCount ), use_ssl( true )
2022-07-09 00:19:30,245Z   main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobStarted [33] at offset None
2022-07-09 00:19:30,248Z   main - INFO Starting tap to discover schemas: tap-env/bin/tap-impact --config /tmp/tap_discover_config.json --discover
2022-07-09 00:19:30,637Z    tap - INFO Starting discover
2022-07-09 00:19:30,665Z    tap - INFO Finished discover
2022-07-09 00:19:30,696Z   main - INFO Tap exited normally.
2022-07-09 00:19:30,700Z   main - INFO Saving list of discovered streams
2022-07-09 00:19:30,720Z   main - INFO Saving structure of stream action_updates (tap_stream_id: action_updates)
2022-07-09 00:19:30,744Z   main - INFO Saving structure of stream report_metadata (tap_stream_id: report_metadata)
2022-07-09 00:19:30,757Z   main - INFO Saving structure of stream media_partner_groups (tap_stream_id: media_partner_groups)
2022-07-09 00:19:30,779Z   main - INFO Saving structure of stream ftp_file_submissions (tap_stream_id: ftp_file_submissions)
2022-07-09 00:19:30,805Z   main - INFO Saving structure of stream phone_numbers (tap_stream_id: phone_numbers)
2022-07-09 00:19:30,821Z   main - INFO Saving structure of stream deals (tap_stream_id: deals)
2022-07-09 00:19:30,843Z   main - INFO Saving structure of stream catalog_items (tap_stream_id: catalog_items)
2022-07-09 00:19:30,872Z   main - INFO Saving structure of stream contacts (tap_stream_id: contacts)
2022-07-09 00:19:30,897Z   main - INFO Saving structure of stream invoices (tap_stream_id: invoices)
2022-07-09 00:19:30,923Z   main - INFO Saving structure of stream campaigns (tap_stream_id: campaigns)
2022-07-09 00:19:30,950Z   main - INFO Saving structure of stream unique_urls (tap_stream_id: unique_urls)
2022-07-09 00:19:30,966Z   main - INFO Saving structure of stream clicks (tap_stream_id: clicks)
2022-07-09 00:19:30,984Z   main - INFO Saving structure of stream api_submissions (tap_stream_id: api_submissions)
2022-07-09 00:19:31,006Z   main - INFO Saving structure of stream media_partners (tap_stream_id: media_partners)
2022-07-09 00:19:31,024Z   main - INFO Saving structure of stream ads (tap_stream_id: ads)
2022-07-09 00:19:31,055Z   main - INFO Saving structure of stream company_information (tap_stream_id: company_information)
2022-07-09 00:19:31,072Z   main - INFO Saving structure of stream tracking_value_requests (tap_stream_id: tracking_value_requests)
2022-07-09 00:19:31,102Z   main - INFO Saving structure of stream reports (tap_stream_id: reports)
2022-07-09 00:19:31,115Z   main - INFO Saving structure of stream exception_lists (tap_stream_id: exception_lists)
2022-07-09 00:19:31,129Z   main - INFO Saving structure of stream exception_list_items (tap_stream_id: exception_list_items)
2022-07-09 00:19:31,146Z   main - INFO Saving structure of stream notes (tap_stream_id: notes)
2022-07-09 00:19:31,168Z   main - INFO Saving structure of stream catalogs (tap_stream_id: catalogs)
2022-07-09 00:19:31,189Z   main - INFO Saving structure of stream actions (tap_stream_id: actions)
2022-07-09 00:19:31,209Z   main - INFO Saving structure of stream action_inquiries (tap_stream_id: action_inquiries)
2022-07-09 00:19:31,231Z   main - INFO Saving structure of stream promo_codes (tap_stream_id: promo_codes)
2022-07-09 00:19:31,254Z   main - INFO Writing catalog to file
2022-07-09 00:19:31,319Z   main - INFO Selected fields for stream ads: minimum_purchase_amount, deal_end_date, description, bogo_get_scope, deal_restricted_media_partners, deal_name, limited_time_start_date, discount_amount, deal_state, bogo_get_discount_amount, restricted_media_partners, bogo_get_name, bogo_buy_name, custom_ad_serving_url, bogo_buy_quantity, deal_description, landing_page, promo_code_tracking, language, third_party_servable_ad_creative_height, discount_currency, limited_time_end_date, gift, synch_ads_promo_codes, deal_categories, iab_ad_unit, campaign_id, mobile_ready, uri, banner_alternative_tag, campaign_name, name, bogo_get_image_url, rebate_amount, coupon_link_name, get_html_code_type, discount_percent_range_end, maximum_savings_amount, deal_start_date, bogo_get_quantity, link_text, id, discount_maximum_percent, phone_tracking, bogo_get_discount_percent, top_seller, deal_type, bogo_get_discount_type, season, restricted_media_partner_groups, discount_percent, maximum_savings_currency, minimum_purchase_amount_currency, bogo_buy_scope, customisation_charge, bogo_buy_image_url, coupon_allow_custom_promo_code, discount_percent_range_start, ad_type, discount_type, rebate_currency, bogo_get_discount_currency, deal_scope, deal_default_promo_code, allow_deep_linking, purchase_limit_quantity, labels, deal_id, ad_code_template, deal_products, third_party_servable_ad_creative_width, deal_restricted_media_partner_groups
2022-07-09 00:19:31,319Z   main - INFO Selected fields for stream company_information: timezone, billing_address, commercial_contact, indirect_tax_number, primary_phone_number_country, corporate_address, currency, industry, organization_type, secondary_phone_number_country, website, minimum_contact_rating, primary_phone_number, registered_for_indirect_tax, financial_contact, secondary_phone_number, uri, ein_ssn_foreign_tax_id, company_name, technical_contact
2022-07-09 00:19:31,319Z   main - INFO Selected fields for stream unique_urls: campaign_name, url, date_last_assigned, media_partner_name, state, date_last_released, id, date_created, media_partner_id, campaign_id, landing_page, uri
2022-07-09 00:19:31,319Z   main - INFO Selected fields for stream media_partner_groups: id, name, media_partners, uri, campaign_id
2022-07-09 00:19:31,319Z   main - INFO Selected fields for stream catalog_items: original_price, shipping_height, mobile_url, is_parent, description, shipping_length, text2, manufacturer, money3, age_group, currency, catalog_id, shipping_rate, product_bid, original_format_category_id, expiration_date, url, category, money1, numeric2, estimated_ship_date, catalog_item_id, parent_sku, launch_date, weight, uri, money2, shipping_width, name, parent_name, manufacturing_cost, shipping_label, mpn, shipping_length_unit, text3, current_price, weight_unit, asin, material, gtin_type, shipping_weight, gender, text1, shipping_weight_unit, numeric1, multi_pack, size_unit, additional_image_urls, gtin, adult, stock_availability, pattern, condition, size, colors, inventory, numeric3, labels, original_format_category, bullets, image_url
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream phone_numbers: id, international_number, last_date_assigned, last_date_released, date_created, number, uri, country
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream media_partners: timezone, postal_code, name, country_state, mp_value1, id, rating, campaigns, relationship_state, address_line1, currency, groups, contact, primary_promotional_method, partner_type, promoting_countries, phone_number, promotional_methods, address_line2, description, mp_value3, country, website, city, mp_value2, date_created, uri, state
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream campaigns: name, tracking_domain, display_future_ads, identity_collapsing, state, display_servicing_agency, company_contacts, id, rating, list_in_marketplace, short_description, long_description, promo_code_tracking, third_party_impression_pixel, shipping_regions, trademark_bidding, resources, categories, view_through_crediting, gift_card_payouts, direct_tracking_settings, search_keywords, mobile_ready_ads, impression_tracking, gateway_tracking_settings, site_definition
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream deals: minimum_purchase_amount, name, bogo_get_image_url, rebate_amount, start_date, restricted_media_partner_groups, bogo_get_discount_currency, discount_percent_range_end, maximum_savings_amount, state, bogo_get_scope, discount_amount, bogo_get_quantity, id, restricted_media_partners, discount_maximum_percent, bogo_get_name, bogo_get_discount_percent, bogo_buy_name, bogo_buy_quantity, scope, discount_percent, maximum_savings_currency, minimum_purchase_amount_currency, type, bogo_get_discount_type, bogo_buy_image_url, discount_percent_range_start, default_promo_code, purchase_limit_quantity, discount_currency, rebate_currency, end_date, gift, synch_ads_promo_codes, categories, bogo_buy_scope, bogo_get_discount_amount, description, campaign_id, products, uri, discount_type
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream tracking_value_requests: minimum_purchase_amount, campaign_name, deal_end_date, unique_urls, deal_restricted_media_partners, state, deal_name, bogo_get_scope, discount_amount, phone_numbers, deal_state, bogo_get_discount_amount, bogo_get_name, bogo_buy_name, bogo_buy_quantity, deal_description, date_completed, promo_codes, processing_comments, discount_currency, date_placed, gift, synch_ads_promo_codes, discount_percent_range_end, media_partner_id, campaign_id, deal_default_promo_code, discount_percent, uri, additional_instructions, bogo_get_image_url, rebate_amount, media_partner_name, maximum_savings_amount, deal_start_date, bogo_get_quantity, id, discount_maximum_percent, bogo_get_discount_percent, request_type, deal_type, maximum_savings_currency, minimum_purchase_amount_currency, bogo_buy_scope, bogo_get_discount_type, bogo_buy_image_url, deal_categories, discount_percent_range_start, purchase_limit_quantity, discount_type, rebate_currency, bogo_get_discount_currency, number_requested, deal_scope, date_needed, deal_id, deal_products, deal_restricted_media_partner_groups
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream exception_list_items: id, name, value, created_date, match_mode, uri, list_id
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream exception_lists: id, campaign_id, uri, created_date, deactivation_date, name, number_of_items, state, action_trackers, items_uri, type
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream api_submissions: error_type, batch_id, type, event_code, status, action_tracker_id, completion_date, error_reason, account_id, payload, media_partner_id, campaign_id, order_id, uri, submission_date
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream reports: id, name, description, run_uri, meta_data_uri
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream promo_codes: minimum_purchase_amount, start_date, deal_end_date, deal_restricted_media_partners, state, deal_name, bogo_get_scope, discount_amount, deal_state, bogo_get_discount_amount, bogo_get_name, bogo_buy_name, bogo_buy_quantity, deal_description, discount_currency, end_date, gift, synch_ads_promo_codes, campaign_id, discount_percent, uri, campaign_name, bogo_get_image_url, rebate_amount, discount_percent_range_end, maximum_savings_amount, deal_start_date, bogo_get_quantity, code, id, discount_maximum_percent, bogo_buy_scope, credit_policy, assigned_partner_id, deal_id, deal_type, assigned_partner_name, maximum_savings_currency, minimum_purchase_amount_currency, type, bogo_get_discount_type, bogo_buy_image_url, deal_categories, discount_percent_range_start, purchase_limit_quantity, discount_type, rebate_currency, bogo_get_discount_currency, deal_scope, deal_default_promo_code, created_date, bogo_get_discount_percent, deal_products, deal_restricted_media_partner_groups
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream contacts: work_phone_number, email_address, title, cellphone_number_country, first_name, id, accounts, work_phone_number_country, cellphone_number, profile_image, last_name, labels, campaign_id, uri
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream notes: id, creator, attachments, type, creation_date, media_name, content, campaign_id, modification_date, uri, media_id
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream action_updates: clearing_date, ad_id, delta_payout, sku, action_id, caller_id, state, media_partner_id, id, customer_status, quantity, update_date, currency, customer_id, shared_id, disposition, state_detail_description, locking_date, state_detail, action_uri, action_tracker_id, action_date, delta_amount, campaign_id, order_id, category, uri
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream invoices: pdf, id, line_items, created_date, media_name, currency, total_vat_amount, total_amount, media_id
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream clicks: campaign_name, ad_id, channel, bid_keyword, payout, ad_group, deal_name, id, keyword, customer_country", deal_type, event_date, search_text, shared_id, landing_page_url, traffic_source, referring_url, unique_click, media_id, referring_domain, product_sku, customer_area, cpc_bid, device_family, ip_address, ad_type, traffic_category, customer_city, device_type, customer_region, browser, ad_campaign, deal_scope, os, media_name, campaign_id, match_type, ad_name, profile_id
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream ftp_file_submissions: account_id, batch_id, errors_uri, completion_date, status, file_name, total_errors, uri, submission_date, type, total_records
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream report_metadata: id, filters, uri, name, description, attributes, run_uri
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream actions: campaign_name, media_partner_id, ad_id, delta_payout, referring_date, payout, media_partner_name, client_cost, state, intended_payout, action_tracker_name, delta_amount, note, id, customer_status, cleared_date, currency, customer_country, shared_id, promo_code, referring_domain, customer_area, amount, locking_date, ip_address, customer_city, referring_type, action_tracker_id, event_date, creation_date, customer_region, caller_id, campaign_id, order_id, customer_post_code, uri, customer_id, intended_amount
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream action_inquiries: campaign_name, expected_payout, auto_approval_date, media_partner_name, action_id, id, transaction_date, comments, transaction_amount, final_payout, tracking_link, resolution_status, action_uri, resolution_date, creation_date, inquiry_type, reject_reason, media_partner_id, campaign_id, order_id, uri, resolution_deadline_date
2022-07-09 00:19:31,320Z   main - INFO Selected fields for stream catalogs: id, campaign_id, date_last_updated, filename, upload_method, name, number_of_items, advertiser_id, uri, items_uri, status
2022-07-09 00:19:31,326Z   main - INFO Current state: {"bookmarks": {"api_submissions": "2022-07-08T21:45:07.000000Z", "action_updates": "2022-07-08T18:38:26.000000Z", "invoices": "2022-07-02T12:34:04.000000Z", "clicks": "2022-07-08T22:50:02.000000Z", "actions": "2022-07-08T18:26:29.000000Z", "action_inquiries": "2022-06-16T21:06:22.000000Z"}, "currently_syncing": "catalogs"}
2022-07-09 00:19:31,327Z   main - INFO Starting tap: tap-env/bin/tap-impact --config /tmp/tap_config.json --properties /tmp/properties.json --catalog /tmp/catalog.json --state /tmp/tap_state.json
2022-07-09 00:19:31,332Z   main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json
2022-07-09 00:19:31,730Z    tap - INFO last/currently syncing stream: catalogs
2022-07-09 00:19:31,730Z    tap - INFO selected_streams: ['catalogs', 'actions', 'action_inquiries', 'promo_codes', 'action_updates', 'report_metadata', 'media_partner_groups', 'ftp_file_submissions', 'phone_numbers', 'deals', 'catalog_items', 'contacts', 'invoices', 'campaigns', 'unique_urls', 'clicks', 'api_submissions', 'media_partners', 'ads', 'company_information', 'tracking_value_requests', 'reports', 'exception_lists', 'exception_list_items', 'notes']
2022-07-09 00:19:31,730Z    tap - INFO START Syncing: promo_codes
2022-07-09 00:19:31,731Z    tap - INFO URL for Stream promo_codes: https://api.impact.com/Advertisers/****/PromoCodes.json?PageSize=1000
2022-07-09 00:19:31,799Z    tap - INFO HTTP request to "promo_codes" endpoint took 0.065s, returned status code 200
2022-07-09 00:19:31,799Z    tap - INFO FINISHED Syncing: promo_codes, total_records: 0
2022-07-09 00:19:31,799Z    tap - INFO START Syncing: ftp_file_submissions
2022-07-09 00:19:31,800Z    tap - INFO URL for Stream ftp_file_submissions: https://api.impact.com/Advertisers/****/FTPFileSubmissions.json?PageSize=1000
2022-07-09 00:19:31,846Z target - INFO Using batch_size_prefernces of {'user_batch_size_preference': None, 'batch_size_preference': None, 'full_table_streams': []}
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.action_inquiries = "2022-06-16T21:06:22.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.action_updates = "2022-07-08T18:38:26.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.actions = "2022-07-08T18:26:29.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.api_submissions = "2022-07-08T21:45:07.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.clicks = "2022-07-08T22:50:02.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding bookmarks.invoices = "2022-07-02T12:34:04.000000Z"
2022-07-09 00:19:31,847Z   main - INFO State update: adding currently_syncing = "promo_codes"
2022-07-09 00:19:31,853Z    tap - INFO HTTP request to "ftp_file_submissions" endpoint took 0.054s, returned status code 200
2022-07-09 00:19:31,853Z    tap - INFO FINISHED Syncing: ftp_file_submissions, total_records: 0
2022-07-09 00:19:31,853Z    tap - INFO START Syncing: reports
2022-07-09 00:19:31,854Z    tap - INFO URL for Stream reports: https://api.impact.com/Advertisers/****/Reports.json?PageSize=1000
2022-07-09 00:19:31,860Z   main - INFO State update: changing currently_syncing from "promo_codes" to "ftp_file_submissions"
2022-07-09 00:19:31,868Z   main - INFO State update: changing currently_syncing from "ftp_file_submissions" to "reports"
2022-07-09 00:19:32,144Z    tap - INFO HTTP request to "reports" endpoint took 0.290s, returned status code 200
2022-07-09 00:19:32,148Z    tap - INFO Stream: reports, Missing key id in record: {'description': 'Shows action listing as category level based on locking date of the action', 'category': 'Custom', 'api_accessible': False, 'run_uri': '/secure/advertiser/report/viewReport.report?id=6282', 'name': 'Action Listing (Category Level) by Locking Date'}
2022-07-09 00:19:32,149Z    tap - CRITICAL 
2022-07-09 00:19:32,150Z    tap - Traceback (most recent call last):
2022-07-09 00:19:32,150Z    tap -   File "tap-env/bin/tap-impact", line 33, in <module>
2022-07-09 00:19:32,150Z    tap -     sys.exit(load_entry_point('tap-impact==1.0.0', 'console_scripts', 'tap-impact')())
2022-07-09 00:19:32,150Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/singer/utils.py", line 229, in wrapped
2022-07-09 00:19:32,150Z    tap -     return fnc(*args, **kwargs)
2022-07-09 00:19:32,151Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/__init__.py", line 50, in main
2022-07-09 00:19:32,151Z    tap -     state=state)
2022-07-09 00:19:32,151Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/sync.py", line 421, in sync
2022-07-09 00:19:32,151Z    tap -     selected_streams=selected_streams)
2022-07-09 00:19:32,151Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/sync.py", line 267, in sync_endpoint
2022-07-09 00:19:32,151Z    tap -     raise RuntimeError
2022-07-09 00:19:32,151Z    tap - RuntimeError
2022-07-09 00:19:32,180Z target - INFO Requests complete, stopping loop
2022-07-09 00:19:32,252Z   main - INFO Target exited normally with status 0
2022-07-09 00:19:33,819Z   main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobFinished [5] at offset None
2022-07-09 00:19:33,821Z   main - INFO No tunnel subprocess to tear down
2022-07-09 00:19:33,821Z   main - INFO Exit status is: Discovery succeeded. Tap failed with code 1. Target succeeded.

Error 2:

2022-07-09 00:11:58,959Z   main - INFO Running tap-impact version 1.0.0 and target-stitch version 3.2.0
2022-07-09 00:12:00,114Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobStarted ), use_ssl( true )
2022-07-09 00:12:00,117Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobFinished ), use_ssl( true )
2022-07-09 00:12:00,117Z   main - INFO [smart-services] building smart service producer: topic( com.stitchdata.streamRecordCount ), use_ssl( true )
2022-07-09 00:12:01,141Z   main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobStarted [18] at offset None
2022-07-09 00:12:01,144Z   main - INFO Starting tap to discover schemas: tap-env/bin/tap-impact --config /tmp/tap_discover_config.json --discover
2022-07-09 00:12:01,580Z    tap - INFO Starting discover
2022-07-09 00:12:01,613Z    tap - INFO Finished discover
2022-07-09 00:12:01,648Z   main - INFO Tap exited normally.
2022-07-09 00:12:01,652Z   main - INFO Saving list of discovered streams
2022-07-09 00:12:01,678Z   main - INFO Saving structure of stream promo_codes (tap_stream_id: promo_codes)
2022-07-09 00:12:01,713Z   main - INFO Saving structure of stream contacts (tap_stream_id: contacts)
2022-07-09 00:12:01,746Z   main - INFO Saving structure of stream campaigns (tap_stream_id: campaigns)
2022-07-09 00:12:01,791Z   main - INFO Saving structure of stream phone_numbers (tap_stream_id: phone_numbers)
2022-07-09 00:12:01,815Z   main - INFO Saving structure of stream actions (tap_stream_id: actions)
2022-07-09 00:12:01,854Z   main - INFO Saving structure of stream tracking_value_requests (tap_stream_id: tracking_value_requests)
2022-07-09 00:12:01,895Z   main - INFO Saving structure of stream exception_list_items (tap_stream_id: exception_list_items)
2022-07-09 00:12:01,918Z   main - INFO Saving structure of stream company_information (tap_stream_id: company_information)
2022-07-09 00:12:01,947Z   main - INFO Saving structure of stream notes (tap_stream_id: notes)
2022-07-09 00:12:01,986Z   main - INFO Saving structure of stream report_metadata (tap_stream_id: report_metadata)
2022-07-09 00:12:02,017Z   main - INFO Saving structure of stream action_inquiries (tap_stream_id: action_inquiries)
2022-07-09 00:12:02,053Z   main - INFO Saving structure of stream api_submissions (tap_stream_id: api_submissions)
2022-07-09 00:12:02,080Z   main - INFO Saving structure of stream clicks (tap_stream_id: clicks)
2022-07-09 00:12:02,110Z   main - INFO Saving structure of stream reports (tap_stream_id: reports)
2022-07-09 00:12:02,162Z   main - INFO Saving structure of stream media_partners (tap_stream_id: media_partners)
2022-07-09 00:12:02,183Z   main - INFO Saving structure of stream media_partner_groups (tap_stream_id: media_partner_groups)
2022-07-09 00:12:02,209Z   main - INFO Saving structure of stream deals (tap_stream_id: deals)
2022-07-09 00:12:02,260Z   main - INFO Saving structure of stream catalogs (tap_stream_id: catalogs)
2022-07-09 00:12:02,286Z   main - INFO Saving structure of stream action_updates (tap_stream_id: action_updates)
2022-07-09 00:12:02,334Z   main - INFO Saving structure of stream exception_lists (tap_stream_id: exception_lists)
2022-07-09 00:12:02,385Z   main - INFO Saving structure of stream invoices (tap_stream_id: invoices)
2022-07-09 00:12:02,424Z   main - INFO Saving structure of stream catalog_items (tap_stream_id: catalog_items)
2022-07-09 00:12:02,468Z   main - INFO Saving structure of stream ads (tap_stream_id: ads)
2022-07-09 00:12:02,523Z   main - INFO Saving structure of stream ftp_file_submissions (tap_stream_id: ftp_file_submissions)
2022-07-09 00:12:02,547Z   main - INFO Saving structure of stream unique_urls (tap_stream_id: unique_urls)
2022-07-09 00:12:02,586Z   main - INFO Writing catalog to file
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream actions: promo_code, customer_area, customer_post_code, referring_domain, ad_id, id, currency, intended_payout, shared_id, creation_date, action_tracker_id, note, media_partner_id, event_date, amount, customer_city, customer_id, action_tracker_name, uri, locking_date, campaign_name, customer_region, referring_date, payout, intended_amount, delta_payout, state, campaign_id, delta_amount, customer_status, caller_id, customer_country, cleared_date, ip_address, referring_type, media_partner_name, order_id, client_cost
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream campaigns: mobile_ready_ads, list_in_marketplace, gift_card_payouts, company_contacts, third_party_impression_pixel, id, gateway_tracking_settings, direct_tracking_settings, display_servicing_agency, resources, impression_tracking, shipping_regions, identity_collapsing, name, categories, site_definition, promo_code_tracking, long_description, display_future_ads, trademark_bidding, tracking_domain, search_keywords, short_description, rating, view_through_crediting, state
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream unique_urls: date_created, campaign_id, uri, id, media_partner_name, media_partner_id, date_last_released, landing_page, url, date_last_assigned, state, campaign_name
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream action_updates: category, action_uri, ad_id, id, currency, state_detail, shared_id, locking_date, action_tracker_id, media_partner_id, action_id, quantity, customer_id, uri, order_id, sku, state_detail_description, delta_payout, disposition, clearing_date, campaign_id, delta_amount, update_date, caller_id, customer_status, action_date, state
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream catalog_items: expiration_date, catalog_item_id, category, current_price, shipping_length, is_parent, currency, mpn, numeric3, pattern, colors, image_url, weight, shipping_height, text2, uri, parent_sku, asin, gender, condition, additional_image_urls, age_group, money1, bullets, text1, material, numeric1, size, inventory, weight_unit, shipping_weight, parent_name, shipping_width, shipping_length_unit, money3, numeric2, estimated_ship_date, shipping_label, original_price, manufacturing_cost, launch_date, text3, shipping_rate, gtin, shipping_weight_unit, size_unit, money2, multi_pack, manufacturer, name, mobile_url, catalog_id, stock_availability, product_bid, labels, original_format_category, original_format_category_id, url, adult, description, gtin_type
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream phone_numbers: id, country, date_created, last_date_released, last_date_assigned, number, uri, international_number
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream ftp_file_submissions: submission_date, status, account_id, total_records, batch_id, errors_uri, completion_date, type, total_errors, uri, file_name
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream media_partner_groups: campaign_id, id, uri, name, media_partners
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream promo_codes: maximum_savings_currency, discount_type, bogo_get_name, deal_name, bogo_buy_quantity, id, start_date, bogo_buy_name, discount_amount, type, discount_currency, minimum_purchase_amount_currency, uri, campaign_name, campaign_id, bogo_get_discount_currency, code, deal_description, discount_percent_range_start, credit_policy, deal_start_date, maximum_savings_amount, minimum_purchase_amount, deal_categories, gift, deal_id, bogo_get_scope, bogo_buy_image_url, deal_state, deal_default_promo_code, rebate_amount, bogo_get_discount_amount, bogo_get_discount_percent, deal_products, bogo_get_image_url, synch_ads_promo_codes, created_date, assigned_partner_id, purchase_limit_quantity, bogo_get_discount_type, discount_percent_range_end, bogo_buy_scope, deal_restricted_media_partner_groups, deal_restricted_media_partners, deal_type, bogo_get_quantity, discount_maximum_percent, end_date, discount_percent, rebate_currency, assigned_partner_name, deal_scope, state, deal_end_date
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream catalogs: campaign_id, upload_method, status, name, advertiser_id, date_last_updated, id, uri, items_uri, number_of_items, filename
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream exception_lists: campaign_id, type, deactivation_date, created_date, name, action_trackers, id, uri, items_uri, number_of_items, state
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream api_submissions: submission_date, error_type, batch_id, completion_date, campaign_id, media_partner_id, action_tracker_id, status, account_id, type, event_code, error_reason, uri, payload, order_id
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream tracking_value_requests: maximum_savings_currency, discount_type, bogo_get_name, date_needed, deal_name, bogo_buy_quantity, date_completed, id, media_partner_id, bogo_buy_name, discount_amount, discount_currency, deal_description, date_placed, uri, campaign_name, number_requested, campaign_id, bogo_get_discount_currency, processing_comments, minimum_purchase_amount_currency, discount_percent_range_start, deal_start_date, maximum_savings_amount, minimum_purchase_amount, deal_categories, gift, deal_id, bogo_get_scope, bogo_buy_image_url, deal_state, deal_default_promo_code, rebate_amount, request_type, bogo_get_discount_amount, unique_urls, bogo_get_discount_percent, phone_numbers, bogo_get_image_url, synch_ads_promo_codes, promo_codes, purchase_limit_quantity, bogo_get_discount_type, discount_percent_range_end, bogo_buy_scope, deal_restricted_media_partners, deal_products, deal_type, additional_instructions, bogo_get_quantity, discount_maximum_percent, discount_percent, rebate_currency, media_partner_name, deal_restricted_media_partner_groups, deal_scope, state, deal_end_date
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream report_metadata: filters, name, description, attributes, id, uri, run_uri
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream invoices: total_amount, pdf, created_date, total_vat_amount, currency, line_items, id, media_name, media_id
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream company_information: financial_contact, minimum_contact_rating, primary_phone_number_country, secondary_phone_number_country, primary_phone_number, commercial_contact, timezone, currency, billing_address, corporate_address, website, ein_ssn_foreign_tax_id, organization_type, company_name, industry, technical_contact, indirect_tax_number, secondary_phone_number, uri, registered_for_indirect_tax
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream clicks: keyword, ad_group, customer_country", match_type, referring_domain, os, id, ad_id, browser, shared_id, traffic_category, event_date, device_family, channel, customer_city, media_name, ad_campaign, product_sku, customer_region, unique_click, payout, deal_name, cpc_bid, traffic_source, campaign_id, profile_id, customer_area, ad_name, deal_scope, search_text, ip_address, device_type, referring_url, ad_type, campaign_name, landing_page_url, bid_keyword, deal_type, media_id
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream ads: maximum_savings_currency, discount_type, bogo_get_name, deal_name, bogo_buy_quantity, id, link_text, promo_code_tracking, bogo_buy_name, custom_ad_serving_url, purchase_limit_quantity, language, discount_currency, deal_description, banner_alternative_tag, phone_tracking, coupon_link_name, restricted_media_partner_groups, restricted_media_partners, uri, campaign_name, get_html_code_type, allow_deep_linking, campaign_id, bogo_get_discount_currency, minimum_purchase_amount_currency, limited_time_start_date, iab_ad_unit, coupon_allow_custom_promo_code, top_seller, ad_code_template, deal_type, ad_type, deal_restricted_media_partners, deal_categories, gift, deal_id, bogo_get_scope, bogo_buy_image_url, deal_start_date, deal_default_promo_code, rebate_amount, bogo_get_discount_amount, bogo_get_discount_percent, landing_page, bogo_get_image_url, limited_time_end_date, season, discount_amount, bogo_get_discount_type, discount_percent_range_end, bogo_buy_scope, third_party_servable_ad_creative_width, deal_restricted_media_partner_groups, discount_percent_range_start, deal_products, minimum_purchase_amount, deal_state, name, third_party_servable_ad_creative_height, description, mobile_ready, bogo_get_quantity, discount_maximum_percent, synch_ads_promo_codes, labels, discount_percent, rebate_currency, customisation_charge, deal_scope, maximum_savings_amount, deal_end_date
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream deals: maximum_savings_currency, discount_percent_range_end, discount_type, bogo_get_name, bogo_buy_image_url, bogo_buy_quantity, bogo_get_discount_amount, id, bogo_get_discount_percent, start_date, bogo_buy_name, discount_percent_range_start, purchase_limit_quantity, bogo_get_image_url, type, discount_currency, minimum_purchase_amount_currency, discount_amount, bogo_get_discount_type, restricted_media_partner_groups, restricted_media_partners, uri, description, default_promo_code, name, categories, campaign_id, products, bogo_get_quantity, discount_maximum_percent, end_date, rebate_amount, discount_percent, bogo_get_discount_currency, rebate_currency, scope, bogo_buy_scope, synch_ads_promo_codes, maximum_savings_amount, minimum_purchase_amount, bogo_get_scope, state, gift
2022-07-09 00:12:02,653Z   main - INFO Selected fields for stream notes: type, attachments, creator, modification_date, content, campaign_id, media_name, id, uri, creation_date, media_id
2022-07-09 00:12:02,654Z   main - INFO Selected fields for stream exception_list_items: match_mode, created_date, name, value, id, uri, list_id
2022-07-09 00:12:02,654Z   main - INFO Selected fields for stream action_inquiries: inquiry_type, action_uri, id, media_partner_name, creation_date, tracking_link, comments, media_partner_id, action_id, uri, auto_approval_date, order_id, resolution_status, campaign_id, transaction_date, resolution_deadline_date, transaction_amount, final_payout, resolution_date, expected_payout, reject_reason, campaign_name
2022-07-09 00:12:02,654Z   main - INFO Selected fields for stream contacts: campaign_id, work_phone_number_country, last_name, cellphone_number, accounts, work_phone_number, id, profile_image, first_name, labels, cellphone_number_country, uri, email_address, title
2022-07-09 00:12:02,654Z   main - INFO Selected fields for stream reports: meta_data_uri, id, description, run_uri, name
2022-07-09 00:12:02,654Z   main - INFO Selected fields for stream media_partners: id, campaigns, address_line2, date_created, timezone, country, currency, partner_type, website, rating, groups, mp_value3, mp_value1, phone_number, promotional_methods, relationship_state, country_state, primary_promotional_method, postal_code, name, uri, city, contact, address_line1, mp_value2, promoting_countries, description, state
2022-07-09 00:12:02,658Z   main - INFO Current state: {"bookmarks": {"actions": "2022-07-08T18:26:29.000000Z", "api_submissions": "2022-07-08T21:45:07.000000Z", "action_updates": "2022-07-08T18:38:26.000000Z", "action_inquiries": "2022-06-16T21:06:22.000000Z", "clicks": "2022-07-08T22:50:02.000000Z"}, "currently_syncing": "reports"}
2022-07-09 00:12:02,659Z   main - INFO Starting tap: tap-env/bin/tap-impact --config /tmp/tap_config.json --properties /tmp/properties.json --catalog /tmp/catalog.json --state /tmp/tap_state.json
2022-07-09 00:12:02,662Z   main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json
2022-07-09 00:12:03,122Z    tap - INFO last/currently syncing stream: reports
2022-07-09 00:12:03,122Z    tap - INFO selected_streams: ['reports', 'media_partners', 'media_partner_groups', 'deals', 'catalogs', 'action_updates', 'exception_lists', 'invoices', 'catalog_items', 'ads', 'ftp_file_submissions', 'unique_urls', 'promo_codes', 'contacts', 'campaigns', 'phone_numbers', 'actions', 'tracking_value_requests', 'exception_list_items', 'company_information', 'notes', 'report_metadata', 'action_inquiries', 'api_submissions', 'clicks']
2022-07-09 00:12:03,122Z    tap - INFO START Syncing: deals
2022-07-09 00:12:03,123Z    tap - INFO URL for Stream deals: https://api.impact.com/Advertisers/****/Deals.json?PageSize=1000
2022-07-09 00:12:03,146Z target - INFO Using batch_size_prefernces of {'user_batch_size_preference': None, 'batch_size_preference': None, 'full_table_streams': []}
2022-07-09 00:12:03,147Z   main - INFO State update: adding bookmarks.action_inquiries = "2022-06-16T21:06:22.000000Z"
2022-07-09 00:12:03,147Z   main - INFO State update: adding bookmarks.action_updates = "2022-07-08T18:38:26.000000Z"
2022-07-09 00:12:03,147Z   main - INFO State update: adding bookmarks.actions = "2022-07-08T18:26:29.000000Z"
2022-07-09 00:12:03,147Z   main - INFO State update: adding bookmarks.api_submissions = "2022-07-08T21:45:07.000000Z"
2022-07-09 00:12:03,147Z   main - INFO State update: adding bookmarks.clicks = "2022-07-08T22:50:02.000000Z"
2022-07-09 00:12:03,147Z   main - INFO State update: adding currently_syncing = "deals"
2022-07-09 00:12:03,226Z target - INFO Serializing batch with 3 messages for table deals
2022-07-09 00:12:03,227Z    tap - INFO HTTP request to "deals" endpoint took 0.098s, returned status code 200
2022-07-09 00:12:03,227Z target - INFO Sending batch of 9706 bytes to https://api.stitchdata.com/v2/import/batch
2022-07-09 00:12:03,299Z   main - INFO State update: changing currently_syncing from "deals" to "ftp_file_submissions"
2022-07-09 00:12:03,363Z   main - INFO State update: changing currently_syncing from "ftp_file_submissions" to "invoices"
2022-07-09 00:12:04,210Z    tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [9] at offset None
2022-07-09 00:12:04,674Z    tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None
2022-07-09 00:12:04,675Z    tap - INFO replicated 3 records from "deals" endpoint
2022-07-09 00:12:04,675Z    tap - INFO Stream deals, batch processed 3 records
2022-07-09 00:12:04,675Z    tap - INFO Synced Stream: deals, page: 1, 0 to 3 of total records: 3
2022-07-09 00:12:04,675Z    tap - INFO FINISHED Syncing: deals, total_records: 3
2022-07-09 00:12:04,675Z    tap - INFO START Syncing: ftp_file_submissions
2022-07-09 00:12:04,675Z    tap - INFO URL for Stream ftp_file_submissions: https://api.impact.com/Advertisers/****/FTPFileSubmissions.json?PageSize=1000
2022-07-09 00:12:04,675Z    tap - INFO HTTP request to "ftp_file_submissions" endpoint took 0.135s, returned status code 200
2022-07-09 00:12:04,675Z    tap - INFO FINISHED Syncing: ftp_file_submissions, total_records: 0
2022-07-09 00:12:04,675Z    tap - INFO START Syncing: invoices
2022-07-09 00:12:04,675Z    tap - INFO URL for Stream invoices: https://api.impact.com/Advertisers/****/Invoices.json?PageSize=1000&StartDate=2021-07-08T00:00:00Z
2022-07-09 00:12:04,675Z    tap - INFO HTTP request to "invoices" endpoint took 0.970s, returned status code 200
2022-07-09 00:12:04,742Z   main - INFO State update: adding bookmarks.invoices = "2022-07-02T12:34:04.000000Z"
2022-07-09 00:12:04,742Z   main - INFO State update: changing currently_syncing from "invoices" to "catalogs"
2022-07-09 00:12:05,136Z    tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [4] at offset None
2022-07-09 00:12:05,136Z    tap - INFO replicated 194 records from "invoices" endpoint
2022-07-09 00:12:05,136Z    tap - INFO Stream invoices, batch processed 194 records
2022-07-09 00:12:05,136Z    tap - INFO Write state for stream: invoices, value: 2022-07-02T12:34:04.000000Z
2022-07-09 00:12:05,136Z    tap - INFO Synced Stream: invoices, page: 1, 0 to 194 of total records: 194
2022-07-09 00:12:05,136Z    tap - INFO FINISHED Syncing: invoices, total_records: 194
2022-07-09 00:12:05,136Z    tap - INFO START Syncing: catalogs
2022-07-09 00:12:05,137Z    tap - INFO URL for Stream catalogs: https://api.impact.com/Advertisers/****/Catalogs.json?PageSize=1000
2022-07-09 00:12:05,137Z    tap - INFO HTTP request to "catalogs" endpoint took 0.214s, returned status code 401
2022-07-09 00:12:05,137Z    tap - ERROR ERROR 401: {"Status":"ERROR","Message":"Bad credentials"}, REASON: Unauthorized
2022-07-09 00:12:05,137Z    tap - CRITICAL 401 Client Error: Unauthorized for url: https://api.impact.com/Advertisers/****/Catalogs.json?PageSize=1000
2022-07-09 00:12:05,137Z    tap - Traceback (most recent call last):
2022-07-09 00:12:05,137Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/client.py", line 80, in raise_for_error
2022-07-09 00:12:05,137Z    tap -     response.raise_for_status()
2022-07-09 00:12:05,137Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/requests/models.py", line 940, in raise_for_status
2022-07-09 00:12:05,137Z    tap -     raise HTTPError(http_error_msg, response=self)
2022-07-09 00:12:05,137Z    tap - requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://api.impact.com/Advertisers/****/Catalogs.json?PageSize=1000
2022-07-09 00:12:05,137Z    tap - 
2022-07-09 00:12:05,137Z    tap - During handling of the above exception, another exception occurred:
2022-07-09 00:12:05,137Z    tap - 
2022-07-09 00:12:05,137Z    tap - Traceback (most recent call last):
2022-07-09 00:12:05,137Z    tap -   File "tap-env/bin/tap-impact", line 33, in <module>
2022-07-09 00:12:05,137Z    tap -     sys.exit(load_entry_point('tap-impact==1.0.0', 'console_scripts', 'tap-impact')())
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/singer/utils.py", line 229, in wrapped
2022-07-09 00:12:05,138Z    tap -     return fnc(*args, **kwargs)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/__init__.py", line 50, in main
2022-07-09 00:12:05,138Z    tap -     state=state)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/sync.py", line 421, in sync
2022-07-09 00:12:05,138Z    tap -     selected_streams=selected_streams)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/sync.py", line 208, in sync_endpoint
2022-07-09 00:12:05,138Z    tap -     endpoint=stream_name)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/client.py", line 208, in get
2022-07-09 00:12:05,138Z    tap -     return self.request('GET', path=path, **kwargs)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/backoff/_sync.py", line 94, in retry
2022-07-09 00:12:05,138Z    tap -     ret = target(*args, **kwargs)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/singer/utils.py", line 95, in wrapper
2022-07-09 00:12:05,138Z    tap -     return func(*args, **kwargs)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/client.py", line 203, in request
2022-07-09 00:12:05,138Z    tap -     raise_for_error(response)
2022-07-09 00:12:05,138Z    tap -   File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_impact/client.py", line 96, in raise_for_error
2022-07-09 00:12:05,138Z    tap -     raise ImpactError(error)
2022-07-09 00:12:05,138Z    tap - tap_impact.client.ImpactError: 401 Client Error: Unauthorized for url: https://api.impact.com/Advertisers/****/Catalogs.json?PageSize=1000
2022-07-09 00:12:05,139Z   main - INFO Target exited normally with status 0
2022-07-09 00:12:05,143Z target - INFO replicated 3 records from "deals" endpoint
2022-07-09 00:12:05,143Z target - I/O operation on closed file.
2022-07-09 00:12:06,673Z   main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobFinished [31] at offset None
2022-07-09 00:12:06,677Z   main - INFO No tunnel subprocess to tear down
2022-07-09 00:12:06,678Z   main - INFO Exit status is: Discovery succeeded. Tap failed with code 1 and error message: "401 Client Error: Unauthorized for url: https://api.impact.com/Advertisers/****/Catalogs.json?PageSize=1000". Target succeeded.

Cannot extract Actions table

Hey guys -

I'm leveraging this tap via Stitch to ingest impact radius data into our Snowflake db. We do not understand why tables like reports, ads, unique_urls, promo_codes, and media_partners successfully sync but Actions does not.

So far I've noticed that the actions table, although selected for replication, is not even queued to replicate records even though it was selected as a table to replicate on Stitch.

Are there requirements we might be missing? We added our Account SID and Auth Token in the integration's settings on Stitch. Other than that, unsure what else to check for.

StitchData Integration - Clicks endpoint has been replaced by ClickExport

Here is the error from the extraction logs.

2022-11-08 16:50:38,978Z tap - INFO URL for Stream clicks: https://api.impact.com/Advertisers/IRiHpVMvnoEb3017645SbGSrA9L5imyKR1/Campaigns/14569/Clicks.json?PageSize=1000&Date=2021-08-09
2022-11-08 16:50:38,979Z tap - INFO HTTP request to "clicks" endpoint took 0.064s, returned status code 404
2022-11-08 16:50:38,979Z tap - ERROR ERROR 404: {"Status":"ERROR","Message":"Support for this endpoint has ended and has been replaced with the new /ClickExport endpoint. Please use /Advertisers/IRiHpVMvnoEb3017645SbGSrA9L5imyKR1/Programs/14569/ClickExport.json?Date=2021-08-09&PageSize=1000 to access your data. Please also review the API documentation if you require additional information."}, REASON: Not Found
2022-11-08 16:50:38,979Z tap - CRITICAL 404 Client Error: Not Found for url: https://api.impact.com/Advertisers/IRiHpVMvnoEb3017645SbGSrA9L5imyKR1/Campaigns/14569/Clicks.json?PageSize=1000&Date=2021-08-09