teyvat-dev / scraper-node Goto Github PK

It seems to be missing when the function is auto deployed with github actions

With the new abilities afforded with p it can simplify connecting tables together.

See: https://github.com/prisma/prisma/releases/tag/2.11.0

To facilitate the scraper to uploader workflow this function needs to save data to google cloud storage.

The following need to be done

• Save output scrape to file that is to be uploaded to google cloud storage
• If process.env.NODE_ENV is not in production do not upload to google cloud however return the scrape output to HTTP response for testing

https://genshin-impact.fandom.com/wiki/Gadgets

In order for the scraper to become production-ready (meaning it will be used on a scheduled basis daily to automatically update the db) it needs to support all of the currently supported variables manually inputted.

• Character: Fix Traveler Non-element bug, since there is no element we need to pass all currently unlocked (anemo and geo)
• Character: Fix Traveler extra talents, it seems that the scraper incorrectly identifies the ascension table as a talent table
• Characer: (Optional) Parse character stats table.
• CharacterProfile: Parse Story
• CharacterProfile: Pass Region
• CharacterProfile: (Optional) Parse Voice lines
• All: Trim Overview text from quoations

To provide files for This the characters should be evaluated and split by each other.

• Separate files for each character
• Combine all outputs when in dev mode

Utilizing the scaffolding create a scraper for elements

The response should include the name of the element, archon, effect and theme, but feel free to scrape extra data, for now, such as, characters related to the element and regions related to the element. (these may be used later in development, comment them out in the final object building)

Utilizing the scaffolding create a scraper for teyvat regions

The response should include the name of the region, but feel free to scrape extra data, for now, such as, elements related to regions, characters related to region and domains related to the region. (these may be used later in development, comment them out in the final object building)

Currently crashes if the object does not currently exist in the scraper bucket, so we must handle it.