shuuji3 / cloud-screen-translation

GUI application to capture text from the screen and translate it into other languages with Google Cloud Vision API (with read aloud feature)

Cloud Screen Translation

Cloud Screen Translation is a cross-platform application to support to read text on the screen written in foreign languages. It detect text in the screen and translate it (optionally speak aloud it by synthesis voice). It is highly powered by Google Cloud Platform. (Note: currently only supports the reading out Japanese and the translation from Japanese into English.)

Download (for Windows user)

CloudScreenTranslation-v0.4.0.zip

Usage

1. Prepare your own service account key of Google Cloud Platform and save it as service_account_creds.json on this directory.
2. Run python main.py (Windows: Extract CloudScreenTranslation-*.zip and run CloudScreenTranslation.cmd).
3. Move the transparent Capture Window to the translation target area like the above screenshot.
4. Click Capture and Translation button on the Main Window.
5. The detected Japanese text will be appended in the above textbox and the translated English in the bottom.

Development

1. Prepare your own service account key of Google Cloud Platform and save it as service_account_creds.json on this directory.
2. Install Python3.
3. Run pip install -r requirements.txt to install required libraries.
4. Run pip install -r requirements-dev.txt to install required libraries for development.
5. (For Windows) Run pip install -r requirements-win.txt.
6. Run python main.py.

License

Cloud Screen Translation

GNU General Public License v3

cmdmp3

MIT License

The distribution files for Windows has cmdmp3 executable to play a voice.

cloud-screen-translation's Issues

Dependabot couldn't authenticate with https://pypi.python.org/simple/

Dependabot couldn't authenticate with https://pypi.python.org/simple/.

You can provide authentication details in your Dependabot dashboard by clicking into the account menu (in the top right) and selecting 'Config variables'.

View the update logs.

No sound played when clicking "translation" button on Windows

No sound played. It seems a valid voice mp3 file is created in the temp dir but we can't hear the sound. Is there a problem in wx.adv.Sound?

Can't capture text on the sub display

I have two displays. When I move the capture window to the second screen, no text is captured and nothing is translated.