r37r0-gh057 / pycatai-pet

A Windows based AI powered desktop pet written in python.

pyCatAI-pet (v0.9)

A Windows based AI powered desktop pet written in Python. It can move around on your screen and jump on top of active program windows. And with the help of Google's Gemini Vision model, it can generate funny comments on current on-screen activity by taking screenshots of your screen every minute.

Watch video demo here

Note

All of the cat sprites used in this project are not mine. They have been taken from here.

Current Features:

• Uses tkinter to display sprite images and text on screen.
• Uses win32gui library to access and utitlize the Windows API to get the active program windows and their X, Y positions.
• Uses pyttsx3 library for Text-to-speech.
• Uses Google's Gemini Vision model for generating comments.

To do:

• Add support for linux.
• Add better TTS.
• Add & use more idle animations.
• Make the sprite draggable using mouse.
• Make the sprite stick on other program window borders.

Getting started

Install Python on your machine if you haven't already.

Download this repository manually, or if you have git installed::

git clone https://github.com/R37r0-Gh057/pyCatAI-pet

Once inside the directory, open your terminal enter the following commands to install the necessary libraries:

pip install -r requirements.txt

Usage

Important

Make sure that you have generated your own Gemini API key and placed it in the script:

pyCatAI-pet/lib/CommentGenerator.py

Line 10 in fa14266

self.API_KEY = ""

Run the main.py file from terminal:

python main.py

Contributing

If you want to suggest a new feature or functionality then you can open a new issue with the "enhancement" title.

If you want to add features or enhance existing code by yourself then feel free to open a Pull Request:

1. Fork this repository
2. Create a separate branch
3. Make your changes
4. Open pull request

You can get started by checking the currently open issues, or create new ones.

Contact

Feel free to reach out to me on discord: @retr0_gh0st

pycatai-pet's Issues

Make the sprite draggable on screen using mouse.

The sprite image does not respond to mouse clicks and cannot be dragged around anywhere.
Have to make it so like user can move it anywhere around the screen manually.

Add better TTS

Currently using the Windows SAPI for text-to-speech conversions.
Need to implement a non-blocking TTS and custom voice model if possible.

Add support for linux

Known issues:

• Unlike Windows, displaying images without a window on the screen is not possible through tkinter.
• Win32API equivalent or some other workaround is needed to interact with other application windows on the screen.

Add & use more idle animations

There are unused idle animations present in the sprites directory, they are yet to be used.

Make the sprite stick on window borders

Make the sprite climb & stick vertically on side borders of an app window.