yashoswalyo / clone-bot-public

It works on my system, so I don't care about yours

CLONE BOT

This repo is lite version of MLTB

1. fill config.env on gist
   
2. use this template make private repo
   
3. add accounts folder and token.pickle
   

Tutorial:

Note:

• If you are using Service accounts add them to google group and then add google group to shared drive as content manager or watch (https://www.youtube.com/watch?v=gFQWJ4ftt48&t=5034s)
• Aria2p is removed so leech/mirror for direct links and magnets will not work
  btw you can leech from google drive

Features:

• Log channel support
• Change filename while cloning, ex: /clone <drive_url> |new file name.ext
• Leech drive links (splitting, thumbnail for each user, setting as document or as media for each user)
• Stop duplicates for all tasks except yt-dlp tasks
• Zip/Unzip G-Drive links
• Counting files/folders from Google Drive link
• Direct Clone from

  GDToT, AppDrive, DriveApp, DriveLinks, DriveAce, DriveBit, DriveSharer, GDFlix, DriveRoot, DriveFlix, DriveHub.in, AniDrive, IndiDrive, HubDrive, KatDrive, DriveHub.ws, Kolop, DriveFire, DriveBuzz, Sharer.pw and ShareDrive links

• View Link button, extra button to open file index link in broswer instead of direct download
• Status Pages for unlimited tasks
• Clone status
• Search in multiple Drive folder/TeamDrive
• Recursive Search (only with root or TeamDrive ID, folder ids will be listed with non-recursive method)
• Multi-TD list by token.pickle if exists
• Extract rar, zip and 7z splits with or without password
• Zip file/folder with or without password
• Use Token.pickle if file not found with Service Account for all Gdrive functions
• Random Service Account at startup
• Mirror/Leech/Watch/Clone/Count/Del by reply
• YT-DLP quality buttons
• Extenstion Filter for uploading/cloning files
• Incomplete task notifier to get incomplete task messages after restart, works with database.
• Mirror Telegram files to Google Drive
• Copy files from someone's Drive to your Drive
• Download/Upload progress, Speeds and ETAs
• Mirror all yt-dlp supported links
• Uploading to Team Drive
• Index Link support
• Service Account support
• Delete files from Drive
• Add sudo users
• Custom Filename* (Only for Telegram files and yt-dlp)
• Extract password protected files
• Extract these filetypes and uploads to Google Drive

  ZIP, RAR, TAR, 7z, ISO, WIM, CAB, GZIP, BZIP2, APM, ARJ, CHM, CPIO, CramFS, DEB, DMG, FAT, HFS, LZH, LZMA, LZMA2, MBR, MSI, MSLZ, NSIS, NTFS, RPM, SquashFS, UDF, VHD, XAR, Z, TAR.XZ

• Run speedtest on remote server

Add this secrets

• HEROKU_API_KEY
• HEROKU_APP_NAME
• HEROKU_EMAIL
• CONFIG_FILE_URL

Deploy on heroku without ban

goto actions and run workflow

Modified By:

Yash Oswal (https://github.com/yashoswalyo)
Majnu Rangeela (https://github.com/majnurangeela)

clone-bot-public's Issues

Add New Feature

Please add Scrape link form Site

Files Corrupted. Check logs

• While uploading to telegram(a gdrive link or leeching a tg file) it gave error([pyrogramEngine.py:306] - ERROR - invalid literal for int() with base 10).

• Uploading to drive working fine for both

My LOGS

• This happened after last commit.

What's the issue??

2022-05-29T09:47:50.329877+00:00 app[api]: Initial release by user [email protected]
2022-05-29T09:47:50.329877+00:00 app[api]: Release v1 created by user [email protected]
2022-05-29T09:47:50.510590+00:00 app[api]: Enable Logplex by user [email protected]
2022-05-29T09:47:50.510590+00:00 app[api]: Release v2 created by user [email protected]
2022-05-29T09:52:27.429458+00:00 app[api]: Release v3 created by user [email protected]
2022-05-29T09:52:27.429458+00:00 app[api]: Set CONFIG_FILE_URL config vars by user [email protected]
2022-05-29T09:54:55.066714+00:00 app[api]: Release v4 created by user [email protected]
2022-05-29T09:54:55.066714+00:00 app[api]: Deployed worker (d080a8ac3e02) by user [email protected]
2022-05-29T09:56:03.853871+00:00 app[api]: Scaled to worker@1:Free by user [email protected]
2022-05-29T09:56:19.137564+00:00 heroku[worker.1]: Starting process with command bash start.sh
2022-05-29T09:56:19.786192+00:00 heroku[worker.1]: State changed from starting to up
2022-05-29T09:56:20.796037+00:00 app[worker.1]: 2022-05-29 09:56:20,795 - bot - INFO - Generating BOT_STRING_SESSION
2022-05-29T09:56:20.796378+00:00 app[worker.1]: 2022-05-29 09:56:20,796 - root - WARNING - BASE_URL_OF_BOT not provided!
2022-05-29T09:56:25.356428+00:00 app[worker.1]: 2022-05-29 09:56:25,356 - bot - INFO - Creating TELEGRAPH Account using 'PWSZySbJ' name
2022-05-29T09:56:25.498780+00:00 app[worker.1]: 2022-05-29 09:56:25,498 - bot - INFO - Database Initiated
2022-05-29T09:56:33.875930+00:00 app[worker.1]: 2022-05-29 09:56:33,875 - apscheduler.scheduler - INFO - Scheduler started
2022-05-29T09:56:34.065038+00:00 app[worker.1]: 2022-05-29 09:56:34,064 - bot - INFO - Bot Started!
2022-05-29T10:23:23.938042+00:00 app[worker.1]: 2022-05-29 10:23:23,937 - bot - INFO - Processing: https://new.gdtot.re/file/1962181632
2022-05-29T10:23:31.559923+00:00 app[worker.1]: Exception in thread Thread-3 (cloneNode):
2022-05-29T10:23:31.559938+00:00 app[worker.1]: Traceback (most recent call last):
2022-05-29T10:23:31.559939+00:00 app[worker.1]: File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
2022-05-29T10:23:31.560221+00:00 app[worker.1]: self.run()
2022-05-29T10:23:31.560225+00:00 app[worker.1]: File "/usr/lib/python3.10/threading.py", line 946, in run
2022-05-29T10:23:31.560464+00:00 app[worker.1]: self._target(*self._args, **self._kwargs)
2022-05-29T10:23:31.560475+00:00 app[worker.1]: File "/usr/src/app/bot/functions/clone.py", line 172, in cloneNode
2022-05-29T10:23:31.560582+00:00 app[worker.1]: _clone(update.message, context.bot)
2022-05-29T10:23:31.560600+00:00 app[worker.1]: File "/usr/src/app/bot/functions/clone.py", line 100, in _clone
2022-05-29T10:23:31.560673+00:00 app[worker.1]: gd = GoogleDriveHelper()
2022-05-29T10:23:31.560682+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/upload/gdrive_helper.py", line 73, in init
2022-05-29T10:23:31.560766+00:00 app[worker.1]: self.__service = self.__authorize()
2022-05-29T10:23:31.560768+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/upload/gdrive_helper.py", line 591, in __authorize
2022-05-29T10:23:31.560994+00:00 app[worker.1]: credentials = pload(f)
2022-05-29T10:23:31.561012+00:00 app[worker.1]: _pickle.UnpicklingError: invalid load key, '{'.
2022-05-29T10:24:45.922146+00:00 app[worker.1]: 2022-05-29 10:24:45,921 - bot.helper.mirror.download.youtube_dl_download_helper - INFO - Downloading with YT-DLP: https://youtu.be/ho0wk1SxaKs
2022-05-29T10:24:47.424138+00:00 app[worker.1]: 2022-05-29 10:24:47,424 - bot - INFO - Download completed: The Strangest Interview Ever Ft. Varun Dhawan _ Stranger Things _ Netflix India.webm
2022-05-29T10:24:47.424252+00:00 app[worker.1]: 2022-05-29 10:24:47,424 - bot - INFO - Upload Name: The Strangest Interview Ever Ft. Varun Dhawan _ Stranger Things _ Netflix India.webm
2022-05-29T10:24:47.424326+00:00 app[worker.1]: Exception in thread Thread-5 (add_download):
2022-05-29T10:24:47.424335+00:00 app[worker.1]: Traceback (most recent call last):
2022-05-29T10:24:47.424344+00:00 app[worker.1]: File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
2022-05-29T10:24:47.424540+00:00 app[worker.1]: self.run()
2022-05-29T10:24:47.424547+00:00 app[worker.1]: File "/usr/lib/python3.10/threading.py", line 946, in run
2022-05-29T10:24:47.424688+00:00 app[worker.1]: self._target(*self._args, **self._kwargs)
2022-05-29T10:24:47.424695+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/download/youtube_dl_download_helper.py", line 202, in add_download
2022-05-29T10:24:47.424768+00:00 app[worker.1]: self.__download(link)
2022-05-29T10:24:47.424770+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/download/youtube_dl_download_helper.py", line 164, in __download
2022-05-29T10:24:47.424845+00:00 app[worker.1]: self.__onDownloadComplete()
2022-05-29T10:24:47.424852+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/download/youtube_dl_download_helper.py", line 106, in __onDownloadComplete
2022-05-29T10:24:47.424905+00:00 app[worker.1]: self.__listener.onDownloadComplete()
2022-05-29T10:24:47.424906+00:00 app[worker.1]: File "/usr/src/app/bot/functions/mirror.py", line 251, in onDownloadComplete
2022-05-29T10:24:47.424997+00:00 app[worker.1]: drive = GoogleDriveHelper(up_name, self)
2022-05-29T10:24:47.425005+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/upload/gdrive_helper.py", line 73, in init
2022-05-29T10:24:47.425059+00:00 app[worker.1]: self.__service = self.__authorize()
2022-05-29T10:24:47.425060+00:00 app[worker.1]: File "/usr/src/app/bot/helper/mirror/upload/gdrive_helper.py", line 591, in __authorize
2022-05-29T10:24:47.425194+00:00 app[worker.1]: credentials = pload(f)
2022-05-29T10:24:47.425205+00:00 app[worker.1]: _pickle.UnpicklingError: invalid load key, '{'.

Getting error on heroku

2022-08-23T12:46:28.718875+00:00 app[worker.1]: return _run_code(code, main_globals, None,
2022-08-23T12:46:28.718878+00:00 app[worker.1]: File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
2022-08-23T12:46:28.718952+00:00 app[worker.1]: exec(code, run_globals)
2022-08-23T12:46:28.718954+00:00 app[worker.1]: File "/usr/src/app/bot/main.py", line 35, in
2022-08-23T12:46:28.719019+00:00 app[worker.1]: from .helper.others.bot_utils import get_readable_file_size, get_readable_time
2022-08-23T12:46:28.719021+00:00 app[worker.1]: File "/usr/src/app/bot/helper/others/bot_utils.py", line 11, in
2022-08-23T12:46:28.719088+00:00 app[worker.1]: from async_class import AsyncClass
2022-08-23T12:46:28.719097+00:00 app[worker.1]: ModuleNotFoundError: No module named 'async_class'
2022-08-23T12:46:28.960578+00:00 heroku[worker.1]: Process exited with status 1
2022-08-23T12:46:29.008224+00:00 heroku[worker.1]: State changed from up to crashed
Autoscroll with outputSave
Blogs
Careers
2022-08-23T12:46:28.718875+00:00 app[worker.1]: return _run_code(code, main_globals, None,
2022-08-23T12:46:28.718878+00:00 app[worker.1]: File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
2022-08-23T12:46:28.718952+00:00 app[worker.1]: exec(code, run_globals)
2022-08-23T12:46:28.718954+00:00 app[worker.1]: File "/usr/src/app/bot/main.py", line 35, in
2022-08-23T12:46:28.719019+00:00 app[worker.1]: from .helper.others.bot_utils import get_readable_file_size, get_readable_time
2022-08-23T12:46:28.719021+00:00 app[worker.1]: File "/usr/src/app/bot/helper/others/bot_utils.py", line 11, in
2022-08-23T12:46:28.719088+00:00 app[worker.1]: from async_class import AsyncClass
2022-08-23T12:46:28.719097+00:00 app[worker.1]: ModuleNotFoundError: No module named 'async_class'
2022-08-23T12:46:28.960578+00:00 heroku[worker.1]: Process exited with status 1
2022-08-23T12:46:29.008224+00:00 heroku[worker.1]: State changed from up to crashed

GDTot Broken

Showing Invalid link while cloning !

Alternative

Heroku stop free service on Nov 28 . So make alternative deploy support . (like koyeb , render & etc )

Youtube playlist video is not merging

Update

Mirror and clone not working😕

Mirror and clone not working😕 fix current update please🙏

Drive cloning issue

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte. showing this message in Heroku Log while cloning Gdtot & also in Large file cloning.
how to fix this brother

Deploy on local machine

Any way to deploy on local mechanic/server?