A Python Based Crawler written in Django(UI).๐
-
Project was developed under
Cyber Peace Foundation
the abstract of this project was do analysis on live streamed "TikTok" data for we called an Api (TikTok-Api).
-
The project is fully written in Djang-Framework (UI).
-
- As we all know lot's of good things about the Django-Framework as it works on Python, we can create a complete project envirnoment with django.
-
- I nothing used like
Scapy
,BeautifulSoap
or other, as we know this was an prototype of our ideology so We wanted to implements our idea behind this project.
- I nothing used like
-
- I added some interesting features like :
- Fetch Raw data from Tiktok Server.
- Trending Feeds
- Comments
- Public profiles
- Trending Videos url
- Descriptions etc.
- I added some interesting features like :
-
Setting up environment : Follow the complete tutorial for Django here
-
- On Windows Download Binary Executable file from it's official website Docs.Djangoproject.com.
- Add this
C:\Python34\;C:\Python34\Scripts;
PATH In system environment.
-
- Install latest version of setuptool from SetupTool
-
- Open a command prompt and execute easy_install pip. This will install pip on your system. This command will work if you have successfully installed Setuptools.
-
pip install django
- Run this command in cmd
django-admin --version
-
- set http_proxy=http://username:password@proxyserver:proxyport
- set https_proxy=https://username:password@proxyserver:proxyport
-
-
- git clone https://github.com/Hack3rOneness/TikTok_Crawler.git
- cd TikTok_Crawler
- cd TikTok-Api
- build setup.py
- cd ../
- python manage.py runserver
- Open browser enter this address localhost : http://127.0.0.1:8000 localhost you must see the complete project.
- Thia project is lacking from some latest technologies like AI, ML and Big Data.
- Will conclude these technologies in thia project in coming days.
- We're open this project to all anyone can contribute!