learnli / capturer

capture pictures from website like sina, lofter, huaban and so on

What's Capturer

A capture tool used to capture pictures from web like Sina, LOFTER, huaban and so on.

If you have any suggestions or awesome websites of pictures want to capture, please let me know!!!

Support Websites

• Sina
• Lofter
• Toutiao
• QQZone: Need verify Captcha
• Huaban
• Vmgirls: Website upgraded
• Fabiaoqing
• telegram
• NetBian

How to use

• install python3 and libs
• update your Parameters of each kind of web
• run ./capturer or run main.py or ***_spider.py to capture images from
  • sina
  • lofter
  • toutiao
  • qqzone
  • telegram
  • netbian
• run huaban/run.py to capture images from huaban
• run vmgirls/run.py to capture images from vmgirls
• run fabiaoqing/fabiaoqing_spider.py key1 [key2] [key3] ...

Notices

Almost all of the file path based on ~/Pictures/python, ~ means home dir.

Parameters

huaban

• USERNAME: username of huaban which you want to capture
• ROOT_DIR: directories where to store the images

Sina

• uid: user-id(10 numbers) of sina weibo that you want to capture
• cookies: your cookies after login the sina weibo
• path: directory to save the pictures

Lofter

• username: username of lofter that you want to capture
• path: directory to save the pictures, see the function _get_path in lofter_spider.py
• query_number: number of blogs in each query packet, default value is 40

Telegram

• api_id: you can get from https://my.telegram.org/apps
• api_hash: you can get from https://my.telegram.org/apps
• socks proxy: set proxy ip and port, default is localhost:1080

Blogs

You can find all the relate blogs in https://www.litreily.top/tags/spider/.

• Lofter - 爬取网易LOFTER图片
• Sina - 爬取新浪微博用户图片
• qqzone - 爬取QQ空间相册
• Vmgirls - Scrapy爬取vmgirls
• Netbian - 爬取彼岸图网美图