badboyback Goto Github PK

500lines

500 Lines or Less

anti-anti-spider

越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因去TX写验证码了，项目暂停）

crawler

Python爬虫相关的笔记、脚本，一些自动化获取数据的工具；微博搜索自动化爬取；股吧评论多进程高速爬取；电影自动下载等...

dingtalk-django-example

dingtalk SDK Django example

facebook-page-post-scraper

Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis

flask_yzd

京东监控，邮件提醒，轻量级Flask网站。可用作学习Flask

flightprice

监控低价机票

httpproxymiddleware

A middleware for scrapy. Used to change HTTP proxy from time to time.

ipproxytool

python ip proxy tool scrapy crawl. 抓取大量免费代理 ip，提取有效 ip 使用

magicmirror

MagicMirror² is an open source modular smart mirror platform. With a growing list of installable modules, the MagicMirror² allows you to convert your hallway or bathroom mirror into your personal assistant.

micropython-umodbus

Modbus Server / Client library for MicroPython ESP32 devices. Based on umodbus.

modbus-master-slave-for-arduino

Modbus Master-Slave library for Arduino

newspaper

News, full-text, and article metadata extraction in Python 3

proxy_pool

Python爬虫代理IP池(proxy pool)

pywebview

A lightweight cross-platform native wrapper around a webview component that allows to display HTML content in its own dedicated window

robot-weixin

wchat robot

rose-dewdrop

websocket消息发布集群 Rose&Dewdrop is a solution of websocket cluster

techxuexi-js

油猴等插件的 学习强国 js 代码 45分/天

test

thinkpython

tushare

TuShare is a utility for crawling historical data of China stocks

urlwatch

A tool for monitoring webpages for updates

urlwatch-1

wechatmomentstat

微信朋友圈简单数据分析脚本，配合WeChatMomentExport1.0使用（仅支持1.0的导出JSON）

weibo-api

对微博m站API进行封装，提供简单易用的用户接口来免登陆获取微博数据

weibo_terminater

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anythings. The Terminator

weibommmm

weibommmm2

weixin

基于aiohttp的微信公众平台开发

xx-net

a web proxy tool