ringtail / pansidong

pansidong(盘丝洞）is a proxy ips' store service.

pansidong

pansidong(盘丝洞）is a proxy ips' store service. pansidong is another name of Cave of the Silken Web. In the movie, There are lots of little spiders in pansidong. Sometimes we want to scrapy pages using web spiders. But it is a game between crawler and anti crawler.Proxy ips are the best solution to do with it.

Fortunatly,there are many free proxy ip provider on the internet. pansidong try to provide a store and standard api to help crawler developers focusing on developing instead of collection free ips.

You can set up pansidong as a microservice and allocate every request a single proxy ip.

Architecture

hmm ...

I found this one (https://github.com/henson/proxypool), pretty cool !

License

This software is released under the Apache 2.0 license.

pansidong's Issues

This repo has not been maintained for a long tim， Consider moving to go modules？

go: finding module for package github.com/virtual-kubelet/virtual-kubelet/providers/aliyun/ingress/errors
github.com/ringtail/pansidong/cache imports
github.com/virtual-kubelet/virtual-kubelet/providers/aliyun/ingress/errors: module github.com/virtual-kubelet/virtual-kubelet@latest found (v1.2.1), but does not contain package github.com/virtual-kubelet/virtual-kubelet/providers/aliyun/ingress/errors

issue

what is version of github.com/virtual-kubelet ? I can not find out 。