Coder Social home page Coder Social logo

ispider's Introduction

简单爬虫实现

使用golang实现简单的爬虫

使用cron定时爬取数据

api接口

/v1/book : 获取小说列表

/v1/book/getchapters?bookid=1&page=1 : 获取指定小说的章节,分页查询,每页10章

/v1/book/chapter?id=950 : 获取指定章节详细内容

给朋友们推荐一下最近发现的一个很好用的全球代理:SmartProxy 拥有1亿真实住宅IP资源,作为专业海外http代理商,覆盖全球城市,高匿稳定提供100%原生住宅IP,而且支持社交账户、电商平台、网络数据收集等服务。 伪装度相当高!本人测试用过之后感觉很不错。 搞跨境电商还可以用来tiktok养号,高速解决ip限制问题。 现在春季价格优惠,动态住宅代理只要65折!

image

点我加入 https://www.smartproxy.cn

邀请码:B6V9HW

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.