gaoxq / sinavideo Goto Github PK
View Code? Open in Web Editor NEW调用新浪api抓取短视频数据
调用新浪api抓取短视频数据
项目的前期工作: 这次要获取微博中短视频的数据,使用微博中自带的过滤功能,只能获取视频的微博。不过无法得到视频的时间,不能得到短视频。 因此我们想到了下面的方法: 1. 首先在微博的搜索框中输入“短视频”,使用视频过滤功能。目前得到的都是时间比较短,大约在2分钟内的短视频微博。 2. 将此页面的url作为要抓取数据的首页,通过page=?设置后面要抓取数据的url。 3. 通过解析html页面,获得该页面所有微博的id。 4. 通过新浪api,得到每条微博的内容,评论,转发数,视频链接。 请先填写相关配置:在Config.properties里 client_ID :appkey client_SERCRET :app_secret redirect_URI : 回调地址
为什么我没有看到视频的链接呢,大神
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.