cenpengzhu / spiderforbilibili

A python project which collect data from bilibili.tv

SpiderForBilibili

A python project which collect data from bilibili.tv

2017.03.09

object spider has jobs and a table

it requests at jobs and writes data back from server in table

bilibili.tv has a ip limit

each ip can send just 396 requests then you must delay about five minutes for another 396 requests

2017.03.10

they changed the ip limit to 200 times

it means you can only request 200 times for every five minutes

there may be someone watching this server and the limit times may change smaller tommorow

it is hart to collect all of the user data

this project is just for practice and learning