omygod9138 / webspider

for crawling websites

webspider

for crawling website

@param $obj : object settings for crawling
base_url : url to use for concating	| string		
url : the url to crawl			| string
keyword: keyword to find		| array
tag : specific tag to find		| array
downLoad_tag : specific download tag 	| array
page : no of page to crawl		| int
depth : how deep to crawl		| int
pagination : attr to get pagination	| array
regexp : for filter strings		| string
record: name of file to record which files have been downloaded | string
action: just get link or download(only torrent) | string

How to use

in console just type php example1.php

or

in browser path/webspider/example1.php