casprwang / sse-option-crawler

SSE 50 index options crawler 上证50期权数据爬虫

SSE Option Crawler

Run

# python3.5+
curl https://raw.githubusercontent.com/casprwang/sse-option-crawler/master/main.py | python3

Depending on your network, it might take up to a few minutes, be patient.

Output

Once finished, you will get a CSV file named sse_option_data.csv with a structure like this:

Source

Sina stock

License

MIT © Casper Wang

sse-option-crawler's Issues

连接主机报错，是否需要更新url?

链接主机报错
Traceback (most recent call last):
File "H:/cats/sina_data_service/sina-stock-crawler-master/main.py", line 96, in
date = get_expire_date(get_expire_url(date_string[:6]))
File "H:/cats/sina_data_service/sina-stock-crawler-master/main.py", line 80, in get_expire_date
with urllib.request.urlopen(url_link) as url:
File "F:\soft\anaconda\lib\urllib\request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "F:\soft\anaconda\lib\urllib\request.py", line 526, in open
response = self._open(req, data)
File "F:\soft\anaconda\lib\urllib\request.py", line 544, in _open
'_open', req)
File "F:\soft\anaconda\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "F:\soft\anaconda\lib\urllib\request.py", line 1346, in http_open
return self.do_open(http.client.HTTPConnection, req)
File "F:\soft\anaconda\lib\urllib\request.py", line 1321, in do_open
r = h.getresponse()
File "F:\soft\anaconda\lib\http\client.py", line 1331, in getresponse
response.begin()
File "F:\soft\anaconda\lib\http\client.py", line 297, in begin
version, status, reason = self._read_status()
File "F:\soft\anaconda\lib\http\client.py", line 258, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "F:\soft\anaconda\lib\socket.py", line 586, in readinto
return self._sock.recv_into(b)
TimeoutError: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应，连接尝试失败。

Demos

need to get consistent coding style