mkowoods / feedmyfriends Goto Github PK

http://www.radiolab.org/

What kind of back-end we're you thinking of using? I know Heroku has quite a few options available. NOSQL could also be a route to take. I enjoyed using Redis for TextThem as the whole key,value system was very easy to implement.

Develop Server Side Parser to extract some critical information from a posting:

Title, Date Posted, text from First paragraph

I would love to contribte but I'm not right sure what to code. Could you give a description of what to code or should I just do something and hope it's something you can use?

Need to decide on the appropriate Data Schema.

Important fields:

Feed ID - Should have a unique key that can be added to the url to direct link
URL ID
Up Votes/Down Votes
Tags?

What attributes should you capture?
Create Time
URL information...

What if any user access should be built in?

I hacked together a sqlalchemy (database) backend. Didn't test if it works with greenlets. All it does is "work". Just wanted to inform you if you would like to base something on it or anything (link).

Need to update code to use RQ or Celery and workers with Heroku so that the scraper and other jobs are happening in the background.

http://python-rq.org/
https://devcenter.heroku.com/articles/python-rq

should send link to parser and return link as an addition to top of feed