macbre / mobify

Download a webpage as an e-book

mobify

Download a webpage as an e-book

Install

pip install mobify

You may need to run sudo apt-get install zlib1g-dev if lxml install fails (python3.4-dev package is required as well to compile lxml).

virtualenv

virtualenv --system-site-packages env3 -p python3
pip install -U -e .

For Kindle users

Your Kindle supports epub files.

Usage

mobify "http://histmag.org/william-wallace-bohater-szkotow-bohater-popkultury-11698"

Or you can render a multi-chapter ebook from several URLs (simply separate them with spaces):

mobify "http://histmag.org/william-wallace-bohater-szkotow-bohater-popkultury-11698" "http://histmag.org/Historia-Szkocji-10-dat-ktore-powinienes-znac-10028"

epub and mobi files will be saved in your working directory.

You can force a specific source to be used to parse the URL:

mobify 'https://deeplearningsandbox.com/how-to-build-an-image-recognition-system-using-keras-and-tensorflow-for-a-1000-everyday-object-559856e04699#.oqknumtc6' --source MediumSource

Debugging

Simply set DEBUG env variable to 1.

DEBUG=1 mobify ...

Supported sources

• Blogspot
• dzieje.pl
• histmag.org
• medium.com
• oreilly.com/ideas
• readthedocs.io
• Tumblr
• Wikipedia

mobify's Issues

Add wordpress.com

https://blogvigdis.wordpress.com/2017/04/24/jol-rytualne-picie-piwa-czochranie-swinskiej-siersci-i-inne-okolo-bozonarodzeniowe-tradycje-skandynawskich-pogan-w-oczach-nieco-pozniejszych-tworcow-sag/

Google SRE

https://landing.google.com/sre/book/index.html

eurosport.co.uk

http://www.eurosport.co.uk/football/premier-league/2016-2017/a-beautiful-mind-dennis-bergkamp-s-perfect-moment_sto6075276/story.shtml

Scalable and Modular Architecture for CSS

https://smacss.com/book/

histmag.org: handle references

http://histmag.org/Kolonizacja-Kanady-i-rywalizacja-Francji-z-Wielka-Brytania-5199

Exploring ES6

http://exploringjs.com/es6/index.html

Handle images

$ mobify https://en.wikipedia.org/wiki/History_of_the_Faroe_Islands

Referenced file u'/wiki/Gondalpara' not found
Referenced file u'/wiki/Template_talk%3aFaroe_Islands_topics' not found
Referenced file u'/wiki/Template%3aDanish_overseas_empire' not found
Referenced file u'//en.wikipedia.org/w/index.php%3ftitle%3dTemplate%3aEuropean_history_by_country%26action%3dedit' not found
Referenced file u'/wiki/Flag_of_the_Faroe_Islands' not found
Referenced file u'/wiki/Danish_West_Indies' not found
Referenced file u'//upload.wikimedia.org/wikipedia/commons/thumb/9/9c/Flag_of_Denmark.svg/76px-Flag_of_Denmark.svg.png' not found
Referenced file u'/wiki/Kozhikode' not found
Referenced file u'/wiki/L\xf8gting' not found
Referenced file u'/wiki/Template_talk%3aDanish_overseas_empire' not found
Referenced file u'/wiki/Coat_of_arms_of_the_Faroe_Islands' not found
Referenced file u'//en.wikipedia.org/w/index.php%3ftitle%3dTemplate%3aHistory_of_Europe%26action%3dedit' not found
Referenced file u'/wiki/Malabar_Coast' not found
Referenced file u'/wiki/Template%3aEuropean_history_by_country' not found
Referenced file u'//en.wikipedia.org/w/index.php%3ftitle%3dTemplate%3aFaroe_Islands_topics%26action%3dedit' not found
Referenced file u'//en.wikipedia.org/wiki/Special%3aCentralAutoLogin/start%3ftype%3d1x1' not found
Referenced file u'/wiki/Template%3aHistory_of_Europe' not found
Referenced file u'/wiki/Serampore' not found
Referenced file u'/wiki/Faroese_kr\xf3na' not found
Referenced file u'/wiki/Denmark' not found
Referenced file u'/wiki/Danish_Gold_Coast' not found
Referenced file u'//upload.wikimedia.org/wikipedia/commons/thumb/9/9b/Coat_of_arms_of_the_Faroe_Islands.svg/80px-Coat_of_arms_of_the_Faroe_Islands.svg.png' not found
Referenced file u'//en.wikipedia.org/w/index.php%3ftitle%3dTemplate%3aDanish_overseas_empire%26action%3dedit' not found
Referenced file u'/wiki/Tharangambadi' not found
Referenced file u'/wiki/Template_talk%3aHistory_of_Europe' not found
Referenced file u'/wiki/Template%3aFaroe_Islands_topics' not found
Referenced file u'/wiki/Nicobar_Islands' not found
Referenced file u'/wiki/\xd3lavs\xf8ka' not found
Referenced file u'/wiki/Template_talk%3aEuropean_history_by_country' not found

The Architecture of Open Source Applications

http://www.aosabook.org/en/index.html

Handle docs.docker.com

https://docs.docker.com/compose/overview/ + subpages

Historykon

• http://historykon.pl/poczet-bogow-slowianskich/
• http://historykon.pl/upadek-slawnego-kanclerza-proces-tomasza-morusa/

The Racket Guide

https://docs.racket-lang.org/guide/index.html

Handle readthedocs.io

• https://lasagne.readthedocs.io/en/latest/
• http://neural-monkey.readthedocs.io/en/latest/overview.html - handle images

epub files provided by readthedocs.io are simply too big and take long to convert to mobi:

$ ls -lh lasagne.*
-rw-r--r-- 1 macbre macbre 167K lut 10 22:10 lasagne.epub
-rw-r--r-- 1 macbre macbre 316K lut 10 22:11 lasagne.mobi

Generated by mobify:

-rw-r--r-- 1 macbre macbre  58K lut 10 22:27 latest.epub
-rw-r--r-- 1 macbre macbre 110K lut 10 22:27 latest.mobi

Tutorials on DigitalOcean

• https://www.digitalocean.com/community/tutorials/an-introduction-to-kubernetes
• https://www.digitalocean.com/community/tutorials/how-to-install-and-configure-kubernetes-on-top-of-a-coreos-cluster
• https://www.digitalocean.com/community/tutorials/an-introduction-to-big-data-concepts-and-terminology
• https://www.digitalocean.com/community/tutorials/an-introduction-to-mesosphere
• https://www.digitalocean.com/community/tutorials/how-to-install-and-manage-rabbitmq

Handle keywords

<meta name="Keywords" content="historia, artykuły, historia polski, wydarzenia, historia świata, informacje, książki, epoki historyczne, serwis historyczny, forum, portal historyczny" lang="pl" />

Learn You a Haskell for Great Good!

http://learnyouahaskell.com/chapters

dzieje.pl - add a source

• http://dzieje.pl/rozmaitosci/radio-w-poznaniu-rozpoczelo-nadawanie-90-lat-temu
• http://dzieje.pl/aktualnosci/poznan-odnaleziono-prawdopodobne-szczatki-zygmunta-goralskiego-ps-chmura
• http://dzieje.pl/aktualnosci/autonomia-woj-slaskiego-w-ii-rzeczpospolitej
• http://dzieje.pl/aktualnosci/wolne-miasto-gdansk

O'Reilly posts: add a source

https://www.oreilly.com/ideas/the-evolution-of-devops?imm_mid=0f5f78&cmp=em-webops-na-na-vlny17_nurture_em9_evolution_devops

lcamtuf.coredump.cx

http://lcamtuf.coredump.cx/postxss/

Add githubengineering.com source

https://githubengineering.com/mitigating-replication-lag-and-reducing-read-load-with-freno/

Source: histmag.org

• http://histmag.org/Niech-zyje-car-Wladyslaw-Zygmuntowicz-Cz.-3-Upadek-planow-hetmana-8449;0
• http://histmag.org/czy-brytyjczycy-zdradzili-polskich-lotnikow-slow-kilka-o-polskiej-wojennej-mitologii-11972;0
• http://histmag.org/zielona-wyspa-kazimierza-wielkiego-11848;0
• http://histmag.org/karolina-wichowska-laczka-poszukiwania-i-identyfikacja-ofiar-terroru-komunistycznego-recenzja-11986;0

https://github.com/macbre/wikisource2mobi/blob/master/convert.pl

https://github.com/booktype/ebooklib

histmag.org - new version

https://histmag.org/Maurycy-Beniowski-bunt-na-Kamczatce-13947?newsletter=true

medium.com

• https://medium.com/javascript-scene/how-one-jira-ticket-made-my-employer-1mm-month-7-metrics-that-actually-matter-ffb5b2376a6b
• https://medium.com/javascript-scene/assessing-employee-performance-1a8bdee45c1a

Support returning multiple chapters from a single URL source

http://www.oreilly.com/openbook/

• http://guide.couchdb.org/editions/1/en/index.html

Add docs.python.org

• https://docs.python.org/3/whatsnew/3.0.html
• https://docs.python.org/3/howto/pyporting.html

Add support for HarpJS books

http://odewahn.github.io/docker-jumpstart/