tristan79 / comicstreamer

ComicStreamer: ToiletStreamer Edition

ComicStream: ToiletStreamer Edition Alpha

Improved ComicStreamer!

Note: this is my personal working branch... for my Mac, I could break stuff at any time! Add hacked-in mac tested features... If something is not working fork it, fix it, pull request it! (or use the original fork :-/ :-)

With CBT, CB7 support, new alpha interface, crude caching system, and a lot of bug fixes

Experimental

MySQL support, static library only

PDF, EPUB, MOBI, AZW3, FB2, LIT, DJVU, CHM Support through calibre's ebook-convert and mupdf's mudraw and qpdf

WebComic support CBW (Hack version)... I got it to display and download CtrlAltDel :-) Currently rewritting the hack to something proper...

Help wanted (fork it pull request it!)

There is something missing... yes!

Are you are a database wizard...

• MySQL support you can not delete commics... (good for static libs if not for the previous point)

... or are you a web magician and able to fix the build in html webcomicbooks reader...

• webp support
• page chooser (slider and/or page number selection?)

...Or general web page

• Add link to result tables to the entity browser in popup
• secondary sort on table (e.g. date/year then issue)
• Fix setup stuff (redirect with restarting & resetting)

Please help!

Did I say I got stuck for a year now on MySQL and SQLAlchemy...

Work done

• Made the web hyperlinked (well somewhat)... i am missing alternative serie title... :-/ o well

Tristan79 Work on this fork (januari 31 -february 12 2017)

• EBook support (basic metadata support)
• Much better (faster) random comic query
• MySQL support (experimental, no modify!)
• Fixed bug (appartently source didn't work for months)
• Page blocker
• Added cbt/tar/webp support
• Comex was disabled, enabled!
• Patched webp (it does not load in web comic book, haven't tested chunky so converted to jpeg :/)
• Experimental Cache System (since remote storage could be slow, even usb2 vs ssd :-)
• Fixed a lot of gui bugs.
• Fixed pdf
• Fixed command line

pre alpha support for

• blacklisting
• comic identification (for finding doubles)
• favorites
• multiuser
• wake up media already when server comes out of idle to minimize wait time

Tristan79 Work on this fork (may 15 2016)

• Lot of bug fixes,
• New (tryout gui) the old gui is still there for use
• Fixes for jpg, bmp, 7z, pdf & other bugfull stuff
• Added option to have alternative mobile site for android/ipad/etc...

If you have web development or graphic design skills, and would like to help out, please contact me at [email protected].

Further ToDo! / Help Wanted!

Web Page

• search result not limited to 10/20../100
• publisher with special chars in name not recognized in entity browser
• Remove showing null comics in table
• Log should be automaticlly updated
• setup redirect with first run

Database

• Other databases backend support
• Faster (or better database, sqlalchemy wizard help needed!!!)
• New db features...
• Very large dataset sqlite will bump into locked db file

General

• Find a good epub page to png/jpg converter for ebook support (pdf works great! better then any ebook reader)
• OSX Calibre works... in remark to previous line :-) so other options/settings/windows?
• ebook caching (now it does not delete)
• Folder with images add as comic
• Create Windows & Mac packages
• Fix Cache did not work on xp :-/ (missing webp?)
• Broke monitor (check!)
• seven zip does not work on newer files not even with the github bug fixed version
• Show unscanned/error files!
• Server won't shutdown if monitor is still checking files...
• SWF support??
• PDF and Calibre converters location not working (hardcoded)
• Better cache system with preloading
• Folder list will disappear after error reading it...

OLD README.md

Work on this fork (september 5 2015)

• added webroot option to configuration, useful for proxy pass configurations (issue #24)
• little unrar automation: after pip installation, run `paver libunrar' to automatically fetch compile and install the unrar library.
• now the scanning component ignores hidden (dot) files (issue #26)
• added new logo from blindpet (issue #27)
• upgraded to latest releases of various dependent packages

Work on this fork (april 5 2015)

• refactoring database access in a Library object (see library branch)
• fulltext indexing and faceting support using whoosh (see whoosh branch)
• mobile optimized user interface based on angularjs and bootstrap. Designed to work with the new search api with facet support

All of these features are experimental and still unfinished.

---

Introduction

ComicStreamer is a media server app for sharing a library of comic files via a simple REST API to client applications. It allows for searching for comics based on a rich set of metadata including fields like series name, title, publisher, story arcs, characters, and creator credits. Client applications may access comics by entire archive file, or by fetching pag e images, one at a time.

A web interface is available for searching and viewing comics files, and also for configuration, log viewing, and some control operations.

It's best used on libraries that have been tagged internally with tools like ComicTagger or ComicRack. However, even without tags, it will try to parse out some information from the filename (usually series, issue number, and publication year).

ComicStreamer is very early ALPHA stages, and may be very flakey, eating up memory and CPU cycles. In particular, with very large datasets, filters on the sub-lists (characters, credits, etc. ) can be slow.

Chunky Comic Reader for iPad has added experimental ComicStreamer support. Pro upgrade required, but it's well worth it for the other features you get. Check it out! If you are comic reader developer (any platform), and would like to add CS support, please contact me if you need any special support or features.

---

Requirements (for running from source)

• python 2.7

(via pip):

• tornado
• sqlalchemy >= 0.9
• watchdog
• python-dateutil
• pillow (PIL fork)
• configobj >= 5.0.5
• natsort

Optional:

• pybonjour (for automatic server discovery)

---

Installation

For source, just unzip somewhere. For the binary packages, it's the usual drill for that platform. (No setup.py yet, sorry)

Settings, database, and logs are kept in the user folder:

• On Linux: "~/.ComicStreamer"
• On Mac OS: "~/Library/Application Support/ComicStreamer"
• On Windows: "%APPDATA%\ComicStreamer"

---

Running

From the source, just run "comicstreamer" in the base folder (on windows you may want to rename it comicstreamer.py).

For the binary builds, run from the installed app icon. There should be no taskbar/dock presence, but an icon should appear in the system tray (windows), or status menu (mac).

A web browser should automatically open to "http://localhost:32500". On your first run, use the "config" page to set the comic folders, and the "control" page to restart the server. It will start scanning, and all comics in the given folders and sub folders will be added to database.

Some tips:

• Use "--help" option to list command-line options
• Use the "--reset" option (CLI) or control page "Rebuild Database" to wipe the database if you're having problems.

comicstreamer's Issues

Alpha edition

Hi there.
Since I'm a complete newbie I'de rather ask if by any chance you could advise me on the best way to compile the latest alpha edition on a Mac.
Thank you!

Scanning/indexing fails with "Watchdog (BUG?)"

I have my Amazon Cloud Drive mounted to my remote server via ACD_CLI. I installed ComicStreamer, added the proper directories in settings, saved and restarted, but no scanning takes place. Instead, the monitor fails with the message "Watchdog (BUG?)."

Log excerpt:

2017-02-27 11:54:04,718 - DEBUG - Monitor: Watchdog: Stopped Indexing
2017-02-27 11:54:04,717 - INFO - Monitor: Watchdog: Indexing
2017-02-27 11:54:04,717 - DEBUG - Monitor: Watchdog (BUG?)
2017-02-27 11:54:04,693 - DEBUG - Monitor: Watchdog: Stopped Indexing
2017-02-27 11:54:04,693 - INFO - Monitor: Watchdog: Indexing
2017-02-27 11:54:04,693 - DEBUG - Monitor: Watchdog (BUG?)
2017-02-27 11:54:04,639 - DEBUG - Bonjour: Started
2017-02-27 11:54:04,638 - DEBUG - Blacklist: Started
2017-02-27 11:54:04,637 - DEBUG - Bookmark: Started
2017-02-27 11:54:04,628 - INFO - Monitor: Scanning '/xxxx/xxxx/xxxx/xxxx/xxxx/xxxx/unsorted comics'
2017-02-27 11:54:04,628 - INFO - Monitor: Scanning '/xxxx/xxxx/xxxx/xxxx/xxxx/xxxx/sorted comics'
2017-02-27 11:54:04,628 - DEBUG - Monitor: Started

This is the error I get when I try to run comicstreamer.py using python 2.7

Here's a screenshot. This window disappears immediately, so I had to have very good timing to get this screenshot. I was getting an error about Python not being able to find a module called lxml, so I looked up how to install that for Python 2.7, and it seemed to work. But now I'm getting this error. I was really hoping the program would just run...

I'm on Windows 10 Pro 64 bit

Windows build or Setup.py?

I would kill for a compiled windows exe build of this... or at least a setup.py file.
I was able to run this directly through python and it is amazing. Kudos. Would love to run it as a standalone exe on my windows machine...

All comics display logo instead of comic page

Whenever I try to read a comic, either in browser or via API on chunkyreader, I get the toilet reader brain logo instead. In the console on the server I get the following error:

"error reading in page"