evilhero / mylar Goto Github PK

On the detailed title page when you change a single comic from Skipped to Wanted, the message "There is a error" appears. After refreshing the page however, one sees that the issue is changed to wanted.

Hi evilhero,

I wanted to point your attention to "Avengers". If you do a search for Avengers, a few pages into the search is Avengers (2010) ComicID=33227. I searched for Avengers, expecting to find another Error like Fantastic Four. However, this search gives a desired result. Granted this Avengers starts with 2010 to present, but that's what I wanted, recent and upcoming comics. I mention it in case it provides some clues in getting better results from other long, multi-rebooted titles.

I'm getting the yellowish square in the lower right saying I'm two commits behind, however if I click update on it (which has always worked in the past) it goes and looks like it's updating (resetting etc.) and then comes back to the main page with the yellowish square still in the lower right. I've tried shutting down Mylar and restarting the program then doing the updating to try to cure any file-locks (I haven't rebooted the whole server yet as it does other, more critical functions but can tonight if desired)

The version it reports I'm on at the bottom of each page is: "6854500a6e9ee11fe1c52a7e592906a45a994c55"

This is probably easier and less frustrating for most - have all the comics that are having problems adding via search be in one thread.

List the comics, with what you see listed for year/# of issues in Mylar when searching. If you want to be proactive, jump to GCD (comics.org) and see what they say for the same title and throw it in here in addition :)

Most likely these will have to be special exceptions in order for the additions to take place successfully.

Thus far these comics are having issues (I know there are more, but can't recall atm):

Fantastic Four (1961) - CV states 517, GCD states 416.

Witchblade (1995) - CV states 162, GCD states 160.

Adventure Time: Marceline Scream Queens (2012) - CV has 'Marceline Scream Queens', GCD has 'Marceline and the Scream Queens'

I mentioned this previously, and you were able to point me in the right direction on what to look for in getting additional logging info. I have no skill, but I modified the mylar/parsit.py file by changing a lot of your commented "print" lines to logger entries. I found out that a comic released in November or December (e.g. 2011) may likely get named with the following year (e.g. 2012) in it's title. Here's some info:

2012-10-04 09:44:39 INFO Couldn't find Issue 4 of Batgirl(2011). Status kept as wanted.
2012-10-04 09:44:36 INFO Shhh be very quiet...I'm looking for Batgirl issue: 4.00 using nzb.su
2012-10-04 09:44:36 INFO More than one search provider given - trying next one.
2012-10-04 09:44:25 INFO Shhh be very quiet...I'm looking for Batgirl issue: 4.00 using dognzb
2012-10-04 09:44:25 INFO More than one search provider given - trying next one.
2012-10-04 09:44:25 INFO MysterBin FINAL: Batgirl_01_(2011)_(GreenGiant-DCP).cbr"
2012-10-04 09:44:25 INFO MysterBin exit mainloop
2012-10-04 09:44:25 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=59308042
2012-10-04 09:44:25 INFO I found 1 results doing my search...now I'm going to analyze the results.
2012-10-04 09:44:24 INFO MysterBin input: http://www.mysterbin.com/advsearch?q=Batgirl%204%20+2011&match=normal&minSize=9&maxSize=75&group=alt.binaries.comics.dcp&maxAge=1269&complete=2
2012-10-04 09:44:24 INFO MysterBin FINAL: Batgirl 020 (2011) (c2c) (Oroboros-CPS).cbr"
2012-10-04 09:44:24 INFO MysterBin exit mainloop
2012-10-04 09:44:23 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=40492604
2012-10-04 09:44:23 INFO MysterBin exit mainloop
2012-10-04 09:44:23 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=40492605
2012-10-04 09:44:23 INFO MysterBin exit mainloop
2012-10-04 09:44:23 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=40520860
2012-10-04 09:44:23 INFO MysterBin exit mainloop
2012-10-04 09:44:23 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=41046577
2012-10-04 09:44:23 INFO MysterBin exit mainloop
2012-10-04 09:44:22 INFO MysterBin nzb-link: http://www.mysterbin.com/nzb?c=41408248
2012-10-04 09:44:22 INFO I found 5 results doing my search...now I'm going to analyze the results.
2012-10-04 09:44:20 INFO MysterBin input: http://www.mysterbin.com/advsearch?q=Batgirl%2004%20+2011&match=normal&minSize=9&maxSize=75&group=alt.binaries.comics.dcp&maxAge=1269&complete=2
2012-10-04 09:44:20 INFO I found 0 results doing my search...now I'm going to analyze the results.
2012-10-04 09:44:19 INFO MysterBin input: http://www.mysterbin.com/advsearch?q=Batgirl%20004%20+2011&match=normal&minSize=9&maxSize=75&group=alt.binaries.comics.dcp&maxAge=1269&complete=2
2012-10-04 09:44:19 INFO Shhh be very quiet...I'm looking for Batgirl issue: 4.00 using experimental
2012-10-04 09:44:19 INFO Marking Batgirl issue: 4.00 as wanted...

The three digit issue search works if the year is changed to 2012. So instead of:
http://www.mysterbin.com/advsearch?q=Batgirl%20004%20+2011&match=normal&minSize=9&maxSize=75&group=alt.binaries.comics.dcp&maxAge=1269&complete=2
Which finds nothing.

http://www.mysterbin.com/advsearch?q=Batgirl%20004%20+2012&match=normal&minSize=9&maxSize=75&group=alt.binaries.comics.dcp&maxAge=1269&complete=2
Finds several good candidates.

Not sure how to solve programatically, but I hope this sample info helps.

Thanks again!

First of all, thanks for this! Woo woo! Love it! Where do I donate?

Trying to add "Fantastic Four". When I search for it, there is a search result for Fantastic Four (1963) with like 571 issues. However it never loads correctly after I add it. A page loads with the comicvine number but it never populates with the info on the comic. Says Error. Here is the log. Note that I deleted it, then restarted, then tried to add it again:

Timestamp Level Message
2012-09-23 16:48:06 WARNING No matching result found for Fantastic Four (1961)
2012-09-23 16:47:53 INFO Now adding/updating: Fantastic Four
2012-09-23 16:45:40 INFO Deleting all traces of Comic: Comic ID: 2045
2012-09-23 16:44:52 INFO Starting Mylar on port: 8090
2012-09-23 16:44:51 INFO Mylar is up to date
2012-09-23 16:44:51 INFO Comparing currently installed version with latest github version
2012-09-23 16:44:50 INFO Retrieving latest version information from github
2012-09-23 16:44:50 INFO Checking to see if the database has all tables....

Forgive me if I'm being stupid, I tried reading the other bug reports and within the script itself and I'm just not getting it. (I've successfully set up CouchPotato, and Sickbeard as well as another show torrenting software written by a friend so I'm not a complete newb to this)

First my system setup:
Ubuntu Server x64 12.04
Directory where I want comics to end up /mnt/samba/Comics/<title>
Directory containing Mylar: /home/bjames/mylar
Sabnzbd scripts directory (I had to create this, pointed Sab at it): /home/bjames/sabnzbd/scripts
Within the scripts dir I did a symlink to /home/bjames/mylar/sabnzbd/ComicRN.py just to make life easier to manage. Permissions on symlink are 777
Sabnzbd group is comics with directory being /mnt/samba/Comics/mylar
ComicRN.py reports in the text that version is 1.02.a (I saw some confusion as to if this is the current version or not)
Comdir = '/mnt/samba/Comics/'
mylaron = "yes"
repblank = "no"
remcrap = "yes"
comicyearopt = "yes"
zerosup = "2"

Sabnzbd is download the files and they are ending up in /mnt/samba/Comics/Mylar with each issue having it's own folder as shown:

/mnt/samba/Comics/mylar$ ls
Green Lantern New Guardians 6 (2011) (2012) Justice League 6 (2011) (2012)
Green Lantern New Guardians 8 (2011) (2012) Justice League 7 (2011) (2012)
Justice League 10 (2011) (2012) Justice League 8 (2011) (2012)
Justice League 11 (2011) (2012) Justice League 9 (2011) (2012)

Justice League 5 (2011) (2012)

Maybe my expectations are off, but I'd expect on the /mnt/samba/Comics to see for the 2 examples above a directory for Green Lantern New Guardians and Justice League with each individual title below that (possibly with a year directory then the individual issues)

have made fix but cant commit.

Disregard: fixed. I had accidentally misspelled destination.

"23-Sep-2012 16:58:42 - INFO :: Thread-15 : Directory successfully created at: '/home/misterfantastic/Dropbox/Comics/FF (2011)"

No, actually, there is nothing by that name in my dropbox!

Whenever I click "want" on any comic on the weekly pull list i get an "There was an error" and the following traceback:

Traceback (most recent call last):
  File "/volume1/homes/admin/mylar/cherrypy/_cprequest.py", line 645, in respond
    response.body = self.handler()
  File "/volume1/homes/admin/mylar/cherrypy/lib/encoding.py", line 188, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/volume1/homes/admin/mylar/cherrypy/_cpdispatch.py", line 29, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/volume1/homes/admin/mylar/mylar/webserve.py", line 232, in queueissue
    issues = myDB.action("SELECT IssueDate FROM issues WHERE IssueID=?", [IssueID]).fetchone()
UnboundLocalError: local variable 'myDB' referenced before assignment

If the user searches for a comic with a lot of search results, multiple pages are returned. If he navigates through the pages of results, then clicks a title, he is taken to the comic vine listing. If he clicks back, he finds himself back at the first page of search results. It might be good if the comicvine page opened in a new window, as it can be annoying to have to navigate through the pages of search results. That or maybe have it working so when you click the Back button, you're returned to the page of search results you were on.

Try to add "Avenging Spider-Man" from either the Pull list or the direct search box.

It is found initially, but won't get issue information.

12-Sep-2012 21:11:20 - INFO :: Thread-15 : Now adding/updating: Avenging Spider-Man
12-Sep-2012 21:11:25 - WARNING :: Thread-15 : No matching result found for Avenging Spider-Man (2011)

A few other series with the same 'spinning' behavior that never completes and the same log error:
"New Avengers", "AvX VS", "Fantastic Four", "Witchblade"

First let me say I'm not a programmer but I'll help with anything I can

I set mylar up on 2 different servers, Server A is also running CP, and SB. Settings in Mylar are identical (except in both instances SABnzbd+ is on the local machine. Even the NZB.su accounts are the same.

On server A books are being found and handed off to SABnzbd+ without a hitch, but that server is far away and slow so I set up Server B which is in my home with Mylar, thought I duplicated all the Mylar settings but B's logs are giving me entries like this:
2012-10-01 14:50:03 INFO Updating complete for: Worlds' Finest
2012-10-01 14:50:03 INFO I've found 0 / 6 issues.
2012-10-01 14:50:02 INFO Now checking files for Worlds' Finest (2012) in /mnt/samba/Comics/Worlds' Finest (2012)

I've even run the side by side against books I KNOW were downloaded on Server A and they're failing on B.

_Update_***
A restart of Mylar resolved this issue. Been working in IT 10+ years and didn't think to try that, shame on me. marking ticket closed

I just updated to the latest version and I am now getting this error when I launch.

Traceback (most recent call last):
File "C:\Mylar\mylar\Mylar.py", line 24, in
from mylar import webstart, logger
File "C:\Mylar\mylar\mylar\webstart.py", line 23, in
from mylar.webserve import WebInterface
File "C:\Mylar\mylar\mylar\webserve.py", line 49, in
class WebInterface(object):
File "C:\Mylar\mylar\mylar\webserve.py", line 315, in WebInterface
manageAlbums.exposed = True
NameError: name 'manageAlbums' is not defined

I am running Win 7 and Python 2.7. I even tried deleting and recreating the folder with the same result.

On the "Weekly pull list" I select all comics, try to change their status to "wanted" in the pulldown list and I get a banner saying "You didn't select any issues". Same thing happens to me no matter how many issues I select, or which status I choose.

No log info on this in the program.

Same thing in other comics lists, like "Wanted" list, but in this case the program logs (all comics selected, tried to change the status to downloaded and then to skipped, getting the "You didn't select any issues"):

2012-09-10 14:05:16 INFO Marking Action Comics 1.00 as Downloaded
2012-09-10 14:05:14 INFO Marking Action Comics 1.00 as Skipped

Version 9386f65

Certainly no big deal at all, but Mylar is reporting correctly that comics have been "snatched", but in fact they've been more than snatched, they have been downloaded. I would have expected the status on the comics' pages to say "downloaded". I just throught I would mention it in case this was unintended behavior. Presumably works just fine as is.

It seems Mylar won't allow my folder structure. I thought originally it was due to the publisher folder, but then I realized it doesn't let me save the destination due to the spaces.

For example D:\Ecomics\DC Comics\Action Comics (2011) and D:\Ecomics\Action Comics (2011) don't save when you try to save the path under the individual comics.

Running latest git on Win 7.
When I told Mylar my default path was D:\Ecomics it used this for the path for Action Comics
D:\Ecomics\Action_Comics_(2011)

When trying to add some comics, the info for the comic itself (main cover, publisher, # of issues, etc.) will download, but none of the actual issues do ("No issue information available").

The only error is in the command line:

10-Sep-2012 04:29:44 - INFO :: Thread-12 : Now adding/updating: Grimm Fairy Tales
ID: /series/23514/
10-Sep-2012 04:29:53 - INFO :: Thread-12 : Sucessfully retrieved details for Grimm Fairy Tales
10-Sep-2012 04:29:53 - INFO :: Thread-12 : Directory successfully created at: C:\Users\nick\Documents\Comics/Grimm_Fairy_Tales_(2005)
10-Sep-2012 04:29:54 - INFO :: Thread-12 : Sucessfully retrieved issue details for Grimm Fairy Tales
Exception in thread Thread-12:
Traceback (most recent call last):
  File "C:\Python27\lib\threading.py", line 551, in __bootstrap_inner
    self.run()
  File "C:\Python27\lib\threading.py", line 504, in run
    self.__target(*self.__args, **self.__kwargs)
  File "C:\Users\nick\WebSpace\git\mylar\mylar\importer.py", line 150, in addComictoDB
    firstval = issued['issuechoice'][n]
IndexError: list index out of range

So far it's looking better everyday. Great Job! I tried to use omniverse back when it was first released and I must say you are miles ahead of what omniverse was. Anyway I keep getting these for specific comics. The walking dead is working beautifully though.

WARNING No matching result found for The Guild (2010)
WARNING No matching result found for Buffy the Vampire Slayer Season Nine (2011)
WARNING No matching result found for Adventure Time: Marceline Scream Queens (2012)

I have added a few popular comics, so I'm certain they exist!

Mylar loads them and all the issues appear as wanted.
Mylar seems to create directories for the comic titles in the destination folder.
However, Sabnzbd never does anything.

Could be related to these errors: #23

SOLUTION: DISCOVERED THAT MYLAR DEFAULTS TO "HTTP" PROTOCOL FOR SABNZBD LOCATION, HOWEVER MY SAB IS SET UP FOR "HTTPS". CHANGING THIS IN THE MYLAR CONFIGURATION SOLVED THE ISSUE.

It looks like the ComicRN.py is creating folders only based on the filename rather than finding the comic book's base year.

       Mylar - ComicRenamer Script - v1.02.a

settings confirmation

Mylar enabled: yes
Append SeriesYear/ComicYear to folder/filename : yes
Comic Directory : /media/books/comics/
Zero supression set to : 2 digits
Replace Spaces enabled : no

Remove extra stuff : yes

passed name from SAB: Justice League 000 (2012) (4 covers) (digital-TheGroup)
actual name with issue: Justice League 000
actual year of series (passed from SAB): 2012
year of publication of this issue (passed from SAB): (4 covers) (digital-TheGroup)
the comic issue is actually: # 000
comyx: Justice League
issue detected less than 10
000...zeroadd level set to:00
The directory should be: /media/books/comics/Justice League (2012)
filename should be: Justice League 000 (4 covers) (digital-TheGroup)
Directory doesn't exist!
Directory successfully created at: /media/books/comics/Justice League (2012)
Found: Justice League 000 (2012) (4 covers) (digital-TheGroup).cbr
--New filename: Justice League 000 (4 covers) (digital-TheGroup).cbr
Removed useless directory: /media/books/comics/Justice League 000 (2012) (4 covers) (digital-TheGroup)

A couple of things I've noticed with the script.

repwith variable is not used as the '_' is hardcoded. This causes issues when repblank is set to "no". Essentially, the script runs all the way through to creating the directory and then skips to the end. It doesn't move the renamed comic to the folder.

Possibly due to this line?
confile = filename.replace(' ','_')

That string is used to compare against the comic name and because one will have blanks and the other not, it skips by this step

Please review this urgent screenshot: http://farm9.staticflickr.com/8316/8050727192_20c4aaa439.jpg

(I should note I'm running this on an Ubuntu server, using Sabnzbd script, and final destination is folder within my dropbox folder)

I'm seeing errors in the Terminal window that aren't in the log file or web interface log:

23-Sep-2012 16:58:35 - INFO :: Thread-15 : Now adding/updating: FF
23-Sep-2012 16:58:42 - INFO :: Thread-15 : Sucessfully retrieved details for FF
23-Sep-2012 16:58:42 - INFO :: Thread-15 : Directory successfully created at: '/home/misterfantastic/Dropbox/Comics/FF (2011)
23-Sep-2012 16:58:43 - INFO :: Thread-15 : Sucessfully retrieved issue details for FF
23-Sep-2012 16:58:43 - INFO :: Thread-15 : Now adding/updating issues forFF
23-Sep-2012 16:58:43 - INFO :: Thread-15 : Checking directory for existing issues.
23-Sep-2012 16:58:46 - INFO :: Thread-15 : Now checking files for FF (2011) in '/home/misterfantastic/Dropbox/Comics/FF (2011)
Exception in thread Thread-15:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 504, in run
self.__target(_self.__args, *_self.__kwargs)
File "/home/misterfantastic/.mylar/mylar/importer.py", line 268, in addComictoDB
updater.forceRescan(comicid)
File "/home/misterfantastic/.mylar/mylar/updater.py", line 140, in forceRescan
reiss = reissues[n]
IndexError: list index out of range

23-Sep-2012 17:00:03 - INFO :: Thread-16 : Shhh be very quiet...I'm looking for Daredevil issue: 1.00 using nzb.su
linkstart:http://nzb.su/getnzb/e51dbad752d805455738e5616c903ecd
savefile:/home/misterfantastic/.mylar/cache/e51dbad752d805455738e5616c903ecd.nzb
retrieved file
Exception in thread Thread-16:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 504, in run
self.__target(_self.__args, *_self.__kwargs)
File "/home/misterfantastic/.mylar/mylar/search.py", line 555, in searchforissue
foundNZB = search_init(result['ComicName'], result['Issue_Number'], str(ComicYear), comic['ComicYear'])
File "/home/misterfantastic/.mylar/mylar/search.py", line 81, in search_init
findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, nzbprov, nzbpr)
File "/home/misterfantastic/.mylar/mylar/search.py", line 410, in NZB_SEARCH
file = urllib2.urlopen(sabqstatusapi);
File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
return _opener.open(url, data, timeout)
File "/usr/lib/python2.7/urllib2.py", line 406, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 519, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 444, in error
return self._call_chain(_args)
File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain
result = func(_args)
File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 401: Unauthorized

The current search and update engine comicvine.com doesn't contain all prefered commics. Therefore it would be nice if other search engines could be used. Preparing the code for this will facilitate the implementation later on.This will also make it possible for other users to write search engines on their on without major code changes.

Possible future search engine once the API is implemented: http://www.comics.org/

I am getting the following when trying to add All-Star Western.

2012-09-16 19:28:57 WARNING No matching result found for All-Star Western (2011)
2012-09-16 19:28:47 INFO Now adding/updating: All-Star Western

and then it never pulls down any info but leaves the comic in the list with the spinning pinwheel, it would be nice if would notify of the error on the homepage.

It would be great if there were test buttons for things like making sure Sab API and directory are correct, etc.

http://farm9.staticflickr.com/8035/8051893049_928115c25f.jpg

my setup appears to have downloaded most comics, but not all were copied. Any idea? note the strange message "Directory exists!" In the instance of the comic shown, only 2 of the 11 or 12 comics made it into the destination, a dropbox folder.

I've tried adding many comics and all I ever get is '(Comic information for this comic is currently being loaded)' and the spinning pinwheel, no publisher, comic name, year, or number of issues. I removed everything reinstalled and this time rather that running from rc.d I ran it from the command line.

I added a comic and the logs it shows:
2012-09-10 00:41:59 INFO Sucessfully retrieved details for The Walking Dead
2012-09-10 00:41:35 INFO Now adding/updating: The Walking Dead[/code]

But in the command line I get
10-Sep-2012 00:41:35 - INFO :: Thread-12 : Now adding/updating: The Walking Dead
ID: /series/54868/
ID: /series/40361/
ID: /series/15174/
10-Sep-2012 00:41:59 - INFO :: Thread-12 : Sucessfully retrieved details for The Walking Dead
Exception in thread Thread-12:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 552, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 505, in run
self.__target(_self.__args, *_self.__kwargs)
File "/home/ben/.mylar/mylar/importer.py", line 108, in addComictoDB
except OSError.e:
AttributeError: type object 'exceptions.OSError' has no attribute 'e'

Hope this info helps.

I think my issue is somewhat similar to #37 but slightly different:

Mylar seems to work as expected and it actually reports that found and sent the nzb to SAB:
<...>
07-Out-2012 18:04:45 - INFO :: CP Server Thread-11 : Found Queen Sonja (2012) issue: 27 using nzb.su
07-Out-2012 18:04:46 - INFO :: CP Server Thread-4 : Successfully sent nzb file to SABnzbd
<...>

But for some reason SAB complains about the nzb files sent by Mylar:
<...>
2012-10-07 18:05:20,022 WARNING: Empty NZB file 586e1c297f365c9d2667efc0eaa34427.nzb
2012-10-07 18:05:17,954 WARNING: Empty NZB file 28ec2d2edd571e182e35f4a3ef4c5f7c.nzb
2012-10-07 18:05:15,242 WARNING: Empty NZB file 818ffd975fbb8313b4d02cb492d4a944.nzb
2012-10-07 18:04:55,408 WARNING: Empty NZB file 8058493862fd17422d4d878218baa24d.nzb
2012-10-07 18:04:49,776 WARNING: Empty NZB file 1429be8d1f75c8b091afc6369681e8d3.nzb
<...>

Sickbeard and Couchpotato are working fine and sending files normally to SAB.
All apps running at the same machine
Mylar is updated:
<...>
07-Out-2012 17:49:53 - INFO :: MainThread : Retrieving latest version information from github
07-Out-2012 17:49:55 - INFO :: MainThread : Comparing currently installed version with latest github version
07-Out-2012 17:49:58 - INFO :: MainThread : Mylar is up to date
07-Out-2012 17:49:58 - INFO :: MainThread : Starting Mylar on port: 8090
<...>

Not sure if there is at the moment any known limitation in sending nzb directly to SAB. Using a blackhole seems to work...

One more time: Excellent work so far with this app. I'm sure you are making lots of people's dreams come true (mine included) :)

Can we please enable API on this (like the way it works with headphones, etc...). This enables 3rd party apps like NZBUnity (http://livingtype.com/?cat=3) to manage the collection from portable devices like mobile phones.

Should read "There is an error".

Not trying to nitpick, just trying to document bugs for you future fixes!

Thanks for getting me back to partially fixed!

I have figured out where things break down, step-wise, anyway:

1. Change comic to wanted (check)
2. Mylar sends nzb to Sab and properly names comic (check)
3. ComicRN or Mylar creates directory in designated destination folder (check)
4. Sab downloads comic to comic directory (check)
5. ComicRN.py or Mylar moves comic to designated destination directory (fail)
6. ComicRN.py removes "useless directory" (fail)
7. ComicRN.py reports that it removed "useless" directory (check)

I peeked into the designated Sab "comic" directory and the comic titles are in there, just not moved!

Terminal log:

01-Oct-2012 17:31:29 - INFO :: CP Server Thread-6 : Retrieving latest version information from github 01-Oct-2012 17:31:29 - INFO :: CP Server Thread-6 : Comparing currently installed version with latest github version 01-Oct-2012 17:31:30 - INFO :: CP Server Thread-6 : Mylar is up to date 01-Oct-2012 17:31:53 - INFO :: CP Server Thread-2 : Marking The Shadow issue # 5.00 as skipped... 01-Oct-2012 17:31:58 - INFO :: CP Server Thread-2 : Marking The Shadow issue: 5.00 as wanted... 01-Oct-2012 17:31:59 - INFO :: CP Server Thread-2 : Shhh be very quiet...I'm looking for The Shadow issue: 5.00 using experimental 01-Oct-2012 17:32:00 - INFO :: CP Server Thread-2 : I found 0 results doing my search...now I'm going to analyze the results. 01-Oct-2012 17:32:01 - INFO :: CP Server Thread-2 : I found 1 results doing my search...now I'm going to analyze the results. 01-Oct-2012 17:32:02 - INFO :: CP Server Thread-2 : I found 1 results doing my search...now I'm going to analyze the results. 01-Oct-2012 17:32:02 - INFO :: CP Server Thread-2 : More than one search provider given - trying next one. 01-Oct-2012 17:32:02 - INFO :: CP Server Thread-2 : Shhh be very quiet...I'm looking for The Shadow issue: 5.00 using nzb.su 01-Oct-2012 17:32:05 - INFO :: CP Server Thread-2 : Couldn't find Issue 5 of The Shadow(2012). Status kept as wanted. 01-Oct-2012 17:33:38 - INFO :: CP Server Thread-9 : Marking Daredevil 18.00 as Skipped 01-Oct-2012 17:34:42 - INFO :: CP Server Thread-10 : Marking Daredevil issue: 18.00 as wanted... 01-Oct-2012 17:34:42 - INFO :: CP Server Thread-10 : Shhh be very quiet...I'm looking for Daredevil issue: 18.00 using experimental 01-Oct-2012 17:34:43 - INFO :: CP Server Thread-10 : I found 1 results doing my search...now I'm going to analyze the results. 01-Oct-2012 17:34:43 - INFO :: CP Server Thread-10 : Found Daredevil (2012) issue: 18 using experimental 01-Oct-2012 17:34:44 - INFO :: CP Server Thread-10 : Sucessfully retrieved nzb file using experimental 01-Oct-2012 17:34:58 - INFO :: CP Server Thread-10 : Successfully sent nzb file to SABnzbd 01-Oct-2012 17:35:08 - INFO :: CP Server Thread-10 : Renamed nzb file in SABnzbd queue to : Daredevil 18 (2011) (2012) misterfantastic@RobbieTheRobot:~/.mylar$

ComicRN.py report in Sab note these are from different comics but you get the idea:

Mylar - ComicRenamer Script - v1.02.a

settings confirmation

Mylar enabled: yes
Append SeriesYear/ComicYear to folder/filename : yes
Comic Directory : /media/DATA/sab/complete/comics/
Zero supression set to : 2 digits
Replace Spaces enabled : no

Remove extra stuff : yes

passed name from SAB: Batman Beyond Unlimited 8 (2012) (2012)
actual name with issue: Batman Beyond Unlimited 8
actual year of series (passed from SAB): 2012
year of publication of this issue (passed from SAB): (2012)
the comic issue is actually: # 8
comyx: Batman Beyond Unlimited
issue detected less than 10
008...zeroadd level set to:00
The directory should be: /media/DATA/sab/complete/comics/Batman Beyond Unlimited (2012)
filename should be: Batman Beyond Unlimited 008 (2012)
Directory doesn't exist!
Directory successfully created at: /media/DATA/sab/complete/comics/Batman Beyond Unlimited (2012)
Found: Batman Beyond Unlimited 008(2012)(FB-DCP)(C2C).CBR
--New filename: Batman Beyond Unlimited 008 (2012).cbr
Removed useless directory: /media/DATA/sab/complete/comics/Batman Beyond Unlimited 8 (2012) (2012)

Enhancement request:

Can we please have a way to manually run the rename script from within Mylar? Like the way you can in SickBeard.

Comics were mostly downloading hunky dory as of this morning. Tonight, after installing prompted updates, Sabnzbd si reporting weird errors for each comic and while folders are being created, comics aren't being put in them. In the Sabnzbd list they are just strings of numbers, not names of comics. There is nothing at all in the mylar logs beyond checking for new version. Here is one of the errors from Sab:

Mylar - ComicRenamer Script - v1.02.a

settings confirmation

Mylar enabled: yes
Append SeriesYear/ComicYear to folder/filename : yes
Comic Directory : /media/DATA/sab/complete/comics/
Zero supression set to : 2 digits
Replace Spaces enabled : no

Remove extra stuff : yes

passed name from SAB: 79339197
actual name with issue: 7933919
actual year of series (passed from SAB): 933919
year of publication of this issue (passed from SAB): 9339197
the comic issue is actually: #
comyx: 793391
Traceback (most recent call last):
File "/home/misterfantastic/.sickbeard/autoProcessTV/ComicRN.py", line 153, in
if int(comiss) < 10:
ValueError: invalid literal for int() with base 10: ''

Also, mylar would pause sab, load up these nzb's, then never unpause sab. Crash at that point, maybe?

Noticed this one while searching for Unwritten 32.5 and 31.5:

Exception in thread Thread-13:
Traceback (most recent call last):
File "C:\Python27\lib\threading.py", line 552, in __bootstrap_inner
self.run()
File "C:\Python27\lib\threading.py", line 505, in run
self.__target(_self.__args, *_self._kwargs)
File "C:\Users\Administrator\Desktop\mylar\mylar\search.py", line 555, in sear
chforissue
foundNZB = search_init(result['ComicName'], result['Issue_Number'], str(Comi
cYear), comic['ComicYear'])
File "C:\Users\Administrator\Desktop\mylar\mylar\search.py", line 81, in searc
h_init
findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, nzbprov,
nzbpr)
File "C:\Users\Administrator\Desktop\mylar\mylar\search.py", line 323, in NZB
SEARCH
if int(findcomiciss[findloop]) == int(comiss):
ValueError: invalid literal for int() with base 10: '032.5'

For the record, both issues are on nzb.su. Probably not a huge priority at the moment! :)

2012-09-29 09:23:46 WARNING No matching result found for Uncanny X-Men (1981)

I've got Mylar setup and working, it's pulling down books for me, however it occasionally gets hung up on one book (not always the same) and won't check for anything else.

I'm not a programmer, however my guess is that it's not finding a copy to download and will keep looking forever (unless I go in and change it to skipped) Is there a way to put a counter in where it tries to find a book for 3 tries, then gives up and moves on to the next one until the next search for the whole list?

In the logs below it tried to find a book (Aquaman1 from the re-release last year) for over 7 hours and never moved on, however as soon as I marked it as skipped it then went on to try to find Aquaman 2)
Relevant logs:
2012-10-02 08:26:31 INFO Shhh be very quiet...I'm looking for Aquaman issue: 2.00 using nzb.su
2012-10-02 08:26:23 INFO Marking Aquaman 1.00 as Skipped
2012-10-02 07:45:54 INFO Mylar is up to date
2012-10-02 07:45:54 INFO Comparing currently installed version with latest github version
2012-10-02 07:45:53 INFO Shhh be very quiet...I'm looking for Aquaman issue: 1.00 using nzb.su
2012-10-02 07:45:53 INFO Retrieving latest version information from github
2012-10-02 01:45:54 INFO Mylar is up to date
2012-10-02 01:45:54 INFO Comparing currently installed version with latest github version
2012-10-02 01:45:53 INFO Shhh be very quiet...I'm looking for Aquaman issue: 1.00 using nzb.su
2012-10-02 01:45:53 INFO Retrieving latest version information from github

I've added a couple of comics, and every time the search is triggered I get this:

Exception in thread Thread-17:
Traceback (most recent call last):
File "C:\Python27\lib\threading.py", line 552, in __bootstrap_inner
self.run()
File "C:\Python27\lib\threading.py", line 505, in run
self.__target(_self.__args, *_self.__kwargs)
File "C:\Users\Administrator\Desktop\mylar\mylar\search.py", line 555, in sear
chforissue
foundNZB = search_init(result['ComicName'], result['Issue_Number'], str(Comi
cYear), comic['ComicYear'])
File "C:\Users\Administrator\Desktop\mylar\mylar\search.py", line 99, in searc
h_init
return findit
UnboundLocalError: local variable 'findit' referenced before assignment

Any kind of alteration to the Configuration and then saving it, results in getting a message saying there's an error when attempting to do anything subsequent (ie. Marking something as wanted - it won't initiate the search module and pop-up with an error message).

Only temporary fix atm is to shutdown Mylar and then restart it with the new Configuration file loaded and it seems to work. Just restarting Mylar won't fix the issue.

Line 306-308 of init.py adds "http://" to the sab_host setting if the user does not.
Unfortunately, this causes a problem when sabnzbd uses "https://" instead.
I preferred the example instead of the force change, but that's just me.

And many thanks for all of your work so far, and the rest to come.

Evilhero, thanks for all your hard work - this program is exactly what I have been looking for! Also, congrats on being a new dad! I imagine we will be seeing less of you on here for the next few weeks!

Anyway, anytime I try to Force Update Active comics, I get the following error:

2012-10-07 08:57:00 ERROR Database error: no such column: LastUpdated

Also, my Active comics show up with a status of wanted on the "This Week" tab but never show up under Wanted Issues on the Wanted tab. (I assume these two issues are related) There is also nothing under upcoming issues.

Everything works perfectly if I manually change the status to wanted.

Thanks again for all your hard work!

When trying to add Dr Who Vol 3 from the This Week page, Mylar crashes.

URL: http://192.168.1.100:8090/searchit?name=DOCTOR%20WHO%20VOL%203&issue=1&mode=pullseries

Error:
500 Internal Server Error

The server encountered an unexpected condition which prevented it from fulfilling the request.

Traceback (most recent call last):
File "/home/nogi/.mylar/cherrypy/_cprequest.py", line 645, in respond
response.body = self.handler()
File "/home/nogi/.mylar/cherrypy/lib/encoding.py", line 188, in call
self.body = self.oldhandler(_args, *_kwargs)
File "/home/nogi/.mylar/cherrypy/_cpdispatch.py", line 29, in call
return self.callable(_self.args, *_self.kwargs)
File "/home/nogi/.mylar/mylar/webserve.py", line 83, in searchit
searchresults = mb.findComic(name, mode, issue=issue)
File "/home/nogi/.mylar/mylar/mb.py", line 59, in findComic
searched = pullsearch(comicapi,comicquery,offset)
File "/home/nogi/.mylar/mylar/mb.py", line 35, in pullsearch
file = urllib2.urlopen(PULLURL)
File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
return _opener.open(url, data, timeout)
File "/usr/lib/python2.7/urllib2.py", line 400, in open
response = self._open(req, data)
File "/usr/lib/python2.7/urllib2.py", line 418, in _open
'_open', req)
File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 1207, in http_open
return self.do_open(httplib.HTTPConnection, req)
File "/usr/lib/python2.7/urllib2.py", line 1177, in do_open
raise URLError(err)
URLError: <urlopen error [Errno -2] Name or service not known>
Powered by CherryPy 3.2.0

This only seems to happen after I try to add another series prior to adding this one from the same page. Nothing on console when error happens:

08-Oct-2012 23:13:39 - INFO :: MainThread : Checking to see if the database has all tables....
08-Oct-2012 23:13:39 - INFO :: MainThread : Retrieving latest version information from github
08-Oct-2012 23:13:42 - INFO :: MainThread : Comparing currently installed version with latest github version
08-Oct-2012 23:13:48 - INFO :: MainThread : Mylar is up to date
08-Oct-2012 23:13:48 - INFO :: MainThread : Starting Mylar on port: 8090
08-Oct-2012 23:16:06 - INFO :: Thread-12 : Now adding/updating: Legends of the Dark Knight
08-Oct-2012 23:16:11 - INFO :: CP Server Thread-8 : Now adding/updating: Legends of the Dark Knight
08-Oct-2012 23:16:16 - WARNING :: CP Server Thread-8 : No matching result found for Legends of the Dark Knight (2012)
08-Oct-2012 23:16:20 - WARNING :: Thread-12 : No matching result found for Legends of the Dark Knight (2012)

Since the update that allowed selection of download priorities mylar hasn't been able to send nzbs to sabnzbd. I get the following error:

2012-09-30 09:16:52 ERROR Unable to send nzb file to SABnzbd
2012-09-30 09:16:46 INFO Sucessfully retrieved nzb file using nzb.su

Couchpotato and Headphones are running without a problem with the same settings. I've tried HTTP and HTTPS and have tried changing my port settings multiple times.

To prevent others from having the same problem we solved, something should be done on the Download Settings tab:

1. "Check here if Sabnzbd is set up for https" OR
2. Prompt user to enter only localhost and port, and auto sense feature (this appears to be how couchpotato does it) OR
3. Other method

A few people have mentioned this over on the comicrack forum, and I've just noticed the same issue myself.

This looks to have come in after commit eaed146 when the local log directory was pushed up to the git source, removing the log directory from git should resolve this

Until this is resolved anyone having issues with this should just call the log directory (settings\advanced\log directory) something other than logs (eg. log).

Hi,

Thanks for working on this - it's looking really promising.
I spotted a small exception handling problem in importer.py:

diff --git a/mylar/importer.py b/mylar/importer.py
index efc9d79..f1e4512 100755
--- a/mylar/importer.py
+++ b/mylar/importer.py
@@ -18,6 +18,7 @@ import os
 import sys
 import shlex
 import datetime
+import errno

 import mylar
 from mylar import logger, helpers, db, mb, albumart, cv, parseit, filechecker, search, updater
@@ -109,7 +110,7 @@ def addComictoDB(comicid):
         try:
             os.makedirs(str(comlocation))
             logger.info(u"Directory successfully created at: " + str(comlocation))
-        except OSError.e:
+        except OSError, e:
             if e.errno != errno.EEXIST:
                 raise

What a great program, espcially considering it's your first Python undertaking! Thanks for all your work!

I've got mylar performing flawlessly with one exception so far. I cannot get it to correctly move and rename any issues of Avengers Vs. X-Men. The other test comics I set up are working as expected.

Setup is as follows:

• Running on OS X 10.8.1
• SAB configured with category "comics", script set to ComicRN.py, path set to /Volumes/Data/Comics/
• mylar set to rename files
• ComicRN.py comdir set to '/Volumes/Data/Comics/'

When the download finishes, I end up with the title folder (Avengers Vs. X-Men (2012)), and a single folder for each title downloaded (e.g. Avengers Vs. X-Men 6 (2012) (2012)), the latter containing the downloaded CBZ.

So far, Avengers vs. X-Men is the only title exhibiting this behavior. I have checked permissions on all folders, and they appear to be correct. I have also deleted the series and all associated folders. As a final step, I deleted all series from mylar, and all files and folders (including the top level "Comics" folder"), allowed it to recreate the entire setup and set SAB to grant 777 to all completed downloads.

AvXM log:

Mylar - ComicRenamer Script - v1.02.b
settings confirmation
---------------------
Mylar enabled: yes
Append SeriesYear/ComicYear to folder/filename : yes
Comic Directory : /Volumes/Data/Comics/
Zero supression set to : 2 digits
Replace Spaces enabled : no
Remove extra stuff : yes
-------------------------
passed name from SAB: Avengers Vs. X-Men 6 (2012) (2012)
actual name with issue: Avengers Vs. X-Men 6
actual year of series (passed from SAB): 2012
year of publication of this issue (passed from SAB): (2012)
the comic issue is actually: # 6
comyx: Avengers Vs. X-Men
issue detected less than 10
006...zeroadd level set to:00
The directory should be: /Volumes/Data/Comics/Avengers Vs. X-Men (2012)
filename should be: Avengers Vs. X-Men 006 (2012)
Directory exists!

"Correct" log:

Mylar - ComicRenamer Script - v1.02.b
settings confirmation
---------------------
Mylar enabled: yes
Append SeriesYear/ComicYear to folder/filename : yes
Comic Directory : /Volumes/Data/Comics/
Zero supression set to : 2 digits
Replace Spaces enabled : no
Remove extra stuff : yes
-------------------------
passed name from SAB: Uncanny X-Men 13 (2012) (2012)
actual name with issue: Uncanny X-Men 13
actual year of series (passed from SAB): 2012
year of publication of this issue (passed from SAB): (2012)
the comic issue is actually: # 13
comyx: Uncanny X-Men
issue detected greater than 10, but less than 100
013..zeroadd level set to:0
The directory should be: /Volumes/Data/Comics/Uncanny X-Men (2012)
filename should be: Uncanny X-Men 013 (2012)
Directory exists!
Found: Uncanny X-Men 013 (2012) (c2c) (Minutemen-Meganubis).cbr
--New filename: Uncanny X-Men 013 (2012).cbr
Removed useless directory: /Volumes/Data/Comics/Uncanny X-Men 13 (2012) (2012)

28-Set-2012 21:13:07 - INFO :: Thread-16 : Attempting to grab wanted issues for : Superman: Secret Identity
Exception in thread Thread-16:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 504, in run
self.__target(_self.__args, *_self.__kwargs)
File "/opt/mylar/mylar/importer.py", line 293, in addComictoDB
foundNZB = search.searchforissue(result['IssueID'])
File "/opt/mylar/mylar/search.py", line 575, in searchforissue
foundNZB = search_init(result['ComicName'], result['Issue_Number'], str(IssueYear), comic['ComicYear'])
File "/opt/mylar/mylar/search.py", line 94, in search_init
return findit
UnboundLocalError: local variable 'findit' referenced before assignment

It would be great to see when "This Week" aka pull list is updated, instead of clicking obsessively and guessing! Example: Text "This Week" changes color, or an icon that says "New!" appears.