deadolus / folders2flickr Goto Github PK

What steps will reproduce the problem?
1. I installed as stated for my mac with the ini file settings as below:

[DEFAULT]

#
# Location to scan for new images (no trailing \)
#
imagedir=/Users/michaeltaylor265/Dropbox/instagram
#
#   File we keep the history of uploaded images in.
#
history_file=history

#visible 1, invisible 0
public= 0
friend = 1
family = 1

#set this to true if name of the auto generated flickr sets should be only name 
of the last sub folder e.g. Crete when folder is 
d:\testpictures\holidays\Crete\123img.jpg
only_sub_sets  = false



#Start from scratch! If you want to delete first everything you have in your 
Flickr account then set this to true
#This is handy if you messed up your uploads before or just want to start from 
the begining. 
#Once everything is deleted turn this feature off so you wont keep deleting 
your pics in your cron job!
#WARNING!!! IF SET TO true THIS WILL DELETE EVERYTHING (pictures and videos) 
FROM YOUR FLICKR ACCOUNT
#SO BE 100% SURE YOU WANT TO DO THIS!!!!!!!!!!!!!!!!!!
#NOTE: The tool will not start uploading pictures unless this is set to false 
in order to prevent delete-upload-delete-upload loops

remove_all_pics_first = false


I get the following error in terminal and no prompt to authorise my flickr 
account:

Traceback (most recent call last):
  File "uploadr.py", line 3, in <module>
    import dbhash,anydbm
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/dbhash.py", line 7, in <module>
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/bsddb/__init__.py", line 67, in <module>
ImportError: No module named _bsddb

What version of the product are you using? On what operating system?

Mac os x v 20.8.2, python version 2.7

What steps will reproduce the problem?
1. Put large file into the upload queue (like 2.2GB video file)
2. Run the synchronization
3. Follow the debug/error log

What is the expected output? What do you see instead?
Either the object should be uploaded, or it should be skipped because of the 
size.
Instead, I see error messages within the error log like:
(<type 'exceptions.MemoryError'>, MemoryError(), <traceback object at 
0x8955dc4>)
(<type 'exceptions.MemoryError'>, MemoryError(), <traceback object at 
0x8955f7c>)
(<type 'exceptions.OverflowError'>, OverflowError('requested number of bytes is 
more than a Python string can hold',), <traceback object at 0xb6cf0be4>)

...and within the debug.log, I see additional:
2013-09-06 19:10:45,795 ERROR (<type 'exceptions.MemoryError'>, MemoryError(), 
<traceback object at 0x8955f7c>)
2013-09-06 19:10:46,135 DEBUG Getting EXIF for 
/data/fotky/flickr/2013/20130618/DSC_0022.MOV
2013-09-06 19:10:46,149 DEBUG NO_EXIF_HEADER for 
/data/fotky/flickr/2013/20130618/DSC_0022.MOV
2013-09-06 19:10:46,150 DEBUG Uploading image 
/data/fotky/flickr/2013/20130618/DSC_0022.MOV
2013-09-06 19:10:46,150 ERROR (<type 'exceptions.OverflowError'>, 
OverflowError('requested number of bytes is more than a Python string can 
hold',), <traceback object at 0xb6cf0be4>)



What version of the product are you using? On what operating system?
flickr.py reports Rev: 42 (hard to say, whether it's the revision number, or 
the correct answer to life, universe and everything...)
xmltramp.py reports version 2.16

Please provide any additional information below.
I run the script on linux server, ubuntu 13.04.

What steps will reproduce the problem?
1. Create folder with ä/ü/ö in name
2. insert some fotos there
3. run folders2flickr
4. run it again

What is the expected output? What do you see instead?
Also folders with german umlaute (ü, ö, ä) are supported and recognized as 
exsisting folder. Instead it alwys creates a new set/album in flickr fr the 
same folder "2013-06-04 11:46:50,371 DEBUG tags2set: Creating new set 
**ö**ä**ü"

What version of the product are you using? On what operating system?
I am using the actual SVN Version in Ubuntu 13.04 from your repository.

Please provide any additional information below.

How to disable reshelf at the first upload?
It's a big time wasting.

When i run the uploader in standalone windows i get errors when the upload 
starts like this:

2014-08-27 19:52:59,520 DEBUG \PC310013.JPG
2014-08-27 19:52:59,520 DEBUG 127112582@N07
2014-08-27 19:53:00,536 DEBUG flickr2history: No image in Flickr (yet) with 
tags #\PC310014.JPG (possibly deleted in Flickr by user)
2014-08-27 19:53:00,536 DEBUG \PC310014.JPG
2014-08-27 19:53:00,536 DEBUG Getting EXIF for F:\My Pictures\2003 New 
Year\Originals\PC310006.JPG
2014-08-27 19:53:00,598 DEBUG Uploading image F:\My Pictures\2003 New 
Year\Originals\PC310006.JPG
2014-08-27 19:53:02,332 ERROR (<class 'urllib2.HTTPError'>, HTTPError(), 
<traceback object at 0x019FCCB0>)
2014-08-27 19:53:02,348 DEBUG Getting EXIF for F:\My Pictures\2003 New 
Year\Originals\PC310007.JPG
2014-08-27 19:53:02,427 DEBUG Uploading image F:\My Pictures\2003 New 
Year\Originals\PC310007.JPG
2014-08-27 19:53:02,552 ERROR (<class 'urllib2.HTTPError'>, HTTPError(), 
<traceback object at 0x019FCFA8>)
2014-08-27 19:53:02,552 DEBUG Getting EXIF for F:\My Pictures\2003 New 
Year\Originals\PC310012.JPG

What is the expected output? What do you see instead?
I would expect the software to create sets but it doesn't

What version of the product are you using? On what operating system?
1.0 on Windows 8.1

Please provide any additional information below.
This is the message from the error.txt:
tags2set: Cannot create set 
<class 'flickr.FlickrError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>

Hi this isn't an issue, just a suggestion,

I love the program BTW. My only suggestion is add a heartbeat or some sort of 
feedback to the user, so the user knows that the program hasn't frozen. 

Maybe printing a truncated version of the Debug information might be a good 
place to start?

Thanks :)

The problem with Cyrillic support in the names of folders.
There is no way to add an exception downloads.
Speed ​​up the work with the vision of the base.

Hi,

Bsddb module in Python 2.7 and up are depreciated and makes it difficult to use 
and compile on Mac and other NAS-based linux systems.

Can it be updated to be more future proof?

Thanks,
Zoltan

I had to download python v2.6 from pyhton.org as the bsddb module is now 
deprecated and _bsddb.so is not found  and throws an error as already reported 
in a previous issue. 

What steps will reproduce the problem?
1. Edit uploadr.ini
2. Run with python uploadr.py
3. Provide 1st time authority when prompted in browser


What is the expected output? What do you see instead?
uploadr.py:5: DeprecationWarning: the md5 module is deprecated; use hashlib 
instead
  import xmltramp, mimetools, mimetypes, md5, webbrowser, exif, flickr2history, tags2set, deleteAll
history
---------



What version of the product are you using? On what operating system?

v1.0 OS X 10.8.2 with

Python 2.6.1 (r261:67515, Dec  6 2008, 16:42:21) 
[GCC 4.0.1 (Apple Computer, Inc. build 5370)] on darwin



Please provide any additional information below.

debug.log

2013-01-22 22:33:02,021 DEBUG Started
2013-01-22 22:33:04,391 DEBUG flickr2history: Started flickr2history
2013-01-22 22:33:05,013 DEBUG 88717261@N03
2013-01-22 22:33:05,015 DEBUG tags2set: Started tags2set
2013-01-22 22:33:05,704 DEBUG 88717261@N03
2013-01-22 22:33:07,688 ERROR tags2set: Cannot create set 
2013-01-22 22:33:07,688 ERROR <type 'exceptions.IndexError'>
2013-01-22 22:33:07,688 ERROR tags2set: Cannot edit set 
2013-01-22 22:33:07,688 ERROR <type 'exceptions.AttributeError'>
2013-01-22 22:33:07,688 DEBUG tags2set: ...added 0 photos

error.log

tags2set: Cannot create set 
<type 'exceptions.IndexError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>
tags2set: Cannot create set 
<type 'exceptions.IndexError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>
tags2set: Cannot create set 
<type 'exceptions.IndexError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>
tags2set: Cannot create set 
<type 'exceptions.IndexError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>
error.log (END) 

It would be nice to have an option to use a command switch with the 
uploadr.exe, something like uploader -f c:\photos\by_data\2011\2011-09-07_Eliza 


What version of the product are you using? On what operating system?
On Windows XP using Folders2Flickr v1.0 WINDOWS standalone executable 

What steps will reproduce the problem?
1. Unpack folder2flickr for Windows 7 machine
2. Authenticate with flickr and setup .ini file with a directory
3. Run uploadr

What is the expected output? What do you see instead?

For each file that should be uploaded, the program gives the error "No image in 
Flickr with tags #\directory\name.jpg (possibly deleted in Flickr by user)"

---
What version of the product are you using? On what operating system?

Windows 7
Downloaded folders2flickr on May 18, 2011


Please provide any additional information below.


ini file below:
[DEFAULT]

#
# Location to scan for new images
#
imagedir=c:/users/ken/pictures/family_photos/2004_1034_files_579_Meg

#
#   File we keep the history of uploaded images in.
#
history_file=history

#visible 1, invisible 0
public= 0
friend = 1
family = 1



DEBUG file shown below:
2011-05-18 23:36:28,871 DEBUG Started
2011-05-18 23:37:41,625 DEBUG Started flickr2history
2011-05-18 23:37:41,980 DEBUG 62789956@N08
2011-05-18 23:37:41,986 DEBUG 62789956@N08
2011-05-18 23:37:42,516 ERROR No image in Flickr with tags 
#\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0002.jpg (possibly deleted in Flickr by 
user)
2011-05-18 23:37:42,517 DEBUG \2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0002.jpg
2011-05-18 23:37:42,520 DEBUG 62789956@N08
2011-05-18 23:37:42,966 ERROR No image in Flickr with tags 
#\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0005.jpg (possibly deleted in Flickr by 
user)


ERRORS file shown below:
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0002.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0005.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0006.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0007.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0008.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0009.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0010.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0011.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0012.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0013.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0025.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0027.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0028.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0029.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0030.jpg 
(possibly deleted in Flickr by user)
No image in Flickr with tags #\2004_ANNIKAS_NEW_YEARS_PARTY\B2004-0031.jpg 
(possibly deleted in Flickr by user)

Hi,
I have added the following enhancements to the base code:
- Support for updating Flickr photo (delete and upload again) if the file was 
modified locally in file system since it was uploaded to Flickr. It takes into 
account the last modified date from the file system and the date posted 
(uploaded) to Flickr.
- Added a LOT of log sentences to describe what the code is doing
- Support for running the process by folders, instead of first uploading all 
the files and then create the sets, now it does this two steps by folder. In 
this case if you have plenty of folders and files to upload you would see that 
the files are uploaded by folder and also included in sets as the folder is 
processed
- Support for stopping the application if a number of files uploaded has been 
reached
- Added logic to manage case when a file has been moved to another folder, for 
instance, if you have these files : C:\Pictures\A\1.jgg, C:\Pictures\A\2.jpg 
and C:\Pictures\B\3.jpg and run uploadr it will upload the files, create the 
sets and tag the files within also the file name (also added support to have a 
tag with the whole name plus extension). Now, if I move the file 1.jpg to folde 
B, next time that uploadr runs it will realize about this change and it will 
delete picture 1.jpg from Flickr and upload 1.jpg with the correct tags and it 
will be included in Set B instead of A.
- Support for grouping pictures in Flickr into a set called "LocallyDeleted" 
when a file has been deleted from file system and the corresponding picture is 
present in Flickr so users could do a manual delete from Flickr if they like it.

Attached is the .patch for SVN.

Regards and Thank you!

It seems to me the use of Tags for this purpose is very messy, as spurious tags 
start appearing in any software (including flickr) that produces Tag Clouds, 
etc. Would it be possible to use the Title or some other EXIF attribute (like 
the MakerNotes or Application field) instead of a Tag?

If folder name is "pictures\home 2008\images 02\img202.jpg"

the tags shows
home, 2008\images, 02\img202.jpg

It's supposed to show
home 2008, images 02, img202.jpg

here's the fix
add this to line 307
folderTag = "\"" + string.strip(folderTag.replace('\\','" "')) + "\""

What steps will reproduce the problem?
1. Comma's in file or folder name
2. Multiple files in same folder
3. On next run finds multiple matching tags as broken up by comma

What is the expected output? What do you see instead?
Report multiple copies and proceeds to delete them

What version of the product are you using? On what operating system?
Ver 1.0, on Ubuntu

Please provide any additional information below.
e.g. /Pictures/Family, cats & stuff/Picture 001.jpg
gets tagged as #/Pictures/Family {new tag} #cats#&#stuff/Picture#001.jpg.... 
Rather than one tag.

I've fixed by adding an additional replace removing any commas in the uploadr 
and the flickr2history. 

What steps will reproduce the problem?
1. I uploaded quite large collection (approx. 24000 images)
2. As the uploading finished, the tags2set was executed automatically
3. Error messages appeared

What is the expected output? What do you see instead?
Probably sets should have been created from the tags (not sure).
Instead, following error message appeared:
Error log:
tags2set: Cannot create set
<type 'exceptions.IndexError'>
tags2set: Cannot edit set
<type 'exceptions.AttributeError'>

Debug log:
2013-09-06 19:10:46,161 DEBUG tags2set: Started tags2set
2013-09-06 19:10:46,815 DEBUG 100984126@N07
2013-09-06 19:10:48,559 ERROR tags2set: Cannot create set
2013-09-06 19:10:48,560 ERROR <type 'exceptions.IndexError'>
2013-09-06 19:10:48,560 ERROR tags2set: Cannot edit set
2013-09-06 19:10:48,561 ERROR <type 'exceptions.AttributeError'>
2013-09-06 19:10:48,561 DEBUG tags2set: ...added 0 photos

I can't see where to start looking for more information about the error message.

What version of the product are you using? On what operating system?
flickr.py reports Rev: 42
xmltramp.py reports version 2.16

Please provide any additional information below.
No additional info except the collection is quite large with many 
folders/subfolders.

What steps will reproduce the problem?
1. Run Windows Exe uploadr.exe with remove_all_pics_first = true
2. Run Windows Exe uploadr.exe with remove_all_pics_first = false

What is the expected output? What do you see instead?
All of my Flickr photos were deleted as expected after Step 1, but the job 
terminated without uploading any photos. When I ran the job again (Step 2) with 
remove_all_pics_first = false the job runs but so far (after an hour) has not 
uploaded any photos.

What version of the product are you using? On what operating system?
Folders2Flickr Win EXE v1

Please provide any additional information below.
This is being run on a Windows 7 PC. Photos are stored on a NAS, mapped as the 
p: drive. Photos are all JPG, and arranged into folders on the p: drive. Many 
of the photos are scans from slides/negatives/prints, with EXIF data for "date 
taken" inserted using 3rd party tools.
Below is an extract from debug.log, showing the first few files. Step 2 did not 
generated any output in error.log.

2014-03-18 10:18:21,523 DEBUG Started
2014-03-18 10:20:39,288 DEBUG flickr2history: Started flickr2history
2014-03-18 10:20:39,905 DEBUG 26454827@N03
2014-03-18 10:20:39,910 DEBUG 26454827@N03
2014-03-18 10:20:40,638 DEBUG flickr2history: No image in Flickr (yet) with 
tags #1978#Orpington\Winter#1978#(from#print).jpg (possibly deleted in Flickr 
by user)
2014-03-18 10:20:40,638 DEBUG 1978 Orpington\Winter 1978 (from print).jpg
2014-03-18 10:20:40,687 DEBUG 26454827@N03
2014-03-18 10:20:41,266 DEBUG flickr2history: No image in Flickr (yet) with 
tags 
#1980#Abu#Dhabi#&#Dubai\View#from#office#-#Passport#Road#Abu#Dhabi#1980#2(from#p
rint).jpg (possibly deleted in Flickr by user)
2014-03-18 10:20:41,266 DEBUG 1980 Abu Dhabi & Dubai\View from office - 
Passport Road Abu Dhabi 1980 2(from print).jpg
2014-03-18 10:20:41,357 DEBUG 26454827@N03
2014-03-18 10:20:42,089 DEBUG flickr2history: No image in Flickr (yet) with 
tags 

What steps will reproduce the problem?
1. Start an upload
2. disconnect internet and reconnect
3. no new photo from the cue will uploaded
4. a ctrl + c will skip actual image and then the skript works again.

What is the expected output? What do you see instead?
I think f I run it as deamon or in a screen session it should continue work 
after reconnect.

What version of the product are you using? On what operating system?
Actual SVN version with Ubuntu Linux 13.04

Please provide any additional information below.
It is a great tool and it works pretty well... looking forward on the next 
version :-)
Thanks and best regards
Jens

What steps will reproduce the problem?
1. Delete all existing photos and sets from Flickr account
2. Run uploadr Win Exe v1 against a NAS (mapped as p:\) containing several 
thousand jpegs, arranged in folders named \yyyy-mm xxxxxx
3.

What is the expected output? What do you see instead?
Sets created for each folder

What version of the product are you using? On what operating system?
Windows exe v1, on Windows 7 Ultimate

Please provide any additional information below.
Output from the end of the Debug log, which is presumably when it starts to 
create sets:

2014-03-21 15:48:46,701 DEBUG successful.
2014-03-21 15:48:46,709 DEBUG tags2set: Started tags2set
2014-03-21 15:48:47,559 DEBUG 26454827@N03
2014-03-21 15:48:48,390 DEBUG tags2set: Adding image \Dogs Behind Bars 
20140214.jpg
2014-03-21 15:48:49,038 ERROR tags2set: Cannot create set 
2014-03-21 15:48:49,038 ERROR <class 'flickr.FlickrError'>
2014-03-21 15:48:49,039 ERROR tags2set: Cannot edit set 
2014-03-21 15:48:49,039 ERROR <type 'exceptions.AttributeError'>
2014-03-21 15:48:49,039 DEBUG tags2set: ...added 1 photos


Last few lines from error.log:
tags2set: Cannot create set 
<class 'flickr.FlickrError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>

What steps will reproduce the problem?
1. run uploadr.exe
2.
3.

What is the expected output? What do you see instead?

expecting file in c:\test to be uploaded
executable runs, deletes the file I had uploaded manually
2013-06-13 22:50:23,625 DEBUG Started
2013-06-13 22:50:24,318 DEBUG 96836794@N04
2013-06-13 22:50:24,318 DEBUG deleteAll: Started Delete
2013-06-13 22:50:24,318 DEBUG 96836794@N04
2013-06-13 22:50:24,661 DEBUG found 1 num pages
2013-06-13 22:50:25,023 DEBUG added 1 page to 1 pic
2013-06-13 22:50:25,023 DEBUG got all 1 pics to delete
2013-06-13 22:50:25,023 DEBUG deleteAll: found 1 media files to delete
2013-06-13 22:50:25,023 DEBUG deleteAll: DONE DELETING - NOTHING ELSE TO DO - 
EXITING

What version of the product are you using? On what operating system?
Folders2Flickr Win EXE v1
Windows 7

Please provide any additional information below.
Great concept!

After trying this program out yesterday I came to the conclusion that it just 
wasn't for me, but I wanted to make some comments in the hope that at some 
point this might be more universally useful.

What I needed was a way to mass-update all my photos to my flickr account.  In 
doing that being able to auto-tag using the folder names was VERY appealing to 
me.  

1. While I can appreciate the desire to have an automatic upload feature and 
one that can keep track of changes, the more I think about it my photos (and 
likely most peoples photos) simply do not get changed once they are placed in a 
folder on my computer.  It's not like a word-doc where it can go through 
multiple revisions.  True that *can* happen, but 99% of the time it doesn't.   
I bring this up because when I did upload a test folder using this tool, the 
number of tags it created imho ruined the purpose and usefulness of tags in the 
first place.  I recognize you've done this so that this tool can be re-used if 
the history file is lost, but I for one would prefer that to be an option, 
where I can choose not to have it create the special tags to deal with a lost 
history file.

2. The system parsed out the path *and* filename and created tags from them.  
Almost all of my photos are auto-named by my cameras, IE img_1010.jpg I didn't 
need tags for: img, 1010 and jpg created.  I think the idea of parsing and 
using tags from the folders is an EXCELLENT idea, but the filename itself 
should at least be an option that can be enabled/disabled.  I am willing to bet 
most people do not rename their photos but simply store them in appropriately 
named folders.  Even if you continue to maintain your history tags as I 
discussed in item 1 above, this even more importantly should be something that 
can be disabled.  In the end I had so many tags, I simply had to start over and 
use another method to upload all my photos.

I don't mean to be negative and I hope this didn't come across as such.  I 
think you've got a good tool here, it just didn't meet my needs.  I decided to 
post this to your site in the hope that at some point you can work these 
suggestions into your product so I can come back and use your tool.  I will be 
sure and keep an eye on the progress of this project to see what changes are 
made in the future.

Sincerely,

Don Langhorne

What steps will reproduce the problem?
1. modify uploadr.ini to use imagedir=C:\Temp\2010\Test
2. ensure no image files use spaces or unusual characters
3. run uploadr.py

What is the expected output? What do you see instead?
Expected:  images uploaded and sets created from new images
Instead:  I get the following error messages in error.log:
Cannot create set 
<class 'flickr.FlickrError'>
Cannot edit set 
<type 'exceptions.AttributeError'>

What version of the product are you using? On what operating system?
folders2flickr v0.6
Windows 7
Python for Windows v2.7

Please provide any additional information below.
The images upload with no problems.  I have issues when it tries to create 
sets.  error.log, debug.log, and uploadr.ini are attached.

What steps will reproduce the problem?
1. Use picasa to edit images
2. commit the change in picasa
3. upload the directory to flickr via folders2flickr

What is the expected output? What do you see instead?
It gives errors for every picasa file and adds the original images in the 
hidden picasa folder that I don't want

What version of the product are you using? On what operating system?
version 1, windows 7, Picasa 3.9.0

Please provide any additional information below.
Picasa is gaining in popularity as a source for editing and organizing photos 
locally from google. 

What steps will reproduce the problem?
1. Start uploader.py
2. Waiting to upload first image
3.

What is the expected output? What do you see instead?
Expecting to have photos uploaded.
2014-06-27 23:45:31,301 DEBUG Started
2014-06-27 23:45:36,528 DEBUG Getting EXIF for 
D:\Képek\2007\barcelona\S6002430.jpg
2014-06-27 23:45:36,857 DEBUG Uploading image 
D:\Képek\2007\barcelona\S6002430.jpg
2014-06-27 23:45:50,214 ERROR (<class 'urllib2.HTTPError'>, HTTPError(), 
<traceback object at 0x0000000003081688>)

What version of the product are you using? On what operating system?
1.0 python version, not exe, windows 8,1, 

Please provide any additional information below.
the traceback object is always a different number.
I'm using the python version, because I needed to comment out that reshelf 
feature, because I'm uploading lots of pictures at the same time.
The uploading was working fine for a couple of hours, and then suddenly started 
to produce this error. 
Restarted application. Restarted computer. Issue still present.

This tool functions well except tags Chinese folder name. And how to deal with 
this issue?

I've attached a diff with the following changes....

 * Updated flickr api urls to use SSL as per https://code.flickr.net/2014/04/30/flickr-api-going-ssl-only-on-june-27th-2014/
 * Added more video file types that flickr supports
 * Ignoring unix style hidden files/folders that start with "." (dot files).

What steps will reproduce the problem?
1. Created a folder called C:\Test\, that has subfolders Subfolder A and 
Subfolder B.  In Subfolder A there is 1 image called 002.jpg.  In Subfolder B, 
as well, there is 1 image called 002.jpg.
2. Set my uploadr.ini file to:

[DEFAULT]

#
# Location to scan for new images (no trailing \)
#
imagedir=C:\Test
#
#   File we keep the history of uploaded images in.
#
history_file=history

#visible 1, invisible 0
public= 0
friend = 0
family = 0

#set this to true if name of the auto generated flickr sets should be only name 
of the last sub folder e.g. Crete when folder is 
d:\testpictures\holidays\Crete\123img.jpg
only_sub_sets  = false



#Start from scratch! If you want to delete first everything you have in your 
Flickr account then set this to true
#This is handy if you messed up your uploads before or just want to start from 
the begining. 
#Once everything is deleted turn this feature off so you wont keep deleting 
your pics in your cron job!
#WARNING!!! IF SET TO true THIS WILL DELETE EVERYTHING (pictures and videos) 
FROM YOUR FLICKR ACCOUNT
#SO BE 100% SURE YOU WANT TO DO THIS!!!!!!!!!!!!!!!!!!
#NOTE: The tool will not start uploading pictures unless this is set to false 
in order to prevent delete-upload-delete-upload loops

remove_all_pics_first = false



3. Ran uploader.exe from the command line.

4. Authorized the app to access my Flickr account.

5. Entered "Y"

6. The output says "history", pauses for about 2 seconds and then shows the 
command line prompt.

7. I look in the error.log and it says the following over and over:

tags2set: Cannot create set 
<type 'exceptions.IndexError'>
tags2set: Cannot edit set 
<type 'exceptions.AttributeError'>
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback 
object at 0x02875210>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback 
object at 0x028750F8>)

**I have attached the debug.log and error.log files for your reference.

What is the expected output? What do you see instead?

I'd expect the image files to be uploaded to my Flickr account.  However, it 
still shows that I have zero pictures uploaded.

What version of the product are you using? On what operating system?
Using Folders2Flickr Win EXE v1
Windows 7 (MacBook Pro running Boot Camp)

Please provide any additional information below.
I have a Flickr Pro account.
I have set my privacy settings to the most private, as I'm basically using 
Flickr as a storage backup.  I'm not sure if the privacy settings are creating 
problems with the image uploading...
I also tried using an earlier version of your Windows executable (v0.9), with 
the same result.

Hello I have a simple question. I am working on a project that I should develop 
program that take photos and automatically upload them to flickr. 

I will use arduino, maxmsp and windows for it. I found an object for max that 
can run applications through CMD and everything looks very simple.

The problem is that I am in trouble with starting uploadr.exe through CMD. I 
can't understand why I can run it if I navigate to folder and next type 
uploadr.exe, but I it gives me an error if I type for example 
D:\folder\folder\exe.exe. I also try this 
http://www.yiiframework.com/forum/index.php/topic/12712-phpexe-is-not-recognized
-as-an-internal-or-external-command/ to make an easier access to uploadr.exe 
but same error???

I am not familiar with CMD can anyone help me       

What steps will reproduce the problem?
1. Using folder2flickr for the second time, after uploading folders.

What is the expected output? What do you see instead?
All folders are perfectly uploaded, but after deleting the folders in the 
upload-directory and reuploading new folders, the deleted folders are 
reuploaded again. I now have 7 identical sets in my Flickr account.
I have no idea how to get rid of the problem.

What version of the product are you using? On what operating system?
V1

Please provide any additional information below.

What steps will reproduce the problem?
1. Upload images 
2. Run uploader a 2nd time - no changes to source
3. Watch the debug.log as all sets are reanalyzed/recreated

What is the expected output? What do you see instead?

I would expect to see very little as no changes have been made, however the 
uploader seems to go through the set creation process from the very beginning 
which can take a long time & is typically unnecessary. I would expect to only 
see this if new photos were to be in the local source to be uploaded though 
perhaps a an option would be useful to enforce the current behaviour in case 
sets are altered via the Flickr web site and I wish to remove those changes

What version of the product are you using? On what operating system?

Folders2Flickr v1.0, Debian Linux running python 2.6


Please provide any additional information below.

Folders2Flickr is working perfectly correctly for me - this issue is more an 
possible optimisation to improve performance. If I create a single new local 
folder with images, F2F properly determines the change and only uploads the new 
images which takes a fairly short time - but then can spend over an hour 
reanalyzing the sets before finally creating the one new set that I require. An 
option to prevent the full reanalysis would be a welcome improvement

Suggestion: Use sqlite for storing history. Lookup of existing entries would be 
miles faster giving good performance.

What steps will reproduce the problem?
1. Upload photos

What is the expected output? What do you see instead?

Traceback (most recent call last):
  File "C:\Folders2Flickr\uploadr.py", line 457, in <module>
    tags2set.createSets( HISTORY_FILE)
  File "C:\Folders2Flickr\tags2set.py", line 78, in createSets
    logging.debug( "Creating set %s with %d pictures" % setName, len(photoSet) )

TypeError: not enough arguments for format string


What version of the product are you using? On what operating system?
Python 2.7

Please provide any additional information below.

What steps will reproduce the problem?
1. Place path\uploadr.exe into .bat file and execute from command line.

This is also the case when attempting to embed in a python script.  When run 
standalone (double clicking), files are uploaded without issue.  When 
attempting from the bat file the following output is produced:

Traceback (most recent call last):
     File "uploadr.py" line 5, in <module>
     File "tags2set.py" line 12, in <module>
KeyError: 'only_sub_sets'


What is the expected output? What do you see instead?
Successful file upload.

What version of the product are you using? On what operating system?
Windows v1

Please provide any additional information below.

As you may have read on the Flickr code blog, we've updated all of the API 
endpoints to fully support SSL. You no longer need to use a special subdomain 
to access the API securely, and we want to make sure that all API communication 
adopts SSL. 

Many of you have moved over to using SSL already, which is great! If you 
haven't, it shouldn't be much more work than updating your apps to call the API 
at: https://api.flickr.com/ 

We'll be updating the blog with information as we get close to the switchover 
date, but here's the most important info: 

New API keys will be issued for HTTPS access only: as of 6 May 2014
First blackout test window: 3 June 2014, 10:00-12:00 Pacific Daylight Time (PDT)
Second blackout test window: 17 June 2014, 18:00-20:00 (PDT)
Non-SSL API deprecated: 27 June 2014, 10:00 (PDT) 

During the blackout tests and after the 27th of June, calls to the Flickr API 
that are not over SSL will fail with an HTTP error code 403. We will also 
return an error message with (Flickr) code 95 and msg "SSL is required". 

Here are example error responses: 

XML (REST): 

<?xml version="1.0" encoding="utf-8" ?> <rsp stat="fail"> <err code="95" 
msg="SSL is required" /> </rsp> 

JSONP: 

jsonFlickrApi({ "stat": "fail", "code": "95", "message": "SSL is required" }) 

JSON: 

{ "stat": "fail", "code": "95", "message": "SSL is required" } 

We realize that this change might be more difficult for some. We will follow 
the Developer Support Group closely, so please let us hear your questions. 

If you have a question about the API transition to SSL that you feel is unique 
to your situation or is more appropriate to handle via conversation directly 
with Flickr, send an email to [email protected]. We will monitor 
that mailbox through July 2014. 

Thank you for being a member of our API community,
The Flickreenos

i noticed that, despite showing "history" in the console window, my copy of 
folders2flickr hasn't been uploading anything since the end of january. 
doing some digging, i found out that flickr recently shut down all non-ssl api 
access: 
http://code.flickr.net/2014/04/30/flickr-api-going-ssl-only-on-june-27th-2014/

are there any programmers out there who could change all calls to 
"http://api.flickr.com" into "https://api.flickr.com" and compile a new windows 
executable?

1. run python uploadr.py in command line
2. Script interrupts with error output: 

File "uploadr.py", line 162
    print "Error getting frob:" , str( sys.exc_info() )
                              ^
SyntaxError: invalid syntax

onal information below.

I am using Linux Manjaro x64

Attached ini file

What steps will reproduce the problem?
1. Followed instructions for config file setup (see below)
2.
3.

What is the expected output? What do you see instead? That all pics are 
assigned to a set named as the folder they were uploaded from


What version of the product are you using? On what operating system? Windows 7, 
Win Exe v1


Please provide any additional information below.


#
# Location to scan for new images (no trailing \)
#
imagedir=d:
#
#   File we keep the history of uploaded images in.
#
history_file=history

#visible 1, invisible 0
public= 0
friend = 0
family = 1

#set this to true if name of the auto generated flickr sets should be only name 
of the last sub folder e.g. Crete when folder is 
d:\testpictures\holidays\Crete\123img.jpg
only_sub_sets  = true



#Start from scratch! If you want to delete first everything you have in your 
Flickr account then set this to true
#This is handy if you messed up your uploads before or just want to start from 
the begining. 
#Once everything is deleted turn this feature off so you wont keep deleting 
your pics in your cron job!
#WARNING!!! IF SET TO true THIS WILL DELETE EVERYTHING (pictures and videos) 
FROM YOUR FLICKR ACCOUNT
#SO BE 100% SURE YOU WANT TO DO THIS!!!!!!!!!!!!!!!!!!
#NOTE: The tool will not start uploading pictures unless this is set to false 
in order to prevent delete-upload-delete-upload loops

remove_all_pics_first = false


Regardless, thanks for taking the time to write and distribute this program!  
Every other 3rd party uploader i've tried has crashed at some point.  Yours has 
uploaded over 3k pics in 12 hours today.

Doesn't work for MACs.

To do some, the folder scheme needs to be change from "\" to "/".  Other issues 
arise when this happens, ie, checking for photoid keys in tags2set.py

What steps will reproduce the problem?
1. Installed on Mac and also Linux as instructed
2. Ran uploadr.py to get auth
3. Ran uploadr.py to upload and failed

When I run the script it displays 'history' then stops after a second. I've run 
through the auth process and tried this on both mac and linux. Below is the 
setup and outputs.

Thanks

I'm using the latest 0.9 release

I've tested first on mac with Python 2.6 then on Linux (ubuntu) with 2.5

My ini file:

[DEFAULT]

#
# Location to scan for new images
#
imagedir="/Users/Jme/Desktop/Photos/"

#
#   File we keep the history of uploaded images in.
#
history_file=history

#visible 1, invisible 0
public= 0
friend = 1
family = 1

My debug.log

2011-03-10 12:22:12,359 DEBUG Started
2011-03-10 12:22:13,338 DEBUG Started flickr2history
2011-03-10 12:22:14,314 DEBUG 79875668@N00
2011-03-10 12:22:14,317 DEBUG Started tags2set
2011-03-10 12:22:15,307 DEBUG 79875668@N00
2011-03-10 12:22:16,324 ERROR Cannot create set 
2011-03-10 12:22:16,324 ERROR <type 'exceptions.IndexError'>
2011-03-10 12:22:16,324 ERROR Cannot edit set 
2011-03-10 12:22:16,324 ERROR <type 'exceptions.AttributeError'>
2011-03-10 12:22:16,324 DEBUG ...added 0 photos

My error.log

Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>
Cannot create set 
<type 'exceptions.IndexError'>
Cannot edit set 
<type 'exceptions.AttributeError'>

Ran this against my folders and it missed a number of folders and subfolders...

Any thoughts?

I'm trying to run this from the command line on Ubuntu 11.10 server (32 bit). 
No files ever get uploaded to flickr. No errors are created in the errors log. 
It runs for hours, and then just stops. 

Any suggestions for tracking down whats going on? The debug log indicates it 
has enumerated my files, but it never uploads them. I did follow the steps to 
give it a flickr token.

I added some code to check for duplicate pictures before uploading.  It checks 
against filename and date taken.


                user = flickr.test_login()
                no_duplicate = True
                #double check for duplicate images
                if exiftags != {}:
                    datetaken_photos = flickr.photos_search(user_id=user.id, text=os.path.basename(image), extras="date_taken")
                    for dt in datetaken_photos:
                        if(dt.datetaken.replace('-',':') == str(exiftags["Image DateTime"])):
                            no_duplicate = False
                            logging.debug("found duplicate picture, skip")
                            self.logUpload(dt.id, folderTag )

this is somehow a non functional problem but users of this tool should be aware

What steps will reproduce the problem?
1. run folder2flickr from raspberry pi and try to upload a bunch of files (more 
than 300, average file size is 5 MB)
2. exceptions occurs in the batch file in the format

2013-11-24 02:55:25,334 ERROR (<type 'exceptions.MemoryError'>, MemoryError(), 
<traceback object at 0x1448080>)
2013-11-24 02:55:25,343 DEBUG Getting EXIF for /media/nas/P9142018.JPG


What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?
the latest from google site.

Please provide any additional information below.
please let me know what additional info I should provide.

[deleted issue]

- What steps will reproduce the problem?
1. Start program with target folder containing subfolders with Russian 
(cyrillic) names.
2. Check results on Flickr

- What is the expected output? What do you see instead?
For example expected tag/set name is "Пляж" but I see "Ïëÿæ" instead

- What version of the product are you using? On what operating system?
"Folders2Flickr v1.0 WINDOWS standalone executable" on Windows7 OS 
(administrator rights)

- Please provide any additional information below.
Changing encoding of these names from CP1252 to CP1251 in any text editor fixes 
this problem. But how to fix it in program? Possible solution: to add encoding 
setting to uploadr.ini.