Coder Social home page Coder Social logo

johanneszab / tumbltwo Goto Github PK

View Code? Open in Web Editor NEW
62.0 16.0 16.0 293 KB

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

Home Page: https://www.jzab.de/content/tumbltwo

License: The Unlicense

C# 100.00%
tumblr tumblr-blog tumblr-downloader crawler downloader photos videos ripper

tumbltwo's Introduction

TumblTwo

TumblTwo, an Improved Fork of TumblOne, a Tumblr Image Downloader.

New: Check out TumblThree for my beginning code rewrite using C# with WPF and the MVVM pattern.


TumblTwo, a TumblOne Fork: TumblTwo is an image downloader for the Bloghoster Tumblr.com largely based on TumblOne by Helena Craven. After supplying a url, the tool will search and download all types of images in a given resolution. You can simultaneously download from multiple blogs and enqueue others.

New Features (over TumblOne):

  • multiple simultaneous picture downloads of a single blog, customizable in the settings. As an alternative, each picture is downloaded successively.
  • multiple simultaneous downloads of different blogs, customizable in the settings.
  • Download of tumblr.com hosted videos
  • it is possible to download images from blogs only for specific tags.
  • a clipboard monitor that detects http(s):// .tumblr.com urls in the clipboard (copy and paste) and automatically adds the blog to the bloglist.
  • a download queue for blogs.
  • a detection if the blog is still online or the owner has changed.
  • the blogview is now sortable and shows more information, e.g. date added, last time finished and the progress.
  • a settings panel (change download location, turn picture preview off/on, define number of simultaneous downloads, set the imagesize of downloaded pictures).
  • Somewhat overhauled user interface which is resizable, faster and saves and restores its settings.
  • Source code at github (Written in C# and WinForms).

Screenshot:

TumblTwo Main UI

Application Usage:

  • To use the application, simply copy the url of any tumblr.com blog you want to download the pictures from into the textbox at the top. Afterwards, click on 'Add Blog' on the right.
  • To start the crawl process, click on 'Crawl' on the right. The application will regularly check for (new) blogs in the queue and start processing them, until you stop the application by pressing 'Stop'. So, you can either add blogs to the queue via 'Add to Queue' first and then click 'Crawl', or you start the crawl process first and add blogs to the queue afterwards.
  • You can set up more than one parallel download in the 'Settings' on the right side. Also, it is possible to change the download location and the sizes of the pictures to download there.

Tags:

  • You can also download only tagged images by adding tags in a comma separated list in the tag column of the blog list in the top. For example: great big car, bears would search for images that are tagged for either a great big car or bears or both.

Performance:

  • If the download stalls after a period of time and just finishes incompletely, you might have to lower the Number of parallel image downloads for all blogs in the settings panel. Most likely the application has opened too many connections to the tumblr network which were timed out and got closed by the servers. Try to recrawl with lower values. The applications restarts where it left off.
  • Otherwise, if the download speeds are not satisfied, you may increase the value.
  • If the download still behaves weird, unticking crawl blogs in parallel in the settings will increase stability on the cost of speed. Images are then download one by one.

Possible Next Features (ToDo-List):

  • Complete code rewrite to remove the spaghetti-code and migrate to WFP (MVVM) instead of WinForms.

I'm completely new to C# and (safe)-threading programming and if anyone wants to help, feel free to commit. So, beware of the code ;). I'll add source code annotations over the next few days and the first git commit is the pure reverse engineered TumblOne code without any modifications from my side.

License:

Since I had to reverse engineer TumblOne (simple reflecting) and TumblOne is under the public domain (http://sourceforge.net/projects/tumblone/), I decided to release the source code with my changes under the public domain as well.

tumbltwo's People

Contributors

johanneszab avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

tumbltwo's Issues

Migrating from beta 1.0.6 to 1.0.7 with problems

So I was using the beta version of TumblTwo 1.0.6 and now when I tried to use the newest version it doesn't work well. Open last version and blog names and dates and practically all of the info is gone, check out:

tumbltwo_2016-04-25_00-13-10

Beta version it's working fine but I want to control the number of blogs to simultaneous crawl, any way to solve this?

Thanks, cheers, great app

CLI interface?

It would be cool to have CLI frontend around - one that just accepts an URL and downloads the pictures to the designated location. (As a bonus, it could check if the files were already downloaded, but it's not important.)

Example scenario:

  • someone sends you a link
  • it looks cool, but you don't want to browse it all just yet, because you're at work
  • you SSH to your home server and schedule downloading of all the pictures with TumblTwo
  • you arrive at home and everything's ready to be conveniently browsed with your favorite picture viewer!

( โ†‘ true story)

current stable version cannot add new blogs

If I write for example http://blog-name-here.tumblr.com

the current stable version errors out and/or generates an entry with the correct name ( "blog-name-here" ) but wrong download link, ("http://.tumblr.com").

the "previous working release" does not show this issue and it works.

Tested in win10 and win7, all versions apart the "previous working release" error out the same.

Would like to have a working "winxp" version so I can test if It can run in Wine under Linux (which is my main OS).

Btw, the one that works is downloading like a champ, good job. :)

Tumbltwo not executing

Hello, I've tried to use Tumbltwo and keep getting an error. I an unable to copy/paste the message, but I took a screen shot that I have linked to. The frustrating part is that I was able to open tumbltwo at first, but after I closed it and tried to open it again, I got this error message. The worst part about the error message is that I can't even close it because it keeps popping up. I have to go into my task manager and end process tree. This seems a bit suspicious.

https://drive.google.com/open?id=0B1M06fow53T-SVRwTTVZeXRlbzA

Deleted blog + dropped blogwhen removing from the app

A tumblr recently was removed, and I was not aware of it until I loaded your program to finish pulling everything from it.
It popped up with a debug error, giving me the option to continue or quit.
I quit, verified the blog had recently disappeared, and then reopened TumblTwo.
I went to remove the blog itself from my to do list, and found the entire folder was also removed, not just the tumbltwo listing.

It seems like we need two things:

  1. A method for the program to not error out if a tumblr is removed, or if it is wiped and new images are added that are less than the original amount (In this case, the error was that I had pulled 2k+ photos, and the replacement blog when I tried to pull the rest had a count of 5, so it threw an error that the pull count was > than the total post count).
  2. A way to remove the blog from the list, but not delete the folder. This just wiped the 2k+ photos that I had collected, so it was too late by the time I realized my mistake. Since that blog is no longer the same one, that means all these photos are now gone.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.