seeker / aid Goto Github PK

Patterns used to: load pages, find threads,posts, image links and image names.
This would make the program much more flexible.

First load of the filterlist after a program start will show a blank list.
Items will show after a "add" or "remove".

Leave the textfields empty and hit "remove" to show the list.

the client should only consider itself banned after it gets lots of 503 responses in a very short time, not just one.

Re-download thumbnails when a filter update is triggered.

Like Mediafire, Rapidshare, Megaupload, ect.
Add them to a list, with thumbnails and the original post, and maybe 1 or 2 preceding / following posts.

Add tests for failed DB connections, failed disk writes, disk full, ect.

Not all tests are written (marked with "Ignore" annotation). Some tests require a re-write.

FileWriter seems to be creating an awful lot of renames.
Maybe hash compare would help?

Improve readability by changing table names from 'cache' to 'imagecache' and from 'lastmodified' to 'threadcache'

On a slow connection or if the board is having problems, the page queue may fill up.

Add a another list identical to the one for filters. Any post content / file names that mach will result in the folder getting tagged.

May need some logic to prevent allot of false positives.

Needs an updater that checks for filter items that have 404'd and remove them.

don't write zero-size files and output a warning to log - might hint to connection issues.

Show the full board name on mouse over in the board selection list.

Add GUI element for viewing thread stats

Needs a code to validate settings.

Add a row of colored squares to every board entry, which will indicate if the page was loaded correctly.

Seems the LogManager also has a shutdown hook that closes the LogHandlers.

Exception in thread "pool-1-thread-57" java.lang.NullPointerException at io.MySQL.isCached(MySQL.java:381) at io.MySQL.isCached(MySQL.java:365) at filter.Filter.isCached(Filter.java:301) at io.ImageLoader.beforeFileAdd(ImageLoader.java:32) at net.FileLoader.add(FileLoader.java:66) at board.Page.run(Page.java:172) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Exception in thread "pool-1-thread-58" java.lang.NullPointerException at io.MySQLaid.getFilterState(MySQLaid.java:84) at filter.Filter.getFilterState(Filter.java:184) at board.Page.run(Page.java:140) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source)

Needs more documentation.

• prune cache on regular interval.
• detect when cache is not getting updated and suspend, otherwise the cache will be cleared.

Exception in thread "Download Worker" java.lang.NumberFormatException: unable to parse http://images.4chan.org/w/src/356719023.jpg at net.GetBinary.getLenght(GetBinary.java:100) at net.GetBinary.getViaHttp(GetBinary.java:207) at net.FileLoader.loadFile(FileLoader.java:109) at net.FileLoader.access$0(FileLoader.java:102) at net.FileLoader$DownloadWorker.run(FileLoader.java:190)

Load the Pending FilterItems from the DB into the GUI.
However, do not check URL's to see if they still exists, leave that to the user and updater.

No point in this any more, files are already buffered when downloading.
Buffering again only adds to complexity and no longer offers a benefit.

the layout has change, the code no longer works.

Filter Updater in the Filter class could also remove items from the GUI.

This happens if page or file queues still have items left.

Load the list once and re use it.
With exception for DL_CLIENT, the list should not change very often.
This saves network and database server load.

Make it so the program can be used without an external database.
Either program internal or use an embedded DB.

Still a few AWT components left.
Replace them with Swing equivalents.

Save the different window locations and restore them on the next program start.

Currently still using windows specific path seperators.

OP post should be weighed more

word count for topics, last processed post

The last few post of a thread are visible on the board pages.
Use this to check if the thread has changed, if not, do not load thread.

Could not think of a better way to solve this at the moment, so i made a Copy of ConnectionPool.java

Idea: Use an Interface with methods that are needed to create a MySQL connection.

add GUI elements for adding items of interest

• Select what will be logged
• Select where it will be logged.

Log text is not appended, the first line is always replaced.