tryolabs / luminoth Goto Github PK
View Code? Open in Web Editor NEWDeep Learning toolkit for Computer Vision.
Home Page: https://tryolabs.com
License: BSD 3-Clause "New" or "Revised" License
Deep Learning toolkit for Computer Vision.
Home Page: https://tryolabs.com
License: BSD 3-Clause "New" or "Revised" License
Currently it is focused on FasterRCNN (the pretrained bit, the dataset). We should abstract it so that any model with or without a pretrained net, a specific dataset can work.
We're sometimes getting 0 foreground samples in RCNN, which makes reg_loss==nan
, and therefore train_loss=nan
. testEmptyCase
and testAbsolutelyEmptyCase
in rcnn_target_test.py
were designed to catch this problem and failed, so we should consider rewriting them to be more solid.
Define what branch/tags, etc. See here.
I am using Anaconda Navigator 1.6.8 at Windows 7 environment.
Python 3.6.3 |Anaconda, Inc.| (default, Oct 6 2017, 10:25:46) [MSC v.1900 64 bit (AMD64)] on win32
How to install luminoth using Anaconda? Or using command prompt?
Thank you very much in advance.
Regards,
Suryadi
Also, try to reuse Pascal VOC methods when doing it.
It is very confusing in the way it does things.
I believe the warning is caused when reading from the .tfrecords
. I don't think it's really a memory performance issue (as its says), but we should look into it.
Should be independent of Google Cloud but also support it.
(Maybe we can use our org and share the link publicly)
I created my virtual env with conda, everthing is working great but when I try access the server I receive the error:
Traceback (most recent call last)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1997, in __call__
return self.wsgi_app(environ, start_response)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1985, in wsgi_app
response = self.handle_exception(e)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1540, in handle_exception
reraise(exc_type, exc_value, tb)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/_compat.py", line 33, in reraise
raise value
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1982, in wsgi_app
response = self.full_dispatch_request()
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1614, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1517, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/_compat.py", line 33, in reraise
raise value
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functions[rule.endpoint](**req.view_args)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/luminoth/tools/server/web.py", line 105, in index
return render_template('index.html')
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/templating.py", line 133, in render_template
return _render(ctx.app.jinja_env.get_or_select_template(template_name_or_list),
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/jinja2/environment.py", line 869, in get_or_select_template
return self.get_template(template_name_or_list, parent, globals)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/jinja2/environment.py", line 830, in get_template
return self._load_template(name, self.make_globals(globals))
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/jinja2/environment.py", line 804, in _load_template
template = self.loader.load(self, name, globals)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/jinja2/loaders.py", line 113, in load
source, filename, uptodate = self.get_source(environment, name)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/templating.py", line 57, in get_source
return self._get_source_fast(environment, template)
File "/home/marco/miniconda2/envs/DeepVision/lib/python3.5/site-packages/flask/templating.py", line 85, in _get_source_fast
raise TemplateNotFound(template)
jinja2.exceptions.TemplateNotFound: index.html
train
itself)When setting use_rcnn = False and removing the subconfig rcnn:
it crashes.
See here where it says:
Note: The preferred way to feed data into a tensorflow program is using the Datasets API.
How can I use Tensorboard for a training job which ran on the Google Cloud?
I used luminoth (checked out from GIT) with default settings, voc2012 (transformed and uploaded to a bucket) and the sample_config.yml (?)
I know how to use the tensorboard command, but only locally..
thanks!
Hi,
I'm trying to install luminoth on Windows 8, and I'm getting an error installing googleapis-common-protos.
Collecting googleapis-common-protos (from gcloud)
Using cached googleapis-common-protos-1.5.3.tar.gz
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\setuptools_init_.py", line 10, in
from setuptools.extern.six.moves import filter, filterfalse, map
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\setuptools\extern_init_.py", line 1, in
from pkg_resources.extern import VendorImporter
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init_.py", line 3017, in
@call_aside
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init.py", line 3003, in cal
l_aside
f(*args, **kwargs)
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init.py", line 3045, in ini
tialize_master_working_set
dist.activate(replace=False)
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init.py", line 2577, in acti
vate
declare_namespace(pkg)
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init_.py", line 2151, in decl
are_namespace
handle_ns(packageName, path_item)
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init.py", line 2091, in _han
dle_ns
rebuild_mod_path(path, packageName, module)
File "c:\users\mariano-dediego\appdata\local\programs\python\python36\lib\site-packages\pkg_resources_init.py", line 2120, in _reb
uild_mod_path
orig_path.sort(key=position_in_sys_path)
AttributeError: '_NamespacePath' object has no attribute 'sort'
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in C:\Users\MARIAN~1\AppData\Local\Temp\pip-build-_ld46zq1\googleapis-common-pro
Any idea?
My platform:
Windows 8
Python 3.6.3
Pip 9.0.1
Thank you very much.
Related to #29
It seems as if we're always setting the last foreground proposal as foreground and ignoring the rest, instead of setting the proposal with the highest IoU as foreground and ignoring the rest.
unmap
the order or anchors is correct.The same way there is a get_initializer
there should be a get_optimizer
or get_learning_decay
which allows for configurable options than they currently exist.
We have to be careful since we might be removing the possibility of those values to be easily available from CLI.
For easier Google Cloud setup using a single file.
Ie. lumi dataset ...
So it can be used in prediction-only mode.
Detailed instructions for running luminoth
on a custom dataset, along with example code. (examples/
dir?)
When submitting package to Google Cloud ML luminoth/models/fasterrcnn/base_config.yml
is not being included.
It was build as a debugging tool but it adds real value when being able to view intermediate images in TensorBoard.
We should:
Make something like this work:
dataset:
dir: '$DATASET_DIR/voc/tf'
or
dataset:
dir: '~/datasets/voc/tf'
or
lumi train -o dataset.dir=~/datasets/voc-2012/tf
Should be consistent and not only do dataset.dir, but every config option that is a path.
Would this be a problem under some configuration?
Do we want to make this an optional feature?
Add comparison with slim/object_detection, DIGITS and TensorBox
Fix is simple. Config files need to be loaded and merged with base_config before all the processing!
Currently, when running a simple lumi --help
command it takes more than 7s for the message to appear. This is because of all the loading of models/sonnet/etc.
We should change the way we import/load submodules to have an instant reply.
Sonnet and Tensorflow have both different packages with and without GPU support. Our setup.py
should be able to handle both cases.
Checkout Sonnet setup.py
Using Google style:
http://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html
You can use bbox_encode to generate valid bbox_pred.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.