xflows / clowdflows Goto Github PK

The widget Build Classifier from the ScikitAlgorithms category has a misleading help message shown for the input "dts".
It recommends the user that the widget Arff to Weka Instances could be connected to it, which is wrong, since an error is thrown.

Hello, I need to add some Weka algorithms to ClowdFlows but I haven't found any tutorial about that. Can anyone give me some idea about how I can add Weka algorithms to ClowdFlows.

The widget "Display decision tree" from the ScikitAlgorithms category shows a "Permission denied" error. The workflow that I am trying to run is shown in the attached image.

When hitting the Del key, the error message "Nothing to delete" appears (on the top of the screen, in red). However, it is never removed, i.e. it stays until the editor is not refreshed.

Hi, I'm trying to use the Database Context widget but I got the next error:

This is my workflow

I have "cforange" package activated. What should I do?

WARNING:root:DotNet assemblies could not be loaded! Probable reasons: missing dlls or wrong interpreter (see http://pythonnet.sourceforge.net). Other functionality of ClowdFlows (besides .Net assemblies) should be OK!

I got this WARNING when I build on Ubuntu1604

What are the plans for, and considerations related to, adding AWS SageMaker widgets to CloudFlows? E.g. training a model and storing it on S3 bucket, etc.

The "Your workflows" view could sort the list of workflows by last modified time

Setting up python3-mysql.connector (2.1.6-1) ...
(mothra-env) nauman@nauman-VirtualBox:/mothra-env/clowdflows$ python manage.py syncdb --noinput
Traceback (most recent call last):
File "manage.py", line 11, in
execute_from_command_line(sys.argv)
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/core/management/init.py", line 443, in execute_from_command_line
utility.execute()
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/core/management/init.py", line 382, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/core/management/init.py", line 261, in fetch_command
klass = load_command_class(app_name, subcommand)
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/core/management/init.py", line 69, in load_command_class
module = import_module('%s.management.commands.%s' % (app_name, name))
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/utils/importlib.py", line 35, in import_module
import(name)
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/south/management/commands/init.py", line 10, in
import django.template.loaders.app_directories
File "/home/nauman/mothra-env/local/lib/python2.7/site-packages/django/template/loaders/app_directories.py", line 23, in
raise ImproperlyConfigured('ImportError %s: %s' % (app, e.args[0]))
django.core.exceptions.ImproperlyConfigured: ImportError workflows.mysql: No module named mysql
(mothra-env) nauman@nauman-VirtualBox:/mothra-env/clowdflows$

With the Python 2 EoL looming, it is a good time to port this project to Python 3 (and Django 2).

E.g. when installing the project on Ubuntu 19.10, which has started using Python 3 as default, I get the following error:

$ pip install -r requirements.txt
...
ERROR: Command errored out with exit status 1:
     command: /home/brylie/Code/clowdflows/mothra-env/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-c1z23ilu/PySimpleSOAP/setup.py'"'"'; __file__='"'"'/tmp/pip-install-c1z23ilu/PySimpleSOAP/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-c1z23ilu/PySimpleSOAP/pip-egg-info
         cwd: /tmp/pip-install-c1z23ilu/PySimpleSOAP/
    Complete output (8 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-c1z23ilu/PySimpleSOAP/setup.py", line 10, in <module>
        import pysimplesoap.client
      File "/tmp/pip-install-c1z23ilu/PySimpleSOAP/pysimplesoap/client.py", line 206
        print "-"*80
                ^
    SyntaxError: Missing parentheses in call to 'print'. Did you mean print("-"*80)?
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

What are some of the major blockers in a Python 3 update?

When several widgets are run one after another, and an error appears, the message "Error occurred when trying to execute widget ..." is shown (on the top of the screen, in red). However, it shows only the error of the last problematic widget (eg. The prerequisites for running this widget have not been met).
It will be more helpful to the user if the error of the first problematic widget is shown instead.

Hello, I created a stream mining workflow with the RSS Reader widget, the Summarize news article widget, Triplet extraction widget, Wordnet Lemmatizer widget, sliding window and Streaming Triplet graph widget.
I was following the example displayed in the "ClowdFlows: Online workflows for distributed big data mining" article, and copied the workflow created by the user janez. The workflow is supposed to generate a graph with words from the most important sentences in the news articles, and show how they are linked to each other via the triplets. However, when I start the stream the graph is empty and it never gets updated with new elements.

When I start the stream mining process, no results are displayed. My public workflow is available here: http://clowdflows.org/workflow/9923/ and the page with the empty graph is available here: http://clowdflows.org/streams/data/161/97519/. It's the same as the one used in the article. I started the stream mining process a while ago, and since then I know new data has been added to the data source (I'm using the CNN Middle East RSS, but also tried using the Google News RSS).

I added an Object viewer widget in order to see if some final triplets are being generated, and they are. When I run the workflow from the Workflow Editor, the Object viewer shows some results.

Can anyone give me some idea about how to solve this? Maybe I'm missing some necessary widget or configuration step, but I couldn't find any manual or tutorial about this.

What are the plans for upgrading this project to use Django 2?

I would like to help with the task. Is there an existing checklist/roadmap?

running under ubuntu 12.04. Everything installs successfully using default options & virtualenv. I launch the server with
python manage.py runserver 0.0.0.0:8000
I navigate to the site and create a new user and login sucessfully.
As shown in the screenshot, there are no processes available except the generic subprocess widgets.

I have uncommented the module folders in mothra/local_settings.py and restarted the server, but the this does not resolve the issue.

Additional question: Is there an administrative page in the web interface for managing the site? If so, how should I access it?

Thanks for a fantastic project.