Coder Social home page Coder Social logo

tensorspace-team / tensorspace Goto Github PK

View Code? Open in Web Editor NEW
5.0K 5.0K 441.0 1.1 GB

Neural network 3D visualization framework, build interactive and intuitive model in browsers, support pre-trained deep learning models from TensorFlow, Keras, TensorFlow.js

Home Page: https://tensorspace.org

License: Apache License 2.0

JavaScript 99.69% HTML 0.30% Shell 0.02%
3d deep-learning keras machine-learning nerual-network tensorflow tfjs threejs visualization

tensorspace's People

Contributors

botime avatar charlesliuyx avatar dylans avatar kageryuuu avatar lq3297401 avatar syt123450 avatar zchholmes avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

tensorspace's Issues

Add functional layer

Add function layer1d, layer2d, layer3d. Users can use these these functional layer to build any kind of layer they like.

  • layer1d
  • layer2d
  • layer3d

Optimize camera position

Now the camera responsive position looks a little bit weird in some cases, for example, 1 layer, 2 layers or 3 layers. Optimize camera position strategy and fix this bug.

Add control for layer animation ratio

Now the animation time for layer animation is 2 seconds, this animation time may be too short or too long in some cases. Let user can configuration animation time in model configuration or in each layer configuration.

Configure for opacity

The default opacity is 0.3 as Constant, support configure for opacity in layer and model.

Callback for loader

Add onComplete callback for loader. User can trigger its own function when load model complete.

Implement new function for auto-fitting shapes of different layers

To implement a function which can auto-fitting the given number of feature map centers.

It should follow the strategy like:

  1. sqrt(), if it's a perfect squre. e.g. if 1024, return 32x32;
  2. rectangle which as close as a square. e.g. if 24, return 4x6 instead of 3x8;
  3. squre/rectangle with less empty slot. e.g. if 47, return 7x7 with 2 empty slots;

Construct network examples

More network examples build with Tensorspace, add interesting examples to "examples" folder:

  • Resnet 50
  • Dense net
  • Acgan generative model
  • pix2pix - Picture style transfer
  • Yolo v3-tiny
  • Mobilenet v1
  • Inceptionv3
  • SqueezeNet
  • ...

Create documentation structure

Create tutorial documentation with proper structure
including:

  • 1. General introduction (Readme.md)
  • 2. Specific example (tf.keras) on how to preprocess models
    • 1. general introduction on model preprocessing;
    • 2. building/loading model (use LeNet as an example);
    • 3. encapsulate multiple intermediate outputs model;
    • 4. convert to tfjs compatable model;

Other examples:

  • TensorFlow (General)
  • Keras
  • TensorFlow.js

Yolo output layer

Add yolo output layer, with selectable channel to get output data from callback function.

Find a way to detect layer type/class from tfjs model

From the loaded tfjs model (json+weights), we'd better to find the way to catch the layer types.

Now we can catch other configurations, such as output_shape, filter, stride etc.

If we can find the layer type/class, we can keep the process on the auto-generation from a target tfjs model for applying tsp API.

Fix hover error log

Hover on layer sometimes show error log, may be caused by last layer's status.

Close button configuration

Add the feature which can change the config of the close button.

Include but not limit on enable or not, displayable or not etc.

Design the UI prototyle

Version 0.0 UI design draft.

  • Page structure
  • Landing page UI (Ongoing)
  • Document page UI

To be done before 09/12/2018

Dense layer optimization

If there is too many units in dense layer, the dense layer will be too long, we need to figure out a strategy to optimize it.

Find a way to move camera along the model

It's too difficult to check detail if the layer is too far from the center (i.e. the layer is close to the two ends).

A proper way to move the camera along the model, or at least provide a way to visualize the layers close to both ends is necessary.

ResNet50 model

  • Preprocess ResNet50 model
  • Apply TensorSpace API to preprocessed model

Merge functions for Layers

Implement merge function for Tensorspace, support all merge function in keras including:

  • Add3d
  • Substract3d
  • Multiply3d
  • Average3d
  • Maximum3d
  • Concatenate3d
  • Dot3d
  • Add2d
  • Substract2d
  • Multiply2d
  • Average2d
  • Maximum2d
  • Concatenate2d
  • Dot2d
  • Add1d
  • Substract1d
  • Multiply1d
  • Average1d
  • Maximum1d
  • Concatenate1d
  • Dot1d

Auto layer creation for tfjs model

Automatically read layer configuration from tfjs model, create and add tensorspace layers for model.

In this way, users only need to create Sequential model, do not need to create and configure the layers.

Supplement more layers

tensorspace API is going to support all keras layers, the layers is going to implement including:

  • conv2dTranspose
  • Cropping1d
  • Cropping2d
  • Activation1d
  • Activation2d
  • Activation3d
  • depthwiseConv2d

Remove hook system

The implementation of layer route do not need hook system any more, remove it from source code.

Coordinate shape of Dense layer

Try to change the single linear structure of the Dense layer to other compatible or other visual-friendly shape.

It is used to avoid the case like when we have a dense layer 4096, it is difficult to see the model compare with the length of dense layer. Camera and other auto-fitting feature may be affected.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.