Comments (4)
On compiling, the costs of (!sin x)
and (!sin (!sin (!sin x)))
should be the same because all tensors used here, has the same shape, same views.
from cl-waffe2.
Goal: 3 Layers MLP's compiling time of forward and backward
<< 5sec
.
Compiling time with cache.lisp
will be approximated as:
O((the number of kernel types used in nodes))
while without cache.lisp
:
O((the number of operation))
from cl-waffe2.
The latest pull request #10 solved this issue, however, there still remained to be optimized of compiling time, especially in backward compiling...
from cl-waffe2.
(Compiling MLP Time) is now <<0.5s
from cl-waffe2.
Related Issues (20)
- [Enhancement] macros to add HOT 2
- [Fix] a ton of undefined-type HOT 1
- [BugFix] Proceed -> Proceed HOT 1
- [BugFix] Batched Matmul won't work HOT 1
- [Enhancement] package naming could be confusing
- [FixME] features on cl-waffe2 is perfectly working on REPL, but the same operation in the test isn't working... HOT 1
- [API Enhancement] Project Simplification for those who is new to Common Lisp HOT 1
- [BugFix] Lambda wrapped backward definition can't return more than one gradient. (i.e.: define-static-node) HOT 1
- My TODO List HOT 1
- [Refactoring] I'm considering rewriting the entire code of VM HOT 5
- Various discussions arising from examples and tutorials HOT 21
- [Fix] Some specifications on Subscript DSL should be changed in the future release HOT 1
- [TODO] AVX512/SSE Extension, CUDA Backend, and more, other backends...
- A survey of improving performance
- [Refactor] APIs for Network Construction HOT 2
- Wrapping/Adapting another frameworks?
- [FixME] Dynamically Shaped Conv2D isn't working due to !reshape HOT 1
- examples/mnist/mlp.lisp - reset-compiled-function-cache! question HOT 3
- [WIP] Petalisp as a high-level IR?
- [WIP] Remove obsolete SIMD and BLAS dependencies (for cpu)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cl-waffe2.