Comments (9)
yes. let us work on python script to invoke cuMF, and also preprocess the input data.
from cumf_als.
I would like to go even a step further, i.e., to wrap cuMF cuda kernels as tensorflow Ops and use TF to "re-write" the glue code. By this means cuMF can run on TF.
from cumf_als.
A Tensorflow interface is added at:
https://github.com/wei-tan/CuMF/blob/master/tensorflow/cumf_as_tensorflow_ops_test.ipynb
from cumf_als.
very cool!
forgive me if I am picky, it seems easier to use if you separate the whole function into (1) training and (2) testing
from cumf_als.
In this case, do we still split training set into training and validation?
from cumf_als.
not really, users may want to determine their training and testing set.
What I want is simply as:
[thetaT,XT] = als_module.train_als(csrRow, csrCol, csrVal, cscRow, cscCol, cscVal, cooRow)
cooValPred = als_module.pred_als(cooRowTest, cooColTest)
rmse = evaluate_mse(cooValTest, cooValPred)
from cumf_als.
Hi, I am attempting to run the TensorFlow example - I run the build script, which builds OK and creates als_tf.so and libALS.so in the current directory, but when I execute "cumf_as_tensorflow_ops_test.py" it says
tensorflow.python.framework.errors.NotFoundError: libALS.so: cannot open shared object file: No such file or directory
So I move the libraries to /usr/lib :
cp *.so /usr/lib
and then running it generates the following error:
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcublas.so locally I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcudnn.so locally I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcufft.so locally I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcuda.so.1 locally I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcurand.so locally Traceback (most recent call last): File "cumf_as_tensorflow_ops_test.py", line 10, in <module> als_module = tf.load_op_library(lib_path) File "/root/CuMF/env3/lib/python3.4/site-packages/tensorflow/python/framework/load_library.py", line 75, in load_op_library raise errors._make_specific_exception(None, None, error_msg, error_code) tensorflow.python.framework.errors.NotFoundError: /usr/lib/libALS.so: undefined symbol: _Z17updateXWithCGHostPfS_S_iif
Can I get some guidance on what went wrong please?
from cumf_als.
Hi sorry we updated the ALS code with a new .o file (the CG solver), but we have not updated it the build libALS.so file. I will update it soon and let you know when it is done.
from cumf_als.
@alainrichardt : I just pushed a update to the code fixing the issue you saw. Here is the result I got from python notebook:
Hello, TensorFlow!
[[ 0.91662455]]
from cumf_als.
Related Issues (19)
- When rank is 70, it does not converge ······ HOT 3
- Provide a direct link to prepared netflix dataset HOT 1
- Does CuMF support implicit feedback data? HOT 2
- Illegal memory access when k=100 for Netflix dataset HOT 2
- Yahoo Music dataset HOT 1
- als.cu(205): error: more than one instance of overloaded function "isnan" matches the argument list HOT 3
- Missing datasets HOT 4
- Extracting Outputs HOT 1
- Dataset for hugewiki HOT 1
- all elements in XTHost and ThetaTHost are all Nan HOT 2
- Input data format? HOT 4
- Issue: ./als_tf.so: undefined symbol: _ZTIN10tensorflow8OpKernelE
- identifier "cusparseScsrmm2" is undefined
- sgd? HOT 9
- Tensorflow interface for cuMF? HOT 1
- MemoryError HOT 6
- it cause 'core dump' on GTX950m(4G) with netflex data.... HOT 2
- Unable to run MovieLens10m Dataset HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cumf_als.