dmlc / parameter_server Goto Github PK

moved to https://github.com/dmlc/ps-lite

License: Apache License 2.0

Shell 4.99% C++ 89.57% MATLAB 0.99% Protocol Buffer 3.46% C 0.26% Makefile 0.74%

parameter_server's Introduction

The parameter server is a distributed system scaling to industry size machine learning problems. It provides asynchronous and zero-copy key-value pair communications between worker machines and server machines. It also supports flexible data consistency model, data filters, and flexible server machine programming.

NOTE: We stop maitaining this repo. Please check the newer version called ps-lite

Document
Wiki
How to build
Examples
- Linear method, Linear method with Cloud
- Deep neural network, see CXXNET and Minverva

parameter_server's People

Contributors

Stargazers

Watchers

Forkers

alienfeel rikima ruil jeevanshankar1991 vrmanx splade wuntoguo snazz2001 liyong3forever lqshixinlei jegonzal xjzhou liyanghua craftsliu kevinking shannonyu xshhhm wachaong sherryshare xingzhixi pauljing andy071001 yiiwood cswanghan openarrow ty01csbaidu lizhangzhan zhengchen1208 chonglinsun onlysang penguinstar li-ch hezila litaoshao chagge meindata jackiexie168 unclegen chenliu0831 wakensky wolfhu mindis loachli dario-di matadorhong raindreams jimmycao cweng6 eagletjane bruce2008github pc27149 chenglongchen zmoon111 imaxmin bowenbao baokunguo vseledkin maxiao001 chyh1990 daishichao eawuchen yipeiw xuxinrui30 yjcelly minghuam 4t-shirt voidexception debasish83 jerrylead codenfish thomasdic2000 huangjun6919 baiyangbupt hengzhang starkmchen appscluster yanshanjing more-free hjk41 oraclexbw akguptakgp diaoxue toothacher17 ankitaggarwalpec thomascarterx zhuangh wycg1984 immars sfurmb twistedmove zhuguoliang alemagnani fysoft2006 jhu-chang zhmz90 zhimingz bingzhengwei suwakozhai derek-zhang aaron276h

parameter_server's Issues

Error on make

I got this error on make
make: *** No rule to make target data/text2bin.cc', needed by../bin/text2bin'. Stop.
According to Makefile:
$(BIN)/text2bin: data/text2bin.cc data/text2bin.h $(LIB)/libps.a
$(CC) $(CFLAGS) data/text2bin.cc $(LDFLAGS) -o $@

There should be text2bin.h and text2bin.cc in data directory.

Can't Build parameter_server

Hi,mli

I'm trying to build ps on Ubuntu14.04(with gcc 4.8.2) after building all third-parties successfully. However, I encounter this error:

../lib/libps.a(remote_node.o)：在函数‘PS::RNode::cacheKeySender(PS::Message const&)’中：
/home/work/paramServer/parameter_server/src/system/remote_node.cc:123：对‘PS::SArray::reset(char*, unsigned long)’未定义的引用

Any ideas to get rid of this?
Thank you!

questions about darlin

Hi muli
I have read part of the code of darlin，I can`t find the implementation of api "void run" in darlin for server and worker, it seems that only scheduler run is used?

the running long also shows:
I0303 14:07:51.796239 16734 postoffice.cc:104] Scheduler has connected 2 servers and 2 workers
I0303 14:07:51.798970 16734 darlin.h:35] Train l_1 logistic regression by block coordinate descent
I0303 14:07:51.799216 16734 postmaster.cc:9] Found 8 files
I0303 14:07:51.799244 16734 postmaster.cc:13] Assign 8 files to 2 workers
I0303 14:07:51.803696 16734 bcd.h:53] Loaded 223836 examples in 0.004 sec
I0303 14:07:53.559219 16734 bcd.h:71] Preprocessing is finished in 1.755 sec
I0303 14:07:53.559294 16734 bcd.h:73] Features with frequency <= 4 are filtered
I0303 14:07:53.559429 16734 bcd.h:98] Features are partitioned into 449 blocks
I0303 14:07:53.559465 16734 bcd.h:120] Prior feature groups: 127, 120
I0303 14:07:53.559478 16734 darlin.h:43] Maximal allowed delay: 8
| training | sparsity | KKT filter | time (sec.)
iter | objective relative | |w|_0 | threshold #activet |(app:min max) total
----+------------------------+-----------+---------------------+-----------------
0 | 1.45414e+05 1.000e+00 | 3601 | 1.0e+20 12754852 | 0.3 0.3 1.1
1 | 1.44370e+05 7.226e-03 | 2916 | 2.9e-01 4162 | 0.3 0.3 1.1
2 | 1.44197e+05 1.203e-03 | 2689 | 1.9e-03 3101 | 0.1 0.1 0.7
3 | 1.44015e+05 1.264e-03 | 2493 | 6.1e-03 2763 | 0.1 0.1 0.7
4 | 1.43952e+05 4.340e-04 | 2382 | 1.0e-03 2529 | 0.1 0.1 0.7
5 | 1.43933e+05 1.366e-04 | 2325 | 5.3e-04 2407 | 0.1 0.1 0.7
6 | 1.43921e+05 7.836e-05 | 2291 | 1.1e-04 2337 | 0.1 0.1 0.7
7 | 1.43916e+05 3.719e-05 | 2276 | 7.8e-04 2299 | 0.1 0.1 0.7
8 | 1.43912e+05 3.138e-05 | 2261 | 1.9e-04 2282 | 0.1 0.1 0.7
9 | 1.43908e+05 2.278e-05 | 2260 | 2.8e-05 2271 | 0.1 0.1 0.7
10 | 1.43906e+05 1.575e-05 | 2248 | 1.5e-03 2263 | 0.1 0.1 0.7
11 | 1.43904e+05 1.541e-05 | 2240 | 1.2e-05 12754840 | 0.3 0.3 1.1

in the log， I also can not find the logs relevant to worker and server

Error on make

I got this error while making the project :
./box/item.h:43:14: error: there are no arguments to ‘IsRoot’ that depend on a template parameter, so a declaration of ‘IsRoot’ must be available

max_delay in async_sgd

Can we change the consistency condition in async_sgd model? I see you defined the max_delay, but never use it.

Thanks,

Running Example problem

I tried to run the example, I have a problem with ZMQ lib, below is the stack trace :-

mustafa@mustafa-HP-ProBook-4540s:~/Documents/ParameterServer/parameter_server/script$ ./local.sh 1 4 ../config/rcv1/batch_l1lr.conf
ps(4874): Operation not permitted
ps(4875): Operation not permitted
ps(4876): Operation not permitted
ps(4877): Operation not permitted
ps(4878): Operation not permitted
F1208 15:59:26.215294 10194 van.cc:64] Check failed: zmq_bind(receiver_, addr.c_str()) == 0 bind to tcp://:8100 failed: Address already in use
** Check failure stack trace: ***
@ 0x7f9dec983daa (unknown)
@ 0x7f9dec983ce4 (unknown)
@ 0x7f9dec9836e6 (unknown)
@ 0x7f9dec986687 (unknown)
F1208 15:59:26.216895 10196 van.cc:64] Check failed: zmq_bind(receiver_, addr.c_str()) == 0 bind to tcp://:8201 failed: Address already in use
@ 0x4e1edb PS::Van::bind()
** Check failure stack trace: ***
@ 0x4e5030 PS::Van::init()
@ 0x7fb9cbfdddaa (unknown)
@ 0x4191a0 PS::Postoffice::run()
@ 0x7fb9cbfddce4 (unknown)
@ 0x40a0c4 main
@ 0x7fb9cbfdd6e6 (unknown)
@ 0x7f9deb771ec5 (unknown)
@ 0x7fb9cbfe0687 (unknown)
@ 0x40e40d (unknown)
@ 0x4e1edb PS::Van::bind()
@ 0x4e5030 PS::Van::init()
@ (nil) (unknown)
@ 0x4191a0 PS::Postoffice::run()
@ 0x40a0c4 main
@ 0x7fb9cadcbec5 (unknown)
@ 0x40e40d (unknown)
@ (nil) (unknown)
F1208 15:59:26.221395 10198 van.cc:64] Check failed: zmq_bind(receiver_, addr.c_str()) == 0 bind to tcp://:8203 failed: Address already in use
** Check failure stack trace: ***
@ 0x7f4508fd5daa (unknown)
@ 0x7f4508fd5ce4 (unknown)
@ 0x7f4508fd56e6 (unknown)

Error building on Mac OS X: error: use of undeclared identifier 'CLOCK_MONOTONIC_RAW'

On Mac OS 10.9.5

I've install all dependencies except eigen3 (since this isn't something explicitly installed to the OS).

Running make in ../parameter_server yields:

In file included from src/util/file.cc:1:
In file included from ./src/util/file.h:8:
In file included from ./src/util/common.h:42:
./src/util/resource_usage.h:35:17: error: use of undeclared identifier 'CLOCK_MONOTONIC_RAW'
  clock_gettime(CLOCK_MONOTONIC_RAW, &tv);
                ^
./src/util/resource_usage.h:41:17: error: use of undeclared identifier 'CLOCK_MONOTONIC_RAW'
  clock_gettime(CLOCK_MONOTONIC_RAW, &curr);
                ^
2 errors generated.
make: *** [build/util/file.o] Error 1

Appears related to clock_gettime not being present on Mac OS X:
http://stackoverflow.com/questions/5167269/clock-gettime-alternative-in-mac-os-x

Error building linear example

Getting error in make with static_third_lib flag.
gcc version : 4.8.2 20140120 (Red Hat 4.8.2-15)
os : Centos 6.6
error log :
$ make -j8 STATIC_THIRD_LIB=1
...
g++ -std=c++0x -Wall -Wno-unused-function -finline-functions -Wno-sign-compare -O3 -ggdb -I./src -I/home/user/parameter_server/third_party/include build/app/linear_method/proto/linear.pb.o build/app/linear_method/main.o build/libps.a /home/user/parameter_server/third_party/lib/libgflags.a /home/user/parameter_server/third_party/lib/libzmq.a /home/user/parameter_server/third_party/lib/libprotobuf.a /home/user/parameter_server/third_party/lib/libglog.a /home/user/parameter_server/third_party/lib/libz.a /home/user/parameter_server/third_party/lib/libsnappy.a -lpthread -lrt -o build/linear
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_client.o): In function zmq::gssapi_client_t::~gssapi_client_t()': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:70: undefined reference togss_release_cred'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_client.o): In function zmq::gssapi_client_t::initialize_context()': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:178: undefined reference togss_init_sec_context'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:169: undefined reference to GSS_C_NT_HOSTBASED_SERVICE' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:169: undefined reference togss_import_name'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_client.o): In function zmq::gssapi_client_t::produce_next_token(zmq::msg_t*)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:195: undefined reference togss_release_buffer'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:198: undefined reference to gss_release_name' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:200: undefined reference togss_delete_sec_context'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:190: undefined reference to gss_release_buffer' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:191: undefined reference togss_release_name'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_client.o): In function zmq::gssapi_client_t::process_next_token(zmq::msg_t*)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_client.cpp:211: undefined reference togss_release_name'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_server.o): In function zmq::gssapi_server_t::~gssapi_server_t()': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:64: undefined reference togss_release_cred'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:67: undefined reference to gss_release_name' /home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_server.o): In functionzmq::gssapi_server_t::send_zap_request()':
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:206: undefined reference to gss_display_name' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:213: undefined reference togss_release_buffer'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_server.o): In function zmq::gssapi_server_t::produce_next_token(zmq::msg_t*)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:332: undefined reference togss_release_name'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:334: undefined reference to gss_delete_sec_context' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:328: undefined reference togss_release_buffer'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_server.o): In function zmq::gssapi_server_t::process_next_token(zmq::msg_t*)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:346: undefined reference togss_release_name'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_server.o): In function zmq::gssapi_server_t::accept_context()': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_server.cpp:359: undefined reference togss_accept_sec_context'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_mechanism_base.o): In function zmq::gssapi_mechanism_base_t::~gssapi_mechanism_base_t()': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:58: undefined reference togss_release_name'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:60: undefined reference to gss_delete_sec_context' /home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_mechanism_base.o): In functionzmq::gssapi_mechanism_base_t::encode_message(zmq::msg_t_)':
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:82: undefined reference to gss_wrap' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:108: undefined reference togss_release_buffer'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_mechanism_base.o): In function zmq::gssapi_mechanism_base_t::decode_message(zmq::msg_t_)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:155: undefined reference to gss_unwrap'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:173: undefined reference togss_release_buffer' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:174: undefined reference to gss_release_buffer'
/home/user/parameter_server/third_party/lib/libzmq.a(libzmq_la-gssapi_mechanism_base.o): In functionzmq::gssapi_mechanism_base_t::acquire_credentials(char_, gss_cred_id_struct_*)': /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:320: undefined reference to GSS_C_NT_HOSTBASED_SERVICE'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:320: undefined reference togss_import_name' /home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:327: undefined reference to gss_acquire_cred'
/home/user/parameter_server/third_party/build/zeromq-4.1.0/src/gssapi_mechanism_base.cpp:332: undefined reference to`gss_release_name'

Workers dynamically join & leave

Hi,

In data parallelism, it is reasonable(or is it? ) to allow workers start to train a model replica at anytime, for 2 reasons: a) worker's resource may not all available at the start of training, b) for better convergence, 1 worker could start first to train a while to give a kickstart before other workers join the group ( mentioned here: http://research.google.com/archive/large_deep_networks_nips2012.html ).

Currently it seems that all servers/workers should be initiated before anyone of them start to run. And it seems to be controlled by PostOffice and can not easily be customized with my Scheduler or Server.

Thanks,

what's the defalut password & the error" libzmq.so.4: cannot open shared "

ubgpu@ubgpu:~/github/DMLC/parameter_server/example/linear$ ../../script/ps.sh start ../../build/linear -app_file ctr/online_l1lr.conf
use binary [../../build/linear] and arg [-app_file ctr/online_l1lr.conf]
starting 1 servers and 1 workers
[email protected]'s password:
[email protected]'s password:
../../build/linear: error while loading shared libraries: libzmq.so.4: cannot open shared object file: No such file or directory
[email protected]'s password:
[email protected]'s password: [email protected]'s password:
Permission denied, please try again.

Missing .h file after "make clean"

For the first time compilation, everything works well. However, after I typed "make clean" and make again, it keeps telling me "wire_format.h:44:43: fatal error: google/protobuf/descriptor.pb.h: No such file or directory".

Does "find . -name ".pb.[ch]" -delete" really need to be in the command?

Thanks,

Error while compiling "third_party" in Mavericks 10.9

My gcc version is
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.10.sdk/usr/include/c++/4.2.1 Apple LLVM version 6.0 (clang-600.0.56) (based on LLVM 3.5svn) Target: x86_64-apple-darwin13.4.0 Thread model: posix

g++ version is
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.10.sdk/usr/include/c++/4.2.1 Apple LLVM version 6.0 (clang-600.0.56) (based on LLVM 3.5svn) Target: x86_64-apple-darwin13.4.0 Thread model: posix

The error occurs while compiling sparsehash

In file included from src/hashtable_test.cc:60:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/../include/c++/v1/vector:502:5: error: implicit instantiation of undefined template
      '__static_assert_test<false>'
    static_assert((is_same<typename allocator_type::value_type, value_type>::value),
    ^
...
src/hashtable_test.cc:614:8: error: no viable conversion from 'google::BaseHashtableInterface<google::sparse_hash_map<int, int, <anonymous>::Hasher, <anonymous>::Hasher,
      <anonymous>::Alloc<int, unsigned long, 18446744073709551615> > >::iterator' to 'const google::BaseHashtableInterface<google::sparse_hash_map<int, int,
      <anonymous>::Hasher, <anonymous>::Hasher, <anonymous>::Alloc<int, unsigned long, 18446744073709551615> > >::const_iterator'
  ci = this->ht_.begin();
       ^~~~~~~~~~~~~~~~~

failed to run example on rcv1 because of relative path

hi, I just obtained the latest source and try to run with the config/rcv1 example, getting a core dump every time.

With gdb and glog output I find that FILE class cannot open the config (and then training data).

Maybe it would be more user-friendly if the config/rcv1 readme file would not suggest to run script/local.sh but cd script && ./local.sh, and not data/rcv1_small.sh but cd data && ./rcv1_small.sh.

Thanks for this project then~

MPI config file

May I ask where I can find the sample of MPI config files (ex, rcv1_mpi.conf)? or it uses the same file (batch_l1lr.conf),

Thanks

Limit on the minibatch config in the async_sgd app?

Hi,

I'm running async_sgd. I find when I set the minibatch config to the size of the whole dataset, the program will hang. The worker log says "the scheduler is died, killing myself". Is there any limit on the minibatch size?

Thanks,
Cui

Error while running "online_l1lr.conf"

$ ./local.sh 1 4 ../config/rcv1/online_l1lr.conf
I1208 16:39:02.350265 28809 postoffice.cc:67] Scheduler connected 1 servers and 4 workers
I1208 16:39:02.351523 28809 scheduler.cc:43] Found 13 training files
I1208 16:39:02.351568 28809 scheduler.cc:46] Assigned 13 files to 4 workers
F1208 16:39:02.511814 28877 ftrl_worker.cc:25] Check failed: ins.size() == 2 (0 vs. 2) 
*** Check failure stack trace: ***
    @     0x7f094e1ecbcd  google::LogMessage::Fail()
    @     0x7f094e1eeb48  google::LogMessage::SendToLog()
    @     0x7f094e1ec763  google::LogMessage::Flush()
    @     0x7f094e1ef47e  google::LogMessageFatal::~LogMessageFatal()
    @           0x487a6a  _ZNSt17_Function_handlerIFbPN2PS2LM10FTRLWorker9MinibatchEPmEZNS2_15computeGradientEvEUlS4_S5_E_E9_M_invokeERKSt9_Any_dataS4_S5_
    @           0x48a777  _ZNSt6thread5_ImplISt12_Bind_simpleIFZN2PS16ProducerConsumerINS2_2LM10FTRLWorker9MinibatchEE13startProducerERKSt8functionIFbPS6_PmEEEUlvE_vEEE6_M_runEv
    @     0x7f094d94fbf0  (unknown)
    @     0x7f094dbaa182  start_thread
    @     0x7f094d0b730d  clone
F1208 16:39:02.620822 28874 ftrl_worker.cc:25] Check failed: ins.size() == 2 (0 vs. 2) 
*** Check failure stack trace: ***
    @     0x7f7cdd7f4bcd  google::LogMessage::Fail()
    @     0x7f7cdd7f6b48  google::LogMessage::SendToLog()
    @     0x7f7cdd7f4763  google::LogMessage::Flush()
    @     0x7f7cdd7f747e  google::LogMessageFatal::~LogMessageFatal()
    @           0x487a6a  _ZNSt17_Function_handlerIFbPN2PS2LM10FTRLWorker9MinibatchEPmEZNS2_15computeGradientEvEUlS4_S5_E_E9_M_invokeERKSt9_Any_dataS4_S5_
    @           0x48a777  _ZNSt6thread5_ImplISt12_Bind_simpleIFZN2PS16ProducerConsumerINS2_2LM10FTRLWorker9MinibatchEE13startProducerERKSt8functionIFbPS6_PmEEEUlvE_vEEE6_M_runEv
    @     0x7f7cdcf57bf0  (unknown)
    @     0x7f7cdd1b2182  start_thread
    @     0x7f7cdc6bf30d  clone

error when make parameter_server in MacOS 10.10.4

error msg:
In file included from src/util/file.cc:1:
In file included from ./src/util/file.h:8:
In file included from ./src/util/common.h:42:
./src/util/resource_usage.h:35:17: error: use of undeclared identifier 'CLOCK_MONOTONIC_RAW'
clock_gettime(CLOCK_MONOTONIC_RAW, &tv);

gcc version:
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Apple LLVM version 5.1 (clang-503.0.40) (based on LLVM 3.4svn)
Target: x86_64-apple-darwin14.4.0
Thread model: posix

How to train a model on a fixed dataset using SGD?

Hi,

I assume the "async_sgd" app is the one to use if we are going to train a model using SGD (correct me if I'm wrong).

And if I understand correctly, the "async_sgd" app will go through the data multiple times (specified by the "max_pass_of_data" config), but the printed "loss" is actually the average loss of all these data passes (the loss of the first pass also gets averaged). Is that correct?

Since we are using a fixed dataset, we hope to train the model using the batched way. But we find the "darlin" app uses BCD instead of SGD. Is that possible to train on batched data using SGD? It will be useful if the async_sgd app could print out the loss of the current model on only one copy of the input dataset during the training.

Thanks,
Cui

running error.

F0729 18:10:19.777163 18343 remote_node.h:26] Check failed: ts < 1000000 (1000000 vs. 1000000)

APIs for Java

Hi,

I'm newbie in this project, and I'm wondering whether there's a Java API to access Parameter Server?

System hangs when a server is killed

The system hangs (node where scheduler is running stops displaying iteration outcomes on the terminal. Logs are also not generated) whenever a server process is killed (both on local machine or on remote machine). Is it the expected behaviour ? Shouldn't it still continue to run with gradients being updated on the backup/replicated server node as described in the paper ?

Here are the steps that I ran (from "parameter_server/example/linear" dir):

../../script/ps.sh start -nw 4 -ns 3 -hostfile hostfile ../../build/linear -app_file ctr/online_l1lr.conf -num_replicas 2 -report_interval 1

Then I killed a server process on one of the nodes. This stops the system. Killing a worker node, still continues the SGD and converges eventually.

Any help in this regard will be highly appreciated.

Thanks,
Danish

Error when make on ubuntu 12.04

the message is as follows:
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
In file included from ./src/util/filelinereader.h:8:0,
from src/util/filelinereader.cc:1:
./src/util/file.h: At global scope:
./src/util/file.h:79:14: sorry, unimplemented: non-static data member initializers
./src/util/file.h:79:14: error: ‘constexpr’ needed for in-class initialization of static data member ‘f_’ of non-integral type
./src/util/file.h:80:18: sorry, unimplemented: non-static data member initializers
./src/util/file.h:80:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘gz_f_’ of non-integral type
./src/util/file.h:81:17: sorry, unimplemented: non-static data member initializers
./src/util/file.h:81:17: error: ISO C++ forbids in-class initialization of non-const static member ‘is_gz_’
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:31: error: ‘f_’ was not declared in this scope
./src/util/file.h: In constructor ‘PS::File::File(FILE_, const string&)’:
./src/util/file.h:74:9: error: class ‘PS::File’ does not have any field named ‘f_’
./src/util/file.h: In constructor ‘PS::File::File(gzFile, const string&)’:
./src/util/file.h:76:9: error: class ‘PS::File’ does not have any field named ‘gz_f_’
In file included from ./src/util/common.h:42:0,
from ./src/data/info_parser.h:2,
from src/data/info_parser.cc:1:
./src/util/resource_usage.h:69:38: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:69:38: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:69:38: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
make: ** [build/util/filelinereader.o] Error 1
In file included from ./src/util/common.h:42:0,
from ./src/util/file.h:8,
from src/util/file.cc:1:
./src/util/resource_usage.h:69:38: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:69:38: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:69:38: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp’ of non-integral type
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
make: *** [build/data/text_parser.o] Error 1
In file included from ./src/util/common.h:42:0,
from ./src/util/shared_array.h:3,
from ./src/util/shared_array_inl.h:2,
from ./src/data/slot_reader.h:2,
from src/data/slot_reader.cc:1:
./src/util/resource_usage.h:69:38: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:69:38: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:69:38: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
In file included from src/util/file.cc:1:0:
./src/util/file.h: At global scope:
./src/util/file.h:79:14: sorry, unimplemented: non-static data member initializers
./src/util/file.h:79:14: error: ‘constexpr’ needed for in-class initialization of static data member ‘f_’ of non-integral type
./src/util/file.h:80:18: sorry, unimplemented: non-static data member initializers
./src/util/file.h:80:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘gz_f_’ of non-integral type
./src/util/file.h:81:17: sorry, unimplemented: non-static data member initializers
./src/util/file.h:81:17: error: ISO C++ forbids in-class initialization of non-const static member ‘is_gz_’
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:31: error: ‘f_’ was not declared in this scope
./src/util/file.h: In constructor ‘PS::File::File(FILE_, const string&)’:
./src/util/file.h:74:9: error: class ‘PS::File’ does not have any field named ‘f_’
./src/util/file.h: In constructor ‘PS::File::File(gzFile, const string&)’:
./src/util/file.h:76:9: error: class ‘PS::File’ does not have any field named ‘gz_f_’
src/util/file.cc: In member function ‘bool PS::File::flush()’:
src/util/file.cc:144:28: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:144:62: error: ‘f_’ was not declared in this scope
src/util/file.cc: In member function ‘bool PS::File::close()’:
src/util/file.cc:148:31: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:148:55: error: ‘f_’ was not declared in this scope
src/util/file.cc: In member function ‘size_t PS::File::read(void_, size_t)’:
src/util/file.cc:154:27: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:154:67: error: ‘f_’ was not declared in this scope
src/util/file.cc: In member function ‘size_t PS::File::write(const void_, size_t)’:
src/util/file.cc:158:28: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:158:69: error: ‘f_’ was not declared in this scope
src/util/file.cc: In member function ‘char_ PS::File::readLine(char_, uint64)’:
src/util/file.cc:162:27: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:162:82: error: ‘f_’ was not declared in this scope
src/util/file.cc: In member function ‘bool PS::File::seek(size_t)’:
src/util/file.cc:167:18: error: ‘gz_f_’ was not declared in this scope
src/util/file.cc:168:17: error: ‘f_’ was not declared in this scope
In file included from ./src/util/common.h:42:0,
from ./src/data/common.h:2,
from src/data/common.cc:2:
./src/util/resource_usage.h:69:38: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:69:38: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:69:38: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
In file included from src/data/info_parser.cc:1:0:
./src/data/info_parser.h: At global scope:
./src/data/info_parser.h:19:20: sorry, unimplemented: non-static data member initializers
./src/data/info_parser.h:19:20: error: ISO C++ forbids in-class initialization of non-const static member ‘num_ex_’
In file included from ./src/util/shared_array.h:4:0,
from ./src/util/shared_array_inl.h:2,
from ./src/data/slot_reader.h:2,
from src/data/slot_reader.cc:1:
./src/util/file.h: At global scope:
./src/util/file.h:79:14: sorry, unimplemented: non-static data member initializers
./src/util/file.h:79:14: error: ‘constexpr’ needed for in-class initialization of static data member ‘f_’ of non-integral type
./src/util/file.h:80:18: sorry, unimplemented: non-static data member initializers
./src/util/file.h:80:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘gz_f_’ of non-integral type
./src/util/file.h:81:17: sorry, unimplemented: non-static data member initializers
./src/util/file.h:81:17: error: ISO C++ forbids in-class initialization of non-const static member ‘is_gz_’
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:31: error: ‘f_’ was not declared in this scope
./src/util/file.h: In constructor ‘PS::File::File(FILE_, const string&)’:
./src/util/file.h:74:9: error: class ‘PS::File’ does not have any field named ‘f_’
./src/util/file.h: In constructor ‘PS::File::File(gzFile, const string&)’:
./src/util/file.h:76:9: error: class ‘PS::File’ does not have any field named ‘gz_f_’
In file included from src/data/common.cc:3:0:
./src/util/file.h: At global scope:
./src/util/file.h:79:14: sorry, unimplemented: non-static data member initializers
./src/util/file.h:79:14: error: ‘constexpr’ needed for in-class initialization of static data member ‘f_’ of non-integral type
./src/util/file.h:80:18: sorry, unimplemented: non-static data member initializers
./src/util/file.h:80:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘gz_f_’ of non-integral type
./src/util/file.h:81:17: sorry, unimplemented: non-static data member initializers
./src/util/file.h:81:17: error: ISO C++ forbids in-class initialization of non-const static member ‘is_gz_’
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:31: error: ‘f_’ was not declared in this scope
./src/util/file.h: In constructor ‘PS::File::File(FILE_, const string&)’:
./src/util/file.h:74:9: error: class ‘PS::File’ does not have any field named ‘f_’
./src/util/file.h: In constructor ‘PS::File::File(gzFile, const string&)’:
./src/util/file.h:76:9: error: class ‘PS::File’ does not have any field named ‘gz_f_’
In file included from ./src/util/common.h:42:0,
from ./src/system/assigner.h:2,
from src/system/assigner.cc:1:
./src/util/resource_usage.h:69:38: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:69:38: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:69:38: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:70:18: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:70:18: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::Timer::start()’:
./src/util/resource_usage.h:62:18: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::Timer::reset()’:
./src/util/resource_usage.h:64:18: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::stop()’:
./src/util/resource_usage.h:65:19: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:65:32: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::Timer::get()’:
./src/util/resource_usage.h:66:25: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: At global scope:
./src/util/resource_usage.h:84:40: error: ‘std::chrono::system_clock::time_point PS::tic()’ is not ‘constexpr’
./src/util/resource_usage.h:84:40: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:84:40: error: ‘constexpr’ needed for in-class initialization of static data member ‘tp_’ of non-integral type
./src/util/resource_usage.h:85:20: sorry, unimplemented: non-static data member initializers
./src/util/resource_usage.h:85:20: error: ‘constexpr’ needed for in-class initialization of static data member ‘time_’ of non-integral type
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::start()’:
./src/util/resource_usage.h:76:20: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘void PS::MilliTimer::reset()’:
./src/util/resource_usage.h:78:20: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::stop()’:
./src/util/resource_usage.h:79:21: error: ‘time_’ was not declared in this scope
./src/util/resource_usage.h:79:39: error: ‘tp_’ was not declared in this scope
./src/util/resource_usage.h: In member function ‘double PS::MilliTimer::get()’:
./src/util/resource_usage.h:80:27: error: ‘time_’ was not declared in this scope
src/util/file.cc:169:1: warning: control reaches end of non-void function [-Wreturn-type]
src/util/file.cc: In member function ‘char_ PS::File::readLine(char_, uint64)’:
src/util/file.cc:163:1: warning: control reaches end of non-void function [-Wreturn-type]
src/util/file.cc: In member function ‘size_t PS::File::write(const void_, size_t)’:
src/util/file.cc:159:1: warning: control reaches end of non-void function [-Wreturn-type]
src/util/file.cc: In member function ‘size_t PS::File::read(void_, size_t)’:
src/util/file.cc:155:1: warning: control reaches end of non-void function [-Wreturn-type]
src/util/file.cc: In member function ‘bool PS::File::flush()’:
src/util/file.cc:145:1: warning: control reaches end of non-void function [-Wreturn-type]
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:44: warning: control reaches end of non-void function [-Wreturn-type]
make: ** [build/util/file.o] Error 1
make: *** [build/data/info_parser.o] Error 1
In file included from src/system/assigner.cc:1:0:
./src/system/assigner.h: At global scope:
./src/system/assigner.h:34:22: sorry, unimplemented: non-static data member initializers
./src/system/assigner.h:34:22: error: ISO C++ forbids in-class initialization of non-const static member ‘num_servers’
./src/system/assigner.h:35:22: sorry, unimplemented: non-static data member initializers
./src/system/assigner.h:35:22: error: ISO C++ forbids in-class initialization of non-const static member ‘server_rank_’
./src/system/assigner.h:36:22: sorry, unimplemented: non-static data member initializers
./src/system/assigner.h:36:22: error: ISO C++ forbids in-class initialization of non-const static member ‘worker_rank_’
./src/system/assigner.h:56:16: sorry, unimplemented: non-static data member initializers
./src/system/assigner.h:56:16: error: ISO C++ forbids in-class initialization of non-const static member ‘cur_i_’
In file included from ./src/util/shared_array_inl.h:2:0,
from ./src/data/slot_reader.h:2,
from src/data/slot_reader.cc:1:
./src/util/shared_array.h: At global scope:
./src/util/shared_array.h:288:18: sorry, unimplemented: non-static data member initializers
./src/util/shared_array.h:288:18: error: ISO C++ forbids in-class initialization of non-const static member ‘size_’
./src/util/shared_array.h:289:22: sorry, unimplemented: non-static data member initializers
./src/util/shared_array.h:289:22: error: ISO C++ forbids in-class initialization of non-const static member ‘capacity_’
./src/util/shared_array.h:290:14: sorry, unimplemented: non-static data member initializers
./src/util/shared_array.h:291:61: sorry, unimplemented: non-static data member initializers
./src/util/shared_array.h:291:61: error: in-class initialization of static data member ‘ptr_’ of non-literal type
./src/util/shared_array.h: In member function ‘const std::shared_ptr& PS::SArray::pointer() const’:
./src/util/shared_array.h:226:57: error: ‘ptr_’ was not declared in this scope
./src/util/shared_array.h: In member function ‘std::shared_ptr& PS::SArray::pointer()’:
./src/util/shared_array.h:227:45: error: ‘ptr_’ was not declared in this scope
make: *** [build/system/assigner.o] Error 1
make: *** [build/data/common.o] Error 1
In file included from ./src/util/dense_matrix.h:3:0,
from ./src/util/shared_array_inl.h:3,
from ./src/data/slot_reader.h:2,
from src/data/slot_reader.cc:1:
./src/util/matrix.h: At global scope:
./src/util/matrix.h:13:22: error: expected unqualified-id before ‘using’
./src/util/matrix.h:14:22: error: expected unqualified-id before ‘using’
./src/util/matrix.h:15:22: error: expected unqualified-id before ‘using’
./src/util/matrix.h:63:11: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:66:11: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:69:3: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:72:3: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:76:11: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:79:11: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h:80:11: error: ‘MatrixPtr’ does not name a type
./src/util/matrix.h: In member function ‘PS::Matrix::EVec PS::Matrix::transTimes(const Eigen::Ref<const Eigen::Matrix<V, -0x00000000000000001, 1> >&) const’:
./src/util/matrix.h:58:18: error: there are no arguments to ‘trans’ that depend on a template parameter, so a declaration of ‘trans’ must be available [-fpermissive]
./src/util/matrix.h:58:18: note: (if you use ‘-fpermissive’, G++ will accept your code, but allowing the use of an undeclared name is deprecated)
In file included from ./src/util/shared_array_inl.h:3:0,
from ./src/data/slot_reader.h:2,
from src/data/slot_reader.cc:1:
./src/util/dense_matrix.h: At global scope:
./src/util/dense_matrix.h:25:11: error: ‘MatrixPtr’ does not name a type
./src/util/dense_matrix.h:28:11: error: ‘MatrixPtr’ does not name a type
./src/util/dense_matrix.h:33:11: error: ‘MatrixPtr’ does not name a type
./src/util/dense_matrix.h:36:11: error: ‘MatrixPtr’ does not name a type
./src/util/dense_matrix.h:44:11: error: ‘MatrixPtr’ does not name a type
./src/util/dense_matrix.h:87:1: error: ‘MatrixPtr’ does not name a type
In file included from ./src/data/slot_reader.h:2:0,
from src/data/slot_reader.cc:1:
./src/util/shared_array_inl.h: In member function ‘void PS::SArray::reset(V_, std::size_t, bool)’:
./src/util/shared_array_inl.h:60:5: error: ‘ptr_’ was not declared in this scope
./src/util/shared_array_inl.h:64:5: error: ‘ptr_’ was not declared in this scope
./src/util/shared_array_inl.h: In member function ‘void PS::SArray::operator=(const PS::SArray&)’:
./src/util/shared_array_inl.h:80:3: error: ‘ptr_’ was not declared in this scope
./src/util/shared_array_inl.h: At global scope:
./src/util/shared_array_inl.h:193:1: error: ‘MatrixPtr’ does not name a type
./src/util/shared_array_inl.h: In member function ‘bool PS::SArray::ReadFromFile(PS::SizeR, const PS::DataConfig&)’:
./src/util/shared_array_inl.h:217:22: error: ‘ptr_’ was not declared in this scope
./src/util/shared_array_inl.h: In member function ‘bool PS::SArray::WriteToFile(PS::SizeR, const string&) const’:
./src/util/shared_array_inl.h:228:23: error: ‘ptr_’ was not declared in this scope
In file included from src/data/slot_reader.cc:3:0:
./src/data/info_parser.h: At global scope:
./src/data/info_parser.h:19:20: sorry, unimplemented: non-static data member initializers
./src/data/info_parser.h:19:20: error: ISO C++ forbids in-class initialization of non-const static member ‘num_ex_’
In file included from src/data/slot_reader.cc:5:0:
./src/util/threadpool.h:44:29: sorry, unimplemented: non-static data member initializers
./src/util/threadpool.h:44:29: error: ISO C++ forbids in-class initialization of non-const static member ‘waiting_to_finish_’
./src/util/threadpool.h:45:19: sorry, unimplemented: non-static data member initializers
./src/util/threadpool.h:45:19: error: ISO C++ forbids in-class initialization of non-const static member ‘started_’
./src/util/shared_array_inl.h: In member function ‘bool PS::SArray::ReadFromFile(PS::SizeR, const PS::DataConfig&) [with V = char, PS::SizeR = PS::Range]’:
./src/util/shared_array_inl.h:218:1: warning: control reaches end of non-void function [-Wreturn-type]
./src/util/file.h: In member function ‘bool PS::File::open() const’:
./src/util/file.h:71:44: warning: control reaches end of non-void function [-Wreturn-type]
./src/util/shared_array_inl.h: In member function ‘bool PS::SArray::WriteToFile(PS::SizeR, const string&) const [with V = char, PS::SizeR = PS::Range, std::string = std::basic_string]’:
./src/util/shared_array_inl.h:230:1: warning: control reaches end of non-void function [-Wreturn-type]
make: *_* [build/data/slot_reader.o] Error 1

sse4.2 instruction set not enabled

How to solve this error？

bug in the file "eval_online.conf"

linear_method {

validation_data {
format: TEXT
text: LIBSVM
file: "data/test/part.*"
}

model_input {
format: TEXT
file: "../output/rcv1_online." // should be " model/rcv1_online. "
}

}

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.