qihoo360 / logkafka Goto Github PK

在producer中如果使用rd_kafka_conf_set_dr_msg_cb设置回调函数msgDelivered2会导致内存泄露，在测试中遇到过这种情况吗？

#0 0x00007fff90ef445c in pthread_mutex_lock () from /usr/lib/system/libsystem_pthread.dylib
#1 0x000000010003a912 in base::Mutex::lock() ()
#2 0x000000010003a8dc in base::ScopedLock::ScopedLock(base::Mutex&) ()
#3 0x000000010003a232 in base::ScopedLock::ScopedLock(base::Mutex&) ()
#4 0x00000001001092aa in logkafka::TailWatcher::isActive (this=0x0) at /Users/datasci/develop/logkafka/src/logkafka/tail_watcher.cc:307
#5 0x000000010007715c in logkafka::Manager::updateWatcherRotate (manager=0x10060c490, path_pattern=..., path=..., position_entry=0x102800100) at /Users/datasci/develop/logkafka/src/logkafka/manager.cc:770
#6 0x00000001001087b8 in logkafka::TailWatcher::onRotate (arg=0x1028007e0, file=0x7fff751e0808) at /Users/datasci/develop/logkafka/src/logkafka/tail_watcher.cc:247
#7 0x00000001001048e8 in logkafka::RotateHandler::onNotify (arg=0x100303f50) at /Users/datasci/develop/logkafka/src/logkafka/rotate_handler.cc:83
#8 0x000000010010736d in logkafka::TailWatcher::onNotify (arg=0x1028007e0) at /Users/datasci/develop/logkafka/src/logkafka/tail_watcher.cc:141
#9 0x00000001001284ad in base::TimerWatcher::cb_func (w=0x1003040f0) at /Users/datasci/develop/logkafka/src/base/timer_watcher.cc:64
#10 0x0000000100171d15 in uv__run_timers (loop=0x10100a400) at src/unix/timer.c:165
#11 0x00000001001661a3 in uv_run (loop=0x10100a400, mode=UV_RUN_DEFAULT) at src/unix/core.c:319
#12 0x000000010003eb0c in logkafka::LogKafka::start (this=0x10060c220) at /Users/datasci/develop/logkafka/src/logkafka/logkafka.cc:91
#13 0x000000010003fa25 in run (option=...) at /Users/datasci/develop/logkafka/src/logkafka/main.cc:130
#14 0x000000010003ef8c in main (argc=5, argv=0x7fff5fbff880) at /Users/datasci/develop/logkafka/src/logkafka/main.cc:54

如题，只能支持0.8版本嘛？高版本不行吗？

Got info as following:
Linking CXX executable ../bin/logkafka
librdkafka/lib/librdkafka.a(rdkafka_broker.o): In function rd_kafka_broker_produce_toppar': /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2101: undefined reference tocrc32'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2106: undefined reference to crc32' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2120: undefined reference tocrc32'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2134: undefined reference to crc32' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2145: undefined reference tocrc32'
librdkafka/lib/librdkafka.a(rdkafka_broker.o):/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2340: more undefined references to crc32' follow librdkafka/lib/librdkafka.a(rdkafka_broker.o): In functionrd_kafka_broker_produce_toppar':
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2193: undefined reference to deflateInit2_' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2213: undefined reference to deflateBound'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2235: undefined reference todeflate' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2259: undefined reference to deflate'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2271: undefined reference todeflateEnd' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2249: undefined reference to deflateEnd'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdkafka_broker.c:2279: undefined reference todeflateEnd' librdkafka/lib/librdkafka.a(rdgz.o): In function rd_gz_decompress':
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:59: undefined reference toinflateInit2_' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:65: undefined reference to inflateGetHeader'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:84: undefined reference toinflate' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:115: undefined reference to inflateEnd'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:90: undefined reference toinflateEnd' /data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:115: undefined reference to inflateEnd'
/data/home/samson/repo/logkafka.git/_build/src/librdkafka/src/project_librdkafka/src/rdgz.c:106: undefined reference to`inflateEnd'
collect2: error: ld returned 1 exit status
collect2: error: ld returned 1 exit status
make[2]: *** [bin/logkafka] Error 1
make[1]: *** [src/CMakeFiles/logkafka.dir/all] Error 2
make: *** [all] Error 2

We will replace original regex with pcre2 library.

Now just support utf-8

$...:c jon.doe$ sudo make install
Password:
/bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I./include -I./tests -I./generated -Wall -Werror -g -O2 -D_GNU_SOURCE -MT zookeeper.lo -MD -MP -MF .deps/zookeeper.Tpo -c -o zookeeper.lo test -f 'src/zookeeper.c' || echo './'src/zookeeper.c
libtool: compile: gcc -DHAVE_CONFIG_H -I. -I./include -I./tests -I./generated -Wall -Werror -g -O2 -D_GNU_SOURCE -MT zookeeper.lo -MD -MP -MF .deps/zookeeper.Tpo -c src/zookeeper.c -fno-common -DPIC -o .libs/zookeeper.o
In file included from src/zookeeper.c:27:
In file included from ./include/zookeeper.h:34:
./include/recordio.h:76:9: error: expected ')'
int64_t htonll(int64_t v);
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'
#define htonll(x) __DARWIN_OSSwapInt64(x)
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/libkern/_OSByteOrder.h:78:30: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
./include/recordio.h:76:9: note: to match this '('
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'
#define htonll(x) __DARWIN_OSSwapInt64(x)
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/libkern/_OSByteOrder.h:78:5: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
In file included from src/zookeeper.c:27:
In file included from ./include/zookeeper.h:34:
./include/recordio.h:76:9: error: cannot redeclare builtin function '__builtin_constant_p'
int64_t htonll(int64_t v);
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'
#define htonll(x) __DARWIN_OSSwapInt64(x)
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/libkern/_OSByteOrder.h:78:6: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
./include/recordio.h:76:9: note: '__builtin_constant_p' is a builtin with type 'int ()'
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'
#define htonll(x) __DARWIN_OSSwapInt64(x)
^
/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/libkern/_OSByteOrder.h:78:6: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
2 errors generated.
make: *** [zookeeper.lo] Error 1

已经按照logkafka的WIKI安装好了logkafka并且启动，kafka manager也已经成功启动。但是无法收集到日志。

logkafka的日志（testLog.log）如下：

kafka manager的配置界面（一直处于inactive，即使运行了kafka consumer进行消费，仍然无日志）

这样可能哪些原因造成？

We will use file operations of libuv to replace the standard io operations of libc, and you can specify delimiter for each log file.

Producer::send是多线程安全的吗？

配置好kafkamanger，一直无法收集到数据，消费端也起来了，application.log日志中也没有报错信息：
2016-08-29 15:24:56,137 - [INFO] - from kafka.manager.BrokerViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-271
Updating broker view...

2016-08-29 15:24:56,143 - [INFO] - from kafka.manager.LogkafkaViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-269
Updating logkafka view...

2016-08-29 15:25:06,084 - [INFO] - from kafka.manager.KafkaManagerActor in kafka-manager-system-akka.actor.default-dispatcher-271
Updating internal state...

2016-08-29 15:25:06,133 - [INFO] - from kafka.manager.BrokerViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-269
Updating broker view...

2016-08-29 15:25:06,144 - [INFO] - from kafka.manager.LogkafkaViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-265
Updating logkafka view...

2016-08-29 15:25:16,074 - [INFO] - from kafka.manager.KafkaManagerActor in kafka-manager-system-akka.actor.default-dispatcher-259
Updating internal state...

2016-08-29 15:25:16,124 - [INFO] - from kafka.manager.BrokerViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-265
Updating broker view...

2016-08-29 15:25:16,143 - [INFO] - from kafka.manager.LogkafkaViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-275
Updating logkafka view...

2016-08-29 15:25:26,073 - [INFO] - from kafka.manager.KafkaManagerActor in kafka-manager-system-akka.actor.default-dispatcher-265
Updating internal state...

2016-08-29 15:25:26,124 - [INFO] - from kafka.manager.BrokerViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-253
Updating broker view...

2016-08-29 15:25:26,144 - [INFO] - from kafka.manager.LogkafkaViewCacheActor in kafka-manager-system-akka.actor.default-dispatcher-276
Updating logkafka view...

麻烦帮忙看一下，是什么原因

Debian jessie packages libuv version 0.10, and building logkafka with that results in this error:

[  7%] Building CXX object src/CMakeFiles/logkafka.dir/logkafka/tail_watcher.cc.o
In file included from /home/geoff/Software/logkafka/src/logkafka/tail_watcher.h:32:0,
                 from /home/geoff/Software/logkafka/src/logkafka/tail_watcher.cc:22:
/home/geoff/Software/logkafka/src/base/stat_watcher.h:65:23: error: ‘uv_stat_t’ does not name a type
                 const uv_stat_t* prev, 
                       ^
/home/geoff/Software/logkafka/src/base/stat_watcher.h:66:23: error: ‘uv_stat_t’ does not name a type
                 const uv_stat_t* curr);
                       ^
src/CMakeFiles/logkafka.dir/build.make:146: recipe for target 'src/CMakeFiles/logkafka.dir/logkafka/tail_watcher.cc.o' failed

From a look at the libuv github, the type uv_stat_t was evidently introduced in version 0.11 (previously uv_statbuf_t).

After cloning the libuv git and building the current version from source (presently 1.7.6), the logkafka build succeeded.

So I can't say exactly which minimum version of libuv is required for logkafka -- at least 0.11, and I would guess probably 1.x. You might want to mention that in the install instructions.

According to the build method 1. when executing the make command. Got error as following.

The OS is centos 6.5

Linking CXX executable ../bin/logkafka
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_ssl_error': /tmp/librdkafka-master/src/rdkafka_transport.c:289: undefined reference toERR_error_string_n'
/tmp/librdkafka-master/src/rdkafka_transport.c:278: undefined reference to ERR_get_error_line_data' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_ssl_io_update':
/tmp/librdkafka-master/src/rdkafka_transport.c:364: undefined reference to SSL_get_error' /tmp/librdkafka-master/src/rdkafka_transport.c:379: undefined reference toSSL_get_error'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_recvmsg': /tmp/librdkafka-master/src/rdkafka_transport.c:444: undefined reference toSSL_read'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_sendmsg': /tmp/librdkafka-master/src/rdkafka_transport.c:412: undefined reference toSSL_write'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_ctx_init': /tmp/librdkafka-master/src/rdkafka_transport.c:649: undefined reference toSSLv23_client_method'
/tmp/librdkafka-master/src/rdkafka_transport.c:649: undefined reference to SSL_CTX_new' /tmp/librdkafka-master/src/rdkafka_transport.c:655: undefined reference toSSL_CTX_set_default_passwd_cb'
/tmp/librdkafka-master/src/rdkafka_transport.c:656: undefined reference to SSL_CTX_set_default_passwd_cb_userdata' /tmp/librdkafka-master/src/rdkafka_transport.c:663: undefined reference toSSL_CTX_set_cipher_list'
/tmp/librdkafka-master/src/rdkafka_transport.c:681: undefined reference to SSL_CTX_load_verify_locations' /tmp/librdkafka-master/src/rdkafka_transport.c:698: undefined reference toSSL_CTX_use_certificate_chain_file'
/tmp/librdkafka-master/src/rdkafka_transport.c:710: undefined reference to SSL_CTX_use_PrivateKey_file' /tmp/librdkafka-master/src/rdkafka_transport.c:718: undefined reference toSSL_CTX_ctrl'
/tmp/librdkafka-master/src/rdkafka_transport.c:725: undefined reference to SSL_CTX_free' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_ssl_ctx_term':
/tmp/librdkafka-master/src/rdkafka_transport.c:630: undefined reference to SSL_CTX_free' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_ssl_init':
/tmp/librdkafka-master/src/rdkafka_transport.c:339: undefined reference to CRYPTO_num_locks' /tmp/librdkafka-master/src/rdkafka_transport.c:345: undefined reference toCRYPTO_set_id_callback'
/tmp/librdkafka-master/src/rdkafka_transport.c:346: undefined reference to CRYPTO_set_locking_callback' /tmp/librdkafka-master/src/rdkafka_transport.c:348: undefined reference toSSL_load_error_strings'
/tmp/librdkafka-master/src/rdkafka_transport.c:349: undefined reference to SSL_library_init' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_close':
/tmp/librdkafka-master/src/rdkafka_transport.c:81: undefined reference to SSL_shutdown' /tmp/librdkafka-master/src/rdkafka_transport.c:82: undefined reference toSSL_free'
/tmp/librdkafka-master/src/rdkafka_transport.c:88: undefined reference to sasl_dispose' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_ssl_handhsake':
/tmp/librdkafka-master/src/rdkafka_transport.c:598: undefined reference to SSL_do_handshake' /usr/local/lib/librdkafka.a(rdkafka_transport.o): In functionrd_kafka_transport_ssl_io_update':
/tmp/librdkafka-master/src/rdkafka_transport.c:364: undefined reference to SSL_get_error' /tmp/librdkafka-master/src/rdkafka_transport.c:379: undefined reference toSSL_get_error'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_connect': /tmp/librdkafka-master/src/rdkafka_transport.c:506: undefined reference toSSL_new'
/tmp/librdkafka-master/src/rdkafka_transport.c:510: undefined reference to SSL_set_fd' /tmp/librdkafka-master/src/rdkafka_transport.c:513: undefined reference toSSL_connect'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_verify': /tmp/librdkafka-master/src/rdkafka_transport.c:565: undefined reference toSSL_get_peer_certificate'
/tmp/librdkafka-master/src/rdkafka_transport.c:566: undefined reference to X509_free' /tmp/librdkafka-master/src/rdkafka_transport.c:574: undefined reference toSSL_get_verify_result'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_handhsake': /tmp/librdkafka-master/src/rdkafka_transport.c:575: undefined reference toX509_verify_cert_error_string'
/usr/local/lib/librdkafka.a(rdkafka_transport.o): In function rd_kafka_transport_ssl_init': /tmp/librdkafka-master/src/rdkafka_transport.c:350: undefined reference toOPENSSL_add_all_algorithms_noconf'
/usr/local/lib/librdkafka.a(rdkafka_sasl.o): In function rd_kafka_sasl_global_init': /tmp/librdkafka-master/src/rdkafka_sasl.c:557: undefined reference tosasl_client_init'
/tmp/librdkafka-master/src/rdkafka_sasl.c:559: undefined reference to sasl_errstring' /usr/local/lib/librdkafka.a(rdkafka_sasl.o): In functionrd_kafka_sasl_client_new':
/tmp/librdkafka-master/src/rdkafka_sasl.c:459: undefined reference to sasl_client_new' /tmp/librdkafka-master/src/rdkafka_sasl.c:484: undefined reference tosasl_client_start'
/tmp/librdkafka-master/src/rdkafka_sasl.c:495: undefined reference to sasl_errdetail' /tmp/librdkafka-master/src/rdkafka_sasl.c:470: undefined reference tosasl_listmech'
/tmp/librdkafka-master/src/rdkafka_sasl.c:463: undefined reference to sasl_errstring' /usr/local/lib/librdkafka.a(rdkafka_sasl.o): In functionrd_kafka_sasl_handle_recv':
/tmp/librdkafka-master/src/rdkafka_sasl.c:118: undefined reference to sasl_client_step' /tmp/librdkafka-master/src/rdkafka_sasl.c:151: undefined reference tosasl_errdetail'
/tmp/librdkafka-master/src/rdkafka_sasl.c:118: undefined reference to sasl_client_step' /tmp/librdkafka-master/src/rdkafka_sasl.c:163: undefined reference tosasl_getprop'
/tmp/librdkafka-master/src/rdkafka_sasl.c:167: undefined reference to sasl_getprop' /tmp/librdkafka-master/src/rdkafka_sasl.c:171: undefined reference tosasl_getprop'
/usr/local/lib/librdkafka.a(rdkafka_sasl.o): In function rd_kafka_sasl_global_term': /tmp/librdkafka-master/src/rdkafka_sasl.c:545: undefined reference tosasl_done'
collect2: ld ?? 1
make[2]: *** [bin/logkafka] Error 1
make[1]: *** [src/CMakeFiles/logkafka.dir/all] Error 2
make: *** [all] Error 2

This will slow down the procedure, we should try to remove it.

这个错误什么意思？好不容配好，但是收集的日志并没有给broker啊。consumer无法消费到日志

My first attempt to build after git clone failed with this message:

[ 10%] Building CXX object src/CMakeFiles/logkafka.dir/logkafka/signal_handler.cc.o
In file included from /usr/include/c++/4.9/thread:35:0,
                 from /home/geoff/Software/logkafka/src/third_party/easylogging/easylogging++.h:280,
                 from /home/geoff/Software/logkafka/src/logkafka/signal_handler.h:33,
                 from /home/geoff/Software/logkafka/src/logkafka/signal_handler.cc:22:
/usr/include/c++/4.9/bits/c++0x_warning.h:32:2: error: #error This file requires compiler and library support for the ISO C++ 2011 standard. This support is currently experimental, and must be enabled with the -std=c++11 or -std=gnu++11 compiler options.

That step succeeded after adding this line to CMakeLists.txt:

set(CMAKE_CXX_FLAGS "-std=c++11")

We will add an id to logkafka.conf, and name the original zookeeper node as "${hostname}-id".

Add log collecting stat bitset, which will include errors like buffer full, file accessing error, etc.

In order to prevent lack of disk space after truncating file to 0.

We will add log config group in v2.0

make[3]: warning: jobserver unavailable: using -j1. Add `+' to parent make rule.
/bin/sh ./libtool --mode=install /usr/bin/install -c libuv.la '/root/logkafka-master/_build/src/libuv/lib'
libtool: install: /usr/bin/install -c .libs/libuv.so.1.0.0 /root/logkafka-master/_build/src/libuv/lib/libuv.so.1.0.0
libtool: install: (cd /root/logkafka-master/_build/src/libuv/lib && { ln -s -f libuv.so.1.0.0 libuv.so.1 || { rm -f libuv.so.1 && ln -s libuv.so.1.0.0 libuv.so.1; }; })
libtool: install: (cd /root/logkafka-master/_build/src/libuv/lib && { ln -s -f libuv.so.1.0.0 libuv.so || { rm -f libuv.so && ln -s libuv.so.1.0.0 libuv.so; }; })
libtool: install: /usr/bin/install -c .libs/libuv.lai /root/logkafka-master/_build/src/libuv/lib/libuv.la
libtool: install: /usr/bin/install -c .libs/libuv.a /root/logkafka-master/_build/src/libuv/lib/libuv.a
libtool: install: chmod 644 /root/logkafka-master/_build/src/libuv/lib/libuv.a
libtool: install: ranlib /root/logkafka-master/_build/src/libuv/lib/libuv.a

libtool: finish: PATH="/usr/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/root/bin:/sbin" ldconfig -n /root/logkafka-master/_build/src/libuv/lib

Libraries have been installed in:
/root/logkafka-master/_build/src/libuv/lib

If you ever happen to want to link against installed libraries
in a given directory, LIBDIR, you must either use libtool, and
specify the full pathname of the library, or use the `-LLIBDIR'
flag during linking and do at least one of the following:

• add LIBDIR to the `LD_LIBRARY_PATH' environment variable
  during execution
• add LIBDIR to the `LD_RUN_PATH' environment variable
  during linking
• use the `-Wl,-rpath -Wl,LIBDIR' linker flag
• have your system administrator add LIBDIR to `/etc/ld.so.conf'

See any operating system documentation about shared libraries for

more information, such as the ld(1) and ld.so(8) manual pages.

/usr/bin/install -c -m 644 include/uv.h include/uv-errno.h include/uv-threadpool.h include/uv-version.h include/uv-unix.h include/uv-linux.h '/root/logkafka-master/_build/src/libuv/include'
/usr/bin/install -c -m 644 libuv.pc '/root/logkafka-master/_build/src/libuv/lib/pkgconfig'
[ 32%] Completed 'project_libuv'
[ 36%] Built target project_libuv
make: *** [all] 错误 2

I'm attempting to test logkafka using the usage example from README, apparently without success. When I try to read from the topic created by log_config using the Kafka console consumer, and append lines to the file specified by log_config, I don't see any messages in the topic.

logkafka started with:

$ _install/bin/logkafka -f _install/conf/logkafka.conf -e _install/conf/easylogging.conf

(Exactly as stated in Usage.)

log_config called as:

$ php tools/log_config.php --create --zookeeper=127.0.0.1:2181 --hostname=localhost --log_path=/tmp/test-logkafka --topic=test-logkafka

Then I append lines to the file using echo foo >> /tmp/test-logkafka, and read from the topic test-logkafka using the console consumer, but no messages are consumed.

Zookeeper is periodically emitting these error messages:

[2015-09-27 10:59:45,010] INFO Got user-level KeeperException when processing sessionid:0x1500dde056b003b type:create cxid:0x5607ae0f zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/logkafka Error:KeeperErrorCode = NodeExists for /logkafka (org.apache.zookeeper.server.PrepRequestProcessor)
[2015-09-27 10:59:45,021] INFO Got user-level KeeperException when processing sessionid:0x1500dde056b003b type:create cxid:0x5607ae10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/logkafka/client Error:KeeperErrorCode = NodeExists for /logkafka/client (org.apache.zookeeper.server.PrepRequestProcessor)

and:

[2015-09-27 11:13:39,056] ERROR Unexpected Exception:  (org.apache.zookeeper.server.NIOServerCnxn)
java.nio.channels.CancelledKeyException
    at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
    at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
    at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:418)
    at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1509)
    at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:367)
    at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:161)
    at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:98)

The zookeeper shell tells me that the path /logkafka/client does exist. Unfortunately I don't know how to investigate the CancelledKeyException (and I can't say whether any of these error messages are relevant to the problem).