Comments (5)
Not sure what do you mean. Right now pipelining in handled as it is handled by most of the clients.
You just keep sending commands without waiting and reading replies. And when you finish sending commands you read all the replies.
Today this increases performance from 23k of ops to 140k of ops, which is a HUGE boost.
If you need more info about how to do pipelining with Jedis you can find it here: https://github.com/xetorthio/jedis/wiki under Pipelining
Let me know if I misunderstood anything. Thanks!
from jedis.
My understanding is that one could issue multiple commands in the same write to the server rather then doing multiple write operations. I haven't seen that happening in Jedis but maybe I've missed something.
On the same topic, the current API requires a 'callback' approach in which one adds all the commands in the JedisPipeline class which then executed by Jedis. For our use case, we're interested in having something like:
- start pipeline
- do op
- do op (and so on)
- stop pipeline
We don't have any control over the client so we'd like to enable batching/pipelining - invoke the client and then disable pipelining once returned. Currently we can't do that.
Could you improve the API so the workflow mentioned above could be supported?
Something like startPipelining/Batch ?
Thanks,
from jedis.
Sorry - seems that I accidentally closed the issue while submitting my previous comment - that wasn't my intention.
from jedis.
I think we are OK with the pipelining approach. But it you have in mind how you can improve it, I will be more than happy to receive a pull request or even discuss in more details you solution :)
And regard the pipelining usage. Maybe I could add something like it is in multi, where you can provide a callback or get a Transaction and work on that. It will be like this:
Pipeline p = jedis.pipeline();
p.set("foo", "bar");
p.get("something");
List results = p.close();
Is that OK?
from jedis.
That would be great. I guess you could create a common interface to avoid duplicating all the methods all over between Jedis/Transaction and Pipeline.
Cheers,
from jedis.
Related Issues (20)
- How to use RedisTimeSeriesCommands with jedis HOT 1
- Pipelined transaction-handling: watch + get & multi + set
- [Suggested change] Log a warning when `ConnectionFactory.validateObject` determines the connection is no longer connected and/or the ping fails HOT 1
- Reduce the log level of validateObject to WARN HOT 6
- Add support for configuring connection pool to MultiClusterPooledConnectionProvider HOT 4
- "ERR unknown command 'memory', with args beginning with: USAGE" with Jedis and AWS ElastiCache HOT 1
- mac端启动连接远程服务cacheCloud redis集群失败 HOT 1
- Jedis 4.4.7 MultiNodePipeline binary command version of zrevrangeByScore is broken HOT 1
- redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream when init JedisCluster using java test container HOT 1
- Sometimes observing high latency when using JedisCluster with large number of threads. HOT 2
- Is renewSlotCache necessary when received MOVED HOT 3
- Using Chinese query plus summarize syntax, the characters are garbled:�
- client side cache is not invalidated upon key deletion from the same client HOT 1
- unable to connect to Google Memorystore HOT 4
- Could not get a resource from the pool HOT 7
- Jedis4 cannot close SentinelListener connection completely in a JedisSentineled mode when executing method close ,caused connection leak
- redis.clients.jedis.exceptions.JedisException: Could not get a resource from the pool
- redis.clients.jedis.exceptions.JedisException: Could not get a resource from the pool at redis.clients.jedis.util.Pool.getResource(Pool.java:42) ~[jedis-5.1.2.jar:?] at redis.clients.jedis.JedisPool.getResource(JedisPool.java:378) ~[jedis-5.1.2.jar:?] HOT 2
- JedisPooled ## Could not get a resource from the pool HOT 5
- redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream. HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jedis.