Comments (13)
@tmitchel2 I come here to thank you for your work with this OS project. 👏 I am continuing using this, until I find AWS autoscaling mature enough and heavily tested.
Probably auto-backup will come next from AWS?
(edit)
And please continue supporting this, because I am certain that AWS will take a while until it can implement all the features of your autoscaling.
It seems to me that AWS is very simple and has high risk for messing up table partitioning. It would be cool to have your feedback on this.
from dynamodb-lambda-autoscale.
@schodemeiss appreciate it.
from dynamodb-lambda-autoscale.
It seems like Amazon's service doesn't really take throttling into account, however. We've experienced some issues with it.
from dynamodb-lambda-autoscale.
And just after months of me reworking it.. 😣
from dynamodb-lambda-autoscale.
@mseank I think that if you have autoscaling enabled, there's a new burst capability that unused provisioned capacity from the past 5 minutes can be consumed in order to avoid throttling. Then hopefully the autoscaling kicks in and boosts the provisioned capacity enough.
from dynamodb-lambda-autoscale.
@efenderbosch no I don't think your right there. The burst capability is something that has been there all along, it means your consumed capacity can burst above the provisioned for a very short period based upon a usage algorithm
from dynamodb-lambda-autoscale.
Like @goncaloneves, I wanted to thank-you for this project. We're using it in a heavy production work-load and it's always been reliable. We wont be moving to AWS's auto-scaling until it's implemented some more of the features of this project at the very least!
from dynamodb-lambda-autoscale.
My team tried out the Amazon version, but we've decided to come back to this. It's more stable and easily used. Thanks, @tmitchel2
from dynamodb-lambda-autoscale.
@mseank That's interesting, would you able to comment on specific stability issues? I did have a newer version in the works with better integrations and a potential paid for version but I'm on the fence about completing it.
from dynamodb-lambda-autoscale.
@tmitchel2 Part of it is perhaps that the documentation for Amazon's is not very in-depth. Yours is much easier to follow. It kind of goes in line with what I was saying earlier in this thread, how it is difficult to control throttling with Amazon's in-house version. It was scaling, but when we would throttle, it wouldn't really register or do much of anythig. It would still be hitting our apparent set percentage, but not realizing that we weren't where we wanted to be. It also seems to struggle scaling down for some reason; again, this may be due to our setting the target utilization incorrectly.
They need more fields and better descriptions as to what they mean. The fields for your version are much more accessible and easily editable.
from dynamodb-lambda-autoscale.
Going to use this issue to record commentary regarding Amazons implementation, good or bad.
For starters it seems like here they are suggesting a full 5 minutes of load to get the scaling to trigger https://forums.aws.amazon.com/thread.jspa?threadID=259029&tstart=0
from dynamodb-lambda-autoscale.
I think we might be coming back to this solution. The official AWS solution doesn't seem to react quickly enough to increased capacity requirements. We'll get spikes of throttles. It also doesn't seem to scale down as often as it should. I've seen periods of more than 12 hours where tables were not scaled down.
Additionally, since the AWS solution uses CloudWatch alarms, you will see an increase in that portion of your bill. Since this solution queries the table's capacity metadata and makes changes itself, there's no cost other than the Lambda function time.
I almost forgot. The official AWS solution is fundamentally broken when being used with CloudFormation. We ended up dropping autoscaling from CloudFormation and now have pre-deploy and post-deploy aws cli scripts that delete and then re-enable autoscaling.
from dynamodb-lambda-autoscale.
We are also still using this project for many of the reasons mentioned above.
from dynamodb-lambda-autoscale.
Related Issues (20)
- How to scale down working HOT 1
- Minimum capacity ignored HOT 6
- [Discussion] Strategy with fixed values. HOT 5
- Incorporate throttled events into provisioning calculations
- Odd logging message & failure to increase throughput capacity HOT 1
- Add an SNS notification channel for increase / decrease throughput? HOT 7
- Table IOPS are currently being updated HOT 1
- Combine getmetricsstatistics into as few requests as possible
- Add circuit breaker logic
- Is there a setting to limit the number of downscales per day? HOT 1
- Configuration per table group HOT 4
- Would be nice to have a --dryRun feature
- Socket timeouts HOT 1
- Decreasing write capacity was disallowed without any reasons, decreasing using Management Console worked HOT 4
- Would be nice to have a provisioner that selects tables based on tags HOT 1
- Missing script build in package.json HOT 2
- Lambda fails with error
- Configuration specific to env or tables HOT 4
- Allow more decreases per day as per docs HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dynamodb-lambda-autoscale.