Comments (5)
@SuperCD Thanks for point it out!
We need to update the kubernetes example that works correctly with the Gunicorn deployment. We will hopefully get that fixed very soon.
Is this issue something very urgent with you? If it is, we will try our best to get it done sooner.
Feel free to ping me on this or any other questions!
from bentoml.
thanks for the fast reply. I've tested it and in fact i was able to make it run if the binding is done on 0.0.0.0
I'm not even sure that changing the binding is the only way of solving this, but is the only one I've found...
from bentoml.
Thanks for investigating @SuperCD!
I think you found the issue. Which is right now, the docker container right now is only listening localhost.
We will address this issue and also improve the experience for deploying with Docker. Those changes should solve the problem you are encountering now.
Just some idea in my head right now, I am thinking about using Nginx/gunicorn setup inside the docker container.
I will link the PR to this issue, hopefully I can get to it sometime close to next week or so. Feel free to ping me, if you need it before that. I will pump it up and work on it sooner
from bentoml.
hi @SuperCD, I did a little bit more digging on this topic and We think your solution right now is the best one moving forward.
We did think about having an Nginx in the docker container as well. However, we realized that right now, most deployment solution probably already have an Nginx component that sits in front of the apps already (kubernetes' ingress controller for example). The Nginx won't bring too much value inside the container.
I think it is more fitting that you submit the PR to fix this problem since you provide the solution as well. What do you think? Otherwise, I will merge in the PR 138 that I linked above
from bentoml.
closing this issue now, since we merged in PR138. Feel free to open again, if there is additional issue relate to this.
from bentoml.
Related Issues (20)
- bug: Concurrent requests with the streaming feature produce parallel calls to the runner
- feature: expose prometheus collector registry client option.
- Trouble in saving the Keras model to the Bentoml model store
- bug: Error when calling "bentoml.bentos.build_bentofile()"
- Bento Service does not support pandas.core.series.Series as a type
- bug: Working Service for HTTP gives error with Grpc "type doesn't support gRPC serving"
- feature: Custom runner support for time series models like ARIMA using BentoML
- feature: Support for River models in BentoML
- bug: Unable to request PILImage with Content-Type image/jpeg with new Service decorator
- bug: pyright failed
- feature: Allow removal of server header HOT 1
- feature: Custom the swagger UI.
- bug: bentoml batch not work HOT 1
- feature: add http api server's uvicorn option
- bug: bentoml serve error pynvml.nvml.NVMLError_DriverNotLoaded: Driver Not Loaded
- bug: i find paddle.py ,but i can't use it HOT 1
- bug: AttributeError: type object 'GrpcClient' has no attribute '_create_channel'
- bug: module 'socket' has no attribute 'AF_UNIX'
- bug: ‘bentoml containerize’ got a problem
- bug: module 'bentoml' has no attribute 'build' HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bentoml.