Comments (7)
@chen116 this seems to be configuration issue related. What is COS bucket you configured in PyWren runtime? Can please you copy-paste your config file ( without credentials of course ) ?
from lithops.
Hi,
Thanks for the reply, my conig file like a bit like this:
pywren:
storage_bucket: pywrenbuck
#storage_prefix: pywren.jobs
#storage_backend: ibm_cos
#data_cleaner: <True/False>
#invocation_retry: <True/False>
#retry_sleeps: [1, 5, 10, 20, 30]
#retries: 5
ibm_cf:
endpoint : https://openwhisk.ng.bluemix.net
namespace : [email protected]_dev
api_key : blah blah blah
ibm_cos:
endpoint : https://s3-api.us-geo.objectstorage.softlayer.net
#(also tried with this url) endpoint : https://s3.us-south.cloud-object-storage.appdomain.cloud
api_key : blah blah blah
Also I am not able to create my own runtime, for example, when I run ./deploy_runtime clone python/3.5-stretch
the error I got is also related to ssl validation:
ibm_botocore.exceptions.SSLError: SSL validation failed for https://s3.us-south.cloud-object-storage.appdomain.cloud/pywrenbuck/runtimes/3.5-stretch.meta.json [Errno 2] No such file or directory
Thanks,
from lithops.
@chen116 do you have an existing bucket that has a name "pywrenbuck" ? This bucket need to be existed in advance prior you use it with PyWren. (Also make sure that bucket exists in the same region as you provided "s3-api.us-geo")
from lithops.
@chen116 few other issues i just notice:
What is python/3.5-stretch ? Is this image you created somehow?
what is your Python version you are using, is it 3.5 or 3.6?
If you use 3.5, then you can try to experiment with this command:
./deploy_runtime clone cactusone/pywren:3.5
this will clone 3.5 from my docker hub.. alternative you can edit Docker file, modify 3.6 to 3.5 and deploy it with your docker hub
./deploy_runtime create "your docker hub name"/pywren:3.5
If you use Python 3.6 then just run ./deploy_runtime without any modifications.
from lithops.
Hi, thanks again for ur patience,
yes, I created the bucket "pywrenbuck" and obtained apikey thru the newly created Service credentials. I also changed the correct endpoint where my bucket is located at "https://s3.us-east.cloud-object-storage.appdomain.cloud" Still doesn't work. I also tried the ACCESS_KEY and the SECRET_KEY for ibm cos, but still having the same error about SSL validation error / [Errno 2] No such file or directory.
python/3.5-stretch is an existing docker image from the official python docker hub
I tried ./deploy_runtime clone cactusone/pywren:3.5
but still getting the error like this:
ibm_botocore.exceptions.SSLError: SSL validation failed for https://s3.us-east.cloud-object-storage.appdomain.cloud/pywrenbuck/runtimes/pywren_3.5.meta.json [Errno 2] No such file or directory
Any hint/directions welcome. Really wanna see it runs. Thanks, again!
from lithops.
Hi,
So I solved the issue, well, more like get around with it. So I was running pywren inside a vm in an openstack cluster, it must have been sth in the networking that caused the issue. Still, thanks for your replies along the way!
from lithops.
@chen116 glad it worked
from lithops.
Related Issues (20)
- [BUG][AWS Lambda] Timeout limits are not correctly set HOT 2
- [Enhancement proposal] Configuration profiles HOT 2
- [BUG][master] 'LocalhostStorageBackend' object has no attribute 'create_bucket'
- k8s - Unable to extract metadata from the runtime HOT 2
- Bug: The argument of reduce function has to be named `results`.
- Add Python 3.10 in AWS Lambda HOT 1
- [Request] New lithops release HOT 3
- Runtime for AWS EC2 HOT 1
- Python 3.7 Lambda: urllib3 v2.0 only supports OpenSSL 1.1.1+ HOT 3
- Python 3.10 is not available for AWS Lambda, please use one of ['3.6', '3.7', '3.8', '3.9'], or use a container runtime HOT 3
- Rebuilding and deploying runtime after temporal credentials expire HOT 5
- Incorrect formatting in log message when calling `wait` with `ANY_COMPLETED` HOT 1
- Breaking changes in the new version HOT 4
- Unexplained exception HOT 2
- Lithops configuration HOT 7
- When using lithops multiprocessing it runs forever HOT 16
- FSTimeoutError HOT 2
- Add support for Python 3.11 HOT 1
- Deployment error when using Lithops with K8s + Redis HOT 3
- Bump a new version HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lithops.