Comments (4)
Seconding Savin on the region being the first place to start troubleshooting. Specifically, the An error occurred (ClientException) when calling the SubmitJob operation: JobQueue arn:aws:batch:eu-west-1:<accountid>:job-queue/job-queue-<local username>-metaflow-test not found.
error indicates that either the AWS shell is configured to default to a different region than the job-queue, the job-queue is either mistyped or non-existent, or there's a permissions problem.
Assuming the regions are correct, can you verify that you can see the Job Queue under the AWS Batch section of the console and that it's named correctly?
from metaflow.
@andaag Did you use the latest version of the cloudformation template to deploy your infrastructure? Does the user have SubmitJob
privileges on the queue?
from metaflow.
Also, given that you are using eu-west-1
, can you confirm that region = eu-west-1
in your AWS config?
from metaflow.
It was a region issue, thanks a lot for the help guys! I had "two" profile default's in my aws config. I'm guessing different defaults were read different places.
[profile default]
region = eu-west-1
[default]
region = eu-central-1
Thanks a lot for the help!
from metaflow.
Related Issues (20)
- add __repr__ methods to Parameter
- create contributing guide
- "Service token file does not exist" error when deploying flow to Argo from CI HOT 1
- argo-workflows create --only-json doesn't export the cron workflow configuration
- Using `tags` as a Parameter name breaks flow. HOT 1
- Add option to batch decorator to increase ephemeralStorage on Fargate
- `--package-suffixes` omits dotfiles HOT 1
- Is it possible to run metaflow steps in custom docker containers on local?
- Opentelemetry configuration not carrying over to Batch
- Add a priority class option for the kubernetes flow decorator HOT 1
- Reduce the number of reserved parameter names
- Logs don't show up on the console. gs_tail raises NotFound error
- Data store error HOT 4
- Missing artifact in the step.task.data._artifacts HOT 1
- Make default kubernetes resources configurable HOT 2
- `python hello.py batch step --help` is broken
- Invalid CloudWatch log group prefix HOT 4
- Allow namespacing of `ArgoEvent` when published from a step
- allow uploading metaflow packages that include "dots" in the path
- Suggest replacing `pull_request_target` in branches as well as `main`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from metaflow.