Comments (19)
Thanks, I'll look into it
from rome.
thanks!
from rome.
@ekimia this works for me if I do
export AWS_ACCESS_KEY_ID=<some access key>
export AWS_SECRET_ACCESS_KEY=<some secret>
Debug tip: Try to echo those two variables from inside your bash script. Seems to me like they are not visible to subprocesses of the shell that is launching rome.
Also, just a tip for your Romefile and travis config:
- avoid downloading rome every build. You can place rome in a cached directory on travis.
- use a local cache for rome and add that to the travis cached directories too.
See https://docs.travis-ci.com/user/caching/
from rome.
update on this. Travis is setup properly and the variables do exist in my build.sh
script. As a workaround I generated the .aws/config
file programmatically
from rome.
@ekimia but do they exist in compile.sh
?
from rome.
yup!
from rome.
@ekimia ok Thanks. The problem then seems to be much deeps than Rome.
I'll try to make a minimal experiment and see. Thanks for your understanding and for finding a workaround in the mean time.
from rome.
no problem, let me know if you need help
from rome.
Unless you're trying to use the "engine" feature, Rome doesn't launch any child process. It's using system provided access to env variables via http://hackage.haskell.org/package/base-4.12.0.0/docs/System-Environment.html#v:lookupEnv
I doubt this is bug in a core Haskell library. Rather something is interfering with your VM's env variables. On Travis for example reading env works just fine.
from rome.
Debugging on a BuddyBuild remote session:
export AWS_REGION=eu-central-1
export AWS_ACCESS_KEY_ID=keyblahblah
export AWS_SECRET_ACCESS_KEY=secretblahblah
Then, rome download --skip-local-cache
results in The AWS Access Key Id you provided does not exist in our records.
for all dependencies
Note that I'm currently using v0.20.0.56
both locally and CI. Latest release didn't work locally
from rome.
try AWS_REGION= ... AWS_ACCESS_KEY_ID=... AWS_SECRET_ACCESS_KEY=... rome ...
from rome.
Also, if you are using Minio instead of S3 you need AWS_ENDPOINT
If you use a custom profile you also need AWS_PROFILE
from rome.
We aren't using Minio, that was my error since I found that issue in the issue list first.
Interesting discoveries, using version v0.20.0.56
on BuddyBuild:
AWS_REGION=eu-central-1 \
AWS_ACCESS_KEY_ID=foo \
AWS_SECRET_ACCESS_KEY=bar \
rome list
List dependencies that are in the bucket... whereas:
AWS_REGION=eu-central-1 \
AWS_ACCESS_KEY_ID=foo \
AWS_SECRET_ACCESS_KEY=bar \
rome download
Complains about the key. Currently the bucket is (even) completely public (for testing purposes!), so this is strange
from rome.
Try running this on CI: https://mega.nz/#!ik1xVArD!7mq-Dtzb07yMZccNSc6rwjYB_enRw6t8XVxDNWEqcWY
Source Code
module Main where
import System.Environment
main :: IO ()
main = do
aws_region <- lookupEnv "AWS_REGION"
aws_id <- lookupEnv "AWS_ACCESS_KEY_ID"
aws_secret <- lookupEnv "AWS_SECRET_ACCESS_KEY"
print aws_region
print aws_id
print aws_secret
from rome.
Can check that in a moment. However, more relevantly, perhaps; we use a wrapper around aws
CLI here, which writes ~/.aws/credentials
with the following keys:
[default]
aws_access_key_id = ...
aws_secret_access_key = ...
aws_session_token = ...
aws_security_token = ...
I suspect for this to work I potentially need to pass all of them...? Also, please forgive my relative AWS ignorance, not my speciality 😢
from rome.
^ Got it now, I think! I just need to pass all of those as env vars:
AWS_REGION
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY
AWS_SESSION_TOKEN
AWS_SECURITY_TOKEN
Generally caused by my ignorance. Perhaps a docs improvement would be to list all of those keys as potential candidates, and something along the lines of; "if these are listed in your profile in credentials, you need to pass them all to Rome"?
from rome.
I have no idea what AWS_SESSION_TOKEN or AWS_SECURITY_TOKEN are doing. I doubt I'm reading them on the latest version.
from rome.
Now confirmed that I have something basically working, although not enough to exactly confirm what the issue is. I'll update again when I know. Other minor issue I'm now seeing is Rome produces no output when running via the build server. I also checked redirecting stderr to stdout to see if BuddyBuild only outputs stdout (seems unlikely). Could there be something sensitive that might prevent Rome producing output? Currently makes it quite hard to work out what's going on
from rome.
No, there is no redirection of std input or output or error. You can use -v
for force more verbose info
from rome.
Related Issues (20)
- Xcode version specific upload/download HOT 4
- Concurrent downloads for remote cache HOT 1
- Nexus as example engine HOT 4
- [Question] Framework produces both static and dynamic output HOT 4
- Losing debug capability when using cached builds downloaded by Rome HOT 2
- Static folder isn't uploaded to remote server on Xcode 12 HOT 4
- Rome won't upload all downstream re-built frameworks HOT 3
- Rome sometimes printing partial output HOT 1
- Rome not failing when engine exit code is not zero HOT 1
- Issues running Rome with --no-skip-current HOT 6
- Needs to be updated to support XCFrameworks. HOT 13
- When using currentMap its not possible to reuse the generated binaries HOT 3
- Rome crashes when downloading dependencies HOT 1
- Skip bcsymbolmaps and dsyms when uploading/downloading a framework HOT 4
- Issues with Rome for xcframeworks HOT 24
- Failed to install latest ROME in MAC HOT 1
- using rome download --concurrently with --use-xcframeworks leads to io error: openBinaryFile: resource busy (file is locked)
- Add Rome arm64 release artifact HOT 3
- Error if carthage cache and rome cache have a file and directory with the same name
- Build failure with ghc 9.6.2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rome.