ajgon / opsworks_ruby

Set of chef recipes for OpsWorks based Ruby projects.

opsworks_ruby Cookbook

A chef cookbook to deploy Ruby applications to Amazon OpsWorks.

NO LONGER MAINTAINED

🚧 THIS PROJECT IS DEPRECATED 🚧

Why?

Quick Start

Refer to Getting Started guide in documentation.

Development

You can either install everything locally using rvm and pip or use the Docker container which includes all necessary dependencies inside it.

Documentation

docker-compose run cookbook mkdocs serve -a 0.0.0.0

Contributing

Please see CONTRIBUTING for details.

Author and Contributors

Author: Igor Rzegocki (@ajgon)

Contributors

• Nick Marden (@nickmarden)
• Phong Si (@phongsi)
• Kevin Olbrich (@olbrich)
• Kevin Pheasey (@kpheasey)
• Nathan Flood (@npflood)
• Teruo Adachi (@interu)
• Marcos Beirigo (@marcosbeirigo)
• John Calvin Young (@johncalvinyoung)
• Rich Seviora (@richseviora)
• Josh Goodall (@inopinatus)
• Kazuki Fujii (@kazukifujii)
• Kazuki Nishikawa (@kzkn)
• Josh Burks (@dotnofoolin)

License

License: MIT

opsworks_ruby's Issues

make `deploy.rollback_on_error` configurable

Support hanami

Support plain Rack app

Support for setup phase when multiple applications are present

Determine somehow currently used layer and included applications in it.

Support thin

https://github.com/macournoyer/thin

Add public/assets to symlinking defaults

Minor bugfixes

• Add build-essentials to required cookbooks in README
• Put sidekiq tests in configure to proper context

Add page title

😢

move `app['environment']` to `app['global']['environment']`

ruby-ng support

bundler support

gem install bundler (via cookbook?) - on root
bundle install during deploy (use bundle_install from application_ruby)

Could not satisfy version constraints for: apt

apt ~> 2.2 is hadcoded into the nginx cookbook at v2.7.2

I'm drawing a blank as to how to change this as the latest nginx doesn't work (2.9.9 ) as i did this by accident at first, so i know it doesn't play well with the build_essentials ~> v2.0.6. ideally none of these restrictions would exist and these two could be coerced into playing nicely with each other. Thoughts? I take it you don't have this issue @ajgon, eh?

After digging, i understand why you pegged them to these two versions, but man crazy times for Opsworks to just say "screw you all, do it yourself" :-)

[2016-07-18T15:26:58+00:00] INFO: HTTP Request Returned 412 Precondition Failed: Could not satisfy version constraints for: apt

================================================================================
Error Resolving Cookbooks for Run List:
================================================================================

Missing Cookbooks:
------------------
Could not satisfy version constraints for: apt

Expanded Run List:
------------------
* opsworks_ruby::setup
* opsworks_ruby::deploy

Platform:
---------
x86_64-linux

Add features enabling in nginx.unicorn.conf based on nginx version

Bundler is unable to install gems from private repositories

When installing an app, I get failures during the deploy phase while it's trying to bundle. The errors indicate that bundler is unable to checkout code from several private repositories that we maintain.

It appears that during the initial checkout of code, the Drivers::Scm::Git class adds a wrapper that injects the deploy key so that the initial checkout can occur.

This does not happen during the perform_bundle_install call in the deploy recipe, and as such the deploy user does not have access to the appropriate keys.

method missing 'bundle_install'

Was that supposed to come from somewhere else when you refactored, or am i missing a dependency?

either way i hardcoded a bundle exec just to get past it. when i have time i'll pull request all this together.

Database parsing order

• First node['deploy'][app]['database']['engine'] - get RDS matching given ID or throw exception
• If no ...['engine'] present, then try to auto-detect the connected RDS
• If no RDS, then use basic node['deploy'][app]['database'] options
• If options are missing as well, throw exception

Support apache2

Detect nginx build_type from `node['nginx']` if not specified directly in the attributes

Support resque

Add workers support (sidekiq for now)

Support delayed_job

bundle install using chef bundle with chef's ruby, not the one intended

I was trying to install rack but failed due to ruby versions being old.

Gem::InstallError: rack requires Ruby version >= 2.2.2

That didn't make sense because the cookbook installs ruby 2.3 by default.
https://github.com/ajgon/opsworks_ruby/blob/master/attributes/default.rb#L18
and the bundler should be pointing to that ruby
https://github.com/ajgon/opsworks_ruby/blob/master/recipes/setup.rb#L26

[deploy@ip-10-0-10-198 ~]$ which bundle
/usr/local/bin/bundle

But in reality the bundle that runs on bundle install is

/opt/chef/embedded/bin/bundle

it wasn't a problem when this cookbook used https://github.com/poise/application_ruby
but i do agree with the change.

Check where `node['hostname']` is stored in Chef 12 setup

Rails: assets:precompile

Do not drop database when migration fails

https://github.com/ajgon/opsworks_ruby/blob/master/attributes/default.rb#L103

I know this is handy because it creates your database when it is missing but it is also extremely dangerous.

Here's an example:
Since we deploy our stack on many instances, chances that more than one of them will run migrations at the same time are quite high. If migration fails, db:setup will try to recreate the database by dropping it if it exists. you don't want to do that on production.

Is node['applications'] always null when apps_not_included is called?

Is apps_not_included always returning false because node['applications'].blank? is true. It doesn't seem to get populated before the deploy so apps with enabled:false get deployed. If so, I can make a PR.

Write integration tests

Reload nginx after successful deploy.

Move all `Chef 11` related options to `app['global']` scope

By Chef 11 options I mean symlinks, create_dirs_before_symlink etc. Keep them in app scope for now as well, but add deprecation warning.

Create simple project webpage

Add DHParam generation/support

Add merging with default modules, when nginx::source is selected

Implement `rollback_on_error` deploy property

Check if nginx reloads/restarts after successful deploy

It's necessary, since stack.json or SSL certificates may change...

Fix broken sqlite path for `rails` framework

Currently (only for Rails) sqlite db always lands in current/db/data.sqlite instead of shared/db/data.sqlite

core_ext spec

Support null

ability to automatically use ENV variables the you input into Opsworks

would be great to create an application.yml file with any environment variables you create in the Opsworks console. Then it'd be there if you use Figaro, or if you use dot.env maybe we put that format in there too. Right now, i'm struggling to figure out how to get those ENVs into this recipe so i can create a Factory for you. i tried even just cowboy coding it but ran up against time and talent.

Write proper documentation

build-essential (~> 2.0) ?

build-essentials is on version 2.4.0 at time of writing. Was this pegged to the 2 year old one for compatibility reasons or something else? nginx is at the latest one, just wondering why this one wasn't.

Support puma

https://github.com/puma/puma

Support padrino

Problems with webserver = null

I'm trying to disable unicorn and nginx entirely. I've been successful at disabling unicorn by using

default['deploy']['report_convertor']['appserver']['adapter'] = 'null' # Don't run unicorn

but when I try to use

default['deploy']['report_convertor']['webserver']['adapter'] = 'null' # Don't run nginx

I get the error below during the 'configure' step.

Seeing that it's ssl related I tried adding these two lines as well, but it didn't help.

default['deploy']['report_convertor']['webserver']['extra_config_ssl'] = false
default['deploy']['report_convertor']['webserver']['ssl_for_legacy_browsers'] = false 

Here's the bits of the log around the error:

[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/config/unicorn.conf] created file /srv/www/report_convertor/shared/config/unicorn.conf
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/config/unicorn.conf] updated file contents /srv/www/report_convertor/shared/config/unicorn.conf
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/config/unicorn.conf] owner changed to 5000
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/config/unicorn.conf] group changed to 33
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/config/unicorn.conf] mode changed to 644
[2016-08-25T19:41:10+00:00] INFO: Processing template[/srv/www/report_convertor/shared/scripts/unicorn.service] action create (opsworks_ruby::configure line 53)
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/scripts/unicorn.service] created file /srv/www/report_convertor/shared/scripts/unicorn.service
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/scripts/unicorn.service] updated file contents /srv/www/report_convertor/shared/scripts/unicorn.service
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/scripts/unicorn.service] owner changed to 5000
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/scripts/unicorn.service] group changed to 33
[2016-08-25T19:41:10+00:00] INFO: template[/srv/www/report_convertor/shared/scripts/unicorn.service] mode changed to 755
[2016-08-25T19:41:10+00:00] INFO: Processing service[unicorn_report_convertor] action nothing (opsworks_ruby::configure line 65)
[2016-08-25T19:41:10+00:00] INFO: Processing directory[/etc/nginx/ssl] action create (opsworks_ruby::configure line 56)

================================================================================
Error executing action `create` on resource 'directory[/etc/nginx/ssl]'
================================================================================

Chef::Exceptions::EnclosingDirectoryDoesNotExist
------------------------------------------------
Parent directory /etc/nginx does not exist, cannot create /etc/nginx/ssl

Cookbook Trace:
---------------
/var/chef/runs/d90bb86d-c81d-4636-9497-fe1e82d6a77a/local-mode-cache/cache/cookbooks/compat_resource/files/lib/chef_compat/monkeypatches/chef/runner.rb:41:in `run_action'

Resource Declaration:
---------------------
# In /var/chef/runs/d90bb86d-c81d-4636-9497-fe1e82d6a77a/local-mode-cache/cache/cookbooks/opsworks_ruby/libraries/drivers_webserver_nginx.rb

56:         context.directory '/etc/nginx/ssl' do
57:           owner 'root'
58:           group 'root'
59:           mode '0700'
60:         end
61:       end

Compiled Resource:
------------------
# Declared in /var/chef/runs/d90bb86d-c81d-4636-9497-fe1e82d6a77a/local-mode-cache/cache/cookbooks/opsworks_ruby/libraries/drivers_webserver_nginx.rb:56:in `add_ssl_directory'

directory("/etc/nginx/ssl") do
action [:create]
retries 0
retry_delay 2
default_guard_interpreter :default
path "/etc/nginx/ssl"
declared_type :directory
cookbook_name "opsworks_ruby"
recipe_name "configure"
mode "0700"
owner "root"
group "root"
end

Platform:
---------
x86_64-linux

[2016-08-25T19:41:10+00:00] INFO: Running queued delayed notifications before re-raising exception
[2016-08-25T19:41:10+00:00] ERROR: Running exception handlers
[2016-08-25T19:41:10+00:00] ERROR: Exception handlers complete
[2016-08-25T19:41:10+00:00] FATAL: Stacktrace dumped to /var/chef/runs/d90bb86d-c81d-4636-9497-fe1e82d6a77a/local-mode-cache/cache/chef-stacktrace.out
[2016-08-25T19:41:10+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2016-08-25T19:41:10+00:00] ERROR: directory[/etc/nginx/ssl] (opsworks_ruby::configure line 56) had an error: Chef::Exceptions::EnclosingDirectoryDoesNotExist: Parent directory /etc/nginx does not exist, cannot create /etc/nginx/ssl
[2016-08-25T19:41:11+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)

undeploy and shutdown actions

ERROR: 412 "Precondition Failed" | No such cookbook: deployer

I am trying to run a new instance on AWS, but I get this following failure log.
Did I miss any settings in my stack? Thank you very much in advance

[2016-11-08T09:13:42+00:00] INFO: AWS OpsWorks instance 7ec0fdf1-3cc4-446d-8ba2-a93a92041c7a, Agent version 4019-20161019094031, Command: setup with id ad61fe9e-73f4-41d3-adb9-05bbb6e97d03
[2016-11-08T09:13:44+00:00] INFO: Started chef-zero at chefzero://localhost:8889 with repository at /opt/aws/opsworks/current
One version per cookbook
data_bags at /var/lib/aws/opsworks/data.internal/data_bags
nodes at /
 
[2016-11-08T09:13:44+00:00] INFO: Forking chef instance to converge...
[2016-11-08T09:13:44+00:00] INFO: *** Chef 12.13.37 ***
[2016-11-08T09:13:44+00:00] INFO: Platform: x86_64-linux
[2016-11-08T09:13:44+00:00] INFO: Chef-client pid: 2584
[2016-11-08T09:13:44+00:00] WARN: The plugin path /opt/aws/opsworks/current/plugins does not exist. Skipping...
[2016-11-08T09:13:47+00:00] INFO: HTTP Request Returned 404 Not Found: Object not found: chefzero://localhost:8889/nodes/caliban.localdomain
[2016-11-08T09:13:48+00:00] WARN: Run List override has been provided.
[2016-11-08T09:13:48+00:00] WARN: Original Run List: []
[2016-11-08T09:13:48+00:00] WARN: Overridden Run List: [recipe[aws_opsworks_agent]]
[2016-11-08T09:13:48+00:00] INFO: Run List is [recipe[aws_opsworks_agent]]
[2016-11-08T09:13:48+00:00] INFO: Run List expands to [aws_opsworks_agent]
[2016-11-08T09:13:48+00:00] INFO: Starting Chef Run for caliban.localdomain
[2016-11-08T09:13:48+00:00] INFO: Running start handlers
[2016-11-08T09:13:48+00:00] INFO: Start handlers complete.
[2016-11-08T09:13:48+00:00] INFO: HTTP Request Returned 404 Not Found: Object not found: 
[2016-11-08T09:13:48+00:00] INFO: Loading cookbooks [[email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]]
[2016-11-08T09:13:48+00:00] INFO: Skipping removal of obsoleted cookbooks from the cache
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_agent/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_agent/libraries/aws_opsworks_command.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_agent/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_helpers/libraries/search.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_helpers/libraries/shellout.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_helpers/libraries/predicates.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_helpers/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_agent_version/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ebs/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ebs/libraries/block_device.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ebs/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ebs/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/libraries/user.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/libraries/aws_opsworks_users_helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/templates/default/sudoers.d.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_agent_version/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_users/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/motd.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/cleanup.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/ntp.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/chef.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/setup.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/hosts.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/yum.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/update_os.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/swap.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/ldconfig.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/recipes/ssh_host_keys.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/libraries/assets_helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/libraries/hosts_helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/libraries/helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/templates/default/hosts.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/templates/default/ldconfig-opsworks-user-space.conf.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/templates/default/motd.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_system/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/checkout_s3.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/checkout.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/checkout_archive.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/create_or_delete.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/checkout_git.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/libraries/s3.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/templates/default/ssh_key.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_cookbooks/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/providers/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/libraries/matchers.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/libraries/aws_opsworks_custom_run_helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/libraries/search_node.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/libraries/data_bag_item.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/templates/default/client.rb.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/resources/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_custom_run/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/recipes/setup.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/recipes/setup_ubuntu.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/recipes/shutdown.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/libraries/ecs_agent.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/libraries/helper.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/files/58118E89F3A912897C070ADBF76221572C52609D.pubkey in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/templates/default/ecs.config.erb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/resources/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/providers/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/recipes/dependencies.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/recipes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/libraries/s3_file.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/libraries/matchers.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/attributes/default.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/CHANGELOG.md in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/README.md in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/aws_opsworks_ecs/recipes/setup_amazon.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/Berksfile in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/.kitchen.yml in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/metadata.rb in the cache.
[2016-11-08T09:13:48+00:00] INFO: Storing updated cookbooks/s3_file/MIT-LICENSE.txt in the cache.
[2016-11-08T09:13:48+00:00] INFO: Cleaning up 0 from /var/lib/aws/opsworks/chef/
[2016-11-08T09:13:48+00:00] INFO: Processing bash[create swap file /var/swapfile] action run (aws_opsworks_system::swap line 1)
[2016-11-08T09:14:04+00:00] INFO: bash[create swap file /var/swapfile] ran successfully
[2016-11-08T09:14:04+00:00] INFO: Processing mount[swap] action enable (aws_opsworks_system::swap line 12)
[2016-11-08T09:14:04+00:00] INFO: mount[swap] enabled
[2016-11-08T09:14:04+00:00] INFO: Processing bash[activate all swap devices] action run (aws_opsworks_system::swap line 18)
[2016-11-08T09:14:04+00:00] INFO: bash[activate all swap devices] ran successfully
[2016-11-08T09:14:04+00:00] INFO: Processing file[/etc/ssh/ssh_host_rsa_key] action create (aws_opsworks_system::ssh_host_keys line 14)
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_rsa_key] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/ssh/ssh_host_rsa_key.chef-20161108091404.074198
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_rsa_key] updated file contents /etc/ssh/ssh_host_rsa_key
[2016-11-08T09:14:04+00:00] INFO: Processing file[/etc/ssh/ssh_host_rsa_key.pub] action create (aws_opsworks_system::ssh_host_keys line 14)
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_rsa_key.pub] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/ssh/ssh_host_rsa_key.pub.chef-20161108091404.091341
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_rsa_key.pub] updated file contents /etc/ssh/ssh_host_rsa_key.pub
[2016-11-08T09:14:04+00:00] INFO: Processing file[/etc/ssh/ssh_host_dsa_key] action create (aws_opsworks_system::ssh_host_keys line 14)
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_dsa_key] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/ssh/ssh_host_dsa_key.chef-20161108091404.095319
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_dsa_key] updated file contents /etc/ssh/ssh_host_dsa_key
[2016-11-08T09:14:04+00:00] INFO: Processing file[/etc/ssh/ssh_host_dsa_key.pub] action create (aws_opsworks_system::ssh_host_keys line 14)
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_dsa_key.pub] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/ssh/ssh_host_dsa_key.pub.chef-20161108091404.098815
[2016-11-08T09:14:04+00:00] INFO: file[/etc/ssh/ssh_host_dsa_key.pub] updated file contents /etc/ssh/ssh_host_dsa_key.pub
[2016-11-08T09:14:04+00:00] INFO: Processing template[/etc/ld.so.conf.d/opsworks-user-space.conf] action create (aws_opsworks_system::ldconfig line 1)
[2016-11-08T09:14:04+00:00] INFO: template[/etc/ld.so.conf.d/opsworks-user-space.conf] created file /etc/ld.so.conf.d/opsworks-user-space.conf
[2016-11-08T09:14:04+00:00] INFO: template[/etc/ld.so.conf.d/opsworks-user-space.conf] updated file contents /etc/ld.so.conf.d/opsworks-user-space.conf
[2016-11-08T09:14:04+00:00] INFO: template[/etc/ld.so.conf.d/opsworks-user-space.conf] owner changed to 0
[2016-11-08T09:14:04+00:00] INFO: template[/etc/ld.so.conf.d/opsworks-user-space.conf] group changed to 0
[2016-11-08T09:14:04+00:00] INFO: template[/etc/ld.so.conf.d/opsworks-user-space.conf] mode changed to 444
[2016-11-08T09:14:04+00:00] INFO: Processing execute[Configure dynamic linker run-time bindings] action run (aws_opsworks_system::ldconfig line 8)
[2016-11-08T09:14:04+00:00] INFO: execute[Configure dynamic linker run-time bindings] ran successfully
[2016-11-08T09:14:04+00:00] INFO: Processing ruby_block[enable keepcache in yum.conf] action run (aws_opsworks_system::yum line 1)
[2016-11-08T09:14:04+00:00] INFO: ruby_block[enable keepcache in yum.conf] called
[2016-11-08T09:14:04+00:00] INFO: Processing ruby_block[disable yum update-motd plugin] action run (aws_opsworks_system::yum line 13)
[2016-11-08T09:14:04+00:00] INFO: ruby_block[disable yum update-motd plugin] called
[2016-11-08T09:14:04+00:00] INFO: Processing bash[install epel] action run (aws_opsworks_system::yum line 24)
[2016-11-08T09:14:04+00:00] INFO: Processing yum_package[monit] action install (aws_opsworks_system::yum line 36)
[2016-11-08T09:14:04+00:00] INFO: Processing group[opsworks] action create (aws_opsworks_users::default line 1)
[2016-11-08T09:14:04+00:00] INFO: group[opsworks] created
[2016-11-08T09:14:04+00:00] INFO: Processing template[/etc/sudoers.d/opsworks] action create (aws_opsworks_users::default line 29)
[2016-11-08T09:14:04+00:00] INFO: template[/etc/sudoers.d/opsworks] created file /etc/sudoers.d/opsworks
[2016-11-08T09:14:04+00:00] INFO: template[/etc/sudoers.d/opsworks] updated file contents /etc/sudoers.d/opsworks
[2016-11-08T09:14:04+00:00] INFO: template[/etc/sudoers.d/opsworks] owner changed to 0
[2016-11-08T09:14:04+00:00] INFO: template[/etc/sudoers.d/opsworks] group changed to 0
[2016-11-08T09:14:04+00:00] INFO: template[/etc/sudoers.d/opsworks] mode changed to 440
[2016-11-08T09:14:04+00:00] INFO: Processing directory[default /var/chef/cookbooks] action delete (aws_opsworks_custom_cookbooks::default line 8)
[2016-11-08T09:14:04+00:00] INFO: Processing directory[/var/chef] action create (aws_opsworks_custom_cookbooks::checkout line 4)
[2016-11-08T09:14:04+00:00] INFO: directory[/var/chef] created directory /var/chef
[2016-11-08T09:14:04+00:00] INFO: Processing yum_package[git] action install (aws_opsworks_custom_cookbooks::checkout_git line 3)
[2016-11-08T09:14:05+00:00] INFO: yum_package[git] installing git-2.7.4-1.47.amzn1 from amzn-main repository
[2016-11-08T09:14:06+00:00] INFO: yum_package[git] installed git at 2.7.4-1.47.amzn1
[2016-11-08T09:14:06+00:00] INFO: Processing git[Download Custom Cookbooks] action checkout (aws_opsworks_custom_cookbooks::checkout_git line 32)
[2016-11-08T09:14:07+00:00] INFO: git[Download Custom Cookbooks] cloning repo https://github.com/mberlanda/opsworks_ruby.git to /var/chef/cookbooks
[2016-11-08T09:14:08+00:00] INFO: git[Download Custom Cookbooks] checked out branch: HEAD onto: deploy reference: a55d317be77d955f32d9a96d2c562da3dd88609d
[2016-11-08T09:14:08+00:00] INFO: git[Download Custom Cookbooks] sending run action to execute[Update custom cookbook Git submodules] (immediate)
[2016-11-08T09:14:08+00:00] INFO: Processing execute[Update custom cookbook Git submodules] action run (aws_opsworks_custom_cookbooks::checkout_git line 56)
[2016-11-08T09:14:08+00:00] INFO: execute[Update custom cookbook Git submodules] ran successfully
[2016-11-08T09:14:08+00:00] INFO: Processing execute[Update custom cookbook Git submodules] action nothing (aws_opsworks_custom_cookbooks::checkout_git line 56)
[2016-11-08T09:14:08+00:00] INFO: Processing ruby_block[Move single cookbook contents into appropriate subdirectory] action run (aws_opsworks_custom_cookbooks::checkout line 20)
[2016-11-08T09:14:08+00:00] INFO: Single cookbook detected, moving into subdirectory '/var/chef/cookbooks/opsworks_ruby'
[2016-11-08T09:14:08+00:00] INFO: ruby_block[Move single cookbook contents into appropriate subdirectory] called
[2016-11-08T09:14:08+00:00] INFO: Processing execute[ensure correct permissions of custom cookbooks] action run (aws_opsworks_custom_cookbooks::checkout line 37)
[2016-11-08T09:14:08+00:00] INFO: execute[ensure correct permissions of custom cookbooks] ran successfully
[2016-11-08T09:14:08+00:00] INFO: Processing yum_package[xfsprogs] action install (aws_opsworks_ebs::default line 1)
[2016-11-08T09:14:08+00:00] INFO: yum_package[xfsprogs] installing xfsprogs-3.2.2-2.20.amzn1 from amzn-main repository
[2016-11-08T09:14:09+00:00] INFO: yum_package[xfsprogs] installed xfsprogs at 3.2.2-2.20.amzn1
[2016-11-08T09:14:09+00:00] INFO: Processing template[/etc/hosts] action create (aws_opsworks_system::hosts line 1)
[2016-11-08T09:14:09+00:00] INFO: template[/etc/hosts] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/hosts.chef-20161108091409.312439
[2016-11-08T09:14:09+00:00] INFO: template[/etc/hosts] updated file contents /etc/hosts
[2016-11-08T09:14:09+00:00] INFO: Processing template[/etc/motd.opsworks-static] action create (aws_opsworks_system::motd line 1)
[2016-11-08T09:14:09+00:00] INFO: template[/etc/motd.opsworks-static] backed up to /var/lib/aws/opsworks/local-mode-cache/backup/etc/motd.opsworks-static.chef-20161108091409.319920
[2016-11-08T09:14:09+00:00] INFO: template[/etc/motd.opsworks-static] updated file contents /etc/motd.opsworks-static
[2016-11-08T09:14:09+00:00] INFO: Processing remote_file[/var/lib/aws/opsworks/cache.internal/chef-12.13.37-1.el6.x86_64.rpm] action create (aws_opsworks_system::chef line 17)
[2016-11-08T09:14:10+00:00] INFO: remote_file[/var/lib/aws/opsworks/cache.internal/chef-12.13.37-1.el6.x86_64.rpm] created file /var/lib/aws/opsworks/cache.internal/chef-12.13.37-1.el6.x86_64.rpm
[2016-11-08T09:14:11+00:00] INFO: remote_file[/var/lib/aws/opsworks/cache.internal/chef-12.13.37-1.el6.x86_64.rpm] updated file contents /var/lib/aws/opsworks/cache.internal/chef-12.13.37-1.el6.x86_64.rpm
[2016-11-08T09:14:11+00:00] INFO: Processing yum_package[chef-client] action upgrade (aws_opsworks_system::chef line 24)
[2016-11-08T09:14:16+00:00] INFO: yum_package[chef-client] upgraded chef-client to 12.13.37-1.el6
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/etc/chef/ohai/hints] action create (aws_opsworks_system::chef line 32)
[2016-11-08T09:14:16+00:00] INFO: Processing file[/etc/chef/ohai/hints/ec2.json] action touch (aws_opsworks_system::chef line 37)
[2016-11-08T09:14:16+00:00] INFO: file[/etc/chef/ohai/hints/ec2.json] updated atime and mtime to 2016-11-08 09:14:16 +0000
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/tmp/opsworks-agent-installer] action delete (aws_opsworks_system::cleanup line 5)
[2016-11-08T09:14:16+00:00] INFO: directory[/tmp/opsworks-agent-installer] deleted /tmp/opsworks-agent-installer recursively
[2016-11-08T09:14:16+00:00] INFO: Processing file[/tmp/opsworks-agent-downloader.sh] action delete (aws_opsworks_system::cleanup line 10)
[2016-11-08T09:14:16+00:00] INFO: file[/tmp/opsworks-agent-downloader.sh] deleted file at /tmp/opsworks-agent-downloader.sh
[2016-11-08T09:14:16+00:00] INFO: Processing file[/tmp/opsworks-agent-installer.tgz] action delete (aws_opsworks_system::cleanup line 10)
[2016-11-08T09:14:16+00:00] INFO: file[/tmp/opsworks-agent-installer.tgz] deleted file at /tmp/opsworks-agent-installer.tgz
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/tmp/opsworks-agent-installer-downloader.zc9oRmFC] action delete (aws_opsworks_system::cleanup line 5)
[2016-11-08T09:14:16+00:00] INFO: directory[/tmp/opsworks-agent-installer-downloader.zc9oRmFC] deleted /tmp/opsworks-agent-installer-downloader.zc9oRmFC recursively
[2016-11-08T09:14:16+00:00] INFO: Processing aws_opsworks_custom_run[ad61fe9e-73f4-41d3-adb9-05bbb6e97d03] action prepare (aws_opsworks_custom_run::default line 3)
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 75)
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 82)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs] created directory /var/chef/runs
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 87)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 92)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/nodes] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 97)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/nodes] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/nodes
[2016-11-08T09:14:16+00:00] INFO: Processing template[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/client.rb] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 106)
[2016-11-08T09:14:16+00:00] INFO: template[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/client.rb] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/client.rb
[2016-11-08T09:14:16+00:00] INFO: template[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/client.rb] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/client.rb
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/attribs.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 114)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/attribs.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/attribs.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/attribs.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/attribs.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app/sky_social_report.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app/sky_social_report.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app/sky_social_report.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app/sky_social_report.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_app/sky_social_report.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance/caliban.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance/caliban.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance/caliban.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance/caliban.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_instance/caliban.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer/rails_layer.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer/rails_layer.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer/rails_layer.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer/rails_layer.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_layer/rails_layer.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack/5054b2b4-5b34-42b8-b96c-c2628d17e202.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack/5054b2b4-5b34-42b8-b96c-c2628d17e202.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack/5054b2b4-5b34-42b8-b96c-c2628d17e202.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack/5054b2b4-5b34-42b8-b96c-c2628d17e202.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_stack/5054b2b4-5b34-42b8-b96c-c2628d17e202.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_command/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_user] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_user] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_user
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_elastic_load_balancer] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_elastic_load_balancer] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_elastic_load_balancer
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance
[2016-11-08T09:14:16+00:00] INFO: Processing file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance/arn_aws_rds_eu-central-1_441951978710_db_pg-sky-social.json] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 208)
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance/arn_aws_rds_eu-central-1_441951978710_db_pg-sky-social.json] created file /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance/arn_aws_rds_eu-central-1_441951978710_db_pg-sky-social.json
[2016-11-08T09:14:16+00:00] INFO: file[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance/arn_aws_rds_eu-central-1_441951978710_db_pg-sky-social.json] updated file contents /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_rds_db_instance/arn_aws_rds_eu-central-1_441951978710_db_pg-sky-social.json
[2016-11-08T09:14:16+00:00] INFO: Processing directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_ecs_cluster] action create (/var/lib/aws/opsworks/cache.internal/cookbooks/aws_opsworks_custom_run/providers/default.rb line 124)
[2016-11-08T09:14:16+00:00] INFO: directory[/var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_ecs_cluster] created directory /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags/aws_opsworks_ecs_cluster
[2016-11-08T09:14:16+00:00] WARN: Skipping final node save because override_runlist was given
[2016-11-08T09:14:16+00:00] INFO: Chef Run complete in 28.631714607 seconds
[2016-11-08T09:14:16+00:00] INFO: Skipping removal of unused files from the cache
[2016-11-08T09:14:16+00:00] INFO: Running report handlers
[2016-11-08T09:14:16+00:00] INFO: Report handlers complete
 
[2016-11-08T09:14:17+00:00] INFO: Started chef-zero at chefzero://localhost:8889 with repository at /var/chef
One version per cookbook
data_bags at /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/data_bags
nodes at /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/nodes
 
[2016-11-08T09:14:17+00:00] INFO: Forking chef instance to converge...
[2016-11-08T09:14:17+00:00] INFO: *** Chef 12.13.37 ***
[2016-11-08T09:14:17+00:00] INFO: Platform: x86_64-linux
[2016-11-08T09:14:17+00:00] INFO: Chef-client pid: 2948
[2016-11-08T09:14:19+00:00] INFO: HTTP Request Returned 404 Not Found: Object not found: chefzero://localhost:8889/nodes/caliban.localdomain
[2016-11-08T09:14:19+00:00] INFO: Setting the run_list to ["recipe[opsworks_ruby::setup]", "recipe[opsworks_ruby::deploy]"] from CLI options
[2016-11-08T09:14:19+00:00] INFO: Run List is [recipe[opsworks_ruby::setup], recipe[opsworks_ruby::deploy]]
[2016-11-08T09:14:19+00:00] INFO: Run List expands to [opsworks_ruby::setup, opsworks_ruby::deploy]
[2016-11-08T09:14:19+00:00] INFO: Starting Chef Run for caliban.localdomain
[2016-11-08T09:14:19+00:00] INFO: Running start handlers
[2016-11-08T09:14:19+00:00] INFO: Start handlers complete.
[2016-11-08T09:14:19+00:00] INFO: HTTP Request Returned 404 Not Found: Object not found: 
[2016-11-08T09:14:19+00:00] INFO: HTTP Request Returned 412 Precondition Failed: No such cookbook: deployer
 
================================================================================
Error Resolving Cookbooks for Run List:
================================================================================
 
Missing Cookbooks:
------------------
No such cookbook: deployer
 
Expanded Run List:
------------------
* opsworks_ruby::setup
* opsworks_ruby::deploy
 
Platform:
---------
x86_64-linux
 
[2016-11-08T09:14:19+00:00] ERROR: Running exception handlers
[2016-11-08T09:14:19+00:00] ERROR: Exception handlers complete
[2016-11-08T09:14:19+00:00] FATAL: Stacktrace dumped to /var/chef/runs/ad61fe9e-73f4-41d3-adb9-05bbb6e97d03/local-mode-cache/cache/chef-stacktrace.out
[2016-11-08T09:14:19+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2016-11-08T09:14:19+00:00] ERROR: 412 "Precondition Failed"
[2016-11-08T09:14:19+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)

Add monitd

monit restart not really restarting services on deploy

Currently, sidekiq on deploy is doing a monit reload before doing a monit restart
https://github.com/ajgon/opsworks_ruby/blob/master/libraries/drivers_worker_sidekiq.rb#L14

This does not restart the sidekiq service. Here is a log.

Aug 23 18:07:49 ip-10-0-10-61 monit[7095]: Reinitializing monit - Control file '/etc/monit.conf'
Aug 23 18:07:49 ip-10-0-10-61 monit[7095]: Shutting down monit HTTP server
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: restart service 'sidekiq_blahblah-1' on user request
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: monit daemon at 7095 awakened
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: monit HTTP server stopped
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: Starting monit HTTP server at [localhost:2812]
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: monit HTTP server started
Aug 23 18:07:50 ip-10-0-10-61 monit[7095]: 'system_ip-10-0-10-61.localdomain' Monit reloaded

When checking the process timestamps, i realize sidekiq didnt restart.

I suspect it might be because the http service for monit is shut down when the restart service command is issued. From the documentation, command line features are disabled when the http service is disabled https://mmonit.com/monit/documentation/monit.html#MONIT-HTTPD.

I feel like reloading monit is only necessary when monit itself has some configuration changes.

suggestions, advice, thoughts?

No way to set RAILS_ENV other than 'production'

From opsworks_ruby/libraries/drivers_framework_rails.rb:12

def raw_out
  super.merge(deploy_environment: { 'RAILS_ENV' => 'production' })
end

This method always sets the RAILS_ENV as production with no way to set it to beta, staging, etc. Unless I'm missing some other place RAILS_ENV is supposed to be set. Should this method maybe be reversed like so?

def raw_out
  {deploy_environment: { 'RAILS_ENV' => 'production' }}.merge(super)
end

That way you can set it in opsworks stack settings via

{
  "deploy": { 
    "app_name": {
      "framework": {
        "deploy_environment": { "RAILS_ENV": "beta" }
      }
    }
  }
}

Start webserver in setup phase

Default attributes