aws-samples / immersive-media-refarch

A full end to end workflow from encoder to play-out for Live and VOD-from-live.

immersive-media-refarch

From encoder to spherical projection client, an end to end workflow for Live and on-demand immersive experiences.

Quickstart

1. Download /templates/template.yaml
2. Open CloudFormation Console, click Create Stack
3. Fill in parameters, keyName is required, click Next
4. Continue with CloudFormation prompts, launch the stack
5. In CloudFormation Outputs tab click the clientTestPatternURL link - you should see colorbars in 360-degrees

Legal

During the launch of this reference architecture, you will install software (and dependencies) on the Amazon EC2 instances launched in your account via stack creation. The software packages and/or sources you will install will be from the Amazon Linux distribution, as well as from third party sites. Here is the list of third party software, the source link, and the license link for each software. Please review and decide your comfort with installing these before continuing.

MediaInfo via Extra Packages for Enterprise Linux EPEL

Source: https://download.fedoraproject.org/

License: https://mediaarea.net/en/MediaInfo/License

NGINX-RTMP-module

Source: https://github.com/arut/nginx-rtmp-module

License: https://github.com/arut/nginx-rtmp-module/blob/master/LICENSE

FFmpeg

Source: https://ffmpeg.org/download.html

License: https://github.com/FFmpeg/FFmpeg/blob/master/LICENSE.md

FFmpeg Static Builds

Source: http://johnvansickle.com/ffmpeg/

License: http://www.gnu.org/licenses/gpl-3.0.en.html

immersive-media-refarch's Issues

error creating stack

Using the template provided by this repo, and spot price set to 1, I am getting the attached error

Remove spot max prices

Remove spot max prices as they are no longer required.

Update to latest AMI Ids

So we are running with the latest and greatest AMIs.

FFmpeg is not displaying color bar pattern to clientTestPatternUrl

After setting up the CloudFormation template in AWS, we were provided with a clientTestPatternUrl in our CloudFormation output. However, upon clicking the link we are taken to a blank screen with no color bar pattern. We have insured that we are setting up the template correctly.

WaitCondition timed out when creating stack

Hey gang - getting this error when launching the stack:

WaitCondition timed out. Received 0 conditions when expecting 1

It's happening on:

11:12:52 UTC+1100 | ROLLBACK_IN_PROGRESS | AWS::CloudFormation::Stack | live-broadcast | The following resource(s) failed to create: [transcodingSpotFleetWaitCondition, testStreamEcsService, cloudFrontDistribution, backupOriginSpotFleetWaitCondition, primaryOriginSpotFleetWaitCondition]. . Rollback requested by user.
-- | -- | -- | -- | --
  | 11:12:51 UTC+1100 | CREATE_FAILED | AWS::CloudFront::Distribution | cloudFrontDistribution | Resource creation cancelled
  | 11:12:50 UTC+1100 | CREATE_FAILED | AWS::CloudFormation::WaitCondition | primaryOriginSpotFleetWaitCondition | Resource creation cancelled
  | 11:12:50 UTC+1100 | CREATE_FAILED | AWS::ECS::Service | testStreamEcsService | Resource creation cancelled
  | 11:12:49 UTC+1100 | CREATE_FAILED | AWS::CloudFormation::WaitCondition | transcodingSpotFleetWaitCondition | WaitCondition timed out. Received 0 conditions when expecting 1
  | 11:12:49 UTC+1100 | CREATE_FAILED | AWS::CloudFormation::WaitCondition | backupOriginSpotFleetWaitCondition | WaitCondition timed out. Received 0 conditions when expecting 1

I've tried increasing the WaitCondition timeout but it does not seem to be signalling back to CF.

Any ideas?

add automatic scaling on Edge fleet

We should do this based on # of requests on the load balancer.

get_reference_source in user-data-origin.sh not resolving SRPM url

the nginx + nginx-rtmp module are not building properly:

Unable to access webservice - please wait a while and try again, or try again with '--debug' for more information.

Requested package: nginx
Found package from local RPM database: nginx-1:1.12.1-1.33.amzn1.x86_64
Corresponding source RPM to found package : nginx-1.12.1-1.33.amzn1.src.rpm

Are these parameters correct? Please type 'yes' to continue: Unable to determine location of source rpm for this package.
yes: standard output: Broken pipe
yes: write error
sed: can't read /rpmbuild/SPECS/nginx.spec: No such file or directory
error: failed to stat /rpmbuild/SPECS/nginx.spec: No such file or directory
error: File not found by glob: /rpmbuild/RPMS/x86_64/nginx*.rpm

It seems that get_reference_source is not resolving the SRPM url

Whole output of the EC2 initialisation process, In the cloud-init-output.log:

Running transaction
  Installing : libzen-0.4.37-1.el6.x86_64                                   1/4
  Installing : tinyxml2-1.0.11-4.20130805git0323851.el6.x86_64              2/4
  Installing : libmediainfo-18.08.1-1.el6.x86_64                            3/4
  Installing : mediainfo-18.08.1-1.el6.x86_64                               4/4
  Verifying  : libzen-0.4.37-1.el6.x86_64                                   1/4
  Verifying  : tinyxml2-1.0.11-4.20130805git0323851.el6.x86_64              2/4
  Verifying  : libmediainfo-18.08.1-1.el6.x86_64                            3/4
  Verifying  : mediainfo-18.08.1-1.el6.x86_64                               4/4

Installed:
  mediainfo.x86_64 0:18.08.1-1.el6

Dependency Installed:
  libmediainfo.x86_64 0:18.08.1-1.el6
  libzen.x86_64 0:0.4.37-1.el6
  tinyxml2.x86_64 0:1.0.11-4.20130805git0323851.el6

Complete!
{
    "AttachmentId": "eni-attach-0f334d872a413d78e"
}
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 31.6M  100 31.6M    0     0  34423      0  0:16:05  0:16:05 --:--:-- 43797
curl: (16) Error in the HTTP2 framing layer
Cloning into 'nginx-rtmp-module'...
Loaded plugins: priorities, update-motd, upgrade-helper
Resolving Dependencies
--> Running transaction check
---> Package nginx.x86_64 1:1.12.1-1.33.amzn1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package      Arch          Version                      Repository        Size
================================================================================
Installing:
 nginx        x86_64        1:1.12.1-1.33.amzn1          amzn-main        561 k

Transaction Summary
================================================================================
Install  1 Package

Total download size: 561 k
Installed size: 1.4 M
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : 1:nginx-1.12.1-1.33.amzn1.x86_64                             1/1
  Verifying  : 1:nginx-1.12.1-1.33.amzn1.x86_64                             1/1

Installed:
  nginx.x86_64 1:1.12.1-1.33.amzn1

Complete!
Unable to access webservice - please wait awhile and try again, or try again with '--debug' for more information.

Requested package: nginx
Found package from local RPM database: nginx-1:1.12.1-1.33.amzn1.x86_64
Corresponding source RPM to found package : nginx-1.12.1-1.33.amzn1.src.rpm

Are these parameters correct? Please type 'yes' to continue: Unable to determine location of source rpm for this package.
yes: standard output: Broken pipe
yes: write error
sed: can't read /rpmbuild/SPECS/nginx.spec: No such file or directory
error: failed to stat /rpmbuild/SPECS/nginx.spec: No such file or directory
error: File not found by glob: /rpmbuild/RPMS/x86_64/nginx*.rpm
‘/tmp/nginx-rtmp-module/stat.xsl’ -> ‘/usr/share/nginx/html/stat.xsl’
‘/root/immersive-media-refarch/user-data/origin/nginx/default.d/rtmp.conf’ -> ‘/etc/nginx/default.d/rtmp.conf’
‘/root/immersive-media-refarch/user-data/origin/nginx/rtmp.d/rtmp.conf’ -> ‘/etc/nginx/rtmp.d/rtmp.conf’
‘/root/immersive-media-refarch/user-data/origin/awslogs/awslogs.conf’ -> ‘/etc/awslogs/awslogs.conf’
‘/root/immersive-media-refarch/user-data/origin/bin/record-postprocess.sh’ -> ‘/usr/local/bin/record-postprocess.sh’
‘/root/immersive-media-refarch/user-data/origin/init/spot-instance-termination-notice-handler.conf’ -> ‘/etc/init/spot-instance-termination-notice-handler.conf’
‘/root/immersive-media-refarch/user-data/origin/bin/spot-instance-termination-notice-handler.sh’ -> ‘/usr/local/bin/spot-instance-termination-notice-handler.sh’
Shutting down system logger: [  OK  ]
Starting system logger: [  OK  ]
Starting awslogs: [  OK  ]
nginx: [emerg] unknown directive "rtmp_stat" in /etc/nginx/default.d/rtmp.conf:2
nginx: configuration file /etc/nginx/nginx.conf test failed
spot-instance-termination-notice-handler start/running, process 9381
{
    "AssociationId": "eipassoc-00cb784061db0931b"
}
CloudFormation signaled successfully with SUCCESS.
Cloud-init v. 0.7.6 finished at Wed, 14 Nov 2018 04:57:20 +0000. Datasource DataSourceEc2.  Up 1055.26 seconds