subhamay-cloudworks Goto Github PK

followers: 0.0 following: 2.0 repos: 45.0 gists: 0.0

Name: Subhamay Bhattacharyya

Type: User

Company: @capgemini

Location: Trumbull, CT

Hi there 👋, I am Subhamay Bhattacharyya, 3x AWS Certified and a AWS Cloud Enthusiast

🔭 I'm currently working on AWS SAM, CloudFormation, Serverless and Terraform projects
🌱 I'm currenly learning Terraform, SAM and Serverless Framework
👯 I’m looking to collaborate on ...
🤔 I’m looking for help with Kubernetes
💬 Ask me about my upcoming projects
📫 How to reach me : [email protected]
😄 Pronouns: ...
⚡ Fun fact: Love to play cuddle my cats Samsung and Thomas.

Languages and Tools:

CF - CloudFormation : TF - HashiCorp Terraform : SAM - AWS Serverless Application Model : SLS - Serverless Framework

ETL Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF
1	0001	Tarius	AWS Serverless Real Time Data Load to DynamoDB.	$${\color{green}Complete}$$	✅	✅	✅	✅
2	0005	Taurus	Creating a Lambda Layer and adding the same to a Lambda function.	❌	❌	✅	✅	✅
3	0007	Pisces	S3 Cross Region / Cross Account Replication.	$${\color{green}Complete}$$	✅	🚫	🚫	✅
4	0018	Sunflowers	Accessing a S3 bucket in one AWS Acount (Account-A) from a Lambda function in another AWS Account(Account-B).	❌	✅	🚫	🚫	🚫
4	0032	Allium	Creating a S3 Bucket with Lifecycle Policy Configuration using Terraform.	❌	❌	❌	❌	✅
5	0032	Allium	Creating a S3 Bucket with Lifecycle Policy Configuration using Terraform.	❌	❌	❌	❌	✅
6	0088	Decumaria	Enable CloudTrail Trail for DynamoDB data events.	❌	❌	❌	❌	❌
7	0089	Delphinium	Scheduling a Lambda function using EventBridge to send an email every day using SES and a pre-signed URL of an image .	❌	❌	❌	❌	✅
8	0090	Detuzia	Creating an audit table for a DynamoDB table using CloudTrail, Kinesis Data Stream, Lambda, S3, Glue and Athena	❌	✅	❌	❌	❌

Glue Job Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF

Step Function Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF
1	0070	Chicory	Manage a Batch Job (AWS Batch, Amazon SNS)	❌	❌	❌	🟡	❌
2			Manage a Container Task (Amazon ECS, Amazon SNS)	❌	❌	❌	❌	❌
3	0069	Celosia	Transfer Data Records (Lambda, DynamoDB, Amazon SQS)	$${\color{green}Complete}$$	✅	✅	✅	✅
4	0071	Chionodoxa	Poll for Job Status (Lambda, AWS Batch)	❌	❌	❌	🟡	❌
5	0086	Daylily	A Step Function Demo using SNS (Simple Notification Service) and Wait state.	❌	❌	✅	✅	✅
6	0038	Bellflower	Callback Pattern Example (Amazon SQS, Amazon SNS, Lambda)	🟡	✅	✅	✅	❌
7	0072	Chrysanthemum	Manage an Amazon EMR Job	❌	❌	❌	🟡	🟡
8			Start a Workflow within a Workflow (Step Functions, Lambda)	❌	❌	❌	❌	❌
9	0063	Carnation	Dynamically process data with a Map state	❌	✅	❌	❌	❌
10			Train a Machine Learning Model	❌	❌	❌	❌	❌
11			Tune a Machine Learning Model	❌	❌	❌	❌	❌
12			Process High-Volume Messages from Amazon SQS (Express Workflows)	❌	❌	❌	❌	❌
13	0087	Dandelion	Selective Checkpointing Example (Express Workflows)	❌	❌	❌	🟡	❌
14			Build an AWS CodeBuild Project (CodeBuild, Amazon SNS)	❌	❌	❌	❌	❌
15			Preprocess data and train a machine learning model	❌	❌	❌	❌	❌
16			Lambda orchestration example	❌	❌	❌	❌	❌
17			Start an Athena query	❌	❌	❌	❌	❌
18			Execute multiple queries (Amazon Athena, Amazon SNS)	❌	❌	❌	❌	❌
19			Query large datasets (Amazon Athena, Amazon S3, AWS Glue, Amazon SNS)	❌	❌	❌	❌	❌
20			Keep data up to date (Amazon Athena, Amazon S3, AWS Glue)	❌	❌	❌	❌	❌
21			Manage an Amazon EKS cluster	❌	❌	❌	❌	❌
22			Make a call to API Gateway	❌	❌	❌	❌	❌
23			Call a microservice with API Gateway	❌	❌	❌	❌	❌
24			Send a custom event to EventBridge	❌	❌	❌	❌	❌
25			Invoke Synchronous Express Workflows	❌	❌	❌	❌	❌
26			Run ETL/ELT workflows using Amazon Redshift	❌	❌	❌	❌	❌
27			Use Step Functions and AWS Batch with error handling	❌	❌	❌	❌	❌
28			Fan out an AWS Batch job	❌	❌	❌	❌	❌
29			AWS Batch with Lambda	❌	❌	❌	❌	❌

Subhamay Bhattacharyya's Projects

0000-lilac-py-cft

AWS CloudFormation Custom Resource to create S3 folder and delete them while deleting the stack

0001-tarius-cft

AWS Serverless Real Time Data Load to DynamoDB using Python Lambda and S3 Event Source Mapping and creating the stack using AWS CloudFormation.

0001-tarius-py-cft

AWS Serverless Real Time Data Load to DynamoDB using Python Lambda and S3 Event Source Mapping and creating the stack using AWS CloudFormation and Language as Python.

0001-tarius-py-tf

AWS Serverless Real Time Data Load to DynamoDB using Lambda and S3 Event Source Mapping and creating the stack using HashiCorp Terraform and Language as Python

0001-tarius-sam

AWS Serverless Real Time Data Load to DynamoDB using Python Lambda and S3 Event Source Mapping and creating the stack using AWS SAM (Serverless Application Model)

0001-tarius-tf

AWS Serverless Real Time Data Load to DynamoDB using Lambda and S3 Event Source Mapping and creating the stack using HashiCorp Terraform

0002-rugops-cft

AWS Serverless Real Time Streaming using S3, Python Lambda, SNS, SQS, SNS and EC2 and creating the entire stack using AWS CloudFormation

0003-anubis-cft

EC2 log file Integration with AWS CloudWatch and creating the stack with AWS CloudFormation

0005-taurus-sam

Creating a Lambda Layer and adding the same to a Lambda function using AWS SAM

0005-taurus-sls

Creating a Lambda Layer and adding the same to a Lambda function using Serverless Framework.

0005-taurus-tf

Creating a Lambda Layer and adding the same to a Lambda function using HashiCorp Terraform

0007-pisces-cft

S3 Cross Region / Cross Account replication created using AWS CloudFormation

0007-pisces-tf

S3 Cross Region / Cross Account replication created using HashiCorp Terraform

0018-sunflower-cft

Accessing a S3 bucket in one AWS Acount (Account-A) from a Lambda function in another AWS Account(Account-B), The stack is created using CloudFormation

0032-allium-tf

Creating a S3 Bucket with Lifecycle Policy Configuration using Terraform

0034-aster-cft

Loading data into DynamoDB Global Table with KMS encryption enabled using Kinesis-Lambda

0035-sedum-cft

A Demo Step Function using Lambda. The entire stack is created using AWS CloudFormation

0038-bellflower-cft

Step Function with Callback Pattern Example (Amazon SQS, Amazon SNS, Lambda) using CloudFormation

0038-bellflower-sam

Step Function with Callback Pattern Example (Amazon SQS, Amazon SNS, Lambda) using AWS SAM

0038-bellflower-sls

Step Function with Callback Pattern Example (Amazon SQS, Amazon SNS, Lambda) using Serverless Framework

0052-agapanthus-cft

Working with Glue Data Catalog and Running the Glue Crawler On Demand

0053-bluebonnets-cft

Working with Glue Data Catalog and running the using S3 Event Notification and creating the entire stack using AWS CloudFormation

0054-hyacinth-tf

Creating a S3 bucket with lifecycle policy enabled and uploading a large file > 5 GB using S3 multipart upload.

0055-borage-cft

Create a Amazon Quantum Ledger Database (QLDB) using HashiCorp Terraform

0055-borage-tf

Amazon Quantum Ledger Database (QLDB) using HashiCorp Terraform

0057-bouvardia-tf

Get notified on EC2 instance state change using EventBridge Terraform

This is a sample project to use map state in a state machine to loop through a list of events and invoke a Lambda to process them and store the erros events in a SQS queue. In the subsequest run the Lambda receives the error events from the SQS to retry the processing. The entire stack is created using AWS CloudFormation.