An cloud engineer is responsible for building, designing, and maintaining cloud databases. Their role can be divided into three specialties: cloud design, development, and administration. You should have skills such as programming, data security, and storage.
Orchestrate Amazon Redshift-Based ETL workflows with AWS Step Functions and AWS Glue
August-2022 to
Description
Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. Amazon Redshift Serverless lets you access and analyze data without all of the configurations of a provisioned data warehouse.
Roles and Responsibilities
Designed and implemented ETL workflows using AWS Step functions and AWS Glue to Extract, Transform, and Load Data into Amazon Redshift. Created State Machines in AWS Step Functions to define and execute complex workflows as a series of steps, ensuring data consistency and accuracy. Integrated AWS Step Functions and AWS Glue, triggering Glue jobs and passing data between the steps in the workflows. Monitored and managed the workflows using the AWS Management Console, troubleshooting any issues and ensuring optimal performance. Documented the workflows and data transformations, providing a clear understanding of the ETL process and enabling easy maintenance and updating. Integrated AWS Secrets Manager with AWS Step Functions and AWS Glue, allowing secure access to sensitive data as needed within the workflows.
Orchestrate Amazon Redshift-Based ETL workflows with AWS Step Functions and AWS Glue
August-2022 to
Description
Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. Amazon Redshift Serverless lets you access and analyze data without all of the configurations of a provisioned data warehouse.
Roles and Responsibilities
Designed and implemented ETL workflows using AWS Step functions and AWS Glue to Extract, Transform, and Load Data into Amazon Redshift. Created State Machines in AWS Step Functions to define and execute complex workflows as a series of steps, ensuring data consistency and accuracy. Integrated AWS Step Functions and AWS Glue, triggering Glue jobs and passing data between the steps in the workflows. Monitored and managed the workflows using the AWS Management Console, troubleshooting any issues and ensuring optimal performance. Documented the workflows and data transformations, providing a clear understanding of the ETL process and enabling easy maintenance and updating. Integrated AWS Secrets Manager with AWS Step Functions and AWS Glue, allowing secure access to sensitive data as needed within the workflows.
Description: An AWS developer is responsible for setting up, maintaining, and evolving the cloud infrastructure of web applications. AWS developers are expected to understand the core AWS services and apply best practices regarding security and scalability.