AWS Data Engineer

About the Role

We are seeking an AWS Data Engineer to design, develop, and maintain data ingestion, transformation, and storage pipelines in Data Warehouse and Data Lake environments.

You will be responsible for ensuring data quality, reliability, and monitoring, as well as creating integrations between systems and the AWS cloud.

Key Responsibilities

• Design, develop, and maintain data ingestion processes;
• Model and design data structures for Data Warehouses and Data Lakes (structured and unstructured);
• Build and maintain data processing and storage processes;
• Build and maintain Data Lake control and monitoring processes;
• Develop integrations using APIs and messaging solutions;
• Create data integrations between systems and the Data Lake using SQL and Apache;
• Monitor data ingestions involving quality cycles;
• Ensure platform and data reliability through unit testing;
• Support the creation of DevOps/DataOps pipelines at scale for services and cloud infrastructure.

Technical Requirements

• Experience with AWS: S3, Lambda, Glue, Athena, CloudWatch, CloudFormation, SNS, SQS, API Gateway, RDS (Aurora), and Terraform;
• Knowledge of SQL and Apache;
• Experience with data modeling for Data Warehouses and Data Lakes;
• Familiarity with APIs, messaging, and infrastructure automation;
• Knowledge of DevOps/DataOps practices.

Preferred Qualifications

• Knowledge of Amazon QuickSight;
• Experience with unit testing in data pipelines;
• Prior experience in high-volume data environments.