Data Engineer - GCP

We are Randstad, a global leader in talent solutions. We have an opportunity to work as a Data Engineer - GCP for one of our clients in the Utilities/Energy sector.

We are seeking a senior professional to join our AI & Data team, serving as a technical reference for building and evolving robust and scalable data pipelines on the Google Cloud Platform.

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines on GCP.
• Ensure data quality, integrity, and reliability throughout the entire processing cycle.
• Implement ETL/ELT processes for data movement and availability across different systems.
• Act as a technical reference (Subject Matter Expert) in Data Engineering.
• Collaborate with multidisciplinary teams, promoting technical alignment and knowledge sharing.
• Support technical decision-making and contribute to solving complex problems.
• Develop and optimize scalable data architectures, including Medallion models (Bronze, Silver, and Gold).
• Work in partnership with data scientists, analysts, and business stakeholders.
• Lead initiatives focused on monitoring, performance, and reliability of pipelines.
• Document processes, standards, and data engineering best practices.
• Contribute to the evaluation and adoption of new technologies, tools, and frameworks.

Required Skills

• Python
• SQL
• Apache Airflow (Google Composer)
• Data pipeline development: Streaming, Batch Processing, and CDC
• Google BigQuery
• Google Cloud Platform (GCP)
• Medallion Architecture (Bronze, Silver, and Gold)

Desired Skills

• GitLab CI/CD
• Experience in cloud data environments
• Experience in Utilities (Energy) sector projects

Differentials

• Prior experience in the Energy and Utilities sector.
• Knowledge of modern data architectures and cloud platforms.
• Ability to work in collaborative and multidisciplinary environments.
• Analytical, proactive profile oriented toward problem-solving.