Randstad

Senior Data Engineer - GCP

Show original

Remote

(Anywhere)

Salary Range

BRL

Full Time Employee

BRL

Contractor

Experience Level

Senior

Requirements

5+ years of experience in the career
Python
SQL
Google BigQuery
Apache Airflow
CDC
Batch Processing
Medallion Architecture
ETL/ELT
Google Cloud Platform (GCP)
Streaming
Data Pipelines

Desired Skills

Utilities
Energy Sector
GitLab CI/CD

Tasks and Responsibilities

Show original

We are Randstad, a global leader in talent solutions. We are looking for a Senior Data Engineer - GCP to work with one of our clients within the AI & Data team.

Responsibilities

  • Design, develop, and maintain scalable and efficient data pipelines.
  • Ensure data quality, integrity, and reliability throughout the entire processing lifecycle.
  • Implement ETL/ELT processes for data movement and availability across different systems.
  • Serve as a Subject Matter Expert (SME) in Data Engineering.
  • Collaborate with multidisciplinary teams, promoting technical alignment and knowledge sharing.
  • Support technical decision-making and contribute to solving complex problems.
  • Develop and optimize scalable data architectures.
  • Work in partnership with data scientists, analysts, and other stakeholders.
  • Lead initiatives focused on monitoring, performance, and pipeline reliability.
  • Document processes, standards, and best practices.
  • Contribute to the evaluation and adoption of new technologies, tools, and frameworks.

Desired Technical Profile

Required Skills: Python, SQL, Apache Airflow (Google Composer), data pipeline development (Streaming, Batch Processing, CDC), Google BigQuery, Google Cloud Platform (GCP), Medallion Architecture (Bronze, Silver, and Gold).

Desired Skills: GitLab CI/CD, experience in cloud data environments, experience in projects within the Utilities (Energy) sector.

Differentials: Previous experience in the Energy and Utilities sector, knowledge of modern data architectures and cloud platforms, analytical profile, proactive attitude, and problem-solving orientation.

Share job:

Share job: