Senior Data Engineer

💼 Day-to-day responsibilities and activities:

Design and implement robust data pipelines, covering the full cycle: source identification, ingestion, transformation, enrichment, and loading;

Provision and maintain all infrastructure needed to run the data stack, managing costs to ensure operational efficiency;

Handle large volumes of data using the Open Source ecosystem;

Contribute to the evolution of our Data Lake and infrastructure, seeking continuous improvement in engineering standards;

Build and maintain strategic dashboards for the Marketing, Product, and Engineering teams;

Define internal processes for the data area and support data-driven decision-making.

🤩 We expect you to have:

Solid experience with AWS (ability to spin up and maintain hosting services);

Proficiency in Python and SQL;

Experience with Apache Spark, Kafka, and Hudi (or similar);

Knowledge of visualization and BI tools: Metabase and Apache Superset;

Experience with Clickhouse;

Autonomy and willingness to build a structure from scratch;

Strong communication skills to interact with different areas of the company.

🌟 It will be a plus if you have:

AWS certifications;

Previous experience structuring data areas from scratch.