DATA ENGINEER (Databricks)

We are looking for an Azure Data Engineer to work on challenging projects focused on pipelines

What you'll do:

• Design and implement scalable and resilient data architectures in Databricks and Azure environments.
• Optimize data pipelines in Apache Spark, ensuring performance and resource efficiency.
• Automate data engineering processes using CLI and SDKs in DevOps environments.
• Support and evolve production environments with high availability and criticality.
• Integrate and orchestrate data from SAP systems and other corporate sources.
• Ensure data governance, quality, and traceability throughout the entire lifecycle.
• Collaborate with multidisciplinary teams to deliver data solutions aligned with business needs.
• Contribute to engineering best practices, code review, and DevOps culture.

Skills and Experiences

• Databricks certification.
• Solid experience with Apache Spark and optimization of large-scale jobs.
• Mastery of Databricks (Delta Lake, Workflows, Unity Catalog) and Azure Data Services.
• Experience with pipeline and infrastructure automation via CLI and SDKs (Databricks CLI, Terraform, Azure CLI).
• Experience in production environments with high availability and fault tolerance requirements.
• Knowledge in data integration with SAP systems (SAP BW, SAP HANA, SAP Data Services).
• Experience with code versioning (Git), CI/CD, and containers (Docker).
• Ability to work autonomously, lead technical initiatives, and collaborate in agile teams.