Senior Data Platform Engineering

Randstad, in partnership with a global multinational leader in the data intelligence and infrastructure sector, is seeking a Senior Data Platform Engineer to work on the construction and evolution of the Common Data Backbone (CDB) — a strategic platform for integration, governance, and data discovery on a global scale.

About the Opportunity The CDB connects multiple cloud services and end applications using Apache Kafka for event orchestration and integration services. You will strengthen the team by expanding the Kafka infrastructure and Databricks implementation on AWS, focusing on cluster security, lifecycle management, performance tuning, Databricks pipelines, and reliability engineering (SRE) in enterprise standards.

What You'll Do

• Design, deploy, and maintain highly available and secure Kafka clusters on AWS (MSK or self-managed).
• Perform capacity planning, performance tuning, and proactive scaling.
• Automate infrastructure and configurations using Terraform and GitOps principles.
• Manage and optimize Databricks workspaces, clusters, jobs, and streaming pipelines on AWS.
• Implement observability with metrics, Grafana dashboards, and CloudWatch alarms.
• Develop runbooks for incident response, disaster recovery, and rolling upgrades.
• Ensure compliance with security and audit requirements (ISO27001).
• Collaborate with development teams providing Kafka best practices for .NET microservices and streaming jobs in Databricks.
• Conduct resilience tests and maintain documented RPO/RTO strategies.
• Promote continuous improvement in cost optimization, reliability, and operational maturity.

What We're Looking For

• Experience: 5+ years in data platform engineering, cloud, SRE, DevOps, or infrastructure, including at least 3 years of practice operating Kafka in production.
• Kafka: Mastery of internal concepts of the ecosystem (partitions, replication, ISR, controller quorum, KRaft).
• AWS: Advanced knowledge in VPC, EC2, MSK, IAM, Secrets Manager, and networking.
• Streaming & Integration: Familiarity with Databricks Structured Streaming and Kafka Connect.
• Security & IaC: Proven experience with TLS/mTLS, SASL/SCRAM, ACLs, secure cluster design, and Infrastructure as Code (Terraform preferably).
• CI/CD & Observability: Experience with CI/CD pipelines for topics/clusters and monitoring via Grafana, CloudWatch, and log aggregation.
• Automation: Strong scripting skills (Bash, Python) for automation and creation of internal tools.
• Language: Advanced/fluent English for oral and written communication (Upper-Intermediate or higher).

Nice to Have

• Cloud Certifications (preferably AWS).
• Knowledge in Schema Registry (Protobuf) and schema governance.
• Previous experience with geospatial data processing.

Why Join the Team?

• International Ecosystem: Work on global scale projects with direct impact on secure infrastructure and environmental sustainability.
• Autonomy Culture: Collaborative environment that balances remote work flexibility with team connection moments, based on trust and responsibility.
• Accelerated Growth: Freedom to take initiatives, propose innovative solutions, and evolve within a global structure.