Senior Data Platform Engineering

Randstad, in partnership with a global multinational leader in the data intelligence and infrastructure sector, is looking for a Senior Data Platform Engineer to help build and evolve the Common Data Backbone (CDB), a strategic platform for data integration, governance, and discovery at global scale.

About the Opportunity The CDB connects multiple cloud services and end applications using Apache Kafka for event orchestration and integration services. You will strengthen the team by expanding the Kafka infrastructure and Databricks implementation on AWS, with a focus on cluster security, lifecycle management, performance tuning, Databricks pipelines, and reliability engineering (SRE) with enterprise standards.

What You Will Do

• Design, deploy, and maintain highly available and secure Kafka clusters on AWS (MSK or self-managed).
• Perform capacity planning, performance tuning, and proactive sizing.
• Automate infrastructure and configurations using Terraform and GitOps principles.
• Manage and optimize Databricks workspaces, clusters, jobs, and streaming pipelines on AWS.
• Implement observability with metrics, Grafana dashboards, and CloudWatch alarms.
• Develop runbooks for incident response, disaster recovery, and rolling upgrades.
• Ensure compliance with security and audit requirements (ISO27001).
• Collaborate with development teams by providing Kafka best practices for .NET microservices and Databricks streaming jobs.
• Conduct resilience testing and maintain documented RPO/RTO strategies.
• Promote continuous improvement in cost optimization, reliability, and operational maturity.

What We Are Looking For

• Experience: 5+ years in data platform engineering, cloud, SRE, DevOps, or infrastructure, including at least 3 years of hands-on experience operating Kafka in production.
• Kafka: Mastery of internal ecosystem concepts (partitions, replication, ISR, controller quorum, KRaft).
• AWS: Advanced knowledge of VPC, EC2, MSK, IAM, Secrets Manager, and networking.
• Streaming & Integration: Familiarity with Databricks Structured Streaming and Kafka Connect.
• Security & IaC: Proven experience with TLS/mTLS, SASL/SCRAM, ACLs, secure cluster design, and Infrastructure as Code (preferably Terraform).
• CI/CD & Observability: Experience with CI/CD pipelines for topics/clusters and monitoring via Grafana, CloudWatch, and log aggregation.
• Automation: Strong scripting skills (Bash, Python) for automation and building internal tools.
• Language: Advanced/fluent English for oral and written communication (Upper-Intermediate or higher).

Differentiators

• Cloud certifications (preferably AWS).
• Knowledge of Schema Registry (Protobuf) and schema governance.
• Prior experience with geospatial data processing.

Why Join the Team?

• International Ecosystem: Work on global-scale projects with direct impact on secure infrastructure and environmental sustainability.
• Autonomy Culture: A collaborative environment that balances the flexibility of remote work with team connection moments, based on trust and accountability.
• Accelerated Growth: Freedom to take initiative, propose innovative solutions, and grow within a global structure.