O
Senior Data Platform Engineer
·Israel
Not specifiedFull-timeData EngineeringLogistics
Join the data platform team in Tel Aviv to design, build, and operate scalable data infrastructure, ingestion pipelines, and distributed processing systems supporting analytics, applications, AI workloads, and large-scale model execution.
Responsibilities
- Build high-volume batch and near-real-time ingestion services and evolve streaming capabilities.
- Design and implement data solutions in distributed microservices environments.
- Develop and optimize large-scale batch and streaming data pipelines.
- Ensure data quality, compliance, and governance.
- Manage and optimize Kubernetes infrastructure and dynamically scale data processing workloads with KEDA.
- Own the data stack lifecycle with Terraform and Kubernetes, from provisioning through application-level frameworks.
- Guide technical practices for infrastructure, CI/CD, testing, and system design.
- Tune memory usage and system performance for cost-effective distributed processing.
Requirements
- At least 5 years of experience as a data platform or infrastructure engineer.
- Experience building and operating scalable data infrastructure and data lake architectures.
- Experience designing and operating large-scale data processing workloads on Kubernetes, including KEDA-based autoscaling.
- Strong proficiency in Python and SQL.
- Hands-on experience with infrastructure as code, preferably Terraform.
- Experience managing data orchestration platforms such as Airflow or Prefect.
- Experience with Snowflake.