M
Data Platform Engineer
·Israel
Not specifiedFull-timeData EngineeringArtificial Intelligence
Design and build cloud-based data platform infrastructure, implement CI/CD, manage AWS services, and support Spark, DBT, Airflow, Athena workloads. Collaborate with data teams to ensure secure, scalable, and cost-efficient data operations.
Responsibilities
- Design, build, and maintain the underlying infrastructure for a modern cloud-based data platform
- Implement and manage CI/CD processes for data pipelines and platform deployments across development and production environments
- Design and manage secure, scalable AWS-based data infrastructure, including IAM roles, permissions, policies, networking, and environment isolation
- Build and maintain orchestration, monitoring, alerting, and observability capabilities for data pipelines and platform services
- Support deployment, reliability, and operational excellence of data workloads running on Spark, DBT, Airflow, Athena, and AWS services
- Collaborate closely with Data Engineers, Analysts, BI teams, and IT/Cyber teams to ensure secure and scalable data operations
- Monitor, troubleshoot, and optimize platform performance, availability, and cost efficiency
- Establish best practices for infrastructure-as-code, deployment standards, security, and production readiness
Requirements
- Hands-on experience building cloud-based data platforms
- Proficiency with AWS services (IAM, Athena, etc.)
- Experience with data pipeline tools such as Spark, Airflow, and DBT
- Knowledge of CI/CD and infrastructure-as-code practices
- Strong understanding of data orchestration and monitoring
Nice to have
- Experience with Infrastructure as Code tools (Terraform / CloudFormation)
- Experience with Kubernetes and containerized environments
- Experience with Kafka, Iceberg, Databricks, Snowflake