M
Senior Data Engineer
Не указаноПолная занятостьData EngineeringAutomotiveArtificial Intelligence
Join an automotive technology company in Petah Tikva to build scalable data infrastructure from the ground up. Own data flows from ingestion through consumption across batch and real-time use cases.
Обязанности
- Design, build, and maintain robust end-to-end batch and real-time data pipelines.
- Design scalable data architectures for evolving business needs.
- Build and manage data lakes, warehouses, and other data platforms.
- Integrate structured and unstructured sources through ETL and streaming solutions.
- Design data models, schemas, and SQL and NoSQL database structures.
- Implement data quality processes for accurate, consistent, reliable data.
- Monitor, optimize, and troubleshoot data infrastructure against performance and SLA requirements.
Требования
- At least 5 years of hands-on Data Engineering experience building data systems from scratch.
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Strong Python and advanced SQL skills, including data modeling.
- Experience designing scalable batch and real-time pipelines, including Kafka-based streaming.
- Strong AWS experience, including S3, Athena, and DynamoDB.
- Experience with Spark and columnar formats such as Parquet.
- Hands-on experience with workflow orchestration tools such as Airflow.
- Fluent English.
- Strong ownership, problem-solving, attention to detail, and collaboration skills in fast-paced, ambiguous environments.
Будет плюсом
- Experience with Databricks or Snowflake.
- Experience building modern lakehouse platforms using technologies such as Iceberg.