V
Senior Data Engineer
במקום העבודהמשרה מלאהBackend DevelopmentHealthTech
Join an enterprise AI platform company serving healthcare, biopharma, and wellness. As a Senior Data Engineer, you will build and scale the data foundation, owning complex data end-to-end from ingestion to production delivery. This hands-on role requires solving difficult data problems independently and collaborating with engineering, data science, and product teams.
תחומי אחריות
- Build and own scalable data pipelines for high-volume structured and unstructured data.
- Develop reusable data models, shared dimensions, and production-ready datasets for analytics, AI, and predictive modeling.
- Ensure data quality and reliability through automated validation, anomaly detection, lineage, monitoring, and recovery processes.
- Own production performance, improving scalability, cost efficiency, security, and observability across the data platform.
- Solve complex data inconsistencies, pipeline failures, performance bottlenecks, and architectural challenges hands-on.
- Partner cross-functionally to translate product, client, compliance, and business requirements into technical designs and production systems.
דרישות
- 5+ years of professional data engineering experience with ownership of production data systems.
- Strong Python and SQL skills with experience writing maintainable, tested production code.
- Deep experience designing and operating ETL/ELT pipelines, data models, and distributed data-processing systems.
- Production experience with Apache Spark or a comparable large-scale processing framework.
- Strong AWS experience, ideally including S3, Glue, EMR, Athena, and related compute and orchestration services.
- Experience with modern data lakehouse or warehouse architectures; Apache Iceberg is a strong advantage.
- Experience with workflow orchestration, CI/CD, Docker, Git, and infrastructure as code (e.g., AWS CDK, CloudFormation).
- Strong understanding of data quality, schema evolution, lineage, observability, privacy, security, and access controls.
- Comfortable operating in a fast-moving environment with incomplete requirements, high ownership, and urgency.