Principal Data Engineer
Join a high-scale HealthTech company developing a life-saving medical AI platform. As Principal Data Engineer, you will define big data methodologies, architect scalable data ecosystems using Databricks, Delta Lake, Spark, and AWS, and lead cross-functional engineering initiatives.
Responsibilities
- Define and implement big data methodologies and architectural standards across engineering squads.
- Design and scale high-throughput, low-latency streaming and batch data architectures.
- Architect modern data lakehouse and data warehouse ecosystems using Databricks, Delta Lake, Spark, and related technologies.
- Lead cross-functional data and AI engineering initiatives.
- Develop and maintain cloud infrastructure using Python, AWS, Terraform, and event-driven services.
Requirements
- 6+ years of hands-on experience in software or data engineering.
- Extensive practical experience in big data engineering and complex data pipeline architectures.
- Proven track record in high-scale, large-scale production environments.
- Deep expertise with modern data lakehouse and data warehouse architectures (e.g., Databricks, Delta Lake, Apache Iceberg, Snowflake, AWS Redshift).
- Experience with distributed computing frameworks (Apache Spark) and event streaming/messaging (Kafka, Kinesis, SQS, SNS).
- Strong technical leadership and architecture design capabilities.
Nice to have
- Hands-on experience with AWS cloud infrastructure and Infrastructure as Code (Terraform).