N
Senior Data Engineer, Databricks
Not specifiedFull-timeData EngineeringIT Services
Lead end-to-end data projects and build scalable, high-performance data solutions on Databricks, from architecture through production.
Responsibilities
- Design, develop, and implement data solutions on Databricks
- Lead data projects from requirements and architecture through production
- Develop scalable, high-performance ETL/ELT processes and data pipelines
- Integrate data from diverse enterprise systems and sources
- Optimize performance, processing efficiency, and costs
- Collaborate with data, DevOps, BI, and architecture teams
- Contribute to data architecture, standards, and best practices
Requirements
- At least 5 years of experience with Databricks projects and as a Data Engineer
- Strong hands-on Python experience
- Production development experience with Databricks
- Strong Apache Spark and PySpark experience
- Experience building ETL/ELT processes and data pipelines
- Hands-on experience with Delta Lake and lakehouse architecture
- Advanced SQL skills
- Experience with at least one cloud platform: Azure, AWS, or GCP
- Experience working with large-scale data systems