Data Engineer
A recruitment firm is hiring a Data Engineer for a large government organization. The role focuses on data infrastructure, lake and lakehouse platforms, processing pipelines, and integration solutions. Work location: Jerusalem or Tel Aviv.
Responsibilities
- Design, develop, maintain, and optimize data infrastructure, ETL/ELT processes, and large-scale data interfaces.
- Build, maintain, and optimize data lake and data lakehouse platforms, incorporating AI and generative AI capabilities.
- Design and implement data integration solutions, including incremental integration, with attention to operational efficiency, cost, and performance.
- Monitor data infrastructure and processing workflows, troubleshoot issues, and support continuous operations.
- Maintain data integrity, accuracy, security, and availability, and implement controls to reduce data quality gaps.
- Evaluate data and AI tools and technologies and recommend improvements to existing platforms and processes.
- Collaborate with data teams, analysts, operations teams, and business stakeholders.
Requirements
- At least 4 years of relevant data engineering or DataOps experience.
- Hands-on experience building, managing, and optimizing data lake or data lakehouse infrastructure and data processing pipelines.
- Experience designing and developing complex data integration solutions, including incremental integration.
- Experience incorporating AI and generative AI capabilities into data workflows.
- Experience with databases, infrastructure monitoring, troubleshooting, and performance optimization.
- Academic studies in engineering, computer science, or data science; alternatively, software engineering technology studies, a technology unit background, or advanced coursework in information systems and data engineering.
- Knowledge of information security, data integrity, and process controls.