ק
Data Engineer
ГибридПолная занятостьData EngineeringGovernment
A government organization in Jerusalem is seeking a Data Engineer to design, develop, optimize, and maintain complex data infrastructure across cloud and on-premise environments. The role is hybrid and involves supporting analytics and data science teams.
Обязанности
- Design, develop, and maintain complex data infrastructure
- Build and manage data pipelines and ETL processes
- Optimize data processing workflows and complex queries
- Develop data quality control systems
- Resolve complex database issues and implement system upgrades
- Support analytics and data science teams
- Document processes and maintain technical knowledge within the unit
Требования
- At least 4 years of professional experience in data or data engineering
- Experience developing and maintaining cloud and on-premise data infrastructure
- Proven experience building data pipelines, complex ETL processes, and query optimization
- Experience with relational and NoSQL databases, including SQL, MongoDB, and S3
- Proficiency in Python
- Strong understanding of big data architecture and distributed systems
- Academic education in engineering, computer science, or information systems; relevant data engineering coursework, software engineering training, or equivalent technical education may also be considered
- Strong problem-solving, systems thinking, independent learning, thoroughness, and teamwork skills
Будет плюсом
- Experience with Apache Spark, Airflow, or similar data engineering tools
- Familiarity with GCP, AWS, and cloud data services
- Experience with data warehouses or lakehouse architectures
- Knowledge of monitoring and data quality tools
- Understanding of AI and machine learning models