Data Engineering Team Lead
Lead and mentor a data engineering team, split 50/50 between management and hands-on development. Architect and build distributed systems, high-performance data pipelines, and data-fusion algorithms across public cloud and on-premises environments. Drive code quality, optimize bulk queries, and ensure data integrity under strict SLAs.
Responsibilities
- Directly lead, mentor, and manage the engineering team while conducting code reviews and setting high engineering standards.
- Drive core system development (at least 50% hands-on) with a strong focus on Python.
- Lead the design and architecture of distributed systems, high-performance data pipelines, and data-fusion algorithms.
- Build and deploy scalable solutions across both public cloud and secure, closed on-premises environments.
- Ensure data integrity and optimize complex bulk queries to meet strict response-time targets.
Requirements
- 3+ years of experience leading a development team or serving as a Tech Lead for data/backend teams.
- 4+ years of hands-on experience with Python.
- 5+ years of proven experience as a Big Data Backend or Data Engineer.
- Deep understanding of cloud environments and containerized on-premises infrastructure (OpenShift, Kubernetes, Docker, Linux).
- Strong experience with SQL and NoSQL (PostgreSQL and OpenSearch/Elasticsearch a significant advantage).
- Proven experience processing large-scale data sets and working with CI/CD methodologies (e.g., GitLab).
- BSc/BA in Computer Science, Software Engineering, or a related field.
Nice to have
- Background in the Cybersecurity industry or service in elite IDF technology units.
- Experience with vector embeddings and AI-based RAG systems.
- Experience with TypeScript (Frontend/Backend).