P
Senior Data Engineer
·Israel
Not specifiedFull-timeData EngineeringPower Transmission & Distribution
Lead design and architecture of cloud-based data solutions, build production-grade data pipelines, ensure data governance and compliance, and integrate with edge computing and AI models for smart infrastructure.
Responsibilities
- Lead the design and architecture of cloud-based data solutions, ensuring scalability, reliability, and performance.
- Design and build data pipelines for field data collection, analysis, and inference using industry production-grade technologies.
- Design and build customer cloud/on-premise data solutions for storage, lookup, and processing flows.
- Study and incorporate standards for data governance, security, and compliance.
- Provide online and real-time monitoring and analysis of data systems health, accuracy, and costs.
- Plan and execute integrations with edge computing solutions and AI models for research and production flows.
Requirements
- 8+ years of hands-on programming experience in high-level languages including Python.
- 8+ years experience in designing, building, or administrating large scale software systems.
- Experience with AWS cloud, EKS, Airflow, Spark, SageMaker, MongoDB, SQL.
- Excellent leadership, communication, and collaboration skills.
- Expert in designing and implementing highly resilient big data applications.
- Academic degree in Computer Science, Computer Engineering, or Information Systems.
- Certifications in AWS or other relevant cloud technologies.
- Proven track record with NIST compliance and security protocols.
Nice to have
- Over 3 years of experience serving in an architect capacity or a comparable role.
- Proficiency in CI/CD pipelines, utilizing tools like Jenkins and GitHub Actions.
- Experience with On-prem Kubernetes (K8s).
- Security-focused background.