T
Senior Data Engineer
Не указаноПолная занятостьData EngineeringEnterprise Software
Join a technology firm building autonomous systems and AI-driven platforms. Design and own real-time data infrastructure, streaming pipelines, and lakehouse solutions for high-scale, mission-critical environments.
Обязанности
- Design, build, and maintain scalable, low-latency pipelines handling millions of real-time messages.
- Architect distributed streaming frameworks and lakehouse solutions for real-time operations and large-scale analytics.
- Own the data infrastructure lifecycle, including architecture, data modeling, deployment, monitoring, optimization, and security.
- Integrate complex data models and simulation telemetry with R&D, AI, algorithm, and product teams.
- Optimize throughput, memory usage, and cloud infrastructure for high-scale, low-latency environments.
- Build and maintain robust, production-grade distributed systems.
Требования
- At least 6 years of experience building production-grade data or backend systems with Python or Java/Spring.
- At least 3 years of hands-on experience with streaming platforms such as Kafka, RabbitMQ, or AWS Kinesis.
- Experience building and maintaining near-real-time data processing systems at scale.
- Strong SQL and NoSQL database skills, including schema design for high-concurrency systems.
- Strong experience with AWS cloud infrastructure.
- Hands-on experience with Docker and Kubernetes.
- Experience with CI/CD pipelines and Infrastructure as Code using Terraform or AWS CDK.
- Strong understanding of microservices, distributed systems, and distributed state management.
- Active Israeli security clearance is required.