S
Senior Data Engineer
·Israel
Not specifiedFull-timeData EngineeringDefense Technology
Lead the architecture and development of real-time data infrastructure supporting high-volume telemetry, coordination data, and AI decision streams from autonomous platforms.
Responsibilities
- Architect and build scalable, low-latency streaming pipelines for high-volume spatial data.
- Implement distributed streaming frameworks and lakehouse schemas for real-time execution and post-mission analytics.
- Own data modeling, infrastructure-as-code deployment, performance monitoring, security, and infrastructure optimization.
- Integrate AI and algorithmic decision models with simulation telemetry.
- Optimize throughput, memory usage, and cloud infrastructure costs for mission-critical deployments.
Requirements
- At least 6 years of production experience building data or backend systems with Python or Java.
- At least 3 years of hands-on experience with streaming platforms such as Kafka, RabbitMQ, or Kinesis.
- Experience processing approximately 10 million or more real-time messages per day.
- Deep proficiency with SQL and NoSQL databases, including PostgreSQL, Elasticsearch, DynamoDB, or Redis.
- Experience with AWS, Docker, Kubernetes, CI/CD, and infrastructure as code using Terraform or CDK.
- Strong understanding of microservices, distributed systems, and distributed state management.
- Bachelor’s degree in Computer Science, Software Engineering, or equivalent practical experience.
- Active security clearance or eligibility to obtain one.