A
Senior Data Engineer
·Israel
Not specifiedFull-timeData EngineeringAerospace and Defense
Design and build real-time data infrastructure for autonomous airspace management and UAV systems. Own streaming pipelines, lakehouse architecture, data modeling, cloud deployment, and performance optimization for high-throughput mission-critical workloads.
Responsibilities
- Design, build, and maintain scalable, low-latency pipelines processing millions of real-time spatial messages daily.
- Implement distributed streaming systems and warehouse or lakehouse schemas for real-time operations and post-mission analytics.
- Own the full lifecycle from architecture and data modeling through Infrastructure as Code deployment, monitoring, optimization, and security.
- Collaborate with research and development, AI and algorithm engineers, and product teams to integrate decision models and simulation telemetry.
- Optimize throughput, memory usage, and cloud infrastructure costs for low-latency deployments.
Requirements
- At least 6 years of experience building production data or backend systems with Python or Java/Spring.
- At least 3 years of hands-on experience with streaming platforms such as Kafka, RabbitMQ, or AWS Kinesis and near-real-time processing at approximately 10 million or more messages per day.
- Strong SQL and NoSQL database experience, including schema design for high-concurrency systems.
- Experience with AWS infrastructure, Docker, Kubernetes, CI/CD, and Infrastructure as Code using Terraform or AWS CDK.
- Understanding of microservices, distributed systems, and distributed state management.
- Bachelor’s degree in Computer Science, Software Engineering, or an equivalent qualification.
Nice to have
- Experience with spatial data modeling, GIS tools, or spatial indexing frameworks such as PostGIS, H3, or GeoJSON.
- Experience with Databricks, Spark, Delta Lake, Snowflake, or ClickHouse.
- Background in defense, aerospace, aviation, or compliance-heavy environments, including ITAR, CMMC, or FedRAMP.
Benefits
- Work on technology supporting infrastructure protection and airspace operations.
- Collaborate with experienced engineers and aviation and defense specialists.
- Use AI tools as part of the engineering workflow.