A
Senior Data Engineer
Не указаноПолная занятостьData EngineeringCybersecurity
Join a fast-moving cybersecurity team building production-scale data infrastructure. You will transform agent telemetry and third-party platform data into reliable, actionable security insights for AI-powered defense systems.
Обязанности
- Design and maintain high-throughput ETL and ELT pipelines using distributed compute frameworks such as Spark and Databricks
- Build resilient connectors for third-party systems and manage API rate limits
- Design scalable schemas across relational databases and high-performance storage layers such as Delta Lake
- Optimize data processing for cost, speed, and low-latency telemetry updates
- Connect raw data ingestion pipelines with backend services that power the user interface
Требования
- At least 5 years of data engineering experience focused on production-scale pipelines
- Expertise with distributed processing frameworks such as Spark and modern lakehouse architectures
- Strong Python and SQL skills, with a focus on clean, modular, tested data jobs
- Experience with cloud environments such as AWS S3 and RDS
- Ability to build scalable systems without unnecessary complexity
Условия и преимущества
- High-impact work in cybersecurity and AI
- Lean, fast-moving engineering environment
- Opportunity to shape how users interact with AI agents