F
Senior Data Engineer
ГибридПолная занятостьData EngineeringEnterprise Software
Build and improve a cloud cost management platform by developing scalable data collection, processing, integration, and monitoring systems.
Обязанности
- Own, enhance, and improve the core platform
- Build and maintain systems that collect and process metrics from client environments
- Improve system efficiency and infrastructure resilience
- Integrate cloud providers and SaaS platforms with the big data repository
- Optimize Spark and Airflow processes
- Contribute to data design and platform architecture
- Test and monitor large-scale data pipelines
- Collaborate with business units and engineering teams
Требования
- At least 7 years of experience developing and operating large-scale, highly available systems
- At least 7 years of experience with Python
- Experience with cloud environments, preferably AWS
- Experience with big data technologies including Spark, Airflow, S3, Snowflake, and EMR
- Strong communication skills and a self-motivated, collaborative approach
Будет плюсом
- Experience with Go
- Familiarity with metrics systems such as Prometheus or cloud monitoring APIs
- Experience with time-series data