A
Mid-Level Data Engineer
Не указаноПолная занятостьData EngineeringCloud ServicesIT Consulting
Join a development team working on a core data warehouse project and AI initiatives. The role focuses on large-scale data ingestion, analysis, and pipeline development across cloud and on-premise environments.
Обязанности
- Ingest large volumes of new data
- Analyze and examine data in collaboration with data scientists
- Design and develop critical, diverse, large-scale data pipelines and processes
- Deploy and optimize data solutions in cloud and on-premise environments
- Collaborate with development teams, production teams, and end users
Требования
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or Statistics
- At least 3 years of data engineering experience
- At least 3 years of Python development experience
- Hands-on object-oriented programming experience
- Hands-on experience with Spark for large-scale data processing
- Experience with dbt
- Experience building and maintaining pipelines with Airflow or Kubeflow
- Practical knowledge of Docker and container platforms such as ECS or Kubernetes
- Understanding of optimization techniques and advanced data formats, including Parquet and Iceberg
- Understanding of machine learning concepts and processes
- Analytical ability, initiative, independence, collaboration, and accountability
Будет плюсом
- Experience with AWS data services such as Athena, Glue, EMR, Redshift, and RDS
- Practical knowledge of generative AI or prompt engineering
- Experience integrating BI tools such as QuickSight, Tableau, or Power BI
Условия и преимущества
- Competitive salary
- Bonus incentives
- Benefits package
- Flexible working hours
- Mentoring
- Learning and personal development opportunities