A
Data Engineer
Not specifiedFull-timeData EngineeringCloud ServicesIT Consulting
Build and optimize large-scale data pipelines for data warehouse and AI projects across cloud and on-premise environments. The role partners closely with data scientists and development teams.
Responsibilities
- Ingest large volumes of new data
- Analyze and examine data in collaboration with data scientists
- Design and develop large-scale data pipelines and processing workflows
- Deploy and optimize data solutions in cloud and on-premise environments
- Collaborate with development teams, production teams, and end users
Requirements
- Bachelor’s degree in computer science, engineering, mathematics, statistics, or a related field
- At least 3 years of data engineering experience
- At least 3 years of Python development experience
- Hands-on experience with object-oriented programming
- Hands-on experience with Apache Spark for large-scale data processing
- Experience with dbt
- Experience building and maintaining pipelines with Airflow or Kubeflow
- Practical knowledge of Docker and container platforms such as ECS or Kubernetes
- Understanding of data optimization techniques and formats including Parquet and Iceberg
- Strong analytical skills, independence, initiative, and ability to collaborate
Nice to have
- AWS data services such as Athena, Glue, EMR, Redshift, and RDS
- BI tools such as QuickSight, Tableau, or Power BI
- Machine learning concepts and processes
- GenAI or prompt engineering
Benefits
- Competitive salary
- Bonus incentives
- Benefits package
- Flexible hours
- Mentoring
- Learning and personal development opportunities