Data Engineer
Design, develop, implement, and maintain data infrastructure and pipelines that support AI, business intelligence, and analytics requirements.
Responsabilidades
- Apply data architecture to support AI, BI, and analytics requirements
- Specify, design, develop, and implement data processes across different environments
- Develop and maintain end-to-end ETL/ELT data pipelines that transfer data from diverse sources
- Design and implement data lake and data warehouse infrastructure
- Monitor, troubleshoot, and improve data pipelines
- Collaborate with BI, data science, and infrastructure teams
- Implement solutions in accordance with information security requirements
Requisitos
- Bachelor’s degree in computer science, information systems, data engineering, mathematics, or engineering
- At least 2 years of experience as a data engineer
- Proven experience with AWS data infrastructure
- Strong understanding of data lake and data warehouse architectures
- Experience writing complex SQL queries and working with relational and NoSQL databases
- Experience with Python, Java, Scala, or C#
Se valora
- Experience with NiFi or other ETL tools
- Experience with Azure or Google Cloud
- Familiarity with on-premises Cloudera