Data Engineer
An experienced data engineer is sought to build and maintain data processing, integration, and access solutions in complex enterprise environments. The role covers on-premises and cloud systems, relational and non-relational databases, and batch and real-time processing.
Responsabilidades
- Design, develop, and maintain ETL/ELT pipelines, data processing workflows, and integrations across high-volume enterprise systems.
- Write and optimize complex SQL queries, procedures, and functions; address performance bottlenecks.
- Implement data models and data warehouse structures for reporting, analytics, regulatory, and core business needs.
- Develop file transfer, synchronization, near-real-time, and real-time processes as needed.
- Maintain code quality through unit testing, troubleshooting, process monitoring, and production stability and performance improvements.
- Follow version-control and CI/CD practices, maintain technical documentation, and meet organizational standards.
- Collaborate with systems analysts, QA, infrastructure, architecture, and business stakeholders from requirements through delivery.
- Clarify and analyze requirements, identify gaps, document technical solutions, and propose implementation options.
- Support integration testing, data quality checks, production deployment, and post-implementation monitoring.
- Learn and adopt new tools, languages, and development practices as the organization moves toward hybrid and cloud environments.
Requisitos
- At least 2 years of experience developing data solutions and ETL/ELT processes in complex enterprise environments.
- Strong SQL skills, including procedures, functions, execution-plan analysis, and query optimization.
- Experience developing data integration, processing, and transfer workflows, including production support and troubleshooting.
- Experience with relational databases and practical familiarity with non-relational databases.
- Understanding of data modeling, including dimensional modeling, star schemas, and normalization.
- Ability to interpret specifications, identify gaps, and translate requirements into feasible technical solutions.
- Practical experience analyzing requirements or writing technical specifications for data tasks.
- Experience with version control and CI/CD.
- Ability to work independently and take ownership from development through production.
- Familiarity with Agile and Scrum.
Se valora
- Experience with cloud environments or hybrid on-premises and cloud architecture.
- Experience with streaming or real-time processing.
- Background in financial services, insurance, or regulated environments.
- Experience working directly with business stakeholders and explaining technical considerations to non-technical audiences.