M
Mid-Level Data Engineer
Not specifiedNot specifiedData Engineering
A leading organization in the Sharon area is seeking a Data Engineer to support production data processes, pipelines, troubleshooting, reconciliation, and data quality activities.
Responsibilities
- Work with data processes and data pipelines in production environments.
- Use SQL extensively to analyze and investigate data.
- Maintain and troubleshoot Airflow processes and existing DAGs.
- Read and understand Python code used for orchestration and pipelines.
- Investigate data incidents, discrepancies, duplicates, and missing records.
- Use logs and monitoring tools to troubleshoot production issues.
- Perform reconciliation and data quality checks.
- Improve and document operational processes.
- Collaborate with technical and business stakeholders.
Requirements
- At least 4 years of experience in Data Engineering, Analytics Engineering, BI Engineering, or a similar data role.
- Advanced SQL skills, including complex queries, joins, aggregations, CTEs, and window functions.
- Experience identifying and investigating data discrepancies, duplicates, and missing records.
- Experience with Airflow and troubleshooting existing DAGs, including task dependencies, schedules, retries, and failures.
- Ability to read and understand Python code used for data pipelines and orchestration.
- Experience with ETL/ELT processes in production environments and strong understanding of data pipelines.
- Experience investigating production data incidents using logs, monitoring, reconciliation, and data quality checks.
- Strong problem-solving skills, attention to detail, and the ability to communicate data issues to technical and business stakeholders.
- Willingness to participate in on-call rotations or provide support outside standard hours when needed.
Nice to have
- Practical familiarity with AI tools such as Cursor, Claude, or similar tools.