S
Senior Data Engineer
Not specifiedFull-timeData EngineeringFinancial ServicesDigital Media
Design, build, and maintain scalable data infrastructure, pipelines, and warehouses for large-scale analysis. Collaborate with data scientists, analytics teams, and business stakeholders. The role is offered on a contractor basis as a private entrepreneur.
Responsibilities
- Identify and prioritize data engineering projects with data scientists, analytics teams, and other stakeholders
- Design, build, and maintain ETL pipelines from APIs, data streams, and data stores
- Develop and maintain data warehouse and data infrastructure architecture
- Monitor and optimize infrastructure performance, reliability, scalability, efficiency, and security
- Implement data privacy and security requirements aligned with applicable standards and frameworks
- Improve the team’s DevOps capabilities
- Evaluate data engineering developments and identify opportunities for organizational improvement
Requirements
- Bachelor’s or master’s degree in computer science, engineering, or a related field
- At least 5 years of professional data engineering experience focused on pipelines and data warehouses
- At least 2 years of experience developing large-scale software with an object-oriented or functional language
- Strong experience with Spark, Scala, and Python
- Experience with AWS services including EC2, S3, Athena, Kinesis or Firehose, Lambda, and EMR
- Knowledge of data warehousing, columnar storage, data lakes, and SQL
- Experience with Airflow or similar pipeline orchestration and scheduling tools
- High-level English proficiency
- Ability to solve complex problems independently and collaborate effectively
Nice to have
- Experience with Vertica or Redshift, including query optimization and performance tuning
- Experience with machine learning or data science projects
- Knowledge of data governance, security best practices, GDPR, and CCPA
- Knowledge of Spark internals and query optimization
Benefits
- Flexible work options
- Professional learning and development opportunities
- Career advancement opportunities
- Workplace perks supporting employee well-being