G
Senior Data Engineer
Не указаноПолная занятостьData EngineeringFinTech
Build and operate a cloud data platform and production-grade data pipelines for a fintech company providing cross-currency solutions to software platforms and marketplaces.
Обязанности
- Own data development end to end, from requirements and design through implementation, quality assurance, and production maintenance.
- Design, build, and operate cloud data infrastructure for ingestion, batch and streaming processing, and analytical data.
- Integrate internal databases, FX feeds, bank files, and third-party APIs into a governed analytical layer.
- Maintain CI/CD, observability, infrastructure as code, environment parity, pipeline monitoring, and data-quality alerting.
- Develop foundations for an ML feature platform.
- Ensure ETL data quality and integrity, including handling failed checks.
- Work with analysts, data scientists, and business stakeholders to translate needs into data models and pipeline logic.
Требования
- At least 5 years of hands-on data engineering experience with AWS.
- Strong Python and SQL skills, including production-quality, testable code.
- Experience with AWS DMS, Glue, and Airflow (MWAA).
- Production streaming experience with Kinesis or Kafka, including troubleshooting consumer lag.
- Experience with CDC architectures and schema evolution in production.
- Experience with Snowflake or a comparable analytical database.
- Understanding of data modeling, cloud costs, and performance tuning.
- Able to work through ambiguous requirements and communicate with non-technical stakeholders.
Будет плюсом
- Production experience with Apache Iceberg.
- Familiarity with financial data such as FX, treasury, or trade reconciliation.
- Experience with dbt or Terraform.
- Experience using AI development tools.