N
Senior Data Engineer
Не указаноПолная занятостьData EngineeringEnterprise SoftwareData Infrastructure
Build and operate the data platform behind an agent-native search product, supporting search quality, machine learning, product analytics, and business operations across large-scale production environments.
Обязанности
- Design, develop, and operate the data platform from real-time ingestion through consumer-facing datasets and dashboards
- Build and maintain reliable batch and streaming pipelines from production and external systems
- Design and evolve scalable data warehouse models and domain entities
- Improve data observability through quality checks, freshness monitoring, lineage, schema evolution, and cost controls
- Partner with researchers, engineers, analysts, finance, and product managers to deliver trustworthy datasets
- Investigate production data issues, including broken pipelines, corrupted datasets, schema changes, and large-scale backfills
- Improve testing, documentation, deployment, incident response, security, governance, and engineering standards
Требования
- At least 5 years of data engineering experience
- Strong experience designing scalable, analytics-ready data models and cloud data warehouses
- Strong knowledge of databases, schema design, query optimization, and data warehouse architecture
- Experience with Airflow and dbt or comparable orchestration and transformation frameworks
- Hands-on experience with Spark, MapReduce, or similar distributed processing systems
- Fluency in Python and SQL for production data work
- Experience operating production data systems, resolving incidents, handling schema changes, and performing backfills
Будет плюсом
- Experience with medallion-style data warehouse modeling
- Experience with Snowflake or a comparable cloud data warehouse
- Experience with AWS or GCP data services
- Familiarity with NoSQL use cases
- Experience with Kafka or Pub/Sub
Условия и преимущества
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams