Q
Data Engineering Tech Lead
במקום העבודהמשרה מלאהData EngineeringEnterprise Software
Lead the architecture and delivery of large-scale data pipelines powering real-time pricing recommendations. This hands-on role combines technical leadership, coding, architectural ownership, and team mentoring.
תחומי אחריות
- Architect and build large-scale batch and streaming ETL/ELT pipelines
- Own data lake design, table modeling, and partitioning for billion-row datasets
- Optimize query performance and cloud costs across AWS and GCP
- Establish data quality, observability, reliability, freshness, correctness, and SLA standards
- Partner with backend, product, and data science teams to expose data through internal and customer-facing APIs
- Review technical designs and code, mentor data engineers, and set technical direction
- Support data infrastructure using technologies including Spark, Airflow, BigQuery, PostgreSQL, Kafka, cloud platforms, Kubernetes, and Terraform
דרישות
- At least 5 years of data engineering experience in production environments at terabyte and billion-row scale
- Deep SQL knowledge and strong distributed-processing experience with Spark or an equivalent technology
- Strong Python and/or Go skills
- Hands-on experience with cloud data warehouses such as BigQuery, Snowflake, or Redshift
- Experience with data orchestration tools
- Regular use of AI coding tools and LLM-based agents to accelerate engineering work
- Experience building or supporting AI- or LLM-driven data products and pipelines
- Proven technical leadership, including mentoring engineers, owning architecture, and driving cross-team decisions
- A product-oriented approach to data engineering
יתרון
- Streaming architectures
- FinOps or cloud cost ownership
- Multi-region or multi-cloud systems
- E-commerce or pricing domain experience
- MCP servers or agentic tooling