S
Senior Data Engineer, Data Collection Ingest
HybridFull-timeData EngineeringEnterprise SoftwareData Infrastructure
Design, build, and operate high-scale online and offline data ingestion pipelines and infrastructure. Own reliable production services that process billions of events daily in a hybrid work environment.
Responsibilities
- Design, code, and manage end-to-end online and offline data ingestion pipelines
- Develop and maintain modern data infrastructure using data pipeline best practices
- Build and operate high-scale ingestion services focused on availability, reliability, and scalability
- Monitor production availability, system health, and data quality
- Own infrastructure features from design through production
- Lead technical design and team decision-making processes
- Solve complex scale, performance, and business-logic problems
- Collaborate with product managers and team leaders on development processes
- Review code, evaluate implementations, and provide improvement feedback
- Mentor engineers and support continuous technical learning
Requirements
- 5+ years of experience developing big data infrastructure
- Experience with Databricks, Spark, Airflow, Firehose, SQS, or similar technologies
- Experience operating high-scale systems on AWS or another cloud provider
- Experience designing large-scale, high-performance production systems
- Ability to translate business requirements into technical alternatives and evaluate risks and tradeoffs
- Strong communication and cross-team collaboration skills
Benefits
- Hybrid work arrangement
- Competitive compensation and benefits
- Team outings and community activities
- Career development, coaching, and ongoing learning opportunities
- Inclusive and respectful workplace