QA Lead
Lead quality engineering across a cloud analytics software domain, covering human-written, AI-generated, and agent-executed systems. Own QA strategy, automation, AI evaluation, risk-based testing, production quality, and cross-team quality standards.
Responsibilities
- Own product quality across human-written, AI-generated, and agent-executed software
- Define QA activities, ownership, acceptance criteria, quality gates, and risk-based test strategies
- Plan, develop, review, and execute testing across cloud analytics and AI-powered systems
- Lead automation, manual testing guidelines, CI/CD quality signals, and regression prevention
- Define performance, concurrency, latency, and non-functional testing scenarios
- Develop evaluation methods for non-deterministic systems, including golden sets and behavioral contracts
- Create adversarial and edge-case testing approaches for AI features
- Monitor post-deployment quality, triage production issues, and lead root-cause reviews
- Report quality metrics, risks, trends, and incidents to leadership
- Coordinate testing across teams and regions and drive systemic quality improvements
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or equivalent
- At least 3 years of QA leadership experience in a team lead or manager role
- At least 5 years of QA engineering experience, including 4 years in test automation
- Experience testing large-scale production distributed systems
- Experience with structured and unstructured data, AI services, and AI models
- Hands-on experience with CI/CD, Test-Driven Development, and Agile software development
- Experience designing evaluation harnesses for non-deterministic AI systems
- Expertise in Python and TypeScript, plus proficiency in at least one compiled language such as Java, Go, or C#
- Strong knowledge of UI, API, and contract testing frameworks
- Deep understanding of agentic AI patterns, prompt engineering, RAG, and structured output techniques
- Ability to lead technical standards and cross-team adoption without direct authority
- Strong written and verbal communication, analytical, mentoring, and stakeholder-management skills
Nice to have
- Experience with agent frameworks such as LangChain, LlamaIndex, AutoGen, or CrewAI
- Experience with AI-assisted code generation and agent-driven development workflows
- Experience with AWS, Azure, or GCP and Infrastructure-as-Code
- Experience with Docker, Kubernetes, and serverless environments
- Experience with Playwright, Stryker, pytest, REST Assured, or Pact
Benefits
- Hybrid work model with two office days and three remote days each week
- Opportunities for learning, growth, and internal career development
- Collaborative, global, and fast-paced work environment