P
Staff Quality Assurance Engineer – AI and Learning Systems
On-siteFull-timeQA & Test AutomationEdTech
Join a digital learning product team in Haifa as a Staff Quality Assurance Engineer. Lead quality engineering for GenAI products, LLM workflows, APIs, integrations, and web applications used by learners worldwide. The role is full-time and preferred onsite in Haifa.
Responsibilities
- Define and lead test strategies for GenAI products and LLM-based workflows
- Validate model accuracy, bias, safety, reliability, hallucinations, and edge cases
- Develop and maintain AI testing frameworks, prompt tests, and model-output evaluation methods
- Build and evolve automation frameworks, CI/CD pipelines, and evaluation harnesses
- Test AI/ML models, APIs, integrated systems, and end-to-end user workflows
- Validate multi-agent orchestration, MCP models, APIs, and user interfaces
- Own quality strategy for data mapping, observability, evaluation workflows, and integrations
- Partner with engineering, product, and data science teams on quality standards
- Lead defect analysis, apply lessons learned, and adopt emerging AI testing methods
Requirements
- At least 6 years of quality engineering experience
- At least 3 years in a technical leadership or managerial role
- Strong experience testing AI/ML products, GenAI workflows, model evaluation, or LLM-based solutions
- Hands-on experience with test automation, API and UI testing, and CI/CD pipelines
- Understanding of prompt variation, nondeterministic outputs, evaluation metrics, and model drift
- Knowledge of Python or a similar programming language for test tools and evaluation harnesses
- Bachelor’s degree in Computer Science, Engineering, or a related field
- Experience working in cross-functional Agile or Scrum environments
- Strong communication and leadership skills
Nice to have
- Exposure to prompt engineering, bias testing, or AI ethics frameworks
- Advanced degree
Benefits
- Work on digital learning products serving millions of users globally
- Join a startup-like culture within a global organization
- Collaborate with a close-knit, talented team
- Shape quality practices for AI-driven education products