G
Senior Product Analyst – AI Evaluation
В офисеПолная занятостьProduct AnalyticsCybersecurity SoftwareEnterprise Software
A cybersecurity and generative AI company is seeking a Senior Product Analyst to research AI system performance in production and improve evaluation of LLM-powered security agents. This is a full-time, in-office role in central Israel.
Обязанности
- Conduct product and behavioral research on AI system performance in production
- Identify performance patterns, failure modes, and optimization opportunities
- Build and scale evaluation frameworks for benchmarking LLM and generative AI agent performance
- Analyze large-scale data and production telemetry using Python and SQL
- Translate research findings into improvements for security workflows and product capabilities
Требования
- At least 3 years of professional experience as a Data Analyst, Research Analyst, or Product Analyst
- Hands-on experience with LLMs, generative AI models, or AI evaluation frameworks
- Strong SQL skills for complex querying and analysis
- Python programming or scripting experience for data analysis
Будет плюсом
- Experience analyzing big data and production AI telemetry
- Background in or strong affinity for cybersecurity