S
Business Data Analyst
·Israel
On-siteFull-timeData ScienceHuman Resources Services
Detail-oriented Business Data Analyst specializing in AI workflow optimization for fraud and risk review. Responsible for evaluating AI decision quality, improving prompts, conducting experiments, and monitoring performance metrics. 12-month contract role.
Responsibilities
- Evaluate AI-generated decisions and reasoning, identifying gaps and improvement areas.
- Analyze AI outputs against business outcomes to prioritize optimization efforts.
- Refine AI prompts and decision guidelines for increased accuracy and consistency.
- Design and conduct controlled experiments to validate prompt and workflow changes.
- Maintain and expand validated test cases for ongoing quality assurance.
- Monitor operational metrics to identify trends and drive data-driven improvements.
- Collaborate with human reviewers to translate feedback into workflow enhancements.
- Drive continuous improvement of AI-assisted fraud and risk review processes.
Requirements
- Strong analytical and problem-solving skills.
- Excellent written communication and ability to write clear, structured instructions.
- Experience analyzing AI-generated outputs and identifying inconsistencies.
- Comfortable with AI-powered development tools (e.g., Cursor, Claude Code).
- Highly organized with a systematic, hypothesis-driven testing approach.
- Exceptional attention to detail in regulated or risk-sensitive environments.
Nice to have
- Experience in fraud operations, compliance, or risk management.
- Familiarity with prompt engineering or AI workflow optimization.
- Understanding of A/B testing and experiment design.
- Basic Python scripting for validation and troubleshooting.