E
Senior Machine Learning Engineer
·Israel
Not specifiedFull-timeAI & Machine LearningHuman Resources Services
Senior ML Engineer role focused on building and optimizing LLM inference workflows, system integration, and performance. Write production Python, integrate models and APIs, and optimize GPU-based systems for throughput and latency.
Responsibilities
- Build and maintain end-to-end integration flows across the AI inference pipeline including serving, orchestration, APIs, and infrastructure.
- Design, implement, and optimize LLM inference workflows, including prefill and decode stages.
- Improve system performance with focus on throughput, latency, and interactivity.
- Write production-grade components in Python and integrate them into the broader system.
- Contribute to system-level logic such as smart hardware selection and execution strategies.
- Integrate models (open source and custom), services, and APIs into cohesive, reliable end-to-end application pipelines.
Requirements
- 4+ years of experience in software engineering or machine learning engineering.
- Strong proficiency in Python.
- Strong experience with LLM inference systems and performance optimization.
- Hands-on experience with system integration and end-to-end workflows.
- Experience with inference frameworks such as vLLM, TensorRT, SGLang.
- Experience working with GPU/accelerator-based systems.
Nice to have
- Hands-on experience with Dynamo and LLM-D for LLM inference and serving.
- Familiarity with Kubernetes and cloud environments.