← Back to jobs
N

Senior AI Infrastructure Engineer

NVIDIA·Israel·en
On-siteFull-timeAI EngineeringComputer HardwareEnterprise Software

Join an AIOps platform team building distributed systems for high-volume GPU telemetry, predictive AI, observability, and enterprise model serving across SaaS and on-premises environments.

Responsibilities

  • Architect and build agentic AIOps systems that monitor GPU fleet health, correlate telemetry, generate alerts, and orchestrate diagnostic and corrective workflows.
  • Design distributed systems for high-density telemetry ingestion, processing, and real-time analysis across large AI clusters.
  • Research and prototype data storage strategies and representations across database technologies to support high-quality model training data.
  • Instrument services with metrics, logs, and traces to enable debugging and performance improvements.
  • Build and operate model-serving infrastructure, including model packaging, versioning, deployment, and monitoring across SaaS and on-premises environments.
  • Develop core libraries and abstractions for the wider AIOps engineering organization.

Requirements

  • Bachelor’s or master’s degree in computer science, computer engineering, or a related technical field.
  • At least 8 years of software engineering experience building production distributed systems.
  • Expert proficiency in Go, C++, Rust, or comparable systems programming languages, with experience in high-performance concurrent architectures.
  • Strong knowledge of Kubernetes and container-based production deployments.
  • Experience deploying, monitoring, and maintaining machine learning models or data-intensive services in production.
  • Ability to work effectively in ambiguous, fast-moving product environments.

Nice to have

  • Experience building ML model-serving platforms or MLOps tools such as model registries, A/B rollout frameworks, or feature stores at scale.
  • Experience taking systems from prototype to stable, production-grade platforms for enterprise customers.
  • Ability to simplify complex systems and build internal tools that improve engineering team productivity.

Benefits

  • Competitive salary
  • Generous benefits package

Relevance

More opportunities

Similar jobs

The newest open roles in AI Engineering.

Questions, answered

Frequently asked questions

Senior AI Infrastructure Engineer for Distributed Systems | CVZilla