N
Senior Systems Software Engineer, AI Networking
·Israel
Not specifiedFull-timeAI EngineeringComputer HardwareArtificial Intelligence
Join a team pioneering AI networking technology. Develop and prototype advancements in distributed training and inference. Optimize communication layers, develop system software including libraries, drivers, and firmware, and co-design features with hardware and SDK teams. Integrate prototypes into NVIDIA's AI infrastructure.
Responsibilities
- Prototype end-to-end solutions to improve distributed training and disaggregated inference performance.
- Analyze and optimize communication flows across application, transport, and network layers.
- Develop system software spanning communication libraries, drivers, and firmware integrations.
- Collaborate with hardware, firmware, and SDK teams to co-design network features.
- Validate and integrate prototypes into AI infrastructure and products.
Requirements
- BSc/MSc/PhD in Computer Science or Electrical Engineering.
- 5+ years of relevant experience in networking or systems software.
- Deep understanding of networking and communication internals: NCCL, RDMA/RoCE, congestion control.
- Hands-on experience with HW/SW/FW integration and low-level programming (C/C++, kernel, drivers).
- Background in distributed training systems (PyTorch DDP, Megatron-LM, DeepSpeed).
Nice to have
- Experience turning prototypes into impactful product features.
- Familiarity with programmable data planes (P4, eBPF, DOCA SDK, switch SDKs).
- Knowledge of NIC firmware scheduling, in-network compute, or congestion management.
- Contributions to open-source projects, academic papers, or performance benchmarking tools.
- Background in AI factory architectures, distributed inference, or network telemetry.