N
Senior Software Architect, AI Networking
במקום העבודהמשרה מלאהSoftware ArchitectureComputer HardwareArtificial Intelligence Infrastructure
Design and optimize scalable infrastructure for large language model inference across GPU clusters. The role spans software, hardware, networking, scheduling, memory orchestration, and production system performance.
תחומי אחריות
- Design and evolve scalable multi-node LLM inference architectures across GPU clusters
- Develop infrastructure that improves latency, throughput, and cost efficiency for production model serving
- Collaborate with model, systems, compiler, and networking teams on integrated solutions
- Prototype KV-cache handling, tensor and pipeline parallelism, and dynamic batching approaches
- Evaluate and integrate technologies for load balancing, telemetry, congestion control, and application integration
- Translate high-level architecture into reliable, high-performance systems with internal teams and external partners
- Write design documents, technical specifications, and technical blog posts
- Contribute to open-source projects when appropriate
דרישות
- Bachelor’s, master’s degree, PhD in Computer Science or Electrical Engineering, or equivalent experience
- At least 8 years of experience building large-scale distributed systems or performance-critical software
- Deep understanding of deep learning systems, GPU acceleration, AI model execution flows, or high-performance networking
- Strong software engineering skills in C++ and/or Python
- Familiarity with CUDA or similar platforms
- System-level understanding of memory, networking, scheduling, and compute orchestration
- Strong communication and cross-functional collaboration skills
יתרון
- Experience with LLM training or inference pipelines
- Transformer model optimization or model-parallel deployments
- Performance profiling across the LLM training or inference stack
- Experience with AI accelerators, distributed communication, congestion control, or load balancing
- Experience driving complex systems from planning through implementation
הטבות
- Competitive salary
- Comprehensive benefits package