Senior Software Engineer, AI Infrastructure
Build highly optimized open-source inference infrastructure using low-level systems programming, GPU acceleration, RDMA, and high-performance networking.
Responsibilities
- Develop a highly optimized inference framework
- Build low-level infrastructure using hardware offloads, GPU kernels, and RDMA network cards
- Optimize performance, scalability, and features for large-scale data centers and supercomputers
- Contribute to an open-source library for AI inference
Requirements
- Bachelor’s degree or equivalent experience in Computer Science or Software Engineering
- At least 5 years of experience with modern C++, C, and Python development
- At least 3 years of experience working in Linux environments and with development tools
- Deep knowledge of the TCP/IP network stack
- Understanding of computer architecture and operating systems
Nice to have
- Linux internals and low-level software optimization experience
- CUDA kernel programming
- Familiarity with machine learning frameworks and large language models
- Parallel programming, high-performance computing, or RDMA experience
Benefits
- Competitive compensation
- Comprehensive benefits package
- Opportunity to work with advanced AI and high-performance computing technologies