Senior HPC and AI Network Software Architect

NVIDIA seeks a Senior HPC and AI Network Software Architect in Switzerland to design scalable infrastructure for distributed AI training and inference.

The company is looking for an expert to help build the next generation of scalable AI infrastructure. This position focuses on distributed training, real-time inference, and communication efficiency across large systems, contributing to the design of systems that power the fastest AI workloads globally.

Responsibilities

• Design and evolve the architecture for scalable software systems supporting distributed AI training and inference.
• Develop and assess new communication and runtime capabilities within libraries like NCCL, UCX, and UCC.
• Work with AI framework and internal platform teams to create integrations and enhance end-to-end performance.
• Collaborate on hardware and system-level features involving GPUs, DPUs, and interconnects.
• Lead innovation in runtime systems, communication libraries, and AI-specific protocol layers.

Requirements

• A Ph.D. or equivalent industry experience in computer science, computer engineering, or a related field.
• At least five years of experience in systems programming, parallel or distributed computing, high-performance networking, or large-scale data movement.
• Strong programming skills in C++, Python, and ideally CUDA or other GPU programming models.
• Extensive hands-on experience with AI frameworks such as PyTorch, TensorFlow, or JAX.
• Proven success in developing and refining high-throughput, low-latency systems.
• Strong collaboration skills in a multi-national, interdisciplinary setting.

Nice to have

• Deep expertise with NCCL, UCX, UCC, or similar communication libraries used in large-scale AI and HPC workloads.
• Strong background in networking and communication protocols, RDMA, collective communications, congestion-aware transport, or accelerator-aware networking.
• Comprehensive knowledge of large model training and inference serving at scale.
• Experience crafting hardware-software co-design for distributed AI systems.
• Familiarity with infrastructure for deployment of LLMs or transformer-based models.

What the company offers

• Highly competitive salaries.
• Comprehensive benefits package.

About the company

NVIDIA fosters a diverse and supportive environment where employees are inspired to do their best work. The company values individuals dedicated to continuous learning and creative problem-solving.

• Immersed in a diverse, supportive environment where everyone is inspired to do their best work.
• Work alongside individuals who are dedicated to continuous learning and creative problem-solving.