Senior Software Developer

NVIDIA seeks a Senior Software Developer to build a high-performance inference framework for AI networking, leveraging C++, Rust, and GPU technologies on large-scale supercomputers.

The company is looking for an experienced engineer to join its AI networking acceleration group. In this position, you will help create a new open-source library that utilizes hardware offloads, GPU kernels, and RDMA network cards. The goal is to develop a low-level infrastructure that significantly improves inference performance on the world's most powerful supercomputers and data centers.

Responsibilities

• Create a highly optimized inference framework
• Deploy and run the framework on major supercomputing and data center environments

Requirements

• Bachelor’s degree in Computer Science or Software Engineering, or equivalent professional experience
• At least eight years of hands-on experience with modern C++, C, or Rust
• Three years of experience working within Linux environments and using standard development tools
• Strong understanding of the TCP/IP network stack
• Solid grasp of computer architecture and operating system principles

Nice to have

• Practical experience with LLM inference stacks
• Knowledge of distributed storage technologies
• Background in Linux internals and low-level software optimizations, including benchmarking and performance tuning
• Experience programming CUDA kernels
• Familiarity with parallel programming, high-performance computing, or RDMA technology

What the company offers

• Aggressive compensation plan designed to reward top performers
• Highly competitive salaries
• Comprehensive benefits package
• Opportunity to collaborate on products that transform how people work and play

About the company

NVIDIA is widely regarded as one of the most desirable employers in the technology sector, known for its passion for supercomputing and groundbreaking innovations. The company employs some of the smartest engineers globally, fostering a dynamic and challenging work environment focused on next-generation products.

• The team thrives in a deeply strong environment and is passionate about innovation
• The work environment is dynamic and challenging, focusing on innovative, next-generation products at the forefront of technology
• NVIDIA is passionate about supercomputing and powerful ground-breaking technologies
• NVIDIA is widely considered to be one of the technology world’s most desirable employers
• The company has some of the smartest engineers in the world working for them