Senior Deep Learning Software Engineer, Inference

- Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI.

- Scale performance of DL models across different architectures and types of NVIDIA accelerators.

- Contribute features and code to NVIDIA's inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.

- Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.

- Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).

- You'll need excellent C/C++ programming and software design skills. SW Agile skills are helpful and Python experience is a plus.

- Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.

- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.

- GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus.

- Contribute to deep learning software projects, such as PyTorch, vLLM, and SGLang to drive advancements in the field.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our special engineering teams are growing fast.

If you're a creative and autonomous engineer with a genuine passion for technology, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Applications for this job will be accepted at least until July 17, 2026.