NVIDIA | NVIDIA

Senior Software Engineer - Local AI

US, TX, Austin
✓ Verified live on the employer's own system · added 12 days ago
Save search
Mid-level · 5+ yrs exp

Requirements

Education: Bachelor's degree or related field

Experience: 5+ years

Skills & tools

Machine LearningProgrammingC Plus PlusTroubleshootingCommunicationsManagement
Apply on company site ↗ See your fit → free

Full job description

- Partnering with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs.

- Collaborate closely with industry partners to advance AI across critical domains-including graphics, web browsers, and edge devices-by driving innovation in both open and closed source technologies with emphasis on system level support.

- Improving performance on current and next-generation GPU architectures by conducting in-depth analysis and end-to-end optimization of AI models, data processing pipelines, and inference runtime features.

- Identifying, evaluating, and implementing compute and memory optimization techniques-such as quantization, distillation, and pruning-for large AI models; fine-tuning and compressing models to fit edge devices.

- Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).

- Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.

- 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp and vLLM.

- Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.

- Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

- Understanding modern techniques in Machine Learning, Deep Neural Networks, and Generative AI with relevant contributions to major open-source projects will be a plus.

- Consistent track record of delivering end-to-end products with geographically distributed teams in multinational product companies.

- Proficiency in lower-level system/GPU programming, CUDA, developing high-performance systems.

- Hands-on experience with building applications using APIs like ONNX RT, DirectX, PyTorch, TensorRT, Vulkan, llama.cpp.

We're a top employer known for innovation and growth. We are an equal-opportunity employer and value diversity at our company. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world's most desirable employers.

We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we would like to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Applications for this job will be accepted at least until August 1, 2026.

More jobs at NVIDIA | NVIDIA

Similar jobs near US, TX, Austin

Tell me when more Software Engineer, Generalist jobs post near Austin, TX We re-check every listing against the employer’s own board — no résumé needed.

Search Senior Software Engineer - Local AI jobs near US, TX, Austin → Browse all live jobs

This posting was published by NVIDIA | NVIDIA on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.