NVIDIA | NVIDIA

Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud

US, CA, Santa Clara
✓ Verified live on the employer's own system · added 35 days ago
Save search
Senior · 8+ yrs exp

Requirements

Education: Bachelor's degree

Experience: 8+ years

Skills & tools

DevopsRest ApisOperationsElectricalCloud Platforms
Apply on company site ↗ See your fit → free

Full job description

- Lead end-to-end performance and scalability analysis across the Kubernetes-based accelerated runtime stack (control and data planes), including NVIDIA components such as GPU Operator, Network Operator, node-feature-discovery, topograph, dra-driver-nvidia-gpu, and nvsentinel, tracking issues from orchestration down to the metal.

- Design and contribute upstream architectural changes to the Kubernetes control plane and related projects to enable reliable operation at hyperscale cluster sizes, doing in the open what today's hyperscalers typically do privately.

- Improve container startup and cold-start latency to enable smooth, low-latency inference scaling on Kubernetes across thousands of GPU nodes, ensuring the AI runtime stack scales without creating API server pressure or operational fragility.

- Assess, improve, and contribute to open-source projects that make Kubernetes an outstanding platform for AI workloads (for example, Grove and gateway-api-inference-extension), composing their architectures with scalability, resilience, and multi-node training/inference in mind.

- Advance scalability and performance of confidential containers (CoCo) on Kubernetes so encrypted inference workloads meet stringent efficiency and latency requirements in production.

- Use DSX and related large-scale simulation infrastructure to model full AI-factory deployments and validate scalability across thousands of simulated GPUs, catching failures that emerge only at scale before hardware arrives.

- Collaborate with AI researchers, developers, customers, and upstream communities to design automated, at-scale workload tests (including replay of production agent traces), build monitoring/analysis tooling, and integrate continuous performance and scale testing into modern CI/CD workflows.

- Document methods and results clearly and present findings internally and at industry events (for example, KubeCon, GTC), while actively engaging with upstream groups (Kubernetes SIG Scalability, CNCF, and NVIDIA OSS communities) to influence and validate AI workload performance and scalability directions.

- Bachelor's or Master's degree in Engineering or equivalent experience, ideally in Electrical, Computer Engineering, or Computer Science

- 8+ years of experience in computer architecture, networking, storage systems, and accelerator-based platforms

- Expertise in Kubernetes and familiarity with the broader CNCF ecosystem

- Deep experience with large-scale, parallel, distributed accelerator systems and performance optimization of AI workloads

- Experience with performance modeling and benchmarking for large-scale systems

- Strong familiarity with the NVIDIA software stack across training and inference

- Expertise with at least one major public cloud provider (for example, AWS, Azure, GCP, or OCI)

- Strong operational experience with any one of the Kubernetes distributions

- Prior experience scaling Kubernetes clusters to ultra-large node and object counts

- Demonstrated history of working in the open-source community

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

Applications for this job will be accepted at least until June 29, 2026.

More jobs at NVIDIA | NVIDIA

Similar jobs near US, CA, Santa Clara

Tell me when more Senior Systems Engineer, Network jobs post near Palo Alto, CA (Open to US-based Remote) We re-check every listing against the employer’s own board — no résumé needed.

Search Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud jobs near US, CA, Santa Clara → Browse all live jobs

This posting was published by NVIDIA | NVIDIA on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.