Baseten

Product Manager, Inference Platform

Full-time · San Francisco (Remote)
✓ Verified live on the employer's own system · added 130 days ago
Save search
Senior · 8+ yrs exp

Requirements

Experience: 8+ years

Skills & tools

Distributed SystemsUI UX DesignDevopsMachine Learning
Apply on company site ↗ See your fit → free

Full job description

- 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.

- You reason fluently about scaling, routing, failover, and the cost/performance frontier - and you earn the respect of staff engineers doing it.

- You've owned capabilities end to end, backend through UX, rather than a single slice.

- You drive cross-team roadmaps and the dependencies beneath them, and you're at your best defining a category that doesn't fully exist yet.

Bonus: hands-on with GPU infrastructure, Kubernetes, or serving frameworks like vLLM, TensorRT-LLM, or SGLang.

- You prefer only strategy, UX, or writing great docs over doing whatever it takes to ship great products for customers.

- You lean toward applied AI over building platform, systems, GPUs, models, and scaling platforms and infrastructure.

- You're not interested in the foundational, sometimes unglamorous work of making AI systems reliable and scalable at the infrastructure level.

More jobs at Baseten

Similar jobs near San Francisco (Remote)

Tell me when more Product Manager, Inference Platform jobs post near San Francisco (Remote) We re-check every listing against the employer’s own board — no résumé needed.

Search Product Manager, Inference Platform jobs near San Francisco (Remote) → Browse all live jobs

This posting was published by Baseten on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.