Experience: 8+ years
- 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.
- You reason fluently about scaling, routing, failover, and the cost/performance frontier - and you earn the respect of staff engineers doing it.
- You've owned capabilities end to end, backend through UX, rather than a single slice.
- You drive cross-team roadmaps and the dependencies beneath them, and you're at your best defining a category that doesn't fully exist yet.
Bonus: hands-on with GPU infrastructure, Kubernetes, or serving frameworks like vLLM, TensorRT-LLM, or SGLang.
- You don't like getting technical.
- You prefer only strategy, UX, or writing great docs over doing whatever it takes to ship great products for customers.
- You lean toward applied AI over building platform, systems, GPUs, models, and scaling platforms and infrastructure.
- You're not interested in the foundational, sometimes unglamorous work of making AI systems reliable and scalable at the infrastructure level.
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Search Product Manager, Inference Platform jobs near San Francisco (Remote) → Browse all live jobs
This posting was published by Baseten on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.