Baseten

Product Manager, Inference Platform

Full-time · San Francisco (Remote)
✓ Verified live on the employer's own system · added 129 days ago
Save search
Senior · 8+ yrs exp

Requirements

Experience: 8+ years

Skills & tools

Distributed SystemsUI UX DesignDevopsMachine Learning

Benefits — mentioned in this posting

Health, dental & visionPaid time offFamily / parental leave401(k) / retirement
Apply on company site ↗ See your fit → free

Full job description

What we're looking for

- 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.

- You reason fluently about scaling, routing, failover, and the cost/performance frontier - and you earn the respect of staff engineers doing it.

- You've owned capabilities end to end, backend through UX, rather than a single slice.

- You drive cross-team roadmaps and the dependencies beneath them, and you're at your best defining a category that doesn't fully exist yet.

Bonus: hands-on with GPU infrastructure, Kubernetes, or serving frameworks like vLLM, TensorRT-LLM, or SGLang.

Not for You if

- You don't like getting technical.

- You prefer only strategy, UX, or writing great docs over doing whatever it takes to ship great products for customers.

- You lean toward applied AI over building platform, systems, GPUs, models, and scaling platforms and infrastructure.

- You're not interested in the foundational, sometimes unglamorous work of making AI systems reliable and scalable at the infrastructure level.

BENEFITS

- Competitive compensation, including meaningful equity.

- 100% coverage of medical, dental, and vision insurance for employee and dependents

- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

- Paid parental leave

- Fertility and family-building stipend through Carrot

- Company-facilitated 401(k)

- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

More jobs at Baseten

Similar jobs near San Francisco (Remote)

Tell me when more Engineering Manager, Product Platform jobs post near Remote We re-check every listing against the employer’s own board — no résumé needed.

Search Product Manager, Inference Platform jobs near San Francisco (Remote) → Browse all live jobs

This posting was published by Baseten on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.