Console

Research Engineer

Full-time · San Francisco (On-site)
✓ Verified live on the employer's own system · added 26 days ago
Save search

Requirements

Education: Master's degree

Skills & tools

HiringOperationsMachine LearningTroubleshootingPharmaceutical CompoundingTeam LeadershipProgrammingReinforcement Learning

Benefits — mentioned in this posting

Health, dental & visionPaid time off401(k) / retirement
Apply on company site ↗ See your fit → free

Full job description

About the role

We're hiring a Research Engineer to push Console's core agent loop from powerful to truly self-improving. As more customers rely on Console to automate critical back-office operations, we need engineers who can turn real production traffic into better agents, evals, and specialist models.

This role sits at the intersection of applied AI engineering and research. You'll build the systems that let us measure, debug, and improve agent behavior in real-world conditions: production traces, offline replay, labeling workflows, eval harnesses, prompt and program optimization, and fine-tuning loops for high-volume agent tasks.

One of your first major focus areas will be improving how Console's agents reason over complex enterprise context. Our agents need to understand users, apps, devices, tickets, licenses, policies, and customer-specific data well enough to answer questions and take action reliably. You'll help turn this into a compounding optimization loop: using production traces, evals, assisted labeling, prompt/program optimization, and targeted model adaptation to make the system measurably better over time.

You'll work closely with product, engineering, and leadership to ship improvements into production quickly, while helping define what research at Console looks like as we scale.

What You'll Do

You'll build and improve AI systems that operate in real-world conditions, where reliability, speed, cost, and adaptability matter. At Console, you will:

- Build the eval and optimization loop for Console's core agents, turning real production usage into measurable improvements in quality, latency, and reliability

- Systematically improve agent behavior across prompts, programs, routing logic, constraints, and model adaptations, applying techniques like DSPy and GEPA where useful

- Fine-tune, adapt, and evaluate specialist models for repeatable, high-volume agent tasks where Console has clear production feedback or verifiable quality signals

- Work across the stack when needed, from traces and eval infrastructure to agent orchestration, product workflows, and customer-facing AI behavior

Who You Are

You're a product-minded research engineer who enjoys building real systems people depend on. You'll likely have:

- Strong technical background in software engineering, machine learning, or applied AI, demonstrated through an advanced degree and/or equivalent experience building production AI systems

- Strong software engineering fundamentals and good judgment for designing, building, and debugging complex systems

- Experience building evals for AI systems, including datasets, judges, metrics, offline replay, tracing, or regression testing

- Practical understanding of modern model adaptation and post-training methods, including LoRA/QLoRA, SFT, distillation, preference optimization, reward modeling, DPO/GRPO, and reinforcement learning from verifiable feedback

- Ownership mindset: you drive projects end-to-end, move quickly from real usage, and care about shipping measurable improvements

- Enjoy following SOTA research into new models, agent architectures, evals, post-training methods, and optimization techniques

Why join Console?

- Product-market fit : We have built the leading product in our category, in a massive market. We've hit an inflection point and are on track to build a generational company.

- World-class team : We seek high agency contributors who are comfortable navigating ambiguity, ruthlessly prioritize what matters and are action-biased.

- Grow with us : We reward impact, not credentials or years of experience. We intend to grow talent from within as we scale up.

- Competitive pay and

benefits : top compensation with full benefits including:

- Comprehensive health, dental, and vision insurance

- Unlimited PTO

- 401(k)

- Equity

- Meals provided daily in office

More jobs at Console

Similar jobs near San Francisco (On-site)

Tell me when more Research Engineer, Mid-Training jobs post near San Francisco We re-check every listing against the employer’s own board — no résumé needed.

Search Research Engineer jobs near San Francisco (On-site) → Browse all live jobs

This posting was published by Console on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.