Auctor

Software Engineer, Applied AI

$175K–$290KFull-time · New York
✓ Verified live on the employer's own system · added 129 days ago
Save search

Skills & tools

OperationsMachine LearningRecordkeepingUI UX Design
Apply on company site ↗ See your fit → free

Full job description

We are looking for someone who wants to build real agent systems, understand how they behave in the wild, and use that understanding to make bold product and architecture decisions.

- Build and improve the core systems behind our agents across retrieval, tool use, document understanding, memory, and orchestration

- Design evals and experiments that help us understand agent quality in production

- Turn traces, failures, and user behavior into concrete product and architecture decisions

- Work closely with operations, GTM, and deployed teams to understand real workflows and where agents break down

- Evaluate models, prompts, and system designs across real enterprise tasks

- Own the loop from idea -> implementation -> measurement -> iteration

- Strong engineering fundamentals and the ability to ship production systems

- Experience building or working on LLM-powered products, agent systems, or adjacent applied AI systems

- An empirical mindset - you reach for logs, traces, experiments, and real usage before guessing

- Strong systems taste - you understand that retrieval, prompting, memory, tools, and UX interact

- Strong opinions about what makes agent systems actually work

- Experience designing evals, benchmarks, or feedback loops for LLM systems

- Experience building internal tools, workflow products, or operator-facing systems

- Experience in startups or other high-ownership environments

This is a new field. We care much more about what you have built than whether your background fits a standard template.

- Designing and shipping an agent harness that materially improved performance on a real task

- Building an eval or benchmark that changed what your team decided to build next

- Designing tool interfaces, memory systems, or retrieval systems for an LLM-powered product

- Building a production workflow around language models that users actually depended on

- Running a careful experiment on prompting, model routing, or orchestration and using it to drive a product decision

If you apply, we would love to see one thing you built with LLMs or agents. It does not need to be perfect or flashy. We mostly want to understand how you think, what you owned, what you learned, and what tradeoffs you made.

More jobs at Auctor

Similar jobs near New York

Tell me when more Applied AI Engineer, Ops jobs post near New York City We re-check every listing against the employer’s own board — no résumé needed.

Search Software Engineer, Applied AI jobs near New York → Browse all live jobs

This posting was published by Auctor on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.