Senior Technical Product Manager - AI Agents, Evals & Reliability

Descripción del puesto

About A1 There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting. Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time. Role This is a deeply technical, hands-on role. Work directly with engineers on system design, evaluation, and trade-offs-defining requirements, but shaping how the system works for global users. You work at the intersection of user needs, model capability, and system constraints, and are responsible for turning AI potential into real, reliable behavior in a real-world application. What You'll be Doing Research and define end-to-end AI system requirements from capability to behavior to user impact Translate model capabilities, data constraints, and evaluation results into clear product and system decisions Make hard trade-offs across quality, latency, cost, reliability, and UX Work closely with ML, backend, and mobile engineers on system design, evaluation, and iteration Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback Drive execution with clear specs, strong judgment, and disciplined prioritization Ensure systems ship quickly, safely, and reliably, with strong feedback loops Own product quality end-to-end - correctness, predictability, and user trust What You Will Need Technical foundation Strong grounding in computer science fundamentals, including algorithms, data structures, and system design. Solid understanding of ML fundamentals and how modern AI systems behave in produ