Latest AI JobsBrowse Jobs
bjakcareer logo

Senior Technical Product Manager - AI Agents, Evals & Reliability

bjakcareerUnited KingdomActAI Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
28 Sept 2026
Status
Open · checked 7d ago

About this role

bjakcareer is hiring a Senior Technical Product Manager for AI Agents, Evals & Reliability based in the United Kingdom. This position suits an experienced, hands-on professional who wants to design proactive AI assistants that handle multi-step reasoning and everyday tasks.

Role Overview

This hands-on position requires close collaboration with engineering teams to shape system design, evaluation protocols, and operational trade-offs. The individual chosen will balance user needs against model capabilities and technical constraints to deliver reliable real-world applications.

Key Responsibilities

Research and formulate end-to-end AI system requirements covering user impact, behavior, and capabilities.
Convert model constraints, evaluation findings, and data limitations into product decisions.
Balance priorities such as latency, cost, reliability, quality, and user experience.
Partner directly with mobile, backend, and machine learning engineers on iteration and system architecture.
Build and refine evaluation methods spanning human feedback, offline metrics, and online experiments.
Manage execution schedules using precise specifications and careful prioritization.
Deliver systems securely and efficiently while maintaining robust feedback mechanisms.
Maintain complete ownership over product correctness, user trust, and predictability.

Requirements

Strong background in computer science principles including system design, algorithms, and data structures.
Understanding of machine learning concepts and production behavior in modern artificial intelligence systems.
Ability to review, read, and engage with technical design documentation.
Practical background working with LLM-powered applications and AI-driven products.
Experience managing pipeline iterations, model evaluations, and feedback loops.
Familiarity with model limitations, biases, drift, and hallucinations.
Background managing complex technical software products throughout their lifecycle.
Track record collaborating alongside machine learning specialists and senior engineering staff.
Decision-making capability within fast-paced, ambiguous settings.

Nice to Have

Background launching consumer products heavy in artificial intelligence.
Previous experience working as a software engineer or technical product manager.
History creating evaluation metrics specifically for machine learning architectures.
Familiarity with AI user experience patterns and managing system failures.
Background working in early-stage zero-to-one product settings.

Skills and Tools

LLMs
AI Agents
Machine Learning
System Design
Algorithms
Data Structures

About the Company

The organization builds proactive smart assistants intended to bring artificial intelligence to everyday applications for billions of users. The team operates as a high-talent, hands-on group that makes collective decisions and focuses on rapid execution.

How to Apply

Interested candidates should apply on the official company careers page.

Skills and tech stack

LLMsAI AgentsMachine LearningLLM

Questions candidates ask

Where is the job located?

The role is located in the United Kingdom.

What kind of experience is required for this position?

Candidates need a strong technical foundation in computer science and machine learning, practical exposure to LLM-based systems and model evaluation, and significant experience owning complex technical products end-to-end.

What will I be working on?

You will work on AI agents, evaluations, and reliability, designing proactive smart assistants that handle multi-step reasoning, persistent context, and real-world task completion.

What does the interview process look like?

The interview process consists of three to four interviews conducted via virtual meetings and/or onsite.

Ready to apply?

The application is on the official bjakcareer careers page.

Apply on company site