Latest AI JobsBrowse Jobs
bjakcareer logo

Senior Technical Product Manager - AI Agents, Evals & Reliability

bjakcareerUnited StatesActAI Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
28 Sept 2026
Status
Open · checked 7d ago

About this role

This Senior Technical Product Manager role at bjakcareer in the United States suits professionals with a strong technical background who want to build proactive smart assistants for everyday users. The position focuses on delivering high reliability and practical task completion for AI-native applications.

Role Overview

The position involves hands-on product leadership at the intersection of user needs, system constraints, and model capabilities. The employee collaborates directly with engineering teams to shape system design, evaluation, and operational trade-offs for global users.

Key Responsibilities

Research and formulate end-to-end AI system specifications covering capability, behavior, and user impact.
Translate data limitations, model capabilities, and evaluation findings into concrete product choices.
Balance competing factors such as quality, latency, cost, reliability, and user experience.
Collaborate directly with mobile, backend, and machine learning engineers on iteration, evaluation, and system design.
Develop and improve evaluation frameworks utilizing human feedback, offline metrics, and online experiments.
Drive execution through clear specifications, disciplined prioritization, and strong professional judgment.
Deliver systems safely, quickly, and reliably while maintaining robust feedback loops.
Manage end-to-end product quality, focusing on user trust, predictability, and correctness.

Requirements

Strong foundation in computer science principles including system design, data structures, and algorithms.
Solid comprehension of machine learning basics and production behavior for modern artificial intelligence systems.
Ability to read, review, and discuss technical design documents.
Practical exposure to LLM-based systems and AI-powered products.
Experience handling model evaluation, feedback loops, and pipeline or prompt iteration.
Clear intuition regarding model limitations, drift, bias, and hallucinations.
Extensive background in end-to-end ownership of complex, technical products.
Demonstrated ability to collaborate effectively with machine learning teams and senior engineers.
Sound judgment and decision-making skills within fast-moving, ambiguous environments.
Capability to balance ambition against operational and technical realities.

Nice to Have

Prior background shipping consumer products heavy in artificial intelligence.
Previous experience working as an engineer or a deeply technical product manager.
Background in defining evaluation metrics specifically for machine learning systems.
Strong understanding of user experience patterns and failure handling for artificial intelligence.
Past experience working within zero-to-one product environments.

Skills and Tools

LLMs
Machine Learning Systems
Mobile and Backend Engineering
Evaluation Frameworks

About the Company

bjakcareer develops proactive smart assistants aimed at bringing intelligence to daily tasks, organizing, and conversations for more than five billion users of non-AI-native applications. The organization operates as a small, high-talent-density team focused on hands-on execution, rapid decision-making, and collective collaboration.

How to Apply

Interested candidates should submit their application directly on the official company careers page.

Skills and tech stack

LLMMachine Learning

Questions candidates ask

What is the primary mission of the product?

The mission is to build a proactive smart assistant that brings intelligence to everyday workflows, conversations, and errands with minimal prompting.

Is this a hands-on technical position?

Yes, this is a deeply technical, hands-on role where the product manager works directly with engineers on system design, trade-offs, and evaluation.

What level of experience is required for this role?

The posting specifies a Senior title requiring significant experience owning complex technical products end-to-end and working closely with machine learning teams.

What does the interview process look like?

If there is a fit, candidates can expect between three and four interviews conducted via virtual meetings or onsite sessions, evaluated by technical team members.

Where is the position located?

The job location is in the United States.

Ready to apply?

The application is on the official bjakcareer careers page.

Apply on company site