Latest AI JobsBrowse Jobs
bjakcareer logo

Senior Technical Product Manager - AI Agents, Evals & Reliability

bjakcareerChinaActAI Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
28 Sept 2026
Status
Open · checked 7d ago

About this role

Bjakcareer is hiring a Senior Technical Product Manager for AI Agents, Evals & Reliability in China to shape proactive smart assistant technology for global users. This hands-on position suits experienced product professionals who want to bridge model capabilities and real-world system constraints.

Role Overview

This position involves working closely with engineering teams to design, evaluate, and scale AI-driven features focused on reliability and long-running workflows. The role bridges user needs, machine learning capabilities, and system limitations to deliver predictable application behavior.

Key Responsibilities

Research and formulate end-to-end AI system requirements covering behavior, capabilities, and user impact.
Convert data constraints, evaluation results, and model capabilities into product decisions.
Balance difficult trade-offs involving cost, latency, reliability, quality, and user experience.
Collaborate with mobile, backend, and machine learning engineers on iteration, system design, and evaluation.
Create and develop evaluation frameworks incorporating online experiments, human feedback, and offline metrics.
Execute product delivery through structured specifications, disciplined prioritization, and sound judgment.
Deliver features rapidly and safely with robust feedback loops.
Maintain end-to-end product quality, focusing on predictability, user trust, and correctness.

Requirements

Solid foundation in computer science principles, system design, data structures, and algorithms.
Understanding of machine learning concepts and production AI system behavior.
Capability to read, discuss, and review technical design documentation.
Practical exposure to LLM-based systems and AI-powered products.
Background in pipeline iteration, model evaluation, and feedback loops.
Awareness of model drift, hallucinations, biases, and limitations.
Direct experience taking complex technical products from inception to completion.
History of collaborating directly with machine learning and senior engineering groups.
Decision-making skills suited for ambiguous and fast-paced settings.

Nice to Have

Experience releasing consumer products heavily reliant on artificial intelligence.
Previous background operating as an engineer or technical product manager.
Background in establishing evaluation metrics for machine learning architectures.
Familiarity with AI failure handling and user experience patterns.
Experience working within zero-to-one product incubation phases.

Skills and Tools

Large Language Models (LLMs)
Offline and online evaluation frameworks
Mobile and backend engineering collaboration

About the Company

Bjakcareer builds proactive smart assistants intended to bring intelligence to everyday tasks, organizing, workflows, and conversations for more than five billion users. The organization operates as a hands-on, high-talent-density group that emphasizes collective decision-making and rapid execution.

How to Apply

Candidates should apply directly on the official company careers page.

Skills and tech stack

LLMAI Agents

Questions candidates ask

What is the primary goal of the product?

The product aims to provide a proactive smart assistant for everyday users to bring intelligence to daily conversations, errands, organization, and workflows while reducing task time significantly.

Is this a hands-on technical position?

Yes, this is a deeply technical, hands-on role requiring collaboration with engineers on system design, trade-offs, and evaluations.

What qualifications are needed in technical foundations?

Candidates need strong computer science fundamentals in system design, algorithms, and data structures, along with a solid understanding of machine learning in production.

What does the interview process look like?

The evaluation process consists of three to four interviews conducted through virtual meetings and/or onsite sessions with technical team members.

Where is the role located?

The position is located in China.

Ready to apply?

The application is on the official bjakcareer careers page.

Apply on company site