Latest AI JobsBrowse Jobs
bjakcareer logo

Senior Technical Product Manager - AI Agents, Evals & Reliability

bjakcareerIndonesiaActAI Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior
Posted
28 Sept 2026
Status
Open · checked 7d ago

About this role

This Senior Technical Product Manager position suits a hands-on professional with strong computer science and machine learning foundations who wants to build proactive smart assistant applications in Indonesia. The role focuses on shaping AI reliability, agent behaviors, and evaluation frameworks for global users.

Role Overview

This is a deeply technical product management position based in Indonesia with bjakcareer. The selected candidate collaborates directly with engineering teams to design and evaluate proactive AI systems, handling multi-step reasoning and real-world task execution.

Key Responsibilities

Research and establish end-to-end AI system specifications covering capability, behavior, and user impact.
Translate data constraints, model capabilities, and evaluation findings into product and system choices.
Balance trade-offs involving cost, latency, quality, reliability, and user experience.
Collaborate directly with mobile, backend, and machine learning engineers on iteration and system architecture.
Create and develop evaluation frameworks utilizing human feedback, online experiments, and offline metrics.
Execute roadmaps through clear specifications, prioritization, and strong technical judgment.
Supervise end-to-end product quality, focusing on user trust, predictability, and correctness.

Requirements

Strong background in computer science principles, system design, data structures, and algorithms.
Solid understanding of machine learning foundations and production AI system behaviors.
Ability to read, review, and discuss technical design documentation.
Practical exposure to LLM-based systems and AI-powered products.
Experience handling model evaluation, feedback loops, and prompt or pipeline iteration.
Clear intuition regarding model drift, bias, limitations, and hallucinations.
Background owning complex, technical products end-to-end.
Demonstrated ability to collaborate with machine learning teams and senior engineers.

Nice to Have

Background as an engineer or technical product manager.
Experience shipping consumer products heavily reliant on artificial intelligence.
History of defining evaluation metrics for machine learning systems.
Understanding of AI user experience patterns and failure handling.
Background working in zero-to-one product environments.

Skills and Tools

Large Language Models (LLMs)
Machine Learning Systems
Mobile and Backend Technologies
Evaluation Frameworks
System Design

About the Company

The company builds proactive smart assistants intended to bring intelligence to everyday conversations, errands, organization, and workflows for a global user base.

How to Apply

Interested candidates should apply directly on the official company careers page.

Skills and tech stack

LLMMachine LearningMobileBackend

Questions candidates ask

Where is this job located?

The position is located in Indonesia.

What kind of experience is required for this role?

Candidates need a strong technical foundation in computer science and machine learning, hands-on experience with LLM-based systems, and a history of owning complex technical products end-to-end.

What will I be doing on a daily basis?

You will research and define AI system requirements, make trade-offs regarding cost and reliability, collaborate with engineers on system design, and evolve evaluation frameworks.

How many interview rounds are there?

The interview process consists of three to four interviews conducted via virtual meetings or onsite.

Ready to apply?

The application is on the official bjakcareer careers page.

Apply on company site