Latest AI JobsBrowse Jobs
H

Senior AI Engineer - Core

hilbertsSan FranciscoAI/ML
Apply on company site
Salary
$180K – $215K
Job type
Full-time
Work mode
Remote
Experience
Senior · 6+ yrs
Posted
14 Sept 2026
Status
Open · checked 7d ago

About this role

In San Francisco, hilberts is hiring a Senior AI Engineer - Core to build production-grade AI systems and agent architectures end-to-end. This role suits an experienced software professional with a background in scaling production software and LLM workflows in a fast-paced environment.

Role Overview

The Senior AI Engineer - Core position involves building and maintaining production-grade AI systems, from initial prototyping to deployment and pipeline management. The engineer will design agent architectures, construct evaluation systems, and balance latency, accuracy, and cost tradeoffs. Responsibilities span across retrieval, orchestration, and execution within the core AI stack.

Key Responsibilities

Design and manage the evaluation layer for agents, including metrics, golden datasets, regression gates, and human-in-the-loop reviews.
Architect and implement agent workflows using frameworks like LangGraph or LangChain, managing state memory, routing, tool registries, and recovery paths.
Operate systems in production by handling tracing, monitoring, latency, cost-per-task budgeting, and participating in on-call rotations.
Diagnose and fix production issues such as hallucinations, tool misuse, retrieval misses, and silent degradation.
Set technical standards for agent development by reviewing designs and defining patterns for the team.
Collaborate closely with the founding team and cross-functional partners while making pragmatic engineering decisions under ambiguity.

Requirements

6+ years of production software engineering experience encompassing APIs, services, and data infrastructure.
2+ years of experience building LLM or agent systems deployed to production for real users.
Practical experience with agent and orchestration frameworks such as LangChain or LangGraph.
Strong verbal and written communication skills for explaining technical decisions to diverse audiences.
High sense of ownership, adaptability in ambiguous environments, and startup speed execution.

Nice to Have

Deep expertise in retrieval-augmented generation including hybrid retrieval, graph-based retrieval, chunking, and ranking strategies.
Familiarity with LLM observability platforms like Langfuse or OpenTelemetry alongside cost and latency optimization.
Experience with MCP, tool-calling frameworks, structured output, and constrained decoding.
Background working in early-stage startups or high-growth settings.

Skills and Tools

LangChain
LangGraph
Langfuse
OpenTelemetry
APIs
Data Infrastructure
Retrieval-Augmented Generation
MCP

Salary and Benefits

Salary range of $180K to $215K with equity and bonus offerings.
100% employer-covered health, dental, and vision insurance premiums.
401k retirement plan via Human Interest with immediate vesting on employer match.
Generous paid time off.
Commuter support for San Francisco-based employees.
Daily lunch vouchers provided via DoorDash in the San Francisco office.

About the Company

hilberts builds a fully agentic demand intelligence platform that orchestrates multi-step inference over enterprise data to streamline decision cycles. The company serves enterprise customers including Fortune 500 organizations, FreshDirect, Blank Street, and Levain Bakery.

How to Apply

To apply for this position, please visit the official company careers page.

Skills and tech stack

LangChainLangGraphLangfuseOpenTelemetryRAGMCPLLMLLMs

Questions candidates ask

Where is the position located?

The role is based in San Francisco, with occasional travel required for team meets, offsites, or customer engagements.

What are the experience requirements for this role?

Candidates must have 6+ years of production software engineering experience and at least 2+ years building LLM or agent systems that have shipped to production for real users.

What is the salary and compensation package?

The position offers a salary between $180K and $215K, alongside equity and bonus offerings.

What benefits are provided?

Benefits include 100% coverage for health, dental, and vision premiums, a 401k plan with an immediate vesting employer match, generous paid time off, commuter support, and DoorDash lunch vouchers for the SF office.

What frameworks and tools are relevant to the work?

Key tools and frameworks mentioned include LangChain, LangGraph, Langfuse, OpenTelemetry, RAG strategies, and tool-calling frameworks.

Ready to apply?

The application is on the official hilberts careers page.

Apply on company site