Latest AI JobsBrowse Jobs
LangChain logo

Research Engineer, LangSmith Engine

LangChainNew York, NYEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
14 Aug 2026
Status
Open · checked 7d ago

About this role

LangChain seeks a dedicated Research Engineer to join the LangSmith Engine team in New York, NY for a full-time position requiring over four years of experience. This opportunity suits an experienced ML professional eager to enhance autonomous agent capabilities and drive real-world production impacts.

Role Overview

The LangSmith Engine team builds proactive agent engineers designed to analyze production traces, detect failures, and recommend fixes. As a Research Engineer, the chosen candidate will study real agent failures, create meaningful benchmarks, run experiments, and convert successful concepts into reliable production systems. This role demands balancing maximum benchmark performance with practical system-level tradeoffs such as latency, cost, and reliability.

Key Responsibilities

Build and maintain evaluations and benchmarks to measure Engine agent quality and efficiency on real-world tasks.
Design and execute experiments focusing on agent performance across prompting, model selection, context, tools, and orchestration.
Research and implement fine-tuning and post-training methods to improve agent capabilities and reduce costs.
Transition successful experimental ideas into live production improvements by collaborating with engineers to measure impact and avoid regressions.
Shape the machine learning roadmap and guide the technical direction for agent enhancements while providing technical leadership to peers.

Requirements

Minimum of four years of professional experience in machine learning, AI research, or a closely related field.
Holds a Master’s degree or a Ph.D. in a relevant scientific discipline.
Practical, hands-on experience working with LLMs and AI agents, including analyzing model behavior.
Demonstrated ability to design robust experiments, benchmarks, and evaluations for AI systems.
Strong software engineering foundation with a history of moving research prototypes into production.
High agency, strong research judgment, and the ability to navigate ambiguity while communicating findings clearly.

Nice to Have

A Ph.D. in Computer Science, Machine Learning, or Physics.
Practical experience utilizing automated graders, synthetic data generation, human evaluation, or LLM-as-a-judge.
Familiarity with reinforcement learning, preference optimization, SFT, RLAIF, RLHF, or other post-training methodologies.
Background in optimizing LLM agents for production efficiency, latency, or cost.
Experience dealing with model serving, inference optimization, distributed systems, or GPU infrastructure.

Skills and Tools

Large Language Models (LLMs)
LangChain
Benchmarking and evaluation frameworks
Fine-tuning and post-training techniques
Software engineering and production system design

Salary and Benefits

Competitive base salary and meaningful equity
Comprehensive health coverage including medical, dental, and vision insurance
Flexible vacation policy
401(k) retirement plan and life insurance
Additional perks such as meals on in-office days in the United States

About the Company

LangChain provides the foundation for agent engineering in the real world, helping developers transition from prototypes to production-ready AI agents. Backed by prominent investors with $125M raised at Series B, the company offers widely adopted open-source tools alongside comprehensive agent platforms like LangSmith and the LangSmith Engine.

How to Apply

Interested candidates should visit the official LangChain careers page to submit an application for this role.

Skills and tech stack

LLMLangChain

Questions candidates ask

What is the location of the Research Engineer role?

The position is based in New York, NY.

How much experience is required for this position?

Candidates must have four or more years of experience in ML, AI research, or a related field, along with a Master's or Ph.D.

What does the LangSmith Engine team build?

The team builds proactive agent engineers that analyze production traces, identify failures, recommend fixes, and continuously improve other AI agents.

What specific skills and tools are highlighted for the job?

Key skills include working with Large Language Models (LLMs) and LangChain, designing benchmarks, fine-tuning, and software engineering for production.

What benefits are provided to US team members?

Benefits include medical, dental, and vision coverage, a 401(k) plan, flexible vacation, life insurance, and meals on in-office days.

Ready to apply?

The application is on the official LangChain careers page.

Apply on company site