Latest AI JobsBrowse Jobs
LangChain logo

Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)

LangChainNew York, NYEngineering
Apply on company site
Salary
$180K- $240K
Job type
Full-time
Experience
Senior · 5+ yrs
Posted
8 Oct 2026
Status
Open · checked 8d ago

About this role

Based in New York, NY, the Senior Backend Software Engineer, AI Observability & Evals Platform position at LangChain involves building and maintaining backend services for the company's AI monitoring and evaluation platform. This role suits an experienced backend specialist with a strong background in high-throughput systems and database optimization who wants to shape production-scale AI infrastructure.

Role Overview

LangChain seeks a Senior Backend Software Engineer to join the LangSmith team in New York, NY. The professional in this role focuses on constructing backend systems that power observability and evaluation workflows for AI applications. Responsibilities include building core services, optimizing high-volume data performance, and collaborating cross-functionally with product managers and engineers.

Key Responsibilities

Design, develop, and maintain backend services and APIs supporting tracing, monitoring, and evaluation workflows within LangSmith.
Participate in architectural decisions to guarantee maintainability and high system performance.
Improve storage and query performance for large volumes of evaluation and observability data.
Maintain system reliability by implementing robust testing, monitoring, and alerting measures.
Investigate and resolve production issues, conduct root-cause analyses, and apply permanent solutions.
Author and update technical documentation, covering system designs and API references.
Partner alongside full-stack engineers, product managers, and designers to release new features.

Requirements

Minimum of 5 years of professional experience in backend engineering focused on complex products.
Competence in at least one backend framework or language, preferably Go or Python.
Solid comprehension of API design and the creation of dependable data services.
Background handling mission-critical or high-throughput systems.
Proven capability to tune backend services for reliability and speed.
Practical knowledge of database technologies like Postgres, Redis, and Clickhouse, alongside cloud environments such as AWS, GCP, and Azure.
Clear communication abilities for cross-functional collaboration.
Customer-focused mindset with a strong sense of ownership.

Skills and Tools

Python
Go
Postgres
Redis
Clickhouse
AWS
GCP
Azure
APIs

Salary and Benefits

Annual salary range: $180,000 to $240,000.
Includes base salary, variable compensation where applicable, equity, perks, and benefits.
Medical, dental, and vision insurance coverage.
Flexible vacation policy.
401(k) retirement plan.
Provided meals on in-office days within the United States.

About the Company

LangChain develops foundational infrastructure for intelligent agents, helping developers transition AI prototypes into reliable production deployments. The platform encompasses open-source frameworks like LangChain, LangGraph, and Deep Agents, alongside the LangSmith platform for observability, evaluation, and deployment. Backed by investors such as IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, the organization supports millions of open-source downloads and thousands of active enterprise customers.

How to Apply

Interested candidates should apply directly on the official company careers page.

Skills and tech stack

PythonGoPostgresRedisClickhouseAWSGCPAzureLangChain

Questions candidates ask

Where is this job located?

This role is located in New York, NY.

What is the salary range for this position?

The annual salary range is $180,000 to $240,000, supplemented by equity, benefits, and perks.

How many years of experience are required?

Candidates must have 5+ years of professional experience in backend engineering working on highly complex products.

What programming languages are preferred?

Proficiency in Python or Go is ideally expected for this role.

What benefits are included?

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, and meals on in-office days in the US.

Ready to apply?

The application is on the official LangChain careers page.

Apply on company site