Latest AI JobsBrowse Jobs
monday.com logo

Data Scientist– AI Infra & Evaluation Foundations

monday.comTel AvivR&D
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior · 3+ yrs
Posted
24 Sept 2026
Status
Open · checked 9d ago

About this role

This Data Scientist role suits a professional with a background in production-grade AI systems who wants to own evaluation methodologies at the Tel Aviv headquarters of monday.com. The position focuses on building centralized evaluation frameworks and infrastructure to ensure reliable, high-quality agentic features across the organization.

Role Overview

The Data Scientist for AI Infra & Evaluation Foundations at monday.com operates out of the Tel Aviv office. The professional in this position connects AI research with production infrastructure by defining the metrics, judges, and error analysis workflows that product and engineering teams rely on to deploy intelligent agents securely and effectively.

Key Responsibilities

Design and establish evaluation methodologies, pipelines, and metrics that serve as the organizational source of truth.
Standardize the AI agent lifecycle by embedding continuous evaluation into daily engineering workflows, regression testing, and post-deployment monitoring.
Partner with various feature teams to translate domain expectations into concrete datasets and test suites.
Prototype and build end-to-end evaluation pipelines that shape production greenlight standards.
Anticipate future failure modes by developing next-generation evaluation strategies for evolving agent architectures.

Requirements

Three or more years of non-academic data science experience working with complex production AI systems.
Familiarity with agentic frameworks such as LangChain, LangGraph, and state-of-the-art SDKs.
Practical knowledge of agent operations including models, context, capabilities, harnesses, and evaluation methodologies.
Production-grade coding skills with a history of building and shipping end-to-end data or evaluation pipelines.
Trace-first diagnostic approach involving raw execution log analysis and qualitative error taxonomy creation.
Strong communication skills and product intuition to translate evaluation data into actionable guidelines.

Nice to Have

Direct experience designing evaluation strategies for production agentic systems.
Background in centralized platform or infrastructure teams supporting multiple verticals.
Experience with modern microservices, GitHub workflows, and automated CI/CD pipelines.
Familiarity with observability and evaluation stacks like LangSmith, Langfuse, or internal platforms.
Knowledge of TypeScript or modern platform architectures.
Master of Science degree in Data Science, Computer Science, Statistics, Engineering, or a related quantitative field.

Skills and Tools

LangChain
LangGraph
LangSmith
Langfuse
TypeScript
CI/CD Pipelines
GitHub

About the Company

monday.com provides an AI work platform utilized by over 250,000 customers across departments to connect people, workflows, and AI agents. The organization operates with an ownership-driven culture based in Tel Aviv.

How to Apply

Interested candidates should apply directly on the official monday.com careers page.

Skills and tech stack

LangChainLangGraphLangSmithLangfuseTypeScript

Questions candidates ask

Where is this job located?

This position is based at the monday.com headquarters in Tel Aviv.

How many years of experience are required?

The role requires 3 or more years of experience as a data scientist in non-academic settings working with complex production-running AI systems.

What tools and frameworks are relevant to the position?

Relevant tools and frameworks include LangChain, LangGraph, LangSmith, Langfuse, and TypeScript.

What is the primary focus of the AI Infra team?

The team builds foundations, tools, and platforms—including the AI Gateway and centralized Evals framework—to ensure all deployed AI features are secure, resilient, cost-effective, and trustworthy.

Is an advanced degree required?

A Master’s degree in Computer Science, Data Science, Statistics, Engineering, or a related quantitative field is listed as a preferred qualification rather than a strict requirement.

Ready to apply?

The application is on the official monday.com careers page.

Apply on company site