Latest AI JobsBrowse Jobs
M

Data Infra - Signals and Evaluations (IC)

matter-intelligenceSan FranciscoSoftware Engineering
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
15 Sept 2026
Status
Open · checked 7d ago

About this role

Based in San Francisco, this full-time Data Infra - Signals and Evaluations role suits an engineer with a strong foundation in machine learning evaluation, dataset engineering, and simulation environments who wants to build scientifically defensible AI systems. Matter Intelligence is hiring an individual contributor to manage data curation, simulation, and model evaluation.

Role Overview

The Data Infra - Signals and Evaluations position at Matter Intelligence involves creating the datasets, benchmarks, environments, and evidence needed for Superintelligent Vision models. Reporting to Ignacio Cases Martin, this onsite role in San Francisco focuses on ensuring artificial intelligence systems and models are scientifically defensible through rigorous testing, dataset curation, and evaluation workflows.

Key Responsibilities

Build versioned dataset workflows for collection, curation, filtering, labeling, ground truth, synthetic data, hard-negative mining, contamination controls, and train-evaluation isolation
Design benchmark suites across perception, multimodal reasoning, physics-informed prediction, retrieval, planning, tool use, world modeling, and customer tasks
Create simulation and environment infrastructure for reinforcement learning, imitation learning, offline learning, model-based learning, and agent training
Define repeatable evaluation methods across accuracy, calibration, generalization, robustness, safety, latency, cost, and operational outcomes
Turn field, mission, and customer failures into versioned datasets, benchmark cases, adversarial tests, and environment scenarios
Build automated promotion gates and communicate clearly what has been tested, what remains unproven, and what evidence supports release

Requirements

Experience in ML evaluation, dataset engineering, reinforcement-learning environments, simulation, scientific ML, test infrastructure, or production AI systems
Strong foundations in statistics, experimental design, benchmark validity, distribution shift, calibration, reward design, and evidence-based acceptance
Fluency in Python and modern machine-learning frameworks, with the software engineering discipline to build tested modules, data contracts, or services
Experience converting qualitative model or agent failures into reproducible datasets, tests, or environment scenarios
Ability to reason across the complete data path and identify how acquisition, transformation, indexing, orchestration, and presentation affect correctness

Nice to Have

Experience with dataset curation, benchmark platforms, deep reinforcement learning, world models, synthetic data, multimodal evaluation, or scientific validation
Experience with PyTorch or JAX, distributed evaluation, experiment tracking, environment frameworks, or model and agent observability
Experience with uncertainty quantification, calibration, out-of-distribution detection, conformal methods, or selective prediction
Experience evaluating models deployed to aircraft, satellites, robotics, industrial systems, or other constrained environments

Skills and Tools

Python
PyTorch
JAX
Machine learning frameworks
Simulation and environment frameworks

Salary and Benefits

Competitive compensation based on experience
Early-stage equity package
100% employer-paid health, dental, and vision coverage
Opportunity to work on novel sensing, data, and AI systems with real-world deployment paths

About the Company

Matter Intelligence builds vision AI by pairing a sensor that sees molecular chemistry, temperature, and 3D shape with a Large World Model designed as an intelligence engine for the physical world. The team has delivered technologies to Mars for NASA/JPL, designed advanced sensors for U.S. Defense, and built frontier artificial intelligence systems, currently focusing on the next generation of space- and airborne-based sensing systems.

How to Apply

Candidates should apply on the official company careers page.

Skills and tech stack

PythonPyTorchJAXReinforcement LearningMachine Learning

Questions candidates ask

Where is the Data Infra - Signals and Evaluations position located?

This role is based in San Francisco, California, and requires onsite work.

Who does this role report to?

This individual contributor role reports to Ignacio Cases Martin.

What are the ITAR compliance requirements for applicants?

Applicants must be a U.S. citizen or national, a lawful permanent resident green card holder, or eligible to obtain required authorizations from the U.S. Department of State.

What benefits are included in the compensation package?

Benefits include competitive compensation, an early-stage equity package, and 100% employer-paid health, dental, and vision coverage.

What programming language fluency is required?

Candidates must have fluency in Python and modern machine-learning frameworks.

Ready to apply?

The application is on the official matter-intelligence careers page.

Apply on company site