Senior Staff Applied AI Engineer

OpenLoopUnited States - RemoteR&D

Apply on company site

Opens the official OpenLoop careers page

Salary

Not listed

Job type

Full-time

Work mode

Remote

Posted

30 Sept 2026

Status

Open · checked 7d ago

About this role

OpenLoop is hiring a remote Sr. Staff Applied AI Engineer to serve as the foundational technical leader for AI initiatives within the research and development department across the United States. This hands-on position suits an experienced software architect eager to shape core AI platforms and guide technical strategies in virtual care delivery.

Role Overview

As the primary technical authority for artificial intelligence, this position anchors the AI Platform pod at OpenLoop. Responsibilities include laying down the infrastructural groundwork for how autonomous agents run, maintaining system security, and setting long-range technological visions until an AI Principal Engineer arrives. The role requires active coding, rigorous design reviews, and close collaboration with the AI Engineering Manager to balance technical quality with team delivery.

Key Responsibilities

Design and guide agent runtimes and orchestration frameworks, determining how agents manage context, execute tools, and handle task handoffs.

Construct comprehensive evaluation systems, regression tests, and AI-graded metrics to verify system reliability.

Manage model routing across various providers, plan for version upgrades, and handle contingency strategies for outages.

Oversee cost tracking and observability, tracing agent behavior and managing API expenditures.

Implement retrieval-augmented generation systems to process messy company data and ensure factual responses.

Partner with operations and business stakeholders to translate human workflows into automated agent processes.

Maintain strict security and privacy standards to protect sensitive patient data in every built system.

Make strategic infrastructure decisions utilizing GCP in coordination with the Data Platform team.

Mentor upcoming engineers and translate complex technical trade-offs into plain language for clinical and product partners.

Requirements

Twelve or more years of professional software engineering background with proven technical leadership scope.

Minimum of two years hands-on experience building and operating Large Language Model systems in production environments.

Deep specialization in agent runtimes or evaluation methodologies, alongside working knowledge of the broader AI stack.

Demonstrated capability in measuring AI quality quantitatively using empirical data and evaluation practices.

Prior history establishing technical direction for small engineering teams from scratch.

Nice to Have

Background working within healthcare or other heavily regulated industries involving PHI and HIPAA compliance.

Familiarity with Google Cloud Platform environments.

Experience designing internal platforms intended for consumption by separate engineering teams.

Exposure to traditional machine learning concepts alongside modern LLM development.

History scaling engineering pods into multi-team structures.

Skills and Tools

Large Language Models (LLMs)

Google Cloud Platform (GCP)

Agent Runtime and Orchestration

AI Evaluation Systems

Retrieval and Grounding Frameworks

Salary and Benefits

Competitive compensation package

Comprehensive medical, dental, and vision insurance plans

Flexible Spending Accounts and Health Savings Accounts

Generous paid time off paired with flexible remote work arrangements

401(k) retirement plan featuring a company match

Additional coverage including life insurance and pet insurance

About the Company

OpenLoop was co-founded by CEO Dr. Jon Lensing and COO Christian Williams with the mission to bring care anywhere through streamlined telehealth support solutions across all 50 states. The organization maintains a flat structural hierarchy that emphasizes core values of autonomy, competence, and belonging, encouraging every team member to share ideas and drive meaningful impact.

How to Apply

Interested candidates should submit their application directly through the official OpenLoop careers page.

Skills and tech stack

LLM RAG GCP Prompt Engineering

Questions candidates ask

Is this position fully remote?

Yes, this role is listed as United States - Remote.

What level of experience is required for this role?

Candidates must have 12 or more years of software engineering experience, including technical leadership scope, plus at least 2 years of hands-on experience building and running production LLM systems.

What cloud platform does OpenLoop use?

OpenLoop runs its cloud and data infrastructure on Google Cloud Platform (GCP).

What benefits are included with employment?

OpenLoop offers competitive compensation, medical, dental, and vision coverage, flexible spending and health savings accounts, generous PTO, hybrid and remote flexibility, a 401(k) with company match, life insurance, and pet insurance.

Who does the Sr. Staff Applied AI Engineer partner with directly?

This engineer partners closely with the AI Engineering Manager, who oversees people and delivery while the engineer owns architecture and technical quality.

Ready to apply?

The application is on the official OpenLoop careers page.

Apply on company site