Latest AI JobsBrowse Jobs
B

AI Inference Engineer

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
3 Aug 2026
Status
Open · checked 7d ago

About this role

Role Overview

The AI Inference Engineer position at Baseten is a full-time role based in San Francisco, with remote flexibility available for qualified professionals. This position suits entrepreneurial software developers who want to partner directly with clients to build and deploy high-scale production AI applications.

Key Responsibilities

Build and maintain software systems and product features using general-purpose programming languages, prioritizing Python for machine learning initiatives.
Guide client success by architecting, implementing, and deploying end-to-end Baseten solutions ranging from initial problem framing to production monitoring.
Transform vague objectives into precise technical specifications and proofs of concept to rapidly deliver well-tested services.
Optimize machine learning operations and enhance technical stacks by collaborating across engineering and product teams.
Take full ownership of client projects, acting as an engineer, project manager, and technical consultant.

Requirements

Hold a Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or a related technical discipline.
Bring a minimum of 2 years of professional work experience within a fast-paced, high-growth corporate setting.
Demonstrate practical experience programming in a production environment, with a strong preference for Python.
Possess familiarity with artificial intelligence and machine learning pipelines, covering the entire lifecycle of model deployment.
Exhibit strong verbal and written communication skills tailored for complex technical subjects.

Skills and Tools

Python
Docker
Spark
AI and ML pipelines
Model server deployment

Salary and Benefits

Competitive annual salary ranging between $165,000 and $330,000 in USD.
Meaningful equity grants included in the compensation package.
Full 100% employer-paid coverage for medical, dental, and vision insurance for U.S. employees and their dependents.
Flexible paid time off policy featuring a company-wide winter break closure from Christmas Eve to New Year's Day.
Paid parental leave alongside a fertility and family-building stipend facilitated through Carrot.
U.S. company-facilitated 401(k) retirement plan.

About the Company

Baseten powers mission-critical inference infrastructure for dynamic artificial intelligence organizations like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. The company recently announced a $1.5 billion Series F funding round led by Altimeter Capital, Conviction Partners, and Spark Capital. Baseten unites applied research, flexible infrastructure, and developer tools to help frontier AI companies ship cutting-edge products.

How to Apply

Interested candidates should visit the official Baseten careers page to submit an application and begin the hiring process.

Skills and tech stack

PythonDockerSpark

Questions candidates ask

What is the location of the AI Inference Engineer role?

The role is based in San Francisco with remote work options available.

What is the salary range for this position?

The salary ranges from $165,000 to $330,000 USD per year.

How many years of experience are required?

Candidates must have at least 2 years of professional work experience in a fast-paced, high-growth environment.

What programming language is preferred for this role?

Python is strongly preferred due to its high relevance in machine learning projects.

What benefits are provided for U.S. employees?

U.S. employees receive 100% coverage for medical, dental, and vision insurance, a 401(k) plan, flexible PTO, paid parental leave, and a family-building stipend.

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site