Latest AI JobsBrowse Jobs
B

Software Engineer - Infrastructure

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
9 Mar 2025
Status
Open · checked 7d ago

About this role

Baseten is hiring a remote Software Engineer for its Infrastructure team based in San Francisco, offering a chance to build and maintain core components of a high-performance machine learning inference platform. This opportunity suits engineers passionate about scalable systems, distributed architecture, and the future of artificial intelligence product deployment.

Role Overview

As an Infrastructure Software Engineer at Baseten, the individual will build and maintain components of the machine learning inference platform that powers production artificial intelligence applications. The position contributes to core infrastructure, empowering developers to deploy, scale, and monitor machine learning models with high performance. Example initiatives include working on multi-cloud capacity management, inference on B200 graphics processing units, multi-node inference, and fractional H100 graphics processing units for efficient model serving.

Key Responsibilities

Develop infrastructure components for the machine learning inference platform using Python and Go.
Implement and maintain Kubernetes deployments for model serving.
Contribute to the inference orchestration layer for model deployments.
Build and enhance monitoring systems for model performance metrics.
Implement efficient resource management solutions for machine learning workloads.
Support infrastructure automation to improve machine learning deployment workflows.
Collaborate closely with team members to implement technical solutions.
Balance performance optimization with system reliability.
Participate in technical discussions around infrastructure improvements.
Learn and apply infrastructure best practices.

Requirements

Bachelor's degree or higher in Computer Science or a related field.
Proficient coding abilities in one or more popular programming or scripting languages, with Go proficiency considered a plus.
Working knowledge of Kubernetes and containerization.
Basic understanding of machine learning concepts and model serving.
Familiarity with distributed systems concepts.
Experience with basic monitoring and logging tools.
Interest in machine learning and artificial intelligence infrastructure alongside a willingness to learn.
Strong collaboration and communication skills.

Skills and Tools

Python
Go
Kubernetes
Spark
Containerization
Distributed Systems
Monitoring and Logging Tools

Salary and Benefits

Competitive compensation package, including meaningful equity.
Salary range from $165,000 to $330,000 per year in USD.
100 percent coverage of medical, dental, and vision insurance for employees and their dependents (U.S. only).
Flexible Paid Time Off policy, which includes a company-wide Winter Break with offices closed from Christmas Eve to New Year's Day.
Paid parental leave.
Fertility and family-building stipend through Carrot.
Company-facilitated 401(k) (U.S. only).
Exposure to a variety of machine learning startups, offering learning and networking opportunities.

About the Company

Baseten powers mission-critical inference for dynamic artificial intelligence companies such as Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied artificial intelligence research, flexible infrastructure, and seamless developer tooling, the company enables organizations operating at the frontier of artificial intelligence to bring cutting-edge models into production. The organization is growing quickly and recently raised a $1.5 billion Series F funding round led by Altimeter Capital, Conviction Partners, and Spark Capital. Baseten is an equal opportunity employer committed to fostering a diverse and inclusive workplace.

How to Apply

Interested candidates should visit the official Baseten careers page to submit an application and join the team shaping the future of artificial intelligence.

Skills and tech stack

Questions candidates ask

What is the salary range for the Software Engineer - Infrastructure role?

The salary range for this position is between $165,000 and $330,000 per year in USD.

Is this position remote?

Yes, this role is listed as remote with a company location in San Francisco.

What technical skills are required?

Requirements include proficiency in popular programming or scripting languages, working knowledge of Kubernetes and containerization, a basic understanding of machine learning concepts and model serving, familiarity with distributed systems, and experience with basic monitoring and logging tools.

What benefits are provided for U.S. employees?

U.S. employees receive 100 percent coverage of medical, dental, and vision insurance for themselves and dependents, a company-facilitated 401(k), flexible PTO, paid parental leave, a fertility and family-building stipend through Carrot, and competitive compensation with meaningful equity.

How do I apply for this job?

Candidates can apply directly through the official Baseten careers page.

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site