Latest AI JobsBrowse Jobs
B

Site Reliability Engineer

BasetenSan FranciscoEPD
Apply on company site
Salary
$165K - $330K USD
Job type
Full-time
Work mode
Remote
Posted
11 May 2026
Status
Open · checked 7d ago

About this role

Role Overview

Baseten is seeking a Site Reliability Engineer to join their team in San Francisco, with remote work options available. This role suits professionals who want to define day-to-day operations and build robust observability tooling for artificial intelligence infrastructure.

Key Responsibilities

Own the reliability of multi-cloud Kubernetes infrastructure through incident response, post-mortems, and remediation tracking.
Build and maintain observability infrastructure, including metrics, logging, dashboards, and alerting as code.
Create and improve runbooks for recurring failure patterns to ensure safe execution.
Identify high-frequency failure patterns and convert them into automated mitigations or self-healing automations.
Diagnose and resolve runtime issues involving latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.
Define and instrument service level objectives and indicators across customer workloads and internal services.
Navigate ambiguity and make principled tradeoffs while avoiding unnecessary system complexity.

Requirements

Extensive hands-on background working with Kubernetes.
Demonstrated experience building and maintaining scalable infrastructure.
Strong foundation in observability tooling, including metrics, logging, dashboards, and alerting pipelines.
Experience with infrastructure-as-code and GitOps workflows.
Background writing and improving runbooks, leading incident response, and conducting post-mortem analysis.
Comfortable working at the intersection of engineering and operations.

Nice to Have

Multi-cloud experience across EKS, GKE, or similar platforms.
Observability-as-code experience.
Familiarity with incident management platforms such as incident.io.
Prior machine learning experience is not required, but curiosity about deploying and serving ML models at scale is helpful.

Skills and Tools

Kubernetes
Spark
Terraform
Helm
VictoriaMetrics
Prometheus
Loki
Grafana
GitOps (Flux CD, ArgoCD)

Salary and Benefits

Annual salary range of $165,000 to $330,000 USD
Competitive compensation package featuring meaningful equity
100% coverage of medical, dental, and vision insurance for employees and dependents (U.S. only)
Flexible paid time off policy, including a company-wide Winter Break from Christmas Eve to New Year's Day
Paid parental leave
Fertility and family-building stipend through Carrot
Company-facilitated 401(k) (U.S. only)
Exposure to various machine learning startups offering learning and networking opportunities

About the Company

Baseten powers mission-critical inference for dynamic artificial intelligence companies such as Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and developer tooling, the company helps organizations bring cutting-edge models into production. The organization recently raised a $1.5 billion Series F funding round led by Altimeter Capital, Conviction Partners, and Spark Capital.

How to Apply

To apply for this position, please visit the official Baseten careers page to submit your application and embark on a rewarding journey in shaping the future of artificial intelligence infrastructure.

Skills and tech stack

KubernetesSparkTerraform

Questions candidates ask

What is the salary range for the Site Reliability Engineer role?

The annual salary range is between $165,000 and $330,000 USD.

Is remote work available for this position?

Yes, this position supports remote work, and the company is based in San Francisco.

Do I need prior machine learning experience to apply?

No prior machine learning experience is required, though curiosity about deploying and serving ML models at scale is encouraged.

What benefits are provided for U.S. employees?

U.S. employees receive 100% coverage of medical, dental, and vision insurance for themselves and dependents, a company-facilitated 401(k), flexible PTO, paid parental leave, a fertility and family-building stipend, and equity.

What technologies and tools will I work with?

You will work with tools and technologies such as Kubernetes, Terraform, Spark, Prometheus, VictoriaMetrics, Grafana, Loki, Helm, and GitOps workflows.

Ready to apply?

The application is on the official Baseten careers page.

Apply on company site