Latest AI JobsBrowse Jobs
Vast.ai logo

Senior Infrastructure Engineer

Vast.aiLos AngelesEngineering
Apply on company site
Salary
$200K - $330K USD
Job type
Full-time
Posted
3 Jul 2026
Status
Open · checked 7d ago

About this role

Vast.ai is hiring a full-time Senior Infrastructure Engineer to design and scale core systems for its global GPU marketplace based on-site in Los Angeles, California. This role suits an experienced engineer with a strong background in distributed systems and cloud infrastructure who wants to help democratize decentralized AI computing.

Role Overview

As a Senior Infrastructure Engineer, the chosen candidate will help design and scale the underlying compute systems that power Vast.ai's global GPU marketplace. Working directly with the founders and core engineering team, the employee will extend compute infrastructure spanning billing, scheduling, GPU provisioning, orchestration, and marketplace dynamics. The position is full-time and requires working on-site at the company office in Los Angeles.

Key Responsibilities

Improve the backend systems that power Vast.ai’s compute marketplace.
Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs.
Develop scalable infrastructure for workload scheduling and resource management.
Optimize pricing and marketplace logic for efficiency and transparency.
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance.
Collaborate with product and infrastructure teams to shape the future of decentralized compute.

Requirements

Experience building high-throughput backend systems or compute clouds involving distributed systems.
Familiarity with Docker or custom scheduling frameworks for compute orchestration.
Understanding of GPU infrastructure, including provisioning, driver management, and workload scheduling.
Experience implementing or integrating usage-based billing and account credit systems.
Knowledge of marketplace dynamics such as dynamic pricing, spot instances, or supply-demand balancing mechanisms.
Experience designing secure, multi-tenant systems in cloud environments.
Strong programming skills in Python and C++ to write performant, maintainable, and well-architected code.
Comfort designing database schemas and queries for large-scale data systems, with a preference for PostgreSQL.

Nice to Have

Experience with GPU security, virtualization, or zero-trust compute isolation.
Prior startup experience or end-to-end product ownership.

Skills and Tools

Python
C++
PostgreSQL
Linux
Docker
KVM
Redis
Terraform
AWS
REST/gRPC APIs
LLM

Salary and Benefits

Annual salary range of $200,000 to $330,000 USD.
Comprehensive health, dental, vision, and life insurance.
401(k) with company match.
Meaningful early-stage equity.
Onsite meals, snacks, and close collaboration with founders and technical leaders.
Ambitious, fast-paced startup culture where initiative is rewarded.

About the Company

Vast.ai operates a cloud network that powers artificial intelligence projects and businesses globally. The organization aims to democratize and decentralize AI computing to reshape the future for humanity. Featuring a flat structure and a growing, highly motivated team, Vast.ai rewards leadership by shipping excellence and seeks professionals with strong intrinsic drive and a passion for advancing state-of-the-art technology.

How to Apply

Interested candidates should visit the official Vast.ai careers page to submit their application for review by the technical team.

Skills and tech stack

Questions candidates ask

What is the salary range for the Senior Infrastructure Engineer position?

The annual salary ranges from $200,000 to $330,000 USD.

Is this a remote position?

No, this is a full-time, on-site role located at the company office in Los Angeles, California (or San Francisco).

What programming languages are required?

Candidates must have strong programming skills in Python and C++.

What benefits are included with this role?

Benefits include comprehensive health, dental, vision, and life insurance, a 401(k) with company match, meaningful early-stage equity, and onsite meals and snacks.

What does the interview process look like?

The process includes an initial virtual screening, a quick dive into work history, a systems and architectures discussion, an LLM-assisted coding assessment, and an on-site meet and greet with a coding assessment.

Ready to apply?

The application is on the official Vast.ai careers page.

Apply on company site