Latest AI JobsBrowse Jobs
Vast.ai logo

GPU Systems Engineer – HPC / Parallel Computing

Vast.aiSan FranciscoEngineering
Apply on company site
Salary
$200K - $330K USD
Job type
Full-time
Posted
3 Jul 2026
Status
Open · checked 7d ago

About this role

Role Overview

Vast.ai is seeking a full-time GPU Systems Engineer with a background in high-performance computing to help scale AI inference and optimize GPU performance. This position is located on-site at the company office in San Francisco, California.

Key Responsibilities

Design and optimize GPU kernels and tensor libraries.
Translate high-performance computing techniques into scalable solutions for artificial intelligence inference.
Evaluate emerging hardware architectures and resource management approaches.
Collaborate directly with technical leadership to improve the efficiency of GPU infrastructure.

Requirements

Advanced proficiency in C++, with C++17 or C++20 preferred.
Expertise working with at least one parallel framework such as CUDA, HIP, SYCL, OpenCL, OpenACC, or a similar framework.
Strong professional background in systems optimization and high-performance computing performance tooling.

Nice to Have

Familiarity with distributed training or inference frameworks.

Skills and Tools

Python
C++
CUDA and GPGPU
Linux
Large Language Models (LLM)

Salary and Benefits

Annual salary range of $200,000 to $330,000 USD.
Comprehensive medical, dental, vision, and life insurance coverage.
401(k) retirement plan that includes a company match.
Meaningful early-stage equity opportunities.
On-site meals, snacks, and close collaboration with the founders and technical leaders in a fast-paced startup environment.

About the Company

Vast.ai provides cloud infrastructure that powers artificial intelligence projects and businesses globally.
The organization focuses on democratizing and decentralizing AI computing to reshape technology for humanity.
The team maintains a flat structure, an ambitious technical plan, and values intrinsic drive and shipping excellence.

How to Apply

Candidates should apply directly on the official company careers page.

Skills and tech stack

Questions candidates ask

Where is this job located?

This full-time position is on-site at the company office in San Francisco, California.

What is the salary range for this role?

The annual salary ranges from $200,000 to $330,000 USD.

What technical skills are required?

Requirements include advanced C++ proficiency (C++17/20 preferred), expertise in a parallel framework like CUDA, HIP, SYCL, OpenCL, or OpenACC, and a strong background in systems optimization and HPC performance tooling.

What benefits are included?

Benefits include comprehensive health, dental, vision, and life insurance, a 401(k) with company match, meaningful early-stage equity, and on-site meals and snacks.

What does the interview process look like?

The process includes a 15-minute virtual screening, a 45-minute background dive, a 45-minute systems and architectures chat, a 1-hour LLM-assisted coding assessment, and a final 2-hour on-site meet and greet with a coding assessment.

Ready to apply?

The application is on the official Vast.ai careers page.

Apply on company site