Latest AI JobsBrowse Jobs
Vast.ai logo

AI, HPC & GPU Infrastructure Support Engineer

Vast.aiLos AngelesOperations
Apply on company site
Salary
$90K - $150K USD
Job type
Full-time
Posted
30 Jul 2026
Status
Open · checked 7d ago

About this role

The AI, HPC & GPU Infrastructure Support Engineer role at Vast.ai in Los Angeles is a full-time position focused on managing and troubleshooting advanced computing environments for AI projects. This role suits professionals with strong Linux and NVIDIA GPU expertise who enjoy solving complex technical issues and supporting distributed systems.

Role Overview

This position centers on troubleshooting complex Linux and GPU infrastructure issues across NVIDIA drivers, CUDA, GPU workloads, Ubuntu, Docker, KVM virtual machines, networking, hardware, BIOS, and firmware. The person in this role will investigate failures, reproduce problems, identify root causes, and propose practical solutions across the full infrastructure stack. Serving as the primary engineering resource for escalated tickets, this engineer will handle complex issues end-to-end, coordinate with various teams, and communicate findings clearly to clients, suppliers, and internal staff. The work schedule offers options for fully on-site Monday through Friday or a hybrid setup working four days on-site and one day from home from Sunday through Thursday.

Key Responsibilities

Diagnose and resolve issues across NVIDIA CUDA and GPU drivers, Docker, and KVM virtualization environments.
Investigate GPU utilization, container resource constraints, thermal throttling, driver conflicts, and disk I/O bottlenecks.
Assist clients and infrastructure suppliers working with TensorFlow, PyTorch, and other GPU-accelerated workloads.
Troubleshoot network-layer issues, including VLAN, DNS, DHCP, VPN, NAT, firewall rules, and connectivity failures on host machines.
Handle escalated support tickets involving GPU workload failures, container issues, networking problems, account infrastructure, and host-side configuration.
Provide managed support for supplier onboarding and ongoing machine management, including installation, configuration, and post-setup troubleshooting.
Advise suppliers on hardware setup, driver configuration, BIOS and firmware settings, and network configuration for optimal performance.
Provide coverage for L1 support overflow during peak periods or incidents.
Write and maintain internal runbooks, escalation guides, and knowledge base articles to reduce repeat escalations.
Build diagnostic and automation tooling in Python and Bash to reduce manual triage overhead.
Collaborate with engineering and support teams to flag and document systemic or recurring platform issues.

Requirements

Strong Linux systems operations experience with Ubuntu, RHEL/CentOS, or Debian, including networking, storage, services, and permissions.
Proficiency with Docker, including container debugging, Docker Compose, image management, cgroup limits, and Docker storage and filesystem troubleshooting.
Experience with virtualization platforms such as Proxmox VE, VMware, or similar hypervisors, including VM provisioning and troubleshooting.
Strong networking fundamentals, including VLANs, DNS, DHCP, NAT, VPNs, firewall rules, and L2/L3 troubleshooting.
Hands-on experience with NVIDIA GPU drivers, CUDA, and GPU workload troubleshooting.
Python and Bash scripting skills for automation and diagnostic tooling.
Strong written English communication that is clear, professional, and technically precise.
Experience providing technical support in a customer-facing or internal help desk environment.
Ability to prioritize across a concurrent queue of escalated tickets, triaging by severity and customer impact.

Nice to Have

Familiarity with AI/ML frameworks like TensorFlow and PyTorch, and running GPU-accelerated containers.
Monitoring and observability experience using Prometheus and Grafana.
Relevant certifications such as RHCSA or CompTIA Linux+.
Prior knowledge of the Vast.ai platform as a client or infrastructure supplier.

Skills and Tools

Linux systems and Ubuntu command line
NVIDIA drivers, CUDA, and GPU workloads
Docker and container management
KVM and virtualization platforms
Networking protocols and firewall configuration
Python and Bash scripting

Salary and Benefits

Annual salary range of $90,000 to $150,000 in USD
Comprehensive health, dental, vision, and life insurance
401(k) with company match
Meaningful early-stage equity
Onsite meals, snacks, and close collaboration with founders and tech leaders

About the Company

Powered by Vast.ai, the company cloud supports AI projects and businesses across the globe with a mission to organize, optimize, and orient the world's computation. The organization values elegance, ownership, integrity, and continuous learning, offering team members the opportunity to work with state-of-the-art AI systems alongside a globally distributed team.

How to Apply

Apply directly on the official Vast.ai careers page to submit your application and begin the interview process.

Skills and tech stack

Questions candidates ask

What is the salary range for this position?

The annual salary range is $90,000 to $150,000 USD, supplemented by equity and benefits.

Where is the job located?

The position is based in the Westwood, Los Angeles office with options for a fully on-site schedule or a hybrid schedule working four days on-site and one day from home.

What are the core technical requirements?

Candidates must have strong Linux systems operations experience, Docker proficiency, virtualization platform experience, networking fundamentals, hands-on NVIDIA GPU and CUDA troubleshooting skills, and Python and Bash scripting abilities.

What benefits are included?

Benefits include comprehensive health, dental, vision, and life insurance, a 401(k) with company match, early-stage equity, and onsite meals and snacks.

What does the interview process look like?

The process takes about one week and includes a 15-minute virtual initial screening, a 45-minute virtual experience interview, and a 2-hour on-site meet and greet with a technical assessment.

Ready to apply?

The application is on the official Vast.ai careers page.

Apply on company site