Latest AI JobsBrowse Jobs
Vast.ai logo

Systems Operations Support Engineer — Linux

Vast.aiLos AngelesOperations
Apply on company site
Salary
$90K - $150K USD
Job type
Full-time
Posted
30 Jul 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Systems Operations Support Engineer position at Vast.ai in Los Angeles is a full-time opportunity focused on resolving complex, escalated infrastructure issues beyond frontline triage. This role suits a methodical Linux professional who enjoys deep technical debugging within artificial intelligence computing environments.

Key Responsibilities

Investigate and resolve escalated support tickets related to GPU workload failures, container errors, networking problems, account infrastructure, and host-side configurations.
Provide managed support for supplier onboarding and ongoing machine management through installation, configuration, and troubleshooting.
Assist clients and infrastructure suppliers working with PyTorch, TensorFlow, and other GPU-accelerated workloads.
Handle L1 support overflow coverage during peak traffic periods or major incidents.
Diagnose and fix issues spanning Docker, KVM virtualization environments, and NVIDIA CUDA and GPU drivers.
Troubleshoot network layer issues such as VLAN, DNS, DHCP, VPN, NAT, firewall rules, and host connectivity failures.
Investigate performance bottlenecks involving GPU utilization, container limits, thermal throttling, driver conflicts, and disk I/O.
Advise suppliers on optimal installation practices, covering hardware setups, driver configurations, BIOS and firmware settings, and network designs.
Author and update internal runbooks, escalation guides, and knowledge base documentation to minimize recurring escalations.
Develop diagnostic and automation tooling using Bash and Python to streamline manual triage tasks.
Partner with engineering and support teams to identify, flag, and document systemic platform issues.

Requirements

Robust Linux systems operations background using Ubuntu, Debian, or RHEL/CentOS, covering networking, storage, services, and permissions.
Skilled in Docker container debugging, Docker Compose, image management, cgroup limits, and filesystem troubleshooting.
Practical experience using virtualization platforms and hypervisors like Proxmox VE or VMware for VM provisioning and debugging.
Solid networking fundamentals encompassing VLANs, DNS, DHCP, NAT, VPNs, firewall rules, and L2 or L3 troubleshooting.
Hands-on background troubleshooting NVIDIA GPU drivers, CUDA, and heavy GPU workloads.
Scripting proficiencies in Python and Bash for creating diagnostic utilities and automation.
Excellent written English communication skills that are clear, professional, and technically precise.
Prior technical support experience gained in a customer-facing or internal help desk setting.
Capability to prioritize an escalated ticket queue by severity and impact, balancing reactive fixes against proactive tooling and documentation work.

Nice to Have

Familiarity with AI and machine learning frameworks like PyTorch and TensorFlow alongside running GPU-accelerated containers.
Observability and monitoring experience utilizing Prometheus and Grafana.
Relevant technical certifications including CompTIA Linux+, RHCSA, or equivalent credentials.
Prior hands-on knowledge of the Vast.ai platform either as a user or an infrastructure supplier.

Skills and Tools

Linux (Ubuntu)
Docker and Docker Compose
Python and Bash Scripting
NVIDIA CUDA and GPU Drivers
Networking (VLAN, DNS, DHCP, NAT, VPN, Firewall)
Virtualization (KVM, Proxmox VE, VMware)
PyTorch and TensorFlow

Salary and Benefits

Annual salary range of $90,000 to $150,000 paid in USD
Comprehensive health, dental, vision, and life insurance coverage
401(k) retirement plan with an active company match
Meaningful early-stage equity opportunities
On-site meals, snacks, and direct collaboration with company founders and technical leaders

About the Company

Vast.ai builds a decentralized cloud powering global artificial intelligence projects and businesses. The company's mission revolves around organizing, optimizing, and orienting worldwide computation for the benefit of humanity. Valuing ownership, elegance, integrity, and continuous learning, the organization offers team members opportunities to engage with state-of-the-art AI systems alongside a globally distributed workforce.

How to Apply

Interested candidates should visit the official Vast.ai careers page to submit an application and review further instructions.

Skills and tech stack

PythonPyTorchTensorFlowDockerLLM

Questions candidates ask

What is the location and work schedule for this role?

The position is based out of the Westwood office in Los Angeles. Available schedules include a fully on-site option from Monday to Friday, or a hybrid schedule working four days on-site and one day from home from Sunday to Thursday.

What compensation and benefits are provided?

The annual salary ranges from $90,000 to $150,000, accompanied by early-stage equity, comprehensive health, dental, vision, and life insurance, a 401(k) with company match, and on-site meals and snacks.

What are the primary technical requirements?

Candidates need strong Linux systems operations experience with Ubuntu or similar distributions, proficiency in Docker, experience with virtualization platforms, strong networking fundamentals, hands-on NVIDIA GPU and CUDA troubleshooting skills, and Bash and Python scripting capabilities.

What does the interview process look like?

The interview process takes approximately one week and includes a 15-minute virtual initial screening, a 45-minute virtual experience interview, and a 2-hour on-site meet and greet with a technical assessment.

Is prior experience with Vast.ai required?

No, prior experience with the platform is not mandatory, though familiarity with Vast.ai as a client or infrastructure supplier is strongly preferred.

Ready to apply?

The application is on the official Vast.ai careers page.

Apply on company site