Latest AI JobsBrowse Jobs
percepta logo

AI Infrastructure Engineer

perceptaNew York CityEngineering
Apply on company site
Salary
$180K – $400K
Job type
Full-time
Experience
Senior · 5+ yrs
Posted
6 Oct 2026
Status
Open · checked 7d ago

About this role

New York City based AI Infrastructure Engineer position at Percepta for professionals with production infrastructure and cloud-agnostic experience. This role suits engineers looking to shape the operational foundations for autonomous AI systems.

Role Overview

Percepta is hiring an AI Infrastructure Engineer in New York City to own the infrastructure, deployment, and operational reliability powering their AI systems and autonomous agents. The position involves hardening existing infrastructure, building missing components, and establishing operational paradigms for non-deterministic workloads across multiple cloud providers.

Key Responsibilities

Build the operational framework including SLOs, alert routing, on-call rotations, incident response, and postmortems
Own and evolve Infrastructure as Code using Terraform across AWS, Azure, and GCP with tests, policy-as-code, and drift discipline
Automate customer environment setup such as firewall exceptions, DNS delegations, deploy identities, tag policies, and cert chains
Maintain cloud parity across Azure, GCP, and AWS to support diverse customer environments
Embed HIPAA and SOC 2 compliance directly into the infrastructure through code and automated evidence generation
Manage the observability stack comprising Grafana, Loki, Mimir, Tempo, Alloy, Langfuse, and LiteLLM to monitor agent behavior and costs
Create a paved road for engineers to deploy services into customer tenants efficiently

Requirements

5+ years of experience operating production infrastructure in SRE, platform, or production engineering roles
Operational experience in environments outside direct control such as BYOC, single-tenant, on-prem, or air-gapped systems
Cloud-agnostic expertise across AWS, Azure, and GCP including networking, IAM, and managed Kubernetes like EKS, AKS, and GKE
Production Kubernetes experience on managed clusters across multiple providers
Deep Terraform expertise covering module design, state, testing, and drift management
Background carrying a pager and implementing improvements like incident command, postmortems, and actionable SLOs
Experience operating under regulated postures such as HIPAA, SOC 2, PCI, or FedRAMP where controls live in infrastructure
Comfortable in customer-facing settings during architecture reviews and technical discussions
Proficiency in Python, Go, or Bash for automation

Nice to Have

Operated infrastructure via vendor control planes like Ryvn, Nuon, or Replicated
Experience with GitOps and progressive delivery across tenant fleets
Multi-region experience and knowledge of provider-native versus portable trade-offs in BYOC products
Depth in the Grafana stack including Mimir, Loki, and Tempo at multi-tenant scale
GPU and inference operations background with Ray, SkyPilot, vLLM, SGLang, or LLM gateways
MLOps or research-to-production handoff experience
Familiarity with observability and blast-radius controls for non-deterministic systems

Skills and Tools

Terraform
AWS, Azure, GCP
Kubernetes, EKS, AKS, GKE
Grafana, Loki, Mimir, Tempo, Alloy, Langfuse, LiteLLM
Python, Go, Bash
Ray, SkyPilot, vLLM, SGLang

Salary and Benefits

Salary range of $180K to $400K
Equity offerings
401(k) matching
Comprehensive health and family benefits
Daily lunch provided

About the Company

Percepta is an office-first company partnering directly with General Catalyst to transform critical institutions like healthcare, manufacturing, and energy using applied AI. The team builds forward-deployed expertise and agentic workflow tools to bridge the gap between research environments and production systems.

How to Apply

Apply on the official company careers page.

Skills and tech stack

TerraformAWSAzureGCPKubernetesEKSAKSGKEGrafanaLokiMimirTempoAlloyLangfuseLiteLLMPythonGoBashRaySkyPilotvLLMSGLangLLMMLOps

Questions candidates ask

What is the location and work style for this role?

The role is based in New York City as an office-first team environment that values in-person collaboration.

What level of experience is required for the AI Infrastructure Engineer position?

Candidates must have 5+ years of experience operating production infrastructure in SRE, platform, or production engineering roles.

Which cloud providers must candidates be familiar with?

Candidates must be comfortable across AWS, Azure, and GCP, treating all three as first-class cloud environments.

What compensation and benefits are included?

The position offers a salary between $180K and $400K, equity, 401(k) matching, comprehensive health and family benefits, and daily lunch.

Is visa sponsorship available?

Visa sponsorship is not mentioned in the posting.

Ready to apply?

The application is on the official percepta careers page.

Apply on company site