Latest AI JobsBrowse Jobs
code-metal logo

Senior AI Platform Engineer

code-metalBoston HubEngineering
Apply on company site
Salary
$170K – $210K
Job type
Full-time
Work mode
Remote
Experience
Senior · 4+ yrs
Posted
9 Oct 2026
Status
Open · checked 7d ago

About this role

Located in Boston Hub, the Senior AI Platform Engineer role at Code Metal involves designing and operating the internal AI enablement stack for machine learning initiatives. This position suits an experienced software engineer with a background in production-grade Python, model serving, or agentic infrastructure.

Role Overview

Code Metal is hiring a Senior AI Platform Engineer to build foundational services for AI-driven code transpilation and modernization solutions. The engineer will operate within an internal platform team to deliver GPU inference serving, model gateways, agent harnesses, context engineering, and experimentation management. The position focuses primarily on building production systems while collaborating with applied AI research teams.

Key Responsibilities

Own one or more platform components end to end, managing the entire lifecycle from design documentation to production operation.
Build and maintain services in designated focus areas while contributing across the broader technical stack.
Write clean, modular, and fully tested code, ensuring that AI-generated code meets the same high standard.
Troubleshoot complex production issues such as tail latency, GPU memory constraints, and failing agent executions.
Collaborate with internal customers to scope projects, estimate timelines, and identify potential risks early.
Review team code and designs while assisting with the onboarding of new engineering staff.
Conduct targeted benchmarks and experiments to gather evidence for technical decisions.

Requirements

Production-grade Python programming abilities alongside strong platform engineering fundamentals covering API design, distributed systems, containers, orchestration tools like Kubernetes, CI/CD, and testing.
Production experience in at least one focus area, which includes model serving for LLMs, agentic infrastructure, or observability and experimentation.
Solid data science and artificial intelligence research fundamentals, including familiarity with transformers, LLM inference, experiment design, benchmarking, PyTorch, and Hugging Face.
Practical experience owning a service or component in a production environment, including debugging and reliability improvements.
Experience writing project design docs, reviewing code, and mentoring colleagues.

Nice to Have

Experience working across multiple platform focus areas.
Production background operating LLM gateways, proxies, or API gateways that handle routing, authentication, rate limiting, and cost attribution.
Familiarity with inference optimization techniques such as speculative decoding, prefix caching, parallelism, and GPU profiling.
Experience utilizing durable workflows, agent frameworks, or tool protocols like MCP.
Background in fine-tuning language models via distributed training across multiple GPU nodes.
Experience using experiment-tracking and artifact management platforms like MLflow or Weights & Biases.
Experience deploying artificial intelligence systems on-premise or within regulated domains such as aerospace and defense.

Skills and Tools

Python
Kubernetes
PyTorch
Hugging Face
vLLM
SGLang
TensorRT-LLM
OpenTelemetry
MLflow
Weights & Biases

Salary and Benefits

Salary range of $170,000 to $210,000 with company equity offers.
Health care plan featuring 100% premium coverage for medical, dental, and vision.
401(k) retirement plan with a 5% match.
Paid time off including uncapped vacation, sick leave, and public holidays.
Flexible hybrid or remote work arrangement.
Relocation assistance for qualifying employees.

About the Company

Founded in 2023 with offices in Boston and San Francisco, Code Metal provides automated software engineering solutions that utilize formal methods to verify AI-generated code. The company is backed by investors including Accel, Salesforce Ventures, B Capital, Smith Point Capital, J2 Ventures, Shield Capital, Overmatch, and RTX. Its customers include the U.S. Air Force, L3Harris, RTX, and Toshiba.

How to Apply

Interested candidates should apply on the official company careers page.

Skills and tech stack

PythonKubernetesPyTorchHugging FacevLLMSGLangTensorRT-LLMOpenTelemetryMLflowWeights & BiasesLLMTransformersFine-tuningDistributed Systems

Questions candidates ask

What is the salary range for the Senior AI Platform Engineer role?

The salary range is $170K to $210K, complemented by equity offers and benefits.

Where is the position located?

The role is based out of Boston Hub, with flexible hybrid or remote work arrangements available.

How many years of experience are required?

The position typically requires 4+ years of software engineering experience, including 2+ years building and operating ML/AI or LLM systems in production.

What benefits are included with employment?

Benefits include fully covered health care plans, a 401(k) with a 5% match, uncapped paid time off, relocation assistance for qualifying employees, and equity.

Are there specific citizenship requirements?

US citizenship may be required for certain project assignments involving security clearance.

Ready to apply?

The application is on the official code-metal careers page.

Apply on company site