Latest AI JobsBrowse Jobs
AssemblyAI logo

Senior Software Engineer, Inference

AssemblyAINorth AmericaEngineering
Apply on company site
Salary
$190K - $225K USD
Job type
Full-time
Posted
28 Aug 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Senior Software Engineer, Inference role at AssemblyAI in North America involves building production-ready inference systems that transform advanced research into robust products. This position suits an experienced backend specialist who wants to drive the future of voice artificial intelligence within a lean, high-impact organization.

Key Responsibilities

Build and deliver customer-facing APIs that introduce brand new model capabilities, taking ownership from initial prototype through official launch and continuous improvement.
Expand inference infrastructure to reliably handle a massive volume of daily API requests.
Collaborate closely with researchers to transform experimental concepts and notebooks into stable, highly performant production features.
Engage with customers and applied engineering groups to gather feedback and shape future product design and research priorities.
Write code across the technical stack, encompassing backend services, inference infrastructure, software development kits, and internal tools.

Requirements

Extensive backend engineering background focused on building and maintaining machine learning infrastructure or production-grade customer-facing APIs.
Ability to thrive in ambiguous environments, managing the natural gaps between research milestones and product deadlines.
Authentic curiosity about artificial intelligence and machine learning technology to guide smart technical decisions.
Strong interpersonal communication abilities to connect effectively with researchers, engineers, and users.

Skills and Tools

Backend Engineering
Machine Learning Infrastructure
API Development
Inference Systems
Large Language Models (LLM)

Salary and Benefits

Annual Salary Range: $190,000 to $225,000 USD
Competitive compensation structures designed to reflect company size, industry standing, and team equity

About the Company

AssemblyAI creates top-tier Voice AI models that power modern voice applications, processing millions of inference calls and extensive audio data daily. Serving thousands of prominent clients, the enterprise operates with a lean and efficient team focused on velocity and high ownership. The workplace culture functions as a meritocracy where employees enjoy direct access to tools, information, and meaningful autonomy.

How to Apply

Interested candidates should submit their application directly through the official AssemblyAI careers page to be considered for this opportunity.

Skills and tech stack

Questions candidates ask

What is the salary range for the Senior Software Engineer, Inference position?

The expected yearly salary falls between $190,000 and $225,000 USD, depending on factors such as relevant experience and qualifications.

Where is this job located?

The role is based in North America.

What department does this role belong to?

This position sits within the Engineering department.

What are the primary responsibilities of this role?

The engineer will design customer-facing APIs, scale inference infrastructure, partner with researchers to productionize models, and contribute across the full technology stack.

How should I apply for this position?

You should apply directly on the official AssemblyAI careers website.

Ready to apply?

The application is on the official AssemblyAI careers page.

Apply on company site