Latest AI JobsBrowse Jobs
Inworld AI logo

Staff / Principal Software Engineer - USA

Inworld AIMountain View, California, USAPlatform
Apply on company site
Salary
$280K - $350K USD
Job type
Full-time
Work mode
Remote
Posted
28 Apr 2025
Status
Open · checked 7d ago

About this role

Role Overview

The Staff / Principal Software Engineer role at Inworld AI is a full-time, individual contributor position based in Mountain View, California, with remote flexibility and required on-site days in the South Bay office. This opportunity is well-suited for an ambitious backend engineer who wants to build high-scale, real-time AI inference systems and developer APIs.

Key Responsibilities

Establish significant scope by collaborating with product managers, engineers, and leads to identify critical product needs.
Operate with technical autonomy to propose solutions, including introducing new technical dependencies or standards.
Collaborate, execute, and deliver features that balance rapid execution with exceptional quality.
Reflect and drive continuous system improvements, advocating for engineering excellence across the platform.
Build and own core systems for the Inworld Router, including multi-provider failover, cost and latency-based routing, live A/B experimentation, and real-time observability.
Develop API-based model services encompassing text-to-speech, speech-to-text, LLMs, and knowledge retrieval augmentation.
Work on complex infrastructure projects, such as system-wide billing, developer tools, and platformization for upcoming product offerings.

Requirements

Excellent programming skills and experience in a statically typed backend language like Go, Python, C++, or Rust.
Experience developing and deploying cloud-based services handling at least hundreds of queries per second.
Hands-on experience with relational databases such as PostgreSQL or MySQL.
Practical background using caching tools like Redis or Memcached, pubsub systems, message queues, data pipelines including Flink or Beam, and cloud storage.
Excellent verbal and written communication skills to coordinate effortlessly with multidisciplinary team members.
Candidates must be based in the SF Bay Area or willing to relocate for hybrid on-site work.

Nice to Have

Experience building API gateways, routing and proxy layers, or multi-provider orchestration systems.
Background using analytics or timeseries databases like ClickHouse, Timescale, or InfluxDB.
Familiarity with OpenTelemetry.
Prior experience working with C++.

Skills and Tools

Python, Rust, C++, Go
LLMs, RAG, AI Inference
PostgreSQL, MySQL
Redis, Memcached
Flink, Beam
Cloud Storage, Pubsub, Queues

Salary and Benefits

The US base salary range for this full-time position is $280,000 to $350,000 per year. Total compensation includes equity and benefits alongside the base pay, with individual pay determined by work location, level, competencies, experience, and business needs.

About the Company

Inworld AI operates as a research lab and inference provider focused on real-time artificial intelligence for consumer-facing applications. The organization builds first-party speech models, serves large language models, and runs inference for high-volume workloads supporting hundreds of millions of users daily. Backed by prominent venture capital firms and investors, Inworld AI has been recognized globally as a leading artificial intelligence innovator and top startup.

How to Apply

Interested candidates should visit the official Inworld AI careers page to submit an application for this position.

Skills and tech stack

PythonRustC++LLMRAG

Questions candidates ask

What is the location for this role?

The position is based in Mountain View, California, with remote flexibility and requires working on-site in the South Bay office a few days a week.

What is the salary range for the Staff / Principal Software Engineer position?

The US base salary range is $280,000 to $350,000 per year, supplemented by equity and benefits.

What programming languages are required or preferred?

Candidates need experience in a statically typed backend language, preferably Go, Python, C++, or Rust.

Is this a management role?

No, this is an individual contributor (IC) focused role designed for someone who enjoys direct technical contribution.

What specific cloud and data technologies are needed?

Requirements include experience with relational databases like PostgreSQL or MySQL, caching tools such as Redis or Memcached, pubsub or queues, data pipelines like Flink or Beam, and cloud storage.

Ready to apply?

The application is on the official Inworld AI careers page.

Apply on company site