Latest AI JobsBrowse Jobs
Hume AI logo

Senior Software Engineer - Data Plane

Hume AIHume AI HQEngineering
Apply on company site
Salary
$150K - $250K USD
Job type
Full-time
Work mode
Remote
Posted
3 Sept 2026
Status
Open · checked 7d ago

About this role

Hume AI is seeking a remote or New York-based Senior Software Engineer for the Data Plane team to design and build on-premises inference platforms for large-scale artificial intelligence workloads. This systems-oriented position suits an independent engineer passionate about resource efficiency, performance optimization, and human-centric artificial intelligence.

Role Overview

In this capacity, the professional will focus on reliability, performance, and resource utilization while bringing new models and inference capabilities into production. The individual will collaborate closely with machine learning engineers, research scientists, backend developers, product managers, and infrastructure specialists. Operating with a high level of autonomy, the engineer will manage systems through their full lifecycle, spanning initial architectural design, implementation, deployment, monitoring, and ongoing production support.

Key Responsibilities

Design, construct, and maintain data plane software responsible for executing artificial intelligence models and voice data workflows.
Develop advanced features including declarative workflow execution, parallel processing, fan-out capabilities, inference-engine integrations, execution-status reporting, and tracing.
Integrate new models and runtimes while preserving consistent performance, operational behavior, and high reliability.
Investigate and resolve complex production problems spanning application, operating-system, container, network, and hardware boundaries.
Profile and fine-tune latency, memory usage, system throughput, and overall resource efficiency.
Enhance the resilience, observability, testability, and operational safety of the platform.
Partner with research and product groups to translate emerging model capabilities into dependable production systems.
Produce comprehensive technical documentation for all engineered systems and features.

Requirements

Extensive professional background in server-side or systems software engineering.
Solid Linux fundamentals coupled with practical experience profiling and troubleshooting production systems.
Proven expertise in at least one systems-oriented programming area such as distributed systems, computer architecture, networking, concurrency, resource management, or filesystems.
Hands-on professional experience coding in a systems-oriented language like Rust, C, or C++.
Strong sense of personal ownership paired with the ability to independently make pragmatic architectural choices.
Exceptional verbal and written communication skills for creating thorough technical documentation.
Proficiency in leveraging AI-assisted coding tools to speed up delivery while fully validating, debugging, and explaining the output.

Nice to Have

Background in designing or constructing control-plane and data-plane system architectures.
Familiarity with machine-learning runtimes such as PyTorch.
Experience working with GPU inference, CUDA, TensorRT, ONNX, or performance profiling for accelerated workloads.
Knowledge of Python or a readiness to learn it for supporting model integration code.
Previous contributions to open-source projects in the backend, systems, or machine learning infrastructure space.
Understanding of neural network execution mechanics including tensor operations, model graphs, and forward propagation.
Experience in building container images and managing CI/CD pipelines.
Background in deploying software solutions into customer-managed or on-premises environments.

Skills and Tools

Python
PyTorch
Rust
C++
Linux
CUDA
ONNX
TensorRT
Distributed Systems
Concurrency

Salary and Benefits

Annual Salary: $150,000 to $250,000 USD

About the Company

Hume AI is a Series B startup headquartered in New York City that builds artificial intelligence optimized directly for human well-being. As the creator of pioneering speech language models, the organization focuses on expanding audio understanding models and enterprise evaluation platforms. Hume AI also conducts scientific research published in leading journals like Nature and supports The Hume Initiative, a non-profit organization establishing ethical guidelines for empathic technology.

How to Apply

Interested candidates should apply directly on the official Hume AI careers page.

Skills and tech stack

PythonPyTorchRustC++

Questions candidates ask

What is the salary range for the Senior Software Engineer - Data Plane role?

The salary ranges from $150,000 to $250,000 USD per year.

Is this position remote or located in an office?

This role offers remote flexibility while being headquartered in New York City.

What programming languages are required for this position?

Professional experience with at least one systems-oriented language such as Rust, C, or C++ is required.

What does Hume AI do as a company?

Hume AI is a Series B startup dedicated to building artificial intelligence optimized for human well-being, including pioneering speech language models and enterprise evaluation platforms.

How should I apply for this job?

Candidates should apply directly on the official Hume AI careers page.

Ready to apply?

The application is on the official Hume AI careers page.

Apply on company site