Latest AI JobsBrowse Jobs
fal logo

Software Engineer, Distributed Systems

falRemote - GlobalEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
13 Mar 2026
Status
Open · checked 7d ago

About this role

Role Overview

The Software Engineer, Distributed Systems position at fal is a full-time, globally remote role tailored for developers with over five years of experience building large-scale computing platforms. This opportunity suits engineers who specialize in managing high-traffic, complex distributed environments and want to shape the future of generative media infrastructure.

Key Responsibilities

Construct the core Python and Rust platform, encompassing request routing, workload orchestration, scheduling, and GPU autoscaling.
Handle large-scale file storage and queueing systems to support robust AI operations.
Create forward-looking architectural designs to scale the platform by 100x while maintaining low global latency.
Utilize advanced AI tools to automate routine tasks involved in engineering complex, reliable systems.
Conduct rigorous profiling and tuning for low-level CPU and memory performance.

Requirements

Bring a minimum of five years of professional background designing distributed compute and orchestration platforms using Python or Rust.
Demonstrate a robust grasp of distributed systems core concepts, including consensus, scheduling, fault tolerance, and capacity planning.
Possess profound knowledge of computational complexity and memory allocation.
Show a documented history of engineering systems that maintain stability under live production demands.
Apply observability practices effectively to inform performance and reliability choices.
Exhibit exceptional communication skills to steer technical choices collaboratively across teams.
Operate as an autonomous self-starter who executes swiftly, embraces ownership, and continuously pursues self-improvement.

Nice to Have

Background working with AI or machine learning inference and training infrastructure.
Exposure to high-performance systems programming, covering async runtimes, zero-copy, and memory-safe concurrency.
Previous involvement in creating multi-tenant compute platforms.
Familiarity with networking principles and performance traits.
Prior insight into GPU workload behaviors and scheduling limitations.

Skills and Tools

Python
Rust
Distributed Compute and Orchestration
Request Routing and GPU Autoscaling
CPU and Memory Performance Tuning

Salary and Benefits

Participation in intellectually stimulating and challenging projects.
Continuous learning and professional development avenues.
Periodic team gatherings and company offsites.

About the Company

fal operates as a generative media ecosystem that supplies the infrastructure, tooling, and model access required by teams to transition AI products from concept to production at scale. The enterprise unites high-performance inference, orchestration, and observability onto a single platform designed for developers and organizations building AI-native applications.

How to Apply

Interested candidates should visit the official fal careers page to submit their application for this remote position.

Skills and tech stack

PythonRust

Questions candidates ask

Is this position fully remote?

Yes, this role is offered as remote on a global scale.

What programming languages are primarily used?

The core platform is built using Python and Rust.

How many years of experience are required?

Applicants must have 5+ years of experience building distributed compute and orchestration platforms.

What kind of projects will I work on?

You will work on core platform elements like request routing, AI workload orchestration, scheduling, GPU autoscaling, large-scale file storage, and queueing.

Are there opportunities for professional growth?

Yes, the company provides learning and growth opportunities through interesting and challenging work.

Ready to apply?

The application is on the official fal careers page.

Apply on company site