Latest AI JobsBrowse Jobs
fal logo

Machine Learning Engineer, Reliability

falRemote - APACEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
24 Jun 2026
Status
Open · checked 7d ago

About this role

The Machine Learning Engineer, Reliability role at fal is a remote position based in the APAC region, specifically India, Australia, or New Zealand. This hybrid engineering position is well-suited for professionals with deep system fundamentals and a passion for managing generative AI infrastructure at scale.

Role Overview

fal is seeking a Machine Learning Engineer focused on reliability to join the engineering team. This unique position combines machine learning engineering with site reliability engineering. The candidate will own the security, safety, and reliability of the platform's large fleet of generative media model APIs. The mission centers on keeping image, video, and audio model APIs available, performant, and secure for thousands of developers and enterprise users daily.

Key Responsibilities

Maintain availability, throughput, and latency SLOs for generative media model APIs operating at scale.
Design observability, monitoring, and alerting systems to catch ML-specific failures, output quality drops, and model regressions early.
Strengthen model deployment workflows through canary releases, automated rollbacks, shadow testing, and validation gates.
Enhance the security posture of the model fleet via secure serving, rate limiting, abuse detection, and defenses against adversarial usage.
Operationalize safety systems including content moderation pipelines, guardrails, and safety classifiers that run efficiently at inference time.
Manage incident response for API outages or degradations, lead postmortems, and execute engineering fixes to prevent future issues.
Optimize capacity planning, autoscaling, and GPU fleet efficiency for heavy inference workloads.
Collaborate with infrastructure and model teams to embed reliability, security, and safety standards into new model onboarding.

Requirements

5+ years of total professional experience.
Minimum of 2 years of experience operating high-scale API systems or production ML, ideally with on-call duties.
Practical experience supporting and working with diffusion models in a production setting.
Strong fundamentals in distributed systems, networking, observability, and incident management.
Working knowledge of modern generative models such as transformers and diffusion, alongside their production failure modes.
Strong preference for automation, measurement, and blameless postmortems.
Location requirement: Must be based in India, Australia, or New Zealand.

Nice to Have

Familiarity with security and safety practices tailored for ML systems.
Background in trust and safety engineering, abuse prevention, or content safety.

Skills and Tools

Python
Kubernetes
Torch
Diffusers
fal Python SDK
Distributed systems and networking

Salary and Benefits

Competitive salary and equity packages
Engaging and challenging work environment
Learning and professional growth opportunities
Regular team events and offsites

About the Company

fal powers the generative media ecosystem by providing the infrastructure, model access, and tools that help teams transition from ideas to production at scale. The platform unifies high-performance inference, orchestration, and observability to make generative media practical for enterprises and developers.

How to Apply

Interested candidates should visit the official fal careers page to submit an application for this remote APAC opportunity.

Skills and tech stack

PythonKubernetes

Questions candidates ask

Where is this job located?

This is a remote position that must be based in India, Australia, or New Zealand.

What type of experience is required?

Candidates must have 5+ years of professional experience, including at least 2 years operating production ML or high-scale API systems with on-call ownership.

What core technologies and tools are used?

The tech stack includes Python, torch, diffusers, Kubernetes, and the fal Python SDK.

What are the primary responsibilities of the role?

Responsibilities include managing SLOs for generative media model APIs, building ML-specific observability, hardening deployment workflows, driving security and safety compliance, and managing incident responses.

What benefits does fal offer?

fal offers competitive salary and equity, learning and growth opportunities, team events, offsites, and challenging work.

Ready to apply?

The application is on the official fal careers page.

Apply on company site