This remote position in the USA is for a Senior Software Engineer focusing on machine learning infrastructure and automation at fal. The role suits an experienced developer who wants to build CI/CD pipelines, developer tooling, and automated systems for generative AI models.
Role Overview
fal is hiring a Senior Software Engineer to support its machine learning team by developing automation, infrastructure, and developer tooling. This position involves owning CI/CD systems for machine learning models and inference pipelines to reduce manual work and accelerate development cycles.
Key Responsibilities
Design, build, and maintain automated testing, validation, and deployment pipelines for machine learning models and inference services.
Reduce CI execution times using intelligent parallelization, caching, test selection, and efficient compute resource utilization.
Develop automated validation systems to test model outputs, detect quality regressions, and check changes across configurations and GPU architectures.
Build continuous performance testing to identify regressions in inference latency, throughput, GPU utilization, and cost.
Validate model pricing, billing configurations, API schemas, and deployments automatically prior to production release.
Develop AI-powered automation and agentic coding systems to diagnose CI failures, propose fixes, and streamline workflows.
Implement automated safeguards, deployment verification, rollback mechanisms, and monitoring for model releases.
Build internal tools and systems that eliminate repetitive tasks for the machine learning team.
Requirements
Five or more years of software engineering background with Python proficiency and experience building production infrastructure and developer tooling.
Experience in designing and operating CI/CD systems using GitHub Actions or comparable technologies.
Understanding of automated testing, build systems, dependency management, caching, and parallel execution.
Experience with containerized workloads, Docker, and cloud infrastructure.
Ability to design reliable distributed systems and debug complex infrastructure failures.
Understanding of observability principles including logs, metrics, tracing, and automated alerting.
Ability to work independently, identify high-impact problems, and create end-to-end solutions.
Nice to Have
Experience with machine learning infrastructure, PyTorch, GPU workloads, or model-serving systems.
Familiarity with NVIDIA GPU architectures and multi-GPU environments.
Experience building automated inference benchmarks or machine learning quality evaluation frameworks.
Experience with agentic coding tools like Codex or Claude Code, or building custom AI engineering agents.
Experience optimizing large-scale CI/CD pipelines with distributed test execution and ephemeral compute environments.
Experience developing internal developer platforms or infrastructure-as-code tooling.
Skills and Tools
Python
PyTorch
Docker
GitHub Actions
Distributed GPU infrastructure
Model serving and inference pipelines
Observability and performance monitoring tools
AI coding agents
Salary and Benefits
Salary range of $170K to $230K with equity offers
Health, dental, and vision insurance for US employees
Regular team events and offsites
Learning and growth opportunities
About the Company
fal operates a generative media ecosystem that builds infrastructure, tools, and model access for teams moving AI products from idea to production at scale. The company provides a unified platform combining high-performance inference, orchestration, and observability.
How to Apply
Apply on the official company careers page.
