Latest AI JobsBrowse Jobs
Cloudflare logo

Senior Machine Learning Engineer

CloudflareHybridEmerging Technology and Incubation
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
9 Jul 2026
Status
Open · checked 7d ago

About this role

The Senior Machine Learning Engineer position at Cloudflare is a hybrid role based in Austin, Texas or London, UK, focused on shaping how machine learning models operate across a massive global network. This opportunity suits experienced engineers who thrive on building AI-native solutions and scaling production inference systems without relying on rigid roadmaps.

Role Overview

Cloudflare is looking for an expert to define how machine learning models run across its global network, ranging from frontier open LLMs and real-time voice models to customer-deployed models. This position sits within the Emerging Technology and Incubation department and involves working alongside systems engineers, product teams, and hardware partners. The goal is to bring advanced models into production with minimal latency, high reliability, and optimal resource utilization at Internet scale.

Key Responsibilities

Create, optimize, and productionize machine learning models specifically for Cloudflare’s serverless inference platform.
Construct benchmarking and evaluation frameworks to track latency, throughput, cost efficiency, and model behavior across multiple model families including LLMs, speech, and vision.
Boost inference performance through caching, batching, quantization, runtime tuning, model compilation, and accelerator-aware optimizations.
Partner closely with distributed systems engineers to embed models into a heterogeneous fleet of GPUs and advanced accelerators.
Refine model deployment workflows to encompass observability, validation, regression testing, rollout safety, and operational readiness.
Translate customer needs into scalable machine learning capabilities for Workers AI in collaboration with product teams.
Provide mentorship to engineers, guide technical direction, and elevate production ML engineering standards across the group.

Requirements

Demonstrated history of building, tuning, and operating machine learning models within active production environments.
High proficiency in Python alongside modern machine learning frameworks such as PyTorch, TensorFlow, or JAX.
Hands-on expertise with large-scale model inference optimization methods, including batching, quantization, caching, and serving runtime tuning.
Practical familiarity with serving frameworks or runtimes like vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton, or llama.cpp.
Working knowledge of diverse deep learning architectures such as LLMs, vision models, speech models, embeddings, multimodal models, or retrieval-augmented generation.
Background in fine-tuning models specifically for GPUs or specialized hardware accelerators.
Solid grasp of production machine learning priorities, covering monitoring, evaluation, reliability, model regressions, and safe rollouts.
Capability to operate comfortably across both machine learning and systems domains, encompassing distributed systems, networking, or serverless platforms.
Proven track record of spearheading complex technical initiatives and mentoring peers.

Nice to Have

Contributions to open source machine learning tooling, inference runtimes, or model serving frameworks.

Skills and Tools

Python
PyTorch
TensorFlow
LLMs
Inference Optimization
Distributed Systems

About the Company

Cloudflare operates one of the largest networks on the internet, accelerating and protecting millions of online properties globally. Recognized for its innovative culture, the company is dedicated to safeguarding a free and open internet through dedicated initiatives like Project Galileo, the Athenian Project, and the privacy-focused public DNS resolver 1.1.1.1.

How to Apply

Interested candidates should submit their application directly through the official Cloudflare careers page.

Skills and tech stack

PythonPyTorchTensorFlowLLM

Questions candidates ask

What locations are available for this hybrid role?

This position is available in Austin, TX or London, UK on a hybrid schedule.

What department does this role belong to?

The Senior Machine Learning Engineer sits within the Emerging Technology and Incubation department.

What core frameworks and languages are required?

The role requires strong proficiency in Python and modern machine learning frameworks like PyTorch or TensorFlow.

What optimization techniques are relevant to this position?

Relevant techniques include quantization, batching, caching, model compilation, serving runtime tuning, and accelerator-aware optimization.

Are there any travel or in-person interview requirements?

Applicants who progress to the offer stage may be requested to attend an in-person interview at a Cloudflare office or hub.

Ready to apply?

The application is on the official Cloudflare careers page.

Apply on company site