Latest AI JobsBrowse Jobs
Sarvam AI logo

ML Ops Engineer, Chanakya

Sarvam AIDelhiEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
17 Apr 2026
Status
Open · checked 7d ago

About this role

Sarvam AI is seeking a full-time ML Ops Engineer in Delhi to own the model lifecycle across defense and strategic sector deployments. This position suits an experienced professional with a background in machine learning engineering who wants to build sovereign AI infrastructure for India.

Role Overview

As an ML Ops Engineer, the professional owns the model lifecycle across strategic deployments, managing serving infrastructure, monitoring, evaluation pipelines, and environment management. The role requires ensuring systems remain operational, accurate, and auditable for mission-critical applications. The engineer bridges the gap between field deployments and product engineering teams by maintaining robust deployment infrastructure where model failure represents a significant operational risk.

Key Responsibilities

Design and operate model serving infrastructure across cloud and on-premises environments.
Build and maintain continuous integration and deployment pipelines for model updates, rollbacks, and evaluation-gated deployments.
Monitor production model performance metrics including latency, accuracy drift, throughput, and failure modes.
Construct evaluation infrastructure such as harnesses, A/B testing frameworks, and model comparison tools.
Manage containerized model serving within constrained, air-gapped, and edge environments.
Collaborate closely with data scientists on evaluation pipelines while owning the underlying infrastructure.
Create clear runbooks and operational playbooks for strategic deployment engineers in the field.
Own incident response for model-layer failures across all active deployments.

Requirements

Three to five years of experience in machine learning engineering or MLOps, including at least one production large language model or machine learning system in continuous operation.
Deep expertise in model serving tools like vLLM, TGI, or Triton Inference Server, alongside familiarity with quantized model formats including GGUF, AWQ, and GPTQ.
Experience in fine-tuning and adapting models within constrained, on-premises, or air-gapped environments.
Strong containerization skills using Docker, Kubernetes, or lightweight alternatives such as K3s and K0s for edge settings.
Proficiency in monitoring and observability platforms like Prometheus and Grafana for custom dashboard creation.
Fluent in Python with familiarity in model fine-tuning workflows and evaluation frameworks.
Hands-on experience using continuous integration and deployment tooling for machine learning pipelines such as GitHub Actions, ArgoCD, or DVC.

Skills and Tools

Python
Kubernetes
Docker
Large Language Models (LLMs)
MLOps
vLLM, TGI, Triton Inference Server
Prometheus and Grafana
GitHub Actions and ArgoCD

About the Company

Sarvam AI is developing India's full-stack sovereign AI platform, focusing on research, models, infrastructure, and applications to make artificial intelligence work for the country. Backed by Lightspeed, Peak XV, and Khosla Ventures, the company partners with leading enterprises and public institutions including Tata Capital, SBI Life, CRED, IDFC, and LIC.

How to Apply

Interested candidates should visit the official Sarvam AI careers page on sarvam.ai to submit an application for the ML Ops Engineer position.

Skills and tech stack

PythonKubernetesDockerLLMMLOps

Questions candidates ask

What is the location of the ML Ops Engineer role?

The position is based in Delhi, India, and is an on-site full-time role.

How many years of experience are required?

Candidates should have 3 to 5 years of experience in machine learning engineering or MLOps, with at least one production system in continuous operation.

What specific technical skills are necessary for this job?

Required skills include Python, Kubernetes, Docker, MLOps practices, large language model serving tools like vLLM or Triton, and monitoring systems like Prometheus and Grafana.

Who backs Sarvam AI?

Sarvam AI is backed by Lightspeed, Peak XV, and Khosla Ventures.

How do I apply for the position?

Candidates can apply directly through the official company careers website at sarvam.ai.

Ready to apply?

The application is on the official Sarvam AI careers page.

Apply on company site