Role Overview
Level AI is seeking a Principal Software Engineer for Backend and Infrastructure based in Noida, India, with remote work flexibility. This role suits an experienced engineering leader ready to guide backend development and machine learning infrastructure through a critical growth phase. Operating as a Principal team member, the chosen professional will set technical standards, direct architectural decisions, and collaborate closely with product and engineering teams across multiple geographical locations.
Key Responsibilities
Architect real-time, high-throughput distributed messaging systems designed for strict latency demands and large-scale data processing.
Formulate and execute the technical strategy for machine learning platforms, enhancing training and serving infrastructure to support growing model complexity.
Supervise GPU infrastructure capacity planning, resource scheduling, and utilization across inference and training fleets to align spend with actual throughput.
Optimize inference performance by minimizing latency and cost per request through advanced routing, batching, compilation, and caching strategies.
Establish system reliability, uptime, observability, and incident response procedures for enterprise-grade production environments.
Translate ambiguous business requirements into actionable technical initiatives in partnership with product and go-to-market teams.
Mentor senior engineers, direct design reviews, and establish engineering standards across the organization.
Assess emerging technological tools and practices, adopting solutions that provide clear value.
Adhere strictly to information security, data protection, privacy guidelines, and complete mandatory compliance training.
Requirements
Extensive background developing large-scale backend and infrastructure systems with demonstrated ownership of architecture and design.
Practical, hands-on experience working with high-throughput messaging platforms, real-time job queues, and large databases.
Demonstrated capability in analyzing complex codebases and evaluating architectural tradeoffs.
Experience guiding technical direction and mentoring senior engineering staff through influence.
Excellent written communication skills suited for cross-time-zone collaboration with technical and executive stakeholders.
Computer Science degree or equivalent professional background.
Nice to Have
Production familiarity with the existing technology stack including Django, Celery, Redis, PostgreSQL, and Google Cloud.
Direct experience scaling inference workloads and managing GPU infrastructure capacity, autoscaling, and cost efficiency in production.
Specialization in inference tools such as vLLM, TensorRT, Triton, Ray Serve, or comparable frameworks.
Prior involvement scaling platforms through rapid corporate growth at global product enterprises.
Background knowledge in natural language processing (NLP), speech technology, or information retrieval.
Skills and Tools
NLP
Backend Systems
Infrastructure Architecture
Distributed Messaging
GPU Infrastructure
Google Cloud
Python
Salary and Benefits
Comprehensive health coverage extending to the employee, spouse, children, and parents.
Generous home-office connectivity allowances, annual learning budgets, and parental leave provisions.
High autonomy and real ownership over systems deployed globally by enterprise clients.
About the Company
Level AI is a conversational intelligence enterprise backed by prominent venture capitalists and headquartered in Mountain View, California, with operations in India. The company applies speech artificial intelligence, natural language processing, and advanced retrieval systems to help enterprise contact centers extract actionable insights from millions of customer interactions.
How to Apply
Candidates interested in this opportunity should submit their application directly on the official Level AI careers page.
