Lead Member of Technical Staff, Inference Infrastructure
About this role
Cohere is seeking a Lead Member of Technical Staff for Inference Infrastructure to shape the next generation of AI platforms powering advanced natural language processing applications. Based in San Francisco with remote flexibility, this full-time position suits an experienced infrastructure leader passionate about high-performance machine learning systems.
Role Overview
The Model Serving team at Cohere develops, deploys, and operates the AI platform that delivers large language models through easy-to-use API endpoints. As a technical leader, you will provide guidance across multiple teams, direct the architecture for deploying optimized NLP models to production, and serve as a main contact for customers requiring customized deployments.
Key Responsibilities
Requirements
Skills and Tools
Salary and Benefits
About the Company
Cohere is a security-first enterprise AI company that builds cutting-edge foundation AI models and end-to-end products designed to solve real-world business problems. Headquartered in Toronto with major offices in cities including San Francisco, London, New York City, Montreal, Paris, Berlin, and Seoul, the organization brings together researchers, engineers, and designers dedicated to advancing enterprise AI adoption.
How to Apply
Interested candidates should visit the official Cohere careers page to submit their application for this position.
Skills and tech stack
Questions candidates ask
What is the salary range for this role?
The annual salary for the Lead Member of Technical Staff, Inference Infrastructure position ranges from $235,000 to $325,000 USD.
Where is this job located?
The role is based in San Francisco with remote-friendly work options available.
What level of experience is required?
Candidates must have 8+ years of engineering experience running production infrastructure at a large scale.
What programming languages are preferred?
Proficiency in Golang, C++, or other languages designed for high-performance scalable servers is required.
What perks and benefits are offered?
Full-time employees receive health and dental benefits, retirement matching, a weekly lunch stipend, 6 weeks of paid vacation, parental leave top-up, learning stipends, and home office or co-working allowances.