Senior Software Engineer - AI/ML (Context Services)
About this role
Cognite needs a Senior Software Engineer to bridge the gap between applied scientists and the central platform team by turning complex analytical solutions into reliable production services. The Context Services team builds the core infrastructure required to transition traditional machine learning models and modern large language model agents into scalable, low-latency APIs. Operating at the forefront of industrial digitalization, the team focuses on supporting thousands of concurrent users with sub-second response times while managing complex industrial data problems.
Working in Bengaluru, the person in this position will design robust system architectures, orchestrate AI workflows, and integrate core infrastructure to build dependable machine learning pipelines. Successful candidates bring extensive backend engineering experience and possess the technical adaptability needed to navigate evolving artificial intelligence paradigms.
What you will do
- Design robust system architectures and develop low-latency APIs and services capable of supporting thousands of concurrent users with sub-second response times.
- Collaborate closely with product, architecture, and artificial intelligence teams to translate complex industrial data problems into scalable solutions.
- Architect frameworks for model serving, vector databases, and agentic workflows to ensure reliable state management and prompt tracking.
- Act as the technical liaison with the central platform team by leveraging core infrastructure to build dependable machine learning pipelines and workflows.
- Drive technical innovation through research, prototyping, and potential contributions to open-source initiatives.
What you need
- Bring 6 to 10 years of industry experience in software engineering, backend engineering, or systems engineering.
- Demonstrate prior exposure to artificial intelligence, machine learning, or large language model production systems.
- Show strong proficiency in Python alongside experience building high-concurrency applications, asynchronous programming, or REST and gRPC APIs.
- Possess a solid understanding of containerization using Docker and modern deployment environments such as Kubernetes or cloud platforms.
Nice to have
- Familiarity with the broader AI lifecycle including traditional model registries, vector databases, or LLM evaluation frameworks
Skills and tech stack
Questions candidates ask
What is the primary focus of the Context Services team?
The team focuses on turning complex analytical solutions—ranging from traditional machine learning and deep learning models to modern large language model agents—into highly reliable, production-grade software services.
Where is this role located?
This position is based in India, specifically in Bengaluru.
What level of experience is required for this position?
Applicants should have 6 to 10 years of industry experience in software engineering, backend engineering, or systems engineering, with exposure to AI, ML, or LLM-based production systems.
The application is on the official Cognite - AI for Industry careers page.
Apply on company site