Latest AI JobsBrowse Jobs
G

SDE IV - GPU Engineer

GlanceBangaloreGlance AI - Tech
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
9 Oct 2025
Status
Open · checked 7d ago

About this role

Role Overview

The SDE IV - GPU Engineer position at Glance in Bengaluru involves leading the design and optimization of the GPU inference stack. This role suits experienced professionals with a strong background in high-performance computing who want to shape generative AI systems at scale.

Key Responsibilities

Architect high-performance inference runtimes, kernel dispatchers, and memory planners for large diffusion and transformer workloads.
Lead investigations into cross-GPU performance bottlenecks, communication overheads, and scheduling inefficiencies.
Drive multi-GPU parallelism strategies including model, pipeline, and tensor parallelization.
Establish company-wide GPU optimization standards, tooling, and service level indicators (SLIs).
Collaborate with research teams to design scalable implementations of novel architectures.
Mentor engineers in profiling, tuning, and low-level optimization techniques.
Partner with hardware vendors and infrastructure teams to maximize cluster utilization.

Requirements

Minimum of 5 years of experience in high-performance computing, GPU runtime systems, or machine learning infrastructure.
Proven expertise in CUDA, Triton, and C++, accompanied by a deep understanding of GPU scheduling, occupancy, register usage, and tensor cores.
Hands-on experience building and maintaining distributed inference or training systems.
Ability to design software abstractions that successfully balance flexibility and performance.
Strong knowledge of NCCL, NVLink, PCIe, and hardware interconnects.
Familiarity with profiling automation and performance dashboards.
Excellent technical leadership and mentoring capabilities.

Nice to Have

Background in compiler-aided optimization tools such as TVM, XLA, MLIR, or Triton.
Experience tuning Stable Diffusion or transformer inference pipelines.
Exposure to heterogeneous compute backends including AMD ROCm, TPUs, and ASICs.
Experience working with hardware-software co-design initiatives.
Open-source or research contributions focused on GPU optimization.

Skills and Tools

C++
CUDA and Triton
NCCL, NVLink, and PCIe
Distributed inference and training systems
Compiler-aided optimization and profiling tools

About the Company

Glance functions as an intelligent shopping agent that redefines the commerce experience through proprietary agentic intelligence and generative AI. It delivers a hyper-personalized consumer experience across mobile and television devices, shaping a new era of shopping. The platform is operated by Glance InMobi Pte. Ltd., a non-consolidated subsidiary of the global technology leader InMobi, and receives backing from Mithril Capital, Google, and Jio Platforms.

How to Apply

Interested candidates should visit the official Glance careers page to submit their application.

Skills and tech stack

C++

Questions candidates ask

What is the location of the SDE IV - GPU Engineer role?

The position is based in Bengaluru, India.

How many years of experience are required for this job?

Candidates must have 5 or more years of experience in high-performance computing, GPU runtime systems, or machine learning infrastructure.

What core technical skills are needed?

Required skills include C++, CUDA, Triton, deep understanding of GPU architecture, distributed inference systems, and interconnects like NCCL and NVLink.

Who operates Glance?

Glance is operated by Glance InMobi Pte. Ltd., which is a non-consolidated subsidiary of InMobi.

How can I apply for this position?

You can apply by visiting the official company careers page and submitting your application through their portal.

Ready to apply?

The application is on the official Glance careers page.

Apply on company site