Latest AI JobsBrowse Jobs
AlphaSense logo

Senior Engineering Manager, AI

AlphaSenseRemote - United StatesEngineering
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
5 Aug 2026
Status
Open · checked 7d ago

About this role

AlphaSense is seeking a remote Senior Engineering Manager to lead its AI Platform team across the United States. This position directs the development and operation of a core AI Gateway that handles large-scale language model traffic for the entire platform. The opportunity suits an experienced engineering leader with a background in distributed systems who enjoys mentoring senior technical talent.

Role Overview

This leadership role focuses on managing, mentoring, and expanding a team of up to ten senior and staff software engineers, predominantly located across North America. The manager oversees the architecture and strategy of an enterprise AI Gateway that processes billions of tokens weekly while preparing for substantial volume growth driven by agentic workflows. Responsibilities include guiding multi-vendor integrations, evaluating numerous models, and establishing robust mechanisms for latency, cost, and reliability optimization.

Key Responsibilities

Guide the strategy, architecture, and scaling of the enterprise AI Gateway to maintain high availability and efficient routing, caching, queueing, and fallback mechanisms.
Manage, mentor, and foster career growth for a team of talented software engineers.
Oversee the evaluation, integration, and management of multiple major LLM vendors and numerous distinct models.
Partner directly with product management, AI research teams, and executive engineering leads to align the gateway roadmap with core product features.
Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry.

Requirements

Proven track record of managing and growing high-performing teams of senior and staff engineers.
Strong background in designing, building, and operating high-throughput, low-latency distributed systems handling complex routing, caching, queueing, or rate limiting.
Ability to engage deeply in high-level architectural discussions and provide constructive technical direction.
Exceptional communication and partnership skills to align diverse engineering, product, and executive partners.
Active embrace of AI tools in developer workflows to maximize engineering velocity.

Nice to Have

Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
Experience working with Python, Java, and highly distributed caching or queueing systems.

Skills and Tools

Python
Java
LLM
LangChain
Distributed Systems Architecture
AI Gateways and Proxies

Salary and Benefits

The base compensation range for this role is $275,000 to $375,000 USD. Final offer amounts are determined by candidate experience and expertise. Additional offerings may include equity and a comprehensive benefits program.

About the Company

AlphaSense provides market intelligence and search built on proven AI to help sophisticated companies make confident decisions. The platform aggregates public and private content such as equity research, filings, event transcripts, and news. Trusted by over 6,000 enterprise customers, including a majority of the S&P 500, the company employs more than 2,000 people globally with headquarters in New York City.

How to Apply

To apply for this position, visit the official AlphaSense careers page to submit your application securely.

Skills and tech stack

Questions candidates ask

What is the location requirement for this job?

This position is a remote role based in the United States.

What is the salary range for the Senior Engineering Manager, AI role?

The base compensation range is $275,000 to $375,000 USD, with final offers determined by candidate experience and expertise, alongside potential equity and benefits.

How many direct reports will this manager oversee?

The manager will lead a team of up to 10 senior and staff software engineers distributed across North America.

What are some of the preferred technical tools and frameworks?

Preferred technologies include Python, Java, LangChain, LangGraph, LiteLLM, OpenRouter, Temporal, and Envoy.

How can I apply safely to this position?

Candidates should apply directly through the official AlphaSense careers page to ensure security and avoid fraudulent postings.

Ready to apply?

The application is on the official AlphaSense careers page.

Apply on company site