Senior Systems Engineer, Enterprise AI Platforms
About this role
To eliminate the friction between adopting rapidly changing AI tools and maintaining enterprise security, CoreWeave needs a technical owner to govern and scale internal AI systems. This role bridges production software engineering, hands-on LLM workflows, and enterprise IT controls to ensure employees have fast, secure access to cutting-edge capabilities.
Working at the bleeding edge of the AI landscape, the incoming engineer will manage chat assistants, coding agents, terminals, and workplace knowledge tools across all employee surfaces. Success in this position requires designing enforceable guardrails through identity and device controls, building out production allowlists, and establishing operational frameworks that allow new vendor models to be rolled out safely within days rather than quarters. Candidates who thrive here are comfortable with high velocity, possess deep experience in at least two of the core domains—software/SRE, LLM administration, or enterprise IT—and enjoy constantly adapting to a monthly shifting toolkit.
What you will do
- Own the end-to-end lifecycle and governance of employee-facing AI platforms across web, desktop, mobile, IDE, terminal, and browser environments.
- Design and implement enforceable AI guardrails using SSO, SCIM provisioning, feature entitlements, and device-trust requirements.
- Build and operate connector and Model Context Protocol allowlists with scoped data-source integrations across major enterprise SaaS platforms.
- Manage the IT-owned control layer for internal chatbots and agents, including gateways, secrets management, logging, rate limiting, and cost attribution.
- Apply site reliability engineering standards to AI services through infrastructure-as-code, automation, on-call participation, and reliability targets.
- Instrument comprehensive telemetry to track usage, cost, quality, and risk metrics for leadership visibility.
- Collaborate with security, legal, and privacy teams to translate regulatory requirements into technical policies and support compliance audits.
What you need
- Bring six or more years of professional experience in software engineering, site reliability engineering, or IT systems engineering.
- Demonstrate at least two years of hands-on experience building or administering LLM-based products, agent frameworks, or multi-agent workflows.
- Possess strong software engineering skills in languages such as Python, Go, Rust, or TypeScript.
- Have practical experience operating production services using containers, infrastructure-as-code, CI/CD pipelines, and observability tooling.
- Understand enterprise IT control systems, including identity and access management, endpoint management, and SaaS administrative frameworks.
- Demonstrate a proven ability to produce clear technical documentation and lead complex cross-functional initiatives.
Nice to have
- Real-world experience administering enterprise identity, endpoint management, or SaaS platforms at scale
- Experience deploying and governing enterprise AI tools across a 1,000+ person organization
- Hands-on experience building custom Model Context Protocol servers and integrations
Skills and tech stack
Questions candidates ask
What surfaces and tools will I actually be managing?
You will own employee-facing AI platforms across every surface they ship on, including web, desktop, mobile, IDE, terminal, and browser. This encompasses chat assistants, coding agents, workplace knowledge tools, and internal MCP servers.
How does this role fit into the broader engineering and IT organization?
The position sits within IT Engineering, partnering closely with Security, Business Development, PeopleOps, and Corporate functions. You will deploy infrastructure on CoreWeave infrastructure alongside the teams that run it.
What background is most important for success?
This is a composite role combining production software and SRE engineering, hands-on LLM and agent work, and enterprise IT controls. Candidates are expected to arrive deep in two of the three areas and grow into the third.