About this role
To scale the next generation of reliable generative artificial intelligence platforms and evaluation systems, Zeta Global needs a Staff Software Engineer to drive architecture and development in New York City. The incoming engineer will design secure platform services for large language models, agentic workflows, and knowledge systems like retrieval-augmented generation pipelines, vector stores, and embeddings while optimizing infrastructure cost and performance.
Operating within the AI-Powered Marketing Cloud organization, the person in this role will shape technical direction for LLM applications, establish evaluation frameworks, and build developer-facing APIs and tooling. An ideal candidate brings a strong software engineering background with C#, Java, JavaScript, Go, or Python, alongside hands-on experience deploying generative AI models and cloud infrastructure in production environments.
What you will do
- Drive the design and development of scalable generative AI platforms supporting large language models and evaluation systems.
- Build secure platform services and tooling for agentic workflows, LLM applications, and experimentation.
- Implement retrieval and knowledge systems including vector stores, embeddings, and RAG pipelines.
- Establish evaluation frameworks and feedback loops to measure the safety, correctness, and quality of AI systems.
- Develop observability tools for tracking latency, tracing, cost monitoring, and failure detection in LLM workloads.
- Architect multi-tenant capabilities featuring configuration, isolation, quota management, and cost attribution.
- Create developer-facing APIs and SDKs to support the rapid productionization of generative AI use cases.
What you need
- Hold a Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or Information Systems.
- Possess five years of progressive experience in the job offered or a closely related occupation.
- Bring professional software development experience using languages such as C#, Java, JavaScript, Go, or Python.
- Demonstrate hands-on familiarity with generative AI, large language models, and cloud infrastructure.
- Work with relevant GenAI platform technologies including MCP, LangGraph, OpenAI, and Bedrock.
Benefits
- Unlimited PTO
- Excellent medical, dental, and vision coverage
- Employee Equity and Stock Purchase Plan
- Employee Discounts, Virtual Wellness Classes, and Pet Insurance
Skills and tech stack
Questions candidates ask
What is the remote work policy for this position?
There is an option to telecommute 3 days per week.
What is the salary for the Staff Software Engineer role?
The salary for the role is $240,000 per year.
Where is the job located?
The position is based in New York City, NY.
How should interested candidates apply?
Interested applicants can send their resume to S Arvelo at Zeta Global Corp., 3 Park Avenue, 33rd Floor, New York, NY 10016.