Principal Software Development Engineer - Agentic Systems
About this role
Engineers who thrive in ambiguity and enjoy shaping the path forward while building complex technical systems will find a strong fit at Zscaler. Operating within the Exposure Management and Security Operations department in Bangalore, the incoming engineer joins a team focused on scaling the Zero Trust Exchange platform to handle advanced security challenges. The position exists to lead the architecture and delivery of large-scale AI and machine learning infrastructure, focusing specifically on agentic systems, LLM serving platforms, and production pipelines.
Daily work involves designing foundational platform elements such as networking, security, authentication, and monitoring while collaborating closely with product, security, and operations teams. Success requires balancing high-level architectural strategy with hands-on technical execution, mentoring teammates, and translating complex distributed systems designs for non-technical stakeholders.
What you will do
- Lead the architecture and development of scalable AI and machine learning infrastructure, large language model serving platforms, and agentic workflows for cybersecurity use cases.
- Architect reusable platform foundations including networking, security, authentication, and monitoring to standardize and secure enterprise artificial intelligence services.
- Define and implement system observability, evaluation, and reliability frameworks to guarantee optimal performance and stability of production artificial intelligence systems.
- Drive cross-functional architectural initiatives alongside product, security, and operations teams to deliver production-grade solutions aligned with business goals.
- Provide technical leadership and mentorship on distributed systems design while translating complex architectures to non-technical stakeholders across the organization.
What you need
- Bring foundational understanding of artificial intelligence and machine learning technologies alongside experience leveraging, securing, or positioning AI-driven solutions.
- Demonstrate proven experience designing and operating large-scale, low-latency distributed systems with deep expertise in availability, fault tolerance, consistency, and cloud-native microservices on platforms like AWS, GCP, or Azure.
- Possess expertise in large language models and production artificial intelligence infrastructure, covering orchestration frameworks, inference systems, and full-lifecycle pipeline operations.
- Show a demonstrated track record of cross-organizational technical leadership by driving architectural decisions, mentoring teams, and shipping production-grade services.
- Hold a Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field backed by a solid foundation in core computer science principles.
Nice to have
- Demonstrate a proven ability to leverage artificial intelligence technologies and workflows to drive measurable operational efficiency.
- Bring a proven track record with large language model observability, explainability, and evaluation frameworks in production environments.
- Have experience with serverless architectures for data-intensive workloads.
- Maintain a deep foundation in core systems, networking, and security architecture for distributed systems, covering identity, encryption, access control, VPC, and network security.
Benefits
- Various health plans
- Time off plans for vacation and sick time
- Parental leave options
- Retirement options
- Education reimbursement
- In-office perks
Skills and tech stack
Questions candidates ask
What is the work location and office policy for this job?
This is a hybrid role based in Bangalore, reporting to the Director, Software Development Engineering in the Exposure Management & Security Operations department.
What kind of systems and infrastructure will I be working on?
You will lead the architecture and development of scalable AI/ML infrastructure, LLM serving platforms, and agentic workflows tailored for cloud-scale cybersecurity use cases. This involves designing low-latency distributed systems, cloud-native microservices, and reusable platform foundations including networking, security, authentication, and monitoring.
What leadership and cross-functional expectations come with the role?
You will drive cross-functional architectural initiatives in collaboration with product, security, and operations teams to deliver production-grade AI solutions. The role also requires providing technical leadership and mentorship on distributed systems design while translating complex architectures to non-technical stakeholders.
What employee benefits does Zscaler provide?
Zscaler offers various health plans, time off plans for vacation and sick time, parental leave options, retirement options, education reimbursement, and in-office perks.