Principal Software Development Engineer - Agentic Systems at Zscaler in Bangalore, IND

Job description

• We are looking for a Principal Software Development Engineer - Agentic Systems to join our team. This is a hybrid role based in Bangalore, reporting to the Director, Software Development Engineering in the Exposure Management & Security Operations department.
• In this role, you will lead the architecture and delivery of large-scale AI/ML infrastructure and production pipelines, mentor team members, and drive strategic technical initiatives across the organization. You bring a deep understanding of building and operating distributed AI systems at scale and translating business challenges into reliable, production-grade AI platforms.
• You thrive in ambiguity. You're comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful.
• You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. True ownership involves leveraging dynamic range: the ability to navigate seamlessly between high-level strategy and hands-on execution.
• You are a problem-solver. You love running towards the challenges because you are laser-focused on finding the solution, knowing that solving the hard problems delivers the biggest impact.
• You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback—knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust.
• You are a learner. You have a true growth mindset and are obsessed with your own development, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose.

Responsibilities

• Lead the architecture and development of scalable AI/ML infrastructure, LLM serving platforms, and agentic workflows tailored for cloud-scale cybersecurity use cases
• Architect reusable platform foundations—including networking, security, authentication, and monitoring—to standardize and secure enterprise AI/ML services
• Define and implement system observability, evaluation, and reliability frameworks to ensure optimal performance and stability of AI systems in production
• Drive cross-functional architectural initiatives in collaboration with product, security, and operations teams to deliver production-grade AI solutions aligned with business goals
• Provide technical leadership and mentorship on distributed systems design while translating complex architectures to non-technical stakeholders to foster alignment across the organization

Requirements

• Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes within your functional domain
• Proven experience designing and operating large-scale, low-latency distributed systems, with deep expertise in availability, fault tolerance, consistency, and cloud-native microservices (AWS preferrable, GCP, or Azure)
• Expertise in LLMs and production AI/ML infrastructure, including orchestration frameworks, inference systems, and full-lifecycle pipeline operations
• Demonstrated track record of cross-organizational technical leadership, driving architectural decisions, mentoring teams, and shipping production-grade services
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, backed by a solid foundation in core computer science principles
• Hands-on experience architecting autonomous AI agentic workflows and fine-tuning domain-specific LLMs for real-time cybersecurity threat and exposure management
• Proven track record with LLM observability, explainability, and evaluation frameworks in production environments, complemented by serverless architectures for data-intensive workloads
• Deep foundation in core systems, networking, and security architecture for distributed systems, including identity, encryption, access control, VPC, and network security

Skills

Required

• AI/ML technologies
• LLMs and production AI/ML infrastructure
• Orchestration frameworks
• Inference systems
• Full-lifecycle pipeline operations
• Technical leadership
• Mentoring

Preferred

• Autonomous AI agentic workflows
• Fine-tuning domain-specific LLMs
• Serverless architectures

Benefits

• Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:
• Various health plans
• Time off plans for vacation and sick time
• Parental leave options
• Retirement options
• Education reimbursement
• In-office perks, and more!
• Learn more about Zscaler's hybrid working model and benefits here.
• Zscaler complies with all applicable federal, state, and local pay transparency rules.