Staff MLOps Engineer at Zscaler

About Zscaler

Zscaler is a pioneer and global leader in zero trust security. The world’s largest businesses, critical infrastructure organizations, and government agencies rely on Zscaler to secure users, branches, applications, data & devices, and to accelerate digital transformation initiatives. Distributed across more than 160 data centers globally, the Zscaler Zero Trust Exchange platform combined with advanced AI combats billions of cyber threats and policy violations every day and unlocks productivity gains for modern enterprises by reducing costs and complexity.

Here, impact in your role matters more than title and trust is built on results. We believe in transparency and value constructive, honest debate—we’re focused on getting to the best ideas, faster. We build high-performing teams that can make an impact quickly and with high quality. To do this, we are building a culture of execution centered on customer obsession, collaboration, ownership and accountability.

We champion an “AI Forward, People First” philosophy to help us accelerate and innovate, empowering our people to embrace their potential. If you’re driven by purpose, thrive on solving complex challenges and want to make a positive difference on a global scale, we invite you to bring your talents to Zscaler to help shape the future of cybersecurity.

Our Engineering team built the world’s largest cloud security platform from the ground up, and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint, the team has made us and our multitenant architecture today's cloud security leader, with more than 15 million users in 185 countries. Bring your vision and passion to our team of cloud architects, software engineers, security experts, and more who are enabling organizations worldwide to harness speed and agility with a cloud-first strategy.

We’re looking for a seasoned Staff AI Platform Engineer to join our IT Enterprise Data & AI Platform Team. Reporting to the Senior Manager of Enterprise Data Strategy, you will be responsible for:

Leading the creation of a scalable and modular AI platform utilizing technologies like Qdrant, Anyscale, and Ray for LLM orchestration, vector search, and multi-agent frameworks

Building essential APIs and infrastructure to enable conversational applications, AI agents, and analytics tools

Executing workflows for Large Language Models, including inference pipelines, fine-tuning, caching, and evaluation for both open-weight and hosted models

Deploying AI services on AWS using Kubernetes (EKS), Lambda, and ECS, while fine-tuning vector databases and model runtimes for optimized cost, scalability, and performance

Partnering with engineering teams for smooth AI integration, establishing governance and security standards, and mentoring junior engineers on best practices in AI infrastructure development and reviews

What We're Looking for (Minimum Qualifications)

8+ years of experience in software, data, or ML infrastructure engineering, including 3+ years in AI/ML platform development, with strong Python expertise

Skilled in independently managing complex projects with excellent problem-solving, analytical, and communication abilities

Proficient in AWS, GCP, or Azure, with experience in MLOps tools like MLflow/Kubeflow, CI/CD pipelines, and infrastructure as code (Terraform/CloudFormation)

Expertise in model observability, CI/CD processes, and incident response for AI/ML services

What Will Make You Stand Out (Preferred Qualifications)

Experience in implementing LLM pipelines with frameworks like LangChain, LlamaIndex, Hugging Face, and using vector databases like Qdrant, Pinecone, or Weaviate

Proficient in distributed orchestration frameworks like Anyscale or Ray Serve, with expertise in containerized application deployment using Docker, Kubernetes, and Helm charts

Strong knowledge of LLMOps patterns, including model registry, prompt versioning, and feedback loops

At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure.

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

Various health plans

Time off plans for vacation and sick time

Parental leave options

Retirement options

Education reimbursement

In-office perks, and more!

Learn more about Zscaler’s Future of Work strategy, hybrid working model, and benefits here.

By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines.

Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link.

Pay Transparency

Zscaler complies with all applicable federal, state, and local pay transparency rules.

Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

Staff MLOps Engineer

Job Description

What We're Looking for (Minimum Qualifications)

What Will Make You Stand Out (Preferred Qualifications)