Label Quality Specialist, M (Archived) | VirtualInterview.ai

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

As the Label Quality Specialist, Moderation, Trust and Safety, you will report to the Senior Director of Trust and Safety, and play an essential role in keeping our community and our platform safe. You will be managing the end to end label quality measurement program for our human and automated moderation workflows. You will understand and enforce our community standards and other policies regarding Developer and User activity on our platform. You will engage deeply with our XFN teams across Policy, Product, Engineering and others to help develop and execute solutions. Protecting our community is important to you.

You will report to the Senior Director, Moderation.

You Will:

Operationalize the label quality measurement workflow at Roblox to deliver high fidelity ground truth data sets for both human and AI/ML based moderation systems

Work closely with Product Policy, Engineering, Data Science and Safety Operations teams to ensure high quality ground truth data sets are delivered on a regular basis.

Identify, evaluate, prioritize and resolve policy, process and tolling gaps through deep root cause analysis

Manage the end-to-end ground truth dataset creation process including scoping, planning, reviewer coordination, quality checks, and final delivery

Act as the subject matter expert on Roblox policies and processes, ensuring accurate and consistent implementation across all product and asset types. Developing a deep understanding of these guidelines.

Collaborate closely with outsourcing partners to scale ground truth dataset creation and ensure high quality data is being delivered by the outsourced partners.

You Have:

4-5 years of experience in managing Trust and Safety programs, with a strong interest in quality assurance

Strong program management skills, with experience leading projects at scale

Experience developing processes to improve operational efficiency

Experience using data to lead decision-making

Strong collaboration skills, with the ability to work with cross-functional teams, specifically Product Policy, Engineering, Data Science and Operations

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range

$135,100—$173,250 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.

Label Quality Specialist, Moderation, Trust and Safety

Job Description

Skills & Requirements