We're looking for a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You'll craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny.
What You'll Do
Develop and evaluate high-difficulty physics prompts spanning classical mechanics, quantum mechanics, electromagnetism, thermodynamics, and related areas
Use adversarial prompting techniques to expose errors in model reasoning and problem-solving
Provide expert critique of AI-generated responses, assessing both correctness and depth
Work closely with project leads to uphold quality benchmarks
What We're Looking For
PhD in Physics or a closely related field
Graduate-level expertise across multiple areas of physics
Prior hands-on experience in AI data annotation or RLHF
Excellent written communication and analytical skills
Experts based out of the US, Canada, Mexico, UK, Ireland, Australia, New Zealand, and Spain
Extra Credit
Publications in peer-reviewed physics or astronomy journals.
Experience with adversarial prompting, model evaluation, or AI red teaming strongly preferred
Teaching, tutoring, or curriculum development experience in physical chemistry or theoretical sciences.
Background in scientific annotation or technical quality assurance.
Additional Information
Location: Fully remote (no visa sponsorship available if based in the US)
Schedule: Flexible hours — contribute as much or as little as you’d like each week. (No minimum hours per week, capped at 40hrs/week.)