AI Adversarial Specialist - Fully Remote | Upto $25/hr at Mercor in Sydney, New South Wales, Australia

Job description

• At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red team data that makes AI safer for our customers.
• This project involves reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text-based, and participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources. Before being exposed to any content, the topics will be clearly communicated.
• You uncover vulnerabilities automated tests miss
• You deliver reproducible artifacts that strengthen customer AI systems
• Evaluation coverage expands: more scenarios tested, fewer surprises in production
• Mercor customers trust the safety of their AI because you’ve already probed it like an adversary
• Build experience in human data-driven AI red teaming at the frontier of safety
• Play a direct role in making AI systems more robust, safe, and trustworthy
• We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Responsibilities

• Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation
• Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks
• Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent
• Document reproducibly: produce reports, datasets, and attack cases customers can act on

Requirements

• Fluent Language Skills Required: English & Malay. Native fluency in English and Malay is required for this position.
• You bring prior red teaming experience (AI adversarial work, cybersecurity, socio-technical probing)
• You’re curious and adversarial: you instinctively push systems to breaking points
• You’re structured: you use frameworks or benchmarks, not just random hacks
• You’re communicative: you explain risks clearly to technical and non-technical stakeholders
• You’re adaptable: thrive on moving across projects and customers
• Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction
• Cybersecurity: penetration testing, exploit development, reverse engineering
• Socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing
• Creative probing: psychology, acting, writing for unconventional adversarial thinking

Skills

Required

• Curious and adversarial mindset
• Native fluency in English and Malay