Remote | AI Data Science Domain Expert — $100–$200/hour at 24-MAG in New York, New York, United States

Job description

• We are sharing a specialised part-time consulting opportunity for experienced Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, and Data Analytics professionals to contribute domain expertise to an advanced AI training and evaluation project focused on analytical reasoning, data quality, prompt development, technical communication, and model-output assessment.
• Selected professionals will review AI-generated analytical content, develop and refine prompts, assess outputs against structured rubrics, conduct research and fact checking, and translate complex findings into clear technical and business-facing conclusions. No prior experience in AI training is required.

Responsibilities

• AI Evaluation & Analytical Review
• Review AI-generated analytical content for accuracy, clarity, relevance, and logical consistency
• Evaluate outputs against structured rubrics and professional analytical standards
• Identify quantitative, factual, or interpretive weaknesses
• Apply professional judgement to ambiguous or technically complex cases
• Provide clear written rationales supporting evaluation decisions
• Prompt Development, Data & Research
• Develop and refine prompts for complex data-science and analytical tasks
• Design scenarios that test quantitative reasoning and data interpretation
• Interpret datasets, experiments, notebooks, and analytical outputs
• Conduct independent research and fact checking to validate technical claims
• Annotate data and identify recurring quality issues across evaluation workflows
• Technical Writing & Quality Assurance
• Produce and review research summaries, analytical reports, experiment findings, and technical documentation
• Translate quantitative findings for both technical and business audiences
• Review labelled examples and model outputs for consistency and quality
• Support calibration across contributors and evaluation standards
• Collaborate asynchronously with project leads and other domain specialists

Requirements

• 3+ years of professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, Data Analytics, or a comparable analytical discipline
• Strong analytical reasoning and quantitative interpretation skills
• Experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation
• Exceptional attention to detail and strong professional writing ability
• Ability to communicate technical and quantitative concepts clearly
• Strong independent research and fact-checking skills
• Experience with data annotation, content review, or rubric-based evaluation is highly desirable
• Prompt engineering or prompt-authoring experience is advantageous
• Familiarity with AI-output evaluation, model-quality assessment, or RLHF is beneficial but not required
• Master's, MBA, PhD, or another advanced degree is preferred but not required
• Experience in leading technology companies, research organisations, or similarly rigorous analytical environments is valuable
• No prior AI-training experience is required

Skills

Required

• Strong analytical reasoning
• Exceptional attention to detail
• Strong professional writing ability
• Data Science
• Machine Learning
• Applied AI
• Statistics
• Quantitative Analytics
• Data Analytics
• Prompt engineering
• AI-output evaluation
• Model-quality assessment