Data Science Expert – Remote Contractor

About the role

We are partnering with a leading AI research organization to engage experienced data scientists on a remote, contract basis. The focus is on evaluating how well AI systems perform real‑world data‑science tasks by defining grading criteria and scoring work samples.

Key responsibilities

• Design precise, task‑specific grading criteria for data‑science deliverables such as analyses, models, dashboards, experiment readouts, and written recommendations.
• Score AI‑generated and human work samples against those criteria, providing detailed written justifications for each score.
• Apply consistent, evidence‑based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on grading frameworks.

Required profile

• 5+ years of professional data‑science experience in industry.
• Background in business operations, product, or growth data science at top‑tier technology companies.
• Deep fluency in experiment design, A/B testing, metric definition, and communicating findings to executive stakeholders.
• Exceptionally strong written communication and comfort with peer review.
• Prior experience with AI training, evaluation, or human‑data projects is a strong plus.

Required skills

• Python
• SQL
• Experiment design
• A/B testing
• Metric definition
• Data analysis
• Dashboard creation
• Model building

What we offer

• Independent contractor engagement with full remote flexibility.
• Weekly payments via Stripe or Wise based on services rendered.
• Variable project length – can be extended, shortened, or concluded early depending on needs and performance.